- dovecot - dovecot.org

Re: [Dovecot] Wrong message information reported shortly after delivery
by Ron Avriel 10 Mar '08

10 Mar '08

> Thanks, in my previous tests I didn't use quota plugin with deliver > which was needed to notice this. The problem is: > > 1. deliver adds "message appended" to index file > 2. quota plugin runs for a while > 3. deliver updates filename<->uid mapping in dovecot-uidlist > Thanks for the quick answer. Why does it take four seconds (!) from the time dovecot first reports an invalid message information until the correct information is reported? The time is measured for the delivery of a 1KB message to an empty mailbox on a completely idle system. 2008-03-09 17:00:41.449833 Sent 1011 bytes to test1(a)imap4test.com 2008-03-09 17:00:41.472034 No messages in INBOX. Waiting... 2008-03-09 17:00:42.480654 No messages in INBOX. Waiting... 2008-03-09 17:00:43.487617 **** ERROR: Got invalid RFC822.SIZE 0: 1 (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 63) 2008-03-09 17:00:44.494382 **** ERROR: Got invalid RFC822.SIZE 0: 1 (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 63) 2008-03-09 17:00:45.501444 **** ERROR: Got invalid RFC822.SIZE 0: 1 (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 63) 2008-03-09 17:00:46.550623 **** ERROR: Got invalid RFC822.SIZE 0: 1 (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 63) 2008-03-09 17:00:47.593704 Got valid RFC822.SIZE 1509: 1 (FLAGS (\Recent) INTERNALDATE "09-Mar-2008 17:00:41 +0200" RFC822.SIZE 1509 UID 63) Thanks again, Ron ____________________________________________________________________________________ Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs

1 0

[Dovecot] Quota problems with IMAP and POP?
by Nicolas Letellier 10 Mar '08

10 Mar '08

Hello, I would like to know if it could be appears problem using POP and IMAP in a mailbox? Is it adviced to use one of the two protocols? My users use IMAP to see their emails (in the webmail) and POP3 to download their emails (in outlook/thunderbird). Is it best to use the same protocol? POP and IMAP have the same quota engine? Thanks. -Nicolas

2 2

[Dovecot] 1.1 master auth not expanding static userdb variables
by Andrew Roberts 10 Mar '08

10 Mar '08

Can dovecot-1.1 deliver work with static userdb? I'm currently running dovecot-1.0.12 and postfix-2.4.6, with virtual users' maildirs all owned by vmail and mail_location = maildir:/var/mail/%Lu. The following definition of the dovecot transport in postfix/master.conf works fine with dovecot-1.0: dovecot unix - n n - 1 pipe flags=DRh user=vmail:vmail argv=/usr/libexec/dovecot/deliver \ -d ${user}@${nexthop} -n -m ${extension} Note that I'm not using postfix pipe's "u" flag, since that lowercases everything to the left of "@", including the extension, and we need the extension to be case sensitive. Dovecot is configured with static userdb and args = user=%Lu uid=206 gid=206 home=/var/mailhomes/%Lu, which takes care of making sure the username is lowercase. All of this has been working fine for some time with dovecot-1.0. After upgrading to 1.1_rc2, however, deliver creates a maildir named "%Lu" and delivers all mail for all users to it. Everything else works just fine as before: users can log in, postfix can auth smtp via dovecot sasl, etc. I've tried invoking deliver with -k, adding "mail=maildir:/var/mail/%Lu" to the end of the userdb args, and checked file permissions on the auth sockets, maildirs, and virtual homes. Rolling back to 1.0.12 is the only way I can get deliver to behave as expected. What changed between 1.0 and 1.1 in the way deliver does userdb lookups or how dovecot auth serves to it that could cause this? Does anyone here here have a similar config working with 1.1? Has anyone else observed similar behavior? Thanks, Andrew

3 6

[Dovecot] Update from 1.0.10 -> 1.1rc1 file message-parser.c: line 766 (message_parser_parse_next_block): assertion failed
by Ralf Hildebrandt 10 Mar '08

10 Mar '08

Feb 23 20:40:36 postamt dovecot: IMAP(username): file message-parser.c: line 766 (message_parser_parse_next_block): assertion failed: (ctx->input->eof || ctx->input->closed || ctx->input->stream_errno != 0) Feb 23 20:40:36 postamt dovecot: IMAP(username): Raw backtrace: /usr/local/libexec/dovecot/imap [0x8009236d] -> /usr/local/libexec/dovecot/imap [0x80091ed8] -> /usr/local/libexec/dovecot/imap(message_parser_parse_next_block+0xad) [0x8008ae0d] -> /usr/local/libexec/dovecot/imap(index_mail_cache_parse_continue+0x32) [0x80053ab2] -> /usr/local/libexec/dovecot/imap(index_mail_cache_parse_deinit+0x35) [0x80055295] -> /usr/local/libexec/dovecot/imap(maildir_save_finish+0xdb) [0x80034f9b] -> /usr/local/libexec/dovecot/imap(mailbox_save_cancel+0x1b) [0x8005f6ab] -> /usr/local/libexec/dovecot/imap [0x80015d08] -> /usr/local/libexec/dovecot/imap [0x80015ecd] -> /usr/local/libexec/dovecot/imap(client_command_cancel+0x2a) [0x8001b7ca] -> /usr/local/libexec/dovecot/imap(client_destroy+0x6c) [0x8001c0ac] -> /usr/local/libexec/dovecot/imap [0x8001c893] -> /usr/local/libexec/dovecot/imap(io_loop_handle_timeouts+0xeb) [0x80099ddb] -> /usr/local/libexec/dovecot/imap(io_loop_handler_run+0x93) [0x8009aa03] -> /usr/local/libexec/dove Feb 23 20:40:36 postamt dovecot: IMAP(username): /usr/local/libexec/dovecot/imap(main+0x4ae) [0x80024d6e] -> /lib/i686/cmov/libc.so.6(__libc_start_main+0xe0) [0xb7db7450] -> /usr/local/libexec/dovecot/imap [0x80015be1] Feb 23 20:40:36 postamt dovecot: child 15224 (imap) killed with signal 6 -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) snickebo(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de vista policy violation: Microsoft optical mouse detected penguin patterns on mousepad. Partition scan in progress to remove offending incompatible products. Reactivate MS software.

3 3

[Dovecot] 1.1r1: auth-worker(default): BUG: PASSV had missing parameters, sig11
by Adam McDougall 10 Mar '08

10 Mar '08

I don't know how this happened. I'm not sure if there is a coredump somewhere because I don't know what user, and I have nothing for 'root' or 'dovecot'. Any advice, or should I make all my coredumps go to a central writable directory so I have better chance of catching it if it happens again? Is it maybe from someone connecting to postfix and causing a SMTP-AUTH to timeout? Although that is unlikely because users should not know how to reach this server's SMTP ports. I cut most of the surrounding log entries below because they seemed unrelated normal activity, but two of the lines below I left because of the timestamp. socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix group: postfix Mar 8 17:02:17 boomhauer dovecot: auth-worker(default): BUG: PASSV had missing parameters Mar 8 17:03:47 boomhauer dovecot: auth-worker(default): BUG: PASSV had missing parameters Mar 8 17:05:17 boomhauer dovecot: imap-login: Disconnected: Inactivity: method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Mar 8 17:05:17 boomhauer dovecot: child 72819 (login) killed with signal 11 Mar 8 17:06:47 boomhauer dovecot: imap-login: Disconnected: Inactivity: method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Mar 8 17:06:47 boomhauer dovecot: child 72857 (login) killed with signal 11

2 5

[Dovecot] (no subject)
by Brent Clark 10 Mar '08

10 Mar '08

Hi Im trying something new with my test dovecot. I set my mail_location to to a new location mail_location = maildir:/var/maildir/%u/Maildir But with this new setup i too am authenticating against Mysql. This worked fine till i decided to move the mail. So now i have moved the mail, deleted the account from /etc/passwd,, but now in my mail client, i cant view my test mail. Here is my DB set up : +-----------------------------+--------+ | home | user | +-----------------------------+--------+ | /var/maildir/bclark/Maildir | bclark | +-----------------------------+--------+ dovecot-sql set up password_query = SELECT username as user, password, home , uid as userdb_uid, gid as userdb_gid FROM user WHERE username = '%u' and domain = '%d' I have removed Mar 8 15:42:56 eccostorage dovecot: auth(default): client out: CONT^I1^I Mar 8 15:42:56 eccostorage dovecot: auth(default): client in: CONT^I1^IAGJjbGFyawBxYXo= Mar 8 15:42:56 eccostorage dovecot: auth-worker(default): sql(bclark, 192.168.111.31): query: SELECT username as user, password, home , uid as userdb_uid, gid as userdb_gid FROM user WHERE username = 'bclark' and domain = 'eccotours.biz' Mar 8 15:42:56 eccostorage dovecot: auth(default): client out: OK^I1^Iuser=bclark^Ihome=/var/maildir/bclark/Maildir Mar 8 15:42:56 eccostorage dovecot: auth(default): master in: REQUEST^I15^I24965^I1 Mar 8 15:42:56 eccostorage dovecot: auth(default): passwd(bclark, 192.168.111.31): lookup Mar 8 15:42:56 eccostorage dovecot: auth(default): passwd(bclark, 192.168.111.31): unknown user Mar 8 15:42:56 eccostorage dovecot: auth(default): userdb(bclark, 192.168.111.31): user not found from userdb Mar 8 15:42:56 eccostorage dovecot: auth(default): master out: NOTFOUND^I15 Mar 8 15:42:56 eccostorage dovecot: imap-login: Internal login failure: user=<bclark>, method=PLAIN, rip=192.168.111.31, lip=192.168.111.11

2 1

Re: [Dovecot] Wrong message information reported shortly after delivery
by Ron Avriel 10 Mar '08

10 Mar '08

> Can you reproduce it without your IMAP client? For example using > imaptest (http://imapwiki.org/ImapTest) as the client and running: > Hi, Here's some more information on how to easily reproduce the problem. First, I'd like to describe my environment: OS - RHEL4, FS - ext3, dovecot 1.0.12. See dovecot -n at end of message. Messages are delivered via dovecot deliver invoked by postfix. The problem is reproduced when the system is completely idle - no user is logged in, except the test user. I wrote a short python script (attached) that reproduces the problem very easily. The script sends an email via SMTP, then IMAP fetches from inbox to check when message arrives. Once it arrives it checks if the size is zero and reports it. The script ends when dovecot reports a non-zero message size. The script consistently reproduces the problem on every RHEL4 server I tested (weak and strong) and with any file size. The script is run as ./send_fetch_test.py USER PASSWORD FILE [SERVER] FILE - any file. Contents doesn't matter. NOTE - The script initially deletes all messages from inbox just to minimize output. The problem occurs also when other messages exist. Here's a sample output: 2008-03-09 17:00:41.449833 Sent 1011 bytes to test1(a)imap4test.com 2008-03-09 17:00:41.472034 No messages in INBOX. Waiting... 2008-03-09 17:00:42.480654 No messages in INBOX. Waiting... 2008-03-09 17:00:43.487617 **** ERROR: Got invalid RFC822.SIZE 0: 1 (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 63) 2008-03-09 17:00:44.494382 **** ERROR: Got invalid RFC822.SIZE 0: 1 (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 63) 2008-03-09 17:00:45.501444 **** ERROR: Got invalid RFC822.SIZE 0: 1 (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 63) 2008-03-09 17:00:46.550623 **** ERROR: Got invalid RFC822.SIZE 0: 1 (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 63) 2008-03-09 17:00:47.593704 Got valid RFC822.SIZE 1509: 1 (FLAGS (\Recent) INTERNALDATE "09-Mar-2008 17:00:41 +0200" RFC822.SIZE 1509 UID 63) For this output I attached also the IMAP network capture and a strace of the imap process. dovecot -n: # 1.0.12: /usr/local/etc/dovecot.conf log_timestamp: “%Y-%m-%d %H:%M:%S ” protocols: imap listen: *:143 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_process_per_connection: no first_valid_uid: 150 last_valid_uid: 150 dotlock_use_excl: yes fsync_disable: yes maildir_copy_with_hardlinks: yes maildir_copy_preserve_filename: yes mail_plugins: quota imap_quota auth default: mechanisms: plain login user: nobody master_user_separator: * passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf passdb: driver: passwd-file args: /usr/local/etc/dovecot.masterusers master: yes userdb: driver: prefetch userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: mail plugin: quota: maildir:storage=1024 I hope this helps, Thanks, Ron ____________________________________________________________________________________ Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs

2 1

[Dovecot] suspect valgrind error in mail-index-map.c
by Diego Liziero 10 Mar '08

10 Mar '08

Hi At line 1118 of src//lib-index/mail-index-map.c, inside the function mail_index_map_move_to_memory, there is: mail_index_map_copy_header(map, map); Valgrind is stating that "Source and destination overlap in memcpy". I'm wondering if this code is just coping the same memory over itself, or if it is doing something useful. Regards, Diego Liziero. --- 1104 void mail_index_map_move_to_memory(struct mail_index_map *map) 1105 { 1106 struct mail_index_record_map *new_map; 1107 1108 if (map->rec_map->mmap_base == NULL) 1109 return; 1110 1111 i_assert(map->rec_map->lock_id != 0); 1112 1113 new_map = array_count(&map->rec_map->maps) == 1 ? map->rec_map : 1114 mail_index_record_map_alloc(map); 1115 1116 mail_index_map_copy_records(new_map, map->rec_map, 1117 map->hdr.record_size); 1118 mail_index_map_copy_header(map, map); 1119 1120 if (new_map != map->rec_map) { 1121 mail_index_record_map_unlink(map); 1122 map->rec_map = new_map; 1123 } else { 1124 mail_index_unlock(map->index, &new_map->lock_id); 1125 if (munmap(new_map->mmap_base, new_map->mmap_size) < 0) 1126 mail_index_set_syscall_error(map->index, "munmap()"); 1127 new_map->mmap_base = NULL; 1128 } 1129 }

2 4

[Dovecot] Automatic Debian repository with packages for Dovecot-1.1 including Sieve and ManageSieve support.
by Stephan Bosch 10 Mar '08

10 Mar '08

Hello Dovecot users, For those of you who like to live on the edge, there is now a Debian-testing repository available with hourly updates from recent Dovecot-1.1 changes in the Mercurial repositories. It automatically releases a new set of packages if it notices any changes in any of the repositories. The packages are built with dovecot-sieve-1.1 and dovecot-1.1-managesieve included. Currently, it only provides binaries for the i386 architecture and no source packages are available. The small Debian-specific patches that are included in the official Debian packages are currently not included for this repository. Also, the packages are currently not PGP signed. I've built this repository to obtain continuous updates on whether the managesieve patch and package still compile and work with the latest Dovecot release. I get an e-mail if anything goes wrong during the build. I implemented the cron script right at the release of dovecot-1.1.rc1 and now that it successfully upgraded the package versions to 1.1.rc2, I decided to release the repository to the world. Needless to say: do **NOT** use this repository for systems that need to be **STABLE**. Usage should be similar to the backports.org repository (http://www.backports.org/dokuwiki/doku.php?id=instructions) but add the following line to your /etc/apt/sources.list: deb http://xi.rename-it.nl/debian/ testing-auto main Package versions look as follows: 1:<upstream-version>~auto+<build number> Current latest version: 1:1.1.rc2~auto+1 For questions, comments and requests, you can send me an e-mail. Regards, -- Stephan Bosch stephan(a)rename-it.nl IRC: Freenode, #dovecot, S[r]us

2 2

[Dovecot] Telephone systems and Dovecot
by Jonathan Knight 10 Mar '08

10 Mar '08

Hi folks, We're looking to integrate our telephone system with our email system. The telephone system will use IMAP4 to store WAV files in a users mailbox and then retrieve them for playing if necessary. This is usually called "unified messaging". The manufacturers are claiming full integration with Microsoft Exchange and Lotus Notes using IMAP4 and a single username and password to access all the users mailboxes. I can see that Dovecot has a master user feature that looks like it will do the job. Has anyone had any experience of using dovecot as a unified message server for a telephone system and has anyone any experience of configuring dovecot so that an MS exchange IMAP4 client using a master user can use dovecot without changing the client? Jon.

3 4