Hello Timo, Hello List,
I just sniffed the communication between Netscape and Dovecot and I catched the error! It seems like dovecot returns different sizes for the same mail:
This mail is displayed correct and the dovecot returns it like this:
- 268 FETCH (UID 542 RFC822.SIZE 2989 BODY[] {2989}..Return-Path: The corrupted one starts like this:
- 268 FETCH (UID 542 FLAGS (\Seen) RFC822.SIZE 2975 BODY[] {2975}.. continuing in next packet (There is data missing): eturn-Path: root@mdn.de.Delivered-To: enderle@mdn.de.Received: by
Also, sometimes there seems to be data from the imap protocol appended to the email, i think its the next byte after the email [one ")"]! I saw it often appended to someones signatures and was wondering if it belongs there. As i have seen the raw text going over the line now, i am sure it doesn't belong to the email.
Can i do something more to discribe that problem? Is it a bug in Netscape or Dovecot? I attached you the stuff i sniffed after the mail...
Regards
Steven
START CORRUPT MESSAGE
# ./ngrep -A tcp port 143 interface: xl0 (212.202.153.176/255.255.255.248) filter: ip and ( port 143 ) # T 10.0.0.122:49510 -> 10.0.2.179:143 [AP] 5 UID fetch 542 (UID RFC822.SIZE BODY[])..
# T 10.0.2.179:143 -> 10.0.0.122:49510 [AP]
- 268 FETCH (UID 542 FLAGS (\Seen) RFC822.SIZE 2975 BODY[] {2975}..
T 10.0.2.179:143 -> 10.0.0.122:49510 [A] eturn-Path: root@mdn.de.Delivered-To: enderle@mdn.de.Received: by mail.mdn.de (Postfix, fro m userid 0)..id 50682A898; Fri, 27 Jun 2003 03:04:18 +0200 (CEST).To: root@mdn.de.Subject: md n.de security check output.Message-Id: 20030627010418.50682A898@mail.mdn.de.Date: Fri, 27 J un 2003 03:04:18 +0200 (CEST).From: root@mdn.de (root).Content-Length: 2485.Status: O.X-UID: 542.X-Keywords:
..Checking setuid files and devices:......Checking for uids of 0:..root 0..toor 0......Checking for passwordless accounts:......mdn.de kernel log messages:..> Jun 2 6 11:04:06 mdn login: ROOT LOGIN (root) ON ttyv0..> Jun 26 13:33:27 mdn su: enderle to root o n /dev/ttyp0..> Jun 26 15:03:49 mdn login: ROOT LOGIN (root) ON ttyv0..> Jun 26 15:30:16 mdn su: BAD SU enderle to root on /dev/ttyp2..> Jun 26 15:30:18 mdn su: enderle to root on /dev/t typ2..> xl0: promiscuous mode enabled..> Jun 26 15:30:58 mdn /kernel: xl0: promiscuous mode e nabled..> xl0: promiscuous mode disabled..> Jun 26 15:31:00 mdn /kernel: xl0: promiscuous mod e disabled..> xl0: promiscuous mode enabled..> Jun 26 15:31:23 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mode disabled..> Jun 26 15:32:24 mdn /kernel: xl0: promiscuo us mode disabled..> xl0: promiscuous mode enabled..> Jun 26 15:33:23 mdn /kernel: xl0: promis cuous mode enabled..> xl0: promiscuous mode disabled.
# T 10.0.2.179:143 -> 10.0.0.122:49510 [A] .> Jun 26 15:33:39 mdn /kernel: xl0: promiscuous mode disabled..> xl0: promiscuous mode enabl ed..> Jun 26 15:33:42 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mode dis abled..> Jun 26 15:33:48 mdn /kernel: xl0: promiscuous mode disabled..> xl0: promiscuous mode enabled..> Jun 26 15:33:51 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mo de disabled..> Jun 26 15:33:52 mdn /kernel: xl0: promiscuous mode disabled..> xl0: promiscuou s mode enabled..> Jun 26 15:34:37 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscu ous mode disabled..> Jun 26 15:34:47 mdn /kernel: xl0: promiscuous mode disabled..> xl0: prom iscuous mode enabled..> Jun 26 15:35:03 mdn /kernel: xl0: promiscuous mode enabled..> xl0: pr omiscuous mode disabled..> Jun 26 15:35:07 mdn /kernel: xl0: promiscuous mode disabled..> xl0 : promiscuous mode enabled..> Jun 26 15:35:36 mdn /kernel: xl0: promiscuous mode enabled..> x l0: promiscuous mode disabled..> Jun 26 15:35:40 mdn /kernel: xl0: promiscuous mode disabled. .> xl0: promiscuous mode enabled..> Jun 26 15:35:41 mdn /kernel: xl0: promiscuous mode enable d..> xl0: promiscuous mode disabled..> Jun 26 15:42:08 mdn /kernel: xl0: promiscuous mode dis abled..> Jun 26 15:44:11 mdn su: enderle to root on /dev/ttyp3..> xl0: promiscuous mode enabl ed..> Jun 26 15:44:14 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mode dis abled..> Jun 26 15:45:37 mdn /kernel: xl0: promiscuou
### T 10.0.2.179:143 -> 10.0.0.122:49510 [AP] s mode disabled......mdn.de login failures:......mdn.de refused connections:.. ## T 10.0.2.179:143 -> 10.0.0.122:49510 [AP] )..5 OK Fetch completed...
## T 10.0.0.122:64953 -> 10.0.2.179:143 [AP] 1885 noop..
# T 10.0.0.122:64931 -> 10.0.2.179:143 [AP] 2013 noop..
# T 10.0.2.179:143 -> 10.0.0.122:64953 [AP] 1885 OK NOOP completed...
# T 10.0.2.179:143 -> 10.0.0.122:64931 [AP] 2013 OK NOOP completed...
# T 10.0.0.122:64953 -> 10.0.2.179:143 [AP] 1886 UID fetch 60:* (FLAGS)..
# T 10.0.0.122:64931 -> 10.0.2.179:143 [AP] 2014 UID fetch 725:* (FLAGS)..
# T 10.0.2.179:143 -> 10.0.0.122:64953 [AP]
- 29 FETCH (UID 59 FLAGS (\Recent))..1886 OK Fetch completed...
T 10.0.2.179:143 -> 10.0.0.122:64931 [AP]
- 121 FETCH (UID 724 FLAGS (\Recent))..2014 OK Fetch completed...
##^Cexit 152 received, 0 dropped END CORRUPT MESSAGE
START CORRECT MESSAGE
# ./ngrep -A tcp port 143 interface: xl0 (212.202.153.176/255.255.255.248) filter: ip and ( port 143 ) # T 10.0.0.122:49520 -> 10.0.2.179:143 [AP] 4 UID fetch 542 (UID RFC822.SIZE BODY[])..
## T 10.0.2.179:143 -> 10.0.0.122:49520 [A] promiscuous mode disabled..> xl0:
268 FETCH (UID 542 RFC822.SIZE 2989 BODY[] {2989}..Return-Path: root@mdn.de..Delivered-To : enderle@mdn.de..Received: by mail.mdn.de (Postfix, from userid 0)...id 50682A898; Fri, 27 J un 2003 03:04:18 +0200 (CEST)..To: root@mdn.de..Subject: mdn.de security check output..Messag e-Id: 20030627010418.50682A898@mail.mdn.de..Date: Fri, 27 Jun 2003 03:04:18 +0200 (CEST)..F rom: root@mdn.de (root)..Content-Length: 2485..Status: RO..X-UID: 542..X-Keywords:
....Checking setuid files and devices:......Checking for uids of 0:..root 0..toor 0......Checking for passwordless accounts:......mdn.de kernel log messages:..> Jun 26 11:04:06 mdn login: ROO T LOGIN (root) ON ttyv0..> Jun 26 13:33:27 mdn su: enderle to root on /dev/ttyp0..> Jun 26 15 :03:49 mdn login: ROOT LOGIN (root) ON ttyv0..> Jun 26 15:30:16 mdn su: BAD SU enderle to roo t on /dev/ttyp2..> Jun 26 15:30:18 mdn su: enderle to root on /dev/ttyp2..> xl0: promiscuous mode enabled..> Jun 26 15:30:58 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuou s mode disabled..> Jun 26 15:31:00 mdn /kernel: xl0: promiscuous mode disabled..> xl0: promis cuous mode enabled..> Jun 26 15:31:23 mdn /kernel: xl0: promiscuous mode enabled..> xl0: prom iscuous mode disabled..> Jun 26 15:32:24 mdn /kernel: xl0:
promiscuous mode enabled..> Jun 26 15:33:23 mdn /kern
Jun 26 15:35:07 mdn /kernel: xl0: promiscuous mode disabled..> xl0:
# T 10.0.2.179:143 -> 10.0.0.122:49520 [A] el: xl0: promiscuous mode enabled..> xl0: promiscuous mode disabled..> Jun 26 15:33:39 mdn /k ernel: xl0: promiscuous mode disabled..> xl0: promiscuous mode enabled..> Jun 26 15:33:42 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mode disabled..> Jun 26 15:33:48 mdn /kernel: xl0: promiscuous mode disabled..> xl0: promiscuous mode enabled..> Jun 26 15:33: 51 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mode disabled..> Jun 26 15: 33:52 mdn /kernel: xl0: promiscuous mode disabled..> xl0: promiscuous mode enabled..> Jun 26 15:34:37 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mode disabled..> Jun 26 15:34:47 mdn /kernel: xl0: promiscuous mode disabled..> xl0: promiscuous mode enabled..> J un 26 15:35:03 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mode disabled.. promiscuous mode enable d..> Jun 26 15:35:36 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mode disa bled..> Jun 26 15:35:40 mdn /kernel: xl0: promiscuous mode disabled..> xl0: promiscuous mode enabled..> Jun 26 15:35:41 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promiscuous mod e disabled..> Jun 26 15:42:08 mdn /kernel: xl0: promiscuous mode disabled..> Jun 26 15:44:11 mdn su: enderle to root on /dev/ttyp3..> xl0: promiscuous mode enabled..> Jun 26 15:44:14 mdn /kernel: xl0: promiscuous mode enabled..> xl0: promi
# T 10.0.2.179:143 -> 10.0.0.122:49520 [AP] scuous mode disabled..> Jun 26 15:45:37 mdn /kernel: xl0: promiscuous mode disabled......mdn. de login failures:......mdn.de refused connections:..)..4 OK Fetch completed... ##^Cexit 49 received, 0 dropped END CORRECT MESSAGE
Steven Enderle wrote:
Hello Timo!
yes, Mozilla and Netscape are almost the same. There is hardly any difference except logos and instant messaging and stuff...
I will sniff the communication as soon as i have time to install a sniffer.
If it's Dovecot's fault, I can think of only two reasons:
a) Dovecot doesn't detect that mbox was changed and doesn't synchronize it, and it starts reading messages from wrong location. I haven't noticed problems with this myself and I've been using Dovecot with mbox for almost a year now. Maybe some other program touches the mbox in a way Dovecot doesn't understand.
There are two other programms working with the mbox directly (postfix though procmail and popa3d - popa3d never at the same time as dovecot), but the corruption also happens in my subfolders, where only dovecot is working.
b) mbox support still doesn't behave fully as IMAP RFC requires. Message headers may change (not permitted) and so message size may not be exactly correct (not permitted either). I doubt Netscape really cares about these though.
I just had some heavy problems with email attachments. It saved just a few bytes of my attachments, sometimes 5KB or 20KB of 66KB, sometimes it saved a null file. i can't really say why, but that happened again and again, i had to open netscape and forward the mail to my second workstation without doing something else or i had to restart netscape completly (e.g. when opening the attachment for reading or saving it). What makes me wondering is, the other workstation is also using the same imap server.
Ok, that was another corruption i saw, but i guess its related to the corrupted email thing.
Steven