July 2008 - dovecot - dovecot.org

[Dovecot] sparc quota bug
by dovecot＠lechtermann.net 30 Aug '08

30 Aug '08

Hi, I am getting the following error: dovecot: Jul 23 18:04:44 Error: child 7600 (imap) killed with signal 10 How to reproduce: Try to delete or move a mail to another folder. The mail actually gets copied to the other folder but the original isn't removed (when using webmail). If using thunderbird this ends up in an infinite loop creating new mails in the destination folder (without deleting the original) until stopped manually. When turning off quota or commenting out the "quota: dirsize:storage=1048576" entry it works, just no quotas anymore. :-( Details: OS: OpenBSD ARCH: sparc64 FS: ffs Dovecot version: 1.0.15 and 1.1.1 If you need more information, please let me know. @timo: I could provide access to a OpenBSD sparc64 box if it would help debugging the problem. Just send me your public SSH key. # dovecot -n # 1.0.15: /etc/dovecot.conf base_dir: /var/dovecot/ log_path: /var/log/dovecot.log protocols: imaps pop3s listen: XXX.XXX.XXX.XXX ssl_ca_file: /etc/ssl/ca.crt ssl_cert_file: /etc/ssl/mail.crt ssl_key_file: /etc/ssl/private/mail.key login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot first_valid_uid: 10000 first_valid_gid: 100 last_valid_gid: 100 mail_location: mbox:/home/mail/%u/mbox:INBOX=/home/mail/%u/mbox/inbox:INDEX=/var/dovecot/index/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota trash mail_plugins(imap): quota imap_quota trash mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: bsdauth userdb: driver: passwd plugin: quota: dirsize:storage=1048576 trash: /etc/dovecot-trash.conf # dmesg Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. Copyright (c) 1995-2008 OpenBSD. All rights reserved. http://www.OpenBSD.org OpenBSD 4.4-beta (GENERIC.MP) #364: Sun Jul 20 17:33:03 MDT 2008 deraadt@sparc64.openbsd.org:/usr/src/sys/arch/sparc64/compile/GENERIC.MP real mem = 8589934592 (8192MB) avail mem = 8369397760 (7981MB) mainbus0 at root: Sun Fire V440 cpu0 at mainbus0: SUNW,UltraSPARC-IIIi (rev 2.4) @ 1062 MHz cpu0: physical 32K instruction (32 b/l), 64K data (32 b/l), 1024K external (64 b/l) cpu1 at mainbus0: SUNW,UltraSPARC-IIIi (rev 2.4) @ 1062 MHz cpu1: physical 32K instruction (32 b/l), 64K data (32 b/l), 1024K external (64 b/l) cpu2 at mainbus0: SUNW,UltraSPARC-IIIi (rev 2.4) @ 1062 MHz cpu2: physical 32K instruction (32 b/l), 64K data (32 b/l), 1024K external (64 b/l) cpu3 at mainbus0: SUNW,UltraSPARC-IIIi (rev 2.4) @ 1062 MHz cpu3: physical 32K instruction (32 b/l), 64K data (32 b/l), 1024K external (64 b/l) "memory-controller" at mainbus0 not configured "memory-controller" at mainbus0 not configured "memory-controller" at mainbus0 not configured "memory-controller" at mainbus0 not configured schizo0 at mainbus0: "Tomatillo", version 4, ign 700, bus A 0 to 0 schizo0: dvma map c0000000-dfffffff, iotdb 5174000-51f4000 pci0 at schizo0 cas0 at pci0 dev 2 function 0 "Sun Cassini" rev 0x20: ivec 0x718, address 00:03:ba:66:75:d1 brgphy0 at cas0 phy 1: BCM5421 10/100/1000baseT PHY, rev. 1 "ppm" at mainbus0 not configured schizo1 at mainbus0: "Tomatillo", version 4, ign 740, bus B 0 to 0 schizo1: dvma map c0000000-dfffffff, iotdb 552c000-55ac000 pci1 at schizo1 mpi0 at pci1 dev 2 function 0 "Symbios Logic 53c1030" rev 0x08: ivec 0x740 scsibus0 at mpi0: 16 targets, initiator 7 schizo2 at mainbus0: "Tomatillo", version 4, ign 780, bus A 0 to 0 schizo2: dvma map c0000000-dfffffff, iotdb 5694000-5714000 pci2 at schizo2 ebus0 at pci2 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00 "flashprom" at ebus0 addr 0-fffff, 290-290 not configured rtc0 at ebus0 addr 70-71: m5819p pcfiic0 at ebus0 addr 320-321 ivec 0x1b iic0 at pcfiic0 "SUNW,i2c-imax" at iic0 addr 0xb not configured "SUNW,i2c-imax" at iic0 addr 0xc not configured admtemp0 at iic0 addr 0x18: max1617, cannot get control register "pca9555" at iic0 addr 0x21 not configured "pca9555" at iic0 addr 0x22 not configured "pca9555" at iic0 addr 0x23 not configured "pca9555" at iic0 addr 0x24 not configured "adm1026" at iic0 addr 0x2e not configured admtemp1 at iic0 addr 0x32: max1617, cannot get control register admtemp2 at iic0 addr 0x40: max1617, cannot get control register admtemp3 at iic0 addr 0x48: max1617, cannot get control register lmtemp0 at iic0 addr 0x4e: lm75, fails to respond "spd" at iic0 addr 0x5b not configured "spd" at iic0 addr 0x5c not configured "spd" at iic0 addr 0x5d not configured "spd" at iic0 addr 0x5e not configured "spd" at iic0 addr 0x63 not configured "spd" at iic0 addr 0x64 not configured "spd" at iic0 addr 0x65 not configured "spd" at iic0 addr 0x66 not configured "spd" at iic0 addr 0x6b not configured "spd" at iic0 addr 0x6c not configured "spd" at iic0 addr 0x6d not configured "spd" at iic0 addr 0x6e not configured "spd" at iic0 addr 0x73 not configured "spd" at iic0 addr 0x74 not configured "spd" at iic0 addr 0x75 not configured "spd" at iic0 addr 0x76 not configured "ics951601" at iic0 addr 0x69 not configured power0 at ebus0 addr 800-82f ivec 0x1a com0 at ebus0 addr 3f8-3ff ivec 0x22: ns16550a, 16 byte fifo com0: console com1 at ebus0 addr 2e8-2ef ivec 0x22: ns16550a, 16 byte fifo "rmc-comm" at ebus0 addr 3e8-3ef ivec 0x22 not configured cas1 at pci2 dev 2 function 0 "NS Saturn" rev 0x30: ivec 0x78c, address 00:14:4f:1e:d6:b4 gentbi0 at cas1 phy 0: Generic ten-bit interface, rev. 0 "ATI Rage XL" rev 0x27 at pci2 dev 4 function 0 not configured alipm0 at pci2 dev 6 function 0 "Acer Labs M7101 Power" rev 0x00: 223KHz clock iic1 at alipm0 ohci0 at pci2 dev 10 function 0 "Acer Labs M5237 USB" rev 0x03: ivec 0x7a1, version 1.0, legacy support ohci1 at pci2 dev 11 function 0 "Acer Labs M5237 USB" rev 0x03: ivec 0x7a5, version 1.0, legacy support pciide0 at pci2 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc4: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI pciide0: using ivec 0x7a6 for native-PCI interrupt atapiscsi0 at pciide0 channel 0 drive 0 scsibus1 at atapiscsi0: 2 targets, initiator 7 cd0 at scsibus1 targ 0 lun 0: <TOSHIBA, DVD-ROM SD-C2612, 1011> ATAPI 5/cdrom removable cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2 pciide0: channel 1 disabled (no drives) usb0 at ohci0: USB revision 1.0 uhub0 at usb0 "Acer Labs OHCI root hub" rev 1.00/1.00 addr 1 usb1 at ohci1: USB revision 1.0 uhub1 at usb1 "Acer Labs OHCI root hub" rev 1.00/1.00 addr 1 "ppm" at mainbus0 not configured schizo3 at mainbus0: "Tomatillo", version 4, ign 7c0, bus B 0 to 0 schizo3: dvma map c0000000-dfffffff, iotdb 5a68000-5ae8000 pci3 at schizo3 cas2 at pci3 dev 1 function 0 "Sun Cassini" rev 0x20: ivec 0x7dc, address 00:03:ba:66:75:d2 brgphy1 at cas2 phy 1: BCM5421 10/100/1000baseT PHY, rev. 1 mpi1 at pci3 dev 2 function 0 "Symbios Logic 53c1030" rev 0x07: ivec 0x7e3 scsibus2 at mpi1: 16 targets, initiator 7 sd0 at scsibus2 targ 0 lun 0: <LSILOGIC, 1030 IM IM, 1000> SCSI2 0/direct fixed sd0: 34732MB, 34732 cyl, 16 head, 128 sec, 512 bytes/sec, 71131136 sec total sd1 at scsibus2 targ 2 lun 0: <FUJITSU, MAP3367N SUN36G, 0401> SCSI2 0/direct fixed sd1: 34732MB, 24622 cyl, 27 head, 107 sec, 512 bytes/sec, 71132959 sec total sd2 at scsibus2 targ 3 lun 0: <FUJITSU, MAP3367N SUN36G, 0401> SCSI2 0/direct fixed sd2: 34732MB, 24622 cyl, 27 head, 107 sec, 512 bytes/sec, 71132959 sec total mpi1: target 2 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 mpi1: target 3 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 mpi1: phys disk 0 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 mpi1: phys disk 1 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 mpi2 at pci3 dev 2 function 1 "Symbios Logic 53c1030" rev 0x07: ivec 0x7e4 scsibus3 at mpi2: 16 targets, initiator 7 "i2c" at mainbus0 not configured softraid0 at root bootpath: /pci@1f,700000/scsi@2,0/disk@0,0 root on sd0a swap on sd0b dump on sd0b

2 2

[Dovecot] Sorting a folder (by THREAD) takes a long time
by Asheesh Laroia 30 Aug '08

30 Aug '08

My email workflow with Dovecot is that mail gets delivered to INBOX, where I handle it and then move it into a folder called archive. I have alpine set to use the Default sort of "THREAD" of a folder. After moving a (few) mail(s) from INBOX to archive, archive takes a long time (10-50s) to load while alpine tells me: [Sorting "archive" ... ] (I can do the IMAP traces, but I figure alpine's terminology is going to be so similar to IMAP terminology that it should be straightforward enough for Timo to know what I'm talking about.) I don't actually know enough about Dovecot to say for sure what makes this slow, but maybe it's just indexes not being updated? What might be making this slow, and what hope is there for it being fast? (-: It seems like the really nice thing to do would be, after the save, in the background examine the archive folder and update whatever caches need to be updated. The more work that happens while I'm not waiting, the happier I'll be! (Same goes for my mom, and the other less-technical users of Dovecot.) Is this the kind of thing I could write a plugin for...? -- Asheesh. -- It seems to make an auto driver mad if he misses you.

6 9

[Dovecot] Online backup with dovecot
by Johan 'yosh' Marklund 29 Aug '08

29 Aug '08

Hi! Do you guys/girls (whichever you prefer) know if it's possible (i.e. in some semitransparent/easy way) to incorporate an online backup system? If the mail is older than a set amount of days it gets compressed. I want my mail storage size to shrink but on the other hand I want to keep the mails I get and have them easily readable :) I'm thinking of symlinks and some kind of gzip fuse filesystem... Please save me ,) /yosh

4 3

[Dovecot] mbox empty messages in Sent folder
by Diego Liziero 14 Aug '08

14 Aug '08

I'm talking about mbox Sent folder, where some mailers append through imap server a copy of each message they send. Sometimes, just three header lines got appended instead of the whole mail message, such as: >From xxxxxxxx(a)xxxxxx.xxxxxx.xxxxx.xx.xx Fri May 23 12:30:14 2008 X-UID: 2852 Status: RO This happened in the past (dovecot-1.1-beta/rc with Evolution and with Thunderbird), and happened last week with dovecot-1.1-rc5 (+ last week hg patches). Anyone had a similar issue? Regards, Diego.

2 17

[Dovecot] syslog with PID
by Heiko Schlichting 13 Aug '08

13 Aug '08

Hi, LOG_NDELAY is the only option for openlog() in dovecot 1.1.2. Wouldn't be LOG_NDELAY|LOG_PID as option parameter much more useful? Without logging the pid, it is impossible to match 'Disconnected' log entries and the corresponding session start/login. Therefore I suggest to use LOG_NDELAY|LOG_PID in the options of i_set_failure_syslog() at all 6 occurrences which passes it to openlog(). I know that it is possible to - use logging to file - patch it myself but I can't see good reasons in not using LOG_PID here. As far as I know, most other programs specify LOG_PID. Without LOG_PID: Jul 31 10:21:08 name dovecot: IMAP(hsg): Disconnected: Logged out bytes=28/242 With LOG_PID: Jul 31 10:21:08 name dovecot[17016]: IMAP(hsg): Disconnected: Logged out bytes=28/242 Heiko Heiko Schlichting Freie Universität Berlin heiko(a)FU-Berlin.DE Zentraleinrichtung für Datenverarbeitung (ZEDAT) Telefon +49 30 838-54327 Fabeckstraße 32 Telefax +49 30 838454327 14195 Berlin

3 5

[Dovecot] Server-side sieve for client-side copies
by Daniel L. Miller 13 Aug '08

13 Aug '08

I know I could test this - but I'd rather ask first. To my knowledge, we haven't come up with a good server-side implementation for savings copies of sent messages (by all means correct my ignorance in this regard). So the typical way is to enable it in clients like Thunderbird (this prompted a whole discussion of how to save these messages without sending them to the server multiple times). My understanding is that sending a message from a client (use Thunderbird for simplicity of this conversation) is performed via SMTP. Saving a copy into a sent folder is performed via IMAP (hence the multiple transfers to the server). Now that I've laid a background - let's make it Dovecot specific. I don't know how "behind-the-scenes" Dovecot performs the act of saving mail messages that it receives from IMAP, instead of SMTP. Specifically, if I'm using sieve filters via deliver - can I setup a filter that will place mail copies to specific recipients into specific subfolders? -- Daniel

9 16

[Dovecot] Integrate Patch
by aledr 13 Aug '08

13 Aug '08

Is It possible to integrate this patch into next dovecot's releases? It implements the "-w ( disable webmail [IMAP from localhost*] access )" option when using vpopmail. ** Patch created following dovecot mailing list information ** Thanks -- [ ]'s Aledr - Alexandre "OpenSource Solutions for SmallBusiness Problems"

2 1

[Dovecot] stopping dovecot
by Arkadiusz Miskiewicz 13 Aug '08

13 Aug '08

This may be a silly question but how to correctly stop dovecot and be sure that it's possible to start it again? kill -TERM `cat /var/run/dovecot/master.pid` doesn't work well. I have imap-login processes staying arround and occupying port which leads to Fatal: listen(0.0.0.0, 993) failed: Address already in use when trying to start again 2s after stopping. -- Arkadiusz Miśkiewicz PLD/Linux Team arekm / maven.pl http://ftp.pld-linux.org/

6 14

[Dovecot] Possible bug in v1.1.1
by John Wood 12 Aug '08

12 Aug '08

Greetings, I recently upgraded our server from Dovecot 1.0.14 to 1.1.1. I am building using the FreeBSD ports system, so nothing is custom aside from the flags set there. dovecot fell down a few days after the update with: pid 1823 (imap), uid 1000: exited on signal 11 the mail log shows: Jul 4 14:36:07 hostname dovecot: IMAP(username): Corrupted index cache file /home/username/mail/.imap/INBOX/dovecot.index.cache: Broken MIME parts for mail UID 10462 Jul 4 14:36:07 hostname dovecot: child 1823 (imap) killed with signal 11 unfortunately I do not have a core. The closest thing I could find in the Changelog is: v1.1.rc13 2008-06-20 Timo Sirainen <tss(a)iki.fi> - Message parser: Fixed assert-crash if cached MIME structure was broken. but, it does not appear to be the same issue. The upgrade file mentions issues with cache/index files, but they are related to downgrades. The rest of the relative information: Dovecot version: v1.1.1 Operating system: FreeBSD 6.2 p11 CPU architecture: x86 Filesystem you used: FreeBSD UFS Message that caused the crash: attached Dovecot configuration: 1.1.1: /usr/local/etc/dovecot.conf Warning: mail_extra_groups setting was often used insecurely so it is now deprecated, use mail_access_groups or mail_privileged_group instead protocols: imap imaps pop3 pop3s listen(default): 127.0.0.1:143 listen(imap): 127.0.0.1:143 listen(pop3): 127.0.0.1:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_ca_file: /etc/ssl/godaddy_cert/gd_intermediate.crt ssl_cert_file: /etc/ssl/godaddy_cert/hostname.cert ssl_key_file: /etc/ssl/godaddy_cert/hostname.key ssl_parameters_regenerate: 400 login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: Hostname ready. login_process_per_connection: no login_process_size: 128 verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_extra_groups: mail mail_access_groups: mail mail_location: mbox:~/mail:INBOX=/var/mail/%u mbox_read_locks: fcntl dotlock mbox_write_locks: fcntl dotlock mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix I have not been able to repeat this so far. Thanks, John

2 3

[Dovecot] optionnal arguments to ntlm_auth helper
by François LEGAL 10 Aug '08

10 Aug '08

Hello, I'm setting up (at least I try) to set up network services with single sign on. I could build and configure dovecat to use samba's ntlm_auth helper to achieve ntlm authentication of imap users. The point is, I wanted to restrict which users could actually authenticate through ntlm. The ntlm_auth helper has this ability with the --require-membership-of=... command line parameter. I first tried (unsuccessfully) to add this parameter to the auth_winbind_helper_path token in dovecot.conf, and figured out by checking the source that this was not possible. I then decided to patch the source so that one can pass any argument to the ntlm_auth helper by specifying at new line in dovecot.conf with the token "auth_winbind_helper_args" (for instance, what I wanted to do is "auth_winbind_helper_args = --require-membership-of=... ") Well, here comes the patch. It is to be used with recent 1.1.2 release. Best regards François

3 2