August 2008 - dovecot

[Dovecot] many users maildir access
by VK 31 Aug '08

31 Aug '08

Hi All, Is it possible when using Dovecot and MySQL to tell dovecot maildir:%h/MailDir -- Yes I know but please read on before you answer this one :-> We have users directories layer structured because of the filesystems 32k directory limit , eg: user foobar(a)example.com's home mail directory is: /mailhosts/example.com/f/fo/foo/foobar I know Dovecot takes maildir:%d/%u/MailDir but as you see this will not work, so I guess I'm after the defination of %h, is that home as in system users home, or home as is like our setup? Or, is there yet another way we could have Dovecot access the users mail, we need to ove away from our current <insert_wellknown_pop3/imap> setup as it is just to slow, and I know dovecot has a 30 fold increase on speed over it from talknig to other people, but none of them do anymore then the /domain/user setup so cant help me. Regards, Vic

2 1

[Dovecot] Input and suggestions: Mail mirror setup
by Ulf Zimmermann 31 Aug '08

31 Aug '08

Hello, everyone. To make life for our operations team easier I am looking at setting up a mail mirror of any email which gets sent from certain machines. My current ideas go along the following lines: Each machine will use the Postfix "always_bcc" option and set it to an address like mailmirror(a)mailmirror.openlane.com. On mailmirror I am looking at setting up Dovecot with public folders and a number of users, which probably will authenticate via Active Directory. I intend to create a main public folder called MailMirror and then underneath sub folders based on the sender email address in a format of like "<sender>_<domain>". Now the sub folders need to be created automatically when it doesn't exist yet. I think the best way to tie this in between Postfix and Dovecot is to use an alias in Postfix for mailmirror(a)mailmirror.openlane.com which will check if a public folder exist or not. It will create the folder and then deliver the message to the folder (maybe via safecat http://www.dovecot.org/list/dovecot/2007-November/026661.html) Anyone got input or suggestion about my plans? Ulf Zimmermann | Senior System Architect OPENLANE 4600 Bohannon Drive, Suite 100 Menlo Park, CA 94025 O: 650-532-6382 M: (510) 396-1764 F: (510) 580-0929 Email: ulf(a)openlane.com | Web: www.openlane.com

2 3

[Dovecot] Dovecot and fake users
by Vytenis Sabaliauskas 31 Aug '08

31 Aug '08

Hi everyone, Our company has decided to make a fake POP3 (and possibly IMAP) server, which accepts any user name and password combination and shows there are no new messages. This is for the purpose that when our mail cluster passes out, we can redirect our clients to this server while we fix our mail system. This way we can prevent our users from getting errors. We are using the latest dovecot server with Ubuntu (currently), but perhaps will migrate to CentOS (if this is important) I am trying to use the following configuration for testing, but it doesn't seem to work (don't laugh :) ) -------8<------------ passdb pam { args = dovecot } userdb static { args = uid=0 gid=0 home=/var/mail/empty allow_all_users=yes } -------8<------------ cat /etc/pam.d/dovecot: ------------------- #%PAM-1.0 auth required pam_permit.so ------------------- I will be very thankful for pointing the way to do this and any thoughts. P.S. Sorry for my english. -- Vytenis

4 3

[Dovecot] Distributed indexes, maildir_copy_preserve_filename, and Microsoft
by Jack Stewart 30 Aug '08

30 Aug '08

Hi, I've just completed a migration from Courier to a Dovecot 1.0.7 (patched RHE 5) which is working great, except for this weirdness of an issue that is impacting a handful of users. My question is that will turning off maildir_copy_preserve_filename help or hurt in a situation where there are multiple servers with their own local INDEX files (uidlist is shared)? The problem is that a few users on a few versions of Microsoft Mail clients are not showing a few messages. They can see the messages just fine in webmail and other, more typical, E-mail clients. I know that the right solution is to upgrade to 1.1.2 and use shared indexes. The plan is to upgrade in a month or so. In my defense, this setup was not of my making, The two things issues that might have an impact are that we have shared (NFS) maildirs on multiple servers with their own local indexes and maildir_copy_preserve_file turned on. The uidlist (CONTROL) is shared and we have sticky connections turned on in our load balancer. The vast majority of clients do not have this issue. Quite frankly I have no idea these clients are ignoring the dovecot-uidlist. Would turning off maildir_copy_preserve_filename help with this setup? Another option might be easier is to delete the users INDEX and let the clients rebuild them. Since this is only a handful of users and we are migrating to 1.1.2 anyway, my preference is to make the bare minimum of changes to help address this problem. The changes need not be perfect nor anytime more than a suggestion or preference. I just want to make things better for a little while. Many thanks in advance. ---Jack P.S. The performance improvement is amazing - anywhere from 2X to 12X depending on what metrics you are looking at. It isn't an apples to apples comparison since we upgraded the servers as well but the "old" servers are pretty powerful beasts. -- Jack Stewart jstewart(a)caltech.edu / 626-395-4690 http://www.imss.caltech.edu

2 2

[Dovecot] sieve forward/redirect to multiple addresses
by Anil 30 Aug '08

30 Aug '08

How can I do this with Sieve? I have a script like this: if header :value "ge" :comparator "i;ascii-numeric" ["X-Spam-Score"] ["25"] { discard; stop; } elsif header :value "ge" :comparator "i;ascii-numeric" ["X-Spam-Score"] ["5"] { fileinto "Junk"; stop; } else { redirect "user(a)test.com"; redirect "user(a)example.com"; keep; } Only the first redirect seems to be honored, the 2nd is not. The only other alternative I see is that I have to create an alias that contains those two addresses, and then I redirect to that alias -- but I would prefer if I can do this through sieve itself. Thanks very much, sorry this is not Dovecot question... but this is on a Dovecot mail server. :)

3 2

[Dovecot] sparc quota bug
by dovecot＠lechtermann.net 30 Aug '08

30 Aug '08

Hi, I am getting the following error: dovecot: Jul 23 18:04:44 Error: child 7600 (imap) killed with signal 10 How to reproduce: Try to delete or move a mail to another folder. The mail actually gets copied to the other folder but the original isn't removed (when using webmail). If using thunderbird this ends up in an infinite loop creating new mails in the destination folder (without deleting the original) until stopped manually. When turning off quota or commenting out the "quota: dirsize:storage=1048576" entry it works, just no quotas anymore. :-( Details: OS: OpenBSD ARCH: sparc64 FS: ffs Dovecot version: 1.0.15 and 1.1.1 If you need more information, please let me know. @timo: I could provide access to a OpenBSD sparc64 box if it would help debugging the problem. Just send me your public SSH key. # dovecot -n # 1.0.15: /etc/dovecot.conf base_dir: /var/dovecot/ log_path: /var/log/dovecot.log protocols: imaps pop3s listen: XXX.XXX.XXX.XXX ssl_ca_file: /etc/ssl/ca.crt ssl_cert_file: /etc/ssl/mail.crt ssl_key_file: /etc/ssl/private/mail.key login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot first_valid_uid: 10000 first_valid_gid: 100 last_valid_gid: 100 mail_location: mbox:/home/mail/%u/mbox:INBOX=/home/mail/%u/mbox/inbox:INDEX=/var/dovecot/index/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota trash mail_plugins(imap): quota imap_quota trash mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: bsdauth userdb: driver: passwd plugin: quota: dirsize:storage=1048576 trash: /etc/dovecot-trash.conf # dmesg Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. Copyright (c) 1995-2008 OpenBSD. All rights reserved. http://www.OpenBSD.org OpenBSD 4.4-beta (GENERIC.MP) #364: Sun Jul 20 17:33:03 MDT 2008 deraadt@sparc64.openbsd.org:/usr/src/sys/arch/sparc64/compile/GENERIC.MP real mem = 8589934592 (8192MB) avail mem = 8369397760 (7981MB) mainbus0 at root: Sun Fire V440 cpu0 at mainbus0: SUNW,UltraSPARC-IIIi (rev 2.4) @ 1062 MHz cpu0: physical 32K instruction (32 b/l), 64K data (32 b/l), 1024K external (64 b/l) cpu1 at mainbus0: SUNW,UltraSPARC-IIIi (rev 2.4) @ 1062 MHz cpu1: physical 32K instruction (32 b/l), 64K data (32 b/l), 1024K external (64 b/l) cpu2 at mainbus0: SUNW,UltraSPARC-IIIi (rev 2.4) @ 1062 MHz cpu2: physical 32K instruction (32 b/l), 64K data (32 b/l), 1024K external (64 b/l) cpu3 at mainbus0: SUNW,UltraSPARC-IIIi (rev 2.4) @ 1062 MHz cpu3: physical 32K instruction (32 b/l), 64K data (32 b/l), 1024K external (64 b/l) "memory-controller" at mainbus0 not configured "memory-controller" at mainbus0 not configured "memory-controller" at mainbus0 not configured "memory-controller" at mainbus0 not configured schizo0 at mainbus0: "Tomatillo", version 4, ign 700, bus A 0 to 0 schizo0: dvma map c0000000-dfffffff, iotdb 5174000-51f4000 pci0 at schizo0 cas0 at pci0 dev 2 function 0 "Sun Cassini" rev 0x20: ivec 0x718, address 00:03:ba:66:75:d1 brgphy0 at cas0 phy 1: BCM5421 10/100/1000baseT PHY, rev. 1 "ppm" at mainbus0 not configured schizo1 at mainbus0: "Tomatillo", version 4, ign 740, bus B 0 to 0 schizo1: dvma map c0000000-dfffffff, iotdb 552c000-55ac000 pci1 at schizo1 mpi0 at pci1 dev 2 function 0 "Symbios Logic 53c1030" rev 0x08: ivec 0x740 scsibus0 at mpi0: 16 targets, initiator 7 schizo2 at mainbus0: "Tomatillo", version 4, ign 780, bus A 0 to 0 schizo2: dvma map c0000000-dfffffff, iotdb 5694000-5714000 pci2 at schizo2 ebus0 at pci2 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00 "flashprom" at ebus0 addr 0-fffff, 290-290 not configured rtc0 at ebus0 addr 70-71: m5819p pcfiic0 at ebus0 addr 320-321 ivec 0x1b iic0 at pcfiic0 "SUNW,i2c-imax" at iic0 addr 0xb not configured "SUNW,i2c-imax" at iic0 addr 0xc not configured admtemp0 at iic0 addr 0x18: max1617, cannot get control register "pca9555" at iic0 addr 0x21 not configured "pca9555" at iic0 addr 0x22 not configured "pca9555" at iic0 addr 0x23 not configured "pca9555" at iic0 addr 0x24 not configured "adm1026" at iic0 addr 0x2e not configured admtemp1 at iic0 addr 0x32: max1617, cannot get control register admtemp2 at iic0 addr 0x40: max1617, cannot get control register admtemp3 at iic0 addr 0x48: max1617, cannot get control register lmtemp0 at iic0 addr 0x4e: lm75, fails to respond "spd" at iic0 addr 0x5b not configured "spd" at iic0 addr 0x5c not configured "spd" at iic0 addr 0x5d not configured "spd" at iic0 addr 0x5e not configured "spd" at iic0 addr 0x63 not configured "spd" at iic0 addr 0x64 not configured "spd" at iic0 addr 0x65 not configured "spd" at iic0 addr 0x66 not configured "spd" at iic0 addr 0x6b not configured "spd" at iic0 addr 0x6c not configured "spd" at iic0 addr 0x6d not configured "spd" at iic0 addr 0x6e not configured "spd" at iic0 addr 0x73 not configured "spd" at iic0 addr 0x74 not configured "spd" at iic0 addr 0x75 not configured "spd" at iic0 addr 0x76 not configured "ics951601" at iic0 addr 0x69 not configured power0 at ebus0 addr 800-82f ivec 0x1a com0 at ebus0 addr 3f8-3ff ivec 0x22: ns16550a, 16 byte fifo com0: console com1 at ebus0 addr 2e8-2ef ivec 0x22: ns16550a, 16 byte fifo "rmc-comm" at ebus0 addr 3e8-3ef ivec 0x22 not configured cas1 at pci2 dev 2 function 0 "NS Saturn" rev 0x30: ivec 0x78c, address 00:14:4f:1e:d6:b4 gentbi0 at cas1 phy 0: Generic ten-bit interface, rev. 0 "ATI Rage XL" rev 0x27 at pci2 dev 4 function 0 not configured alipm0 at pci2 dev 6 function 0 "Acer Labs M7101 Power" rev 0x00: 223KHz clock iic1 at alipm0 ohci0 at pci2 dev 10 function 0 "Acer Labs M5237 USB" rev 0x03: ivec 0x7a1, version 1.0, legacy support ohci1 at pci2 dev 11 function 0 "Acer Labs M5237 USB" rev 0x03: ivec 0x7a5, version 1.0, legacy support pciide0 at pci2 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc4: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI pciide0: using ivec 0x7a6 for native-PCI interrupt atapiscsi0 at pciide0 channel 0 drive 0 scsibus1 at atapiscsi0: 2 targets, initiator 7 cd0 at scsibus1 targ 0 lun 0: <TOSHIBA, DVD-ROM SD-C2612, 1011> ATAPI 5/cdrom removable cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2 pciide0: channel 1 disabled (no drives) usb0 at ohci0: USB revision 1.0 uhub0 at usb0 "Acer Labs OHCI root hub" rev 1.00/1.00 addr 1 usb1 at ohci1: USB revision 1.0 uhub1 at usb1 "Acer Labs OHCI root hub" rev 1.00/1.00 addr 1 "ppm" at mainbus0 not configured schizo3 at mainbus0: "Tomatillo", version 4, ign 7c0, bus B 0 to 0 schizo3: dvma map c0000000-dfffffff, iotdb 5a68000-5ae8000 pci3 at schizo3 cas2 at pci3 dev 1 function 0 "Sun Cassini" rev 0x20: ivec 0x7dc, address 00:03:ba:66:75:d2 brgphy1 at cas2 phy 1: BCM5421 10/100/1000baseT PHY, rev. 1 mpi1 at pci3 dev 2 function 0 "Symbios Logic 53c1030" rev 0x07: ivec 0x7e3 scsibus2 at mpi1: 16 targets, initiator 7 sd0 at scsibus2 targ 0 lun 0: <LSILOGIC, 1030 IM IM, 1000> SCSI2 0/direct fixed sd0: 34732MB, 34732 cyl, 16 head, 128 sec, 512 bytes/sec, 71131136 sec total sd1 at scsibus2 targ 2 lun 0: <FUJITSU, MAP3367N SUN36G, 0401> SCSI2 0/direct fixed sd1: 34732MB, 24622 cyl, 27 head, 107 sec, 512 bytes/sec, 71132959 sec total sd2 at scsibus2 targ 3 lun 0: <FUJITSU, MAP3367N SUN36G, 0401> SCSI2 0/direct fixed sd2: 34732MB, 24622 cyl, 27 head, 107 sec, 512 bytes/sec, 71132959 sec total mpi1: target 2 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 mpi1: target 3 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 mpi1: phys disk 0 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 mpi1: phys disk 1 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 mpi2 at pci3 dev 2 function 1 "Symbios Logic 53c1030" rev 0x07: ivec 0x7e4 scsibus3 at mpi2: 16 targets, initiator 7 "i2c" at mainbus0 not configured softraid0 at root bootpath: /pci@1f,700000/scsi@2,0/disk@0,0 root on sd0a swap on sd0b dump on sd0b

2 2

[Dovecot] Deliver autocreate with auto-subscribe?
by Paul Reilly 30 Aug '08

30 Aug '08

Hello, I'm using dovecot with postfix configured for address extensions, so email to me+folder(a)mydomain.com <me%2Bfolder(a)mydomain.com>, automatically is handed off to dovecot deliver, which sees there is no folder called "folder" and autocreates it. This is brilliant, as it means I can give out subject orrientated email addresses, and the mail is automatically put in the right mailbox :) I love dovecot with postfix. However, my problem is my IMAP client (roundcube and HordeIMP) does not see the newly created folder. I have to manually subscribe it in the webmail client, or I have to add the folder to the "subscriptions" file in my home dir. So my question is, can the deliver command which auto-creates this folder, also add it to the subscriptions file? It seems like it just needs another switch on the command line. http://wiki.dovecot.org/LDA Is this currently possible, and if not, what code do I need to hack to make it work? Thanks Paul

2 3

[Dovecot] Sorting a folder (by THREAD) takes a long time
by Asheesh Laroia 30 Aug '08

30 Aug '08

My email workflow with Dovecot is that mail gets delivered to INBOX, where I handle it and then move it into a folder called archive. I have alpine set to use the Default sort of "THREAD" of a folder. After moving a (few) mail(s) from INBOX to archive, archive takes a long time (10-50s) to load while alpine tells me: [Sorting "archive" ... ] (I can do the IMAP traces, but I figure alpine's terminology is going to be so similar to IMAP terminology that it should be straightforward enough for Timo to know what I'm talking about.) I don't actually know enough about Dovecot to say for sure what makes this slow, but maybe it's just indexes not being updated? What might be making this slow, and what hope is there for it being fast? (-: It seems like the really nice thing to do would be, after the save, in the background examine the archive folder and update whatever caches need to be updated. The more work that happens while I'm not waiting, the happier I'll be! (Same goes for my mom, and the other less-technical users of Dovecot.) Is this the kind of thing I could write a plugin for...? -- Asheesh. -- It seems to make an auto driver mad if he misses you.

6 9

[Dovecot] Dovecot 1.1.2
by Lauri Jesmin 30 Aug '08

30 Aug '08

Hello, I upgraded dovecot to 1.1.2 this weekend and i get those errors: grep dovecot /var/log/net/maillog |grep Panic | cut -d " " -f 11-100| sort | uniq -c | sort -rn 7547 file index-sync.c: line 39: assertion failed: (seq_range_exists(&ibox->recent_flags, uid)) 89 file index-mail.c: line 1091: assertion failed: (! mail->data.destroying_stream) 18 file mbox-sync-rewrite.c: line 590: assertion failed: (mails[idx].from_offset == start_offset) 5 file ostream-file.c: line 533: assertion failed: ((size_t)ret == total_size || !fstream->file) 5 file mbox-lock.c: line 675: assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) 1 file message-parser.c: line 684: assertion failed: (ctx->part->physical_pos >= ctx->input->v_offset) My setup is this: 3 servers, all Solaris, running dovecot, share home directiories via NFS, mbox format mailboxes in home directories. Indexes are separate in every server, not shared via NFS. About 20 000 users total. When old indexes (1.0.15) were present, mailboxes with UID validity problems did not fix themselves, but after i removed index directories in all machines, seems like it started to repair uid validity problems. The first panic seems to be tied to UID validity problems. Some locking problems may be, because i renamed index directory and created new while dovecot was running. -- Lauri Jesmin <lauri.jesmin(a)ut.ee> Tartu Ülikool

3 3

[Dovecot] Proxy logging destuser
by Paul Gamble - MWEB 30 Aug '08

30 Aug '08

Hi All My first post to the list, so "hello world"! Having searched the list archives and the wiki for an answer to this, I don't think it is possible. However, let me ask nonetheless... Is it possible for a Dovecot proxy's login process (IMAP and POP3) to include the "destuser", i.e. the uid used to authenticate to the backend IMAP/POP3 server, in its logging? "%u" gives me the uid provided by the client of course, but it would useful for my purposes to catch the "destuser" in the same log line. The only way to get the proxy to log "destuser" at all, as far as I can figure out, is to enable "auth debug" - not something I want to do in a production environment. Thanking-you, Paul New from MWEB: Cellphone and Internet bundles! Bundle your Internet access with your cellular contract from R75 per month. Call 08600 32000 or click here(http://www.mweb.co.za/productsservices/MTALKMobile/tabid/1223/Default.aspx) for more info on the great deals available. MWEB :-) JUST LIKE THAT

2 5