- dovecot - dovecot.org

[Dovecot] expire plugin + --exec-mail in 1.2.6 version
by Nikita Koshikov 25 Nov '09

25 Nov '09

Hello list, After upgrade to dovecot version 1.2.6 I have noticed some quota malfunctions(users become often overquota). Looking at logs closely I have found that quota value resets to general dovecot-config( quota = maildir:Mailbox quota quota_rule = *:storage=500M quota_rule2 = Trash:storage=10%% ), after dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool.sh command. The problem that some users have their own quotas stored in ldap. For example, user sr(a)domain.com have maildirsize before running expire-tool(1G value from ldap): # head -2 /data/mail/domain.com/sr/data/maildirsize 10485760000S 836423205 8285 Then I run expire-tool with mail_debug enabled: # /usr/sbin/dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool.sh Info: Loading modules from directory: /usr/lib/dovecot/imap Info: Module loaded: /usr/lib/dovecot/imap/lib10_quota_plugin.so Info: Module loaded: /usr/lib/dovecot/imap/lib11_trash_plugin.so Info: Module loaded: /usr/lib/dovecot/imap/lib20_autocreate_plugin.so Info: Module loaded: /usr/lib/dovecot/imap/lib20_expire_plugin.so Info: Module loaded: /usr/lib/dovecot/imap/lib20_virtual_plugin.so Info: Module loaded: /usr/lib/dovecot/imap/lib20_zlib_plugin.so Info: Quota root: name=Mailbox quota backend=maildir args= Info: Quota rule: root=Mailbox quota mailbox=* bytes=524288000 messages=0 Info: Quota rule: root=Mailbox quota mailbox=Trash bytes=52428800 (10%) messages=0 Info: Quota warning: bytes=471859200 (90%) messages=0 command=/etc/dovecot/plugins/quota_warning.sh 90 Info: expire: pattern=Trash type=expunge secs=2592000 Info: expire: pattern=Spam type=expunge secs=2592000 Info: auth input: uid=8 Info: auth input: gid=12 Info: auth input: home=/data/mail/domain.com/koshikov.n Info: auth input: mail=maildir:~/data Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Info: maildir: data=~/data Info: maildir++: root=/data/mail/domain.com/koshikov.n/data, index=, control=, inbox=/data/mail/domain.com/koshikov.n/data Info: Namespace: type=private, prefix=Agromat/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no Info: virtual: data=/var/mail/virtual:INDEX=MEMORY:LAYOUT=maildir++ Info: maildir++: root=/var/mail/virtual, index=, control=, inbox= Info: Namespace : Using permissions from /data/mail/domain.com/koshikov.n/data: mode=0700 gid=-1 Info: trash plugin: Added 'Trash' with priority 1 Info: trash plugin: Added 'Spam' with priority 2 Info: koshikov.n(a)domain.com/Spam: seq=1 uid=1869: Expunge Info: koshikov.n(a)domain.com/Spam: seq=2 uid=1870: Expunge Info: koshikov.n(a)domain.com/Spam: seq=3 uid=1871: Expunge Info: koshikov.n(a)domain.com/Spam: seq=4 uid=1872: Expunge Info: koshikov.n(a)domain.com/Spam: seq=5 uid=1873: Expunge Info: koshikov.n(a)domain.com/Spam: seq=6 uid=1874: Expunge Info: koshikov.n(a)domain.com/Spam: seq=7 uid=1875: Expunge Info: koshikov.n(a)domain.com/Spam: seq=8 uid=1876: Expunge Info: koshikov.n(a)domain.com/Spam: seq=9 uid=1877: Expunge Info: koshikov.n(a)domain.com/Spam: seq=10 uid=1878: Expunge Info: koshikov.n(a)domain.com/Spam: seq=11 uid=1879: Expunge Info: koshikov.n(a)domain.com/Spam: seq=12 uid=1880: Expunge Info: koshikov.n(a)domain.com/Spam: timestamp 1256618680 (Tue Oct 27 06:44:40 2009) -> 1256716674 (Wed Oct 28 09:57:54 2009) Info: auth input: uid=8 Info: auth input: gid=12 Info: auth input: home=/data/mail/domain.com/fsb Info: auth input: mail=maildir:~/data Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Info: maildir: data=~/data Info: maildir++: root=/data/mail/domain.com/fsb/data, index=, control=, inbox=/data/mail/domain.com/fsb/data Info: Namespace: type=private, prefix=Agromat/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no Info: virtual: data=/var/mail/virtual:INDEX=MEMORY:LAYOUT=maildir++ Info: maildir++: root=/var/mail/virtual, index=, control=, inbox= Info: Namespace : Using permissions from /data/mail/domain.com/fsb/data: mode=0700 gid=-1 Info: trash plugin: Added 'Trash' with priority 1 Info: trash plugin: Added 'Spam' with priority 2 Info: fsb(a)domain.com/Trash: seq=1 uid=578: Expunge Info: fsb(a)domain.com/Trash: seq=2 uid=579: Expunge Info: fsb(a)domain.com/Trash: seq=3 uid=580: Expunge Info: fsb(a)domain.com/Trash: seq=4 uid=581: Expunge Info: fsb(a)domain.com/Trash: seq=5 uid=582: Expunge Info: fsb(a)domain.com/Trash: seq=6 uid=583: Expunge Info: fsb(a)domain.com/Trash: seq=7 uid=584: Expunge Info: fsb(a)domain.com/Trash: seq=8 uid=585: Expunge Info: fsb(a)domain.com/Trash: seq=9 uid=586: Expunge Info: fsb(a)domain.com/Trash: seq=10 uid=587: Expunge Info: fsb(a)domain.com/Trash: seq=11 uid=588: Expunge Info: fsb(a)domain.com/Trash: seq=12 uid=589: Expunge Info: fsb(a)domain.com/Trash: seq=13 uid=590: Expunge Info: fsb(a)domain.com/Trash: timestamp 1256627284 (Tue Oct 27 09:08:04 2009) -> 1256732991 (Wed Oct 28 14:29:51 2009) Info: auth input: uid=8 Info: auth input: gid=12 Info: auth input: home=/data/mail/domain.com/arsen Info: auth input: mail=maildir:~/data Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Info: maildir: data=~/data Info: maildir++: root=/data/mail/domain.com/arsen/data, index=, control=, inbox=/data/mail/domain.com/arsen/data Info: Namespace: type=private, prefix=Agromat/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no Info: virtual: data=/var/mail/virtual:INDEX=MEMORY:LAYOUT=maildir++ Info: maildir++: root=/var/mail/virtual, index=, control=, inbox= Info: Namespace : Using permissions from /data/mail/domain.com/arsen/data: mode=0700 gid=-1 Info: trash plugin: Added 'Trash' with priority 1 Info: trash plugin: Added 'Spam' with priority 2 Info: arsen(a)domain.com/Trash: seq=1 uid=14: Expunge Info: arsen(a)domain.com/Trash: seq=2 uid=15: Expunge Info: arsen(a)domain.com/Trash: seq=3 uid=16: Expunge Info: arsen(a)domain.com/Trash: seq=4 uid=17: Expunge Info: arsen(a)domain.com/Trash: seq=5 uid=18: Expunge Info: arsen(a)domain.com/Trash: seq=6 uid=19: Expunge Info: arsen(a)domain.com/Trash: seq=7 uid=20: Expunge Info: arsen(a)domain.com/Trash: seq=8 uid=21: Expunge Info: arsen(a)domain.com/Trash: seq=9 uid=22: Expunge Info: arsen(a)domain.com/Trash: seq=10 uid=23: Expunge Info: arsen(a)domain.com/Trash: seq=11 uid=24: Expunge Info: arsen(a)domain.com/Trash: timestamp 1256630371 (Tue Oct 27 09:59:31 2009) -> 1256733711 (Wed Oct 28 14:41:51 2009) Info: auth input: uid=8 Info: auth input: gid=12 Info: auth input: home=/data/mail/domain.com/koshikov.n Info: auth input: mail=maildir:~/data Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Info: maildir: data=~/data Info: maildir++: root=/data/mail/domain.com/koshikov.n/data, index=, control=, inbox=/data/mail/domain.com/koshikov.n/data Info: Namespace: type=private, prefix=Agromat/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no Info: virtual: data=/var/mail/virtual:INDEX=MEMORY:LAYOUT=maildir++ Info: maildir++: root=/var/mail/virtual, index=, control=, inbox= Info: Namespace : Using permissions from /data/mail/domain.com/koshikov.n/data: mode=0700 gid=-1 Info: trash plugin: Added 'Trash' with priority 1 Info: trash plugin: Added 'Spam' with priority 2 Info: koshikov.n(a)domain.com/Trash: seq=1 uid=2561: Expunge Info: koshikov.n(a)domain.com/Trash: timestamp 1256709279 (Wed Oct 28 07:54:39 2009) -> 1256795118 (Thu Oct 29 07:45:18 2009) Info: auth input: quota_rule=*:bytes=10485760000 Info: auth input: uid=8 Info: auth input: gid=12 Info: auth input: home=/data/mail/domain.com/sr Info: auth input: mail=maildir:~/data Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Info: maildir: data=~/data Info: maildir++: root=/data/mail/domain.com/sr/data, index=, control=, inbox=/data/mail/domain.com/sr/data Info: Namespace: type=private, prefix=Agromat/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no Info: virtual: data=/var/mail/virtual:INDEX=MEMORY:LAYOUT=maildir++ Info: maildir++: root=/var/mail/virtual, index=, control=, inbox= Info: Namespace : Using permissions from /data/mail/domain.com/sr/data: mode=0700 gid=-1 Info: trash plugin: Added 'Trash' with priority 1 Info: trash plugin: Added 'Spam' with priority 2 Info: sr(a)domain.com/Spam: seq=1 uid=405: Expunge Info: sr(a)domain.com/Spam: seq=2 uid=406: Expunge Info: sr(a)domain.com/Spam: seq=3 uid=407: Expunge Info: sr(a)domain.com/Spam: timestamp 1256710764 (Wed Oct 28 08:19:24 2009) -> 1256980000 (Sat Oct 31 11:06:40 2009) Info: kolotilo.m(a)domain.com/Trash: stop, expire time in future: Wed Oct 28 10:27:41 2009 And after expire-tool ends it's stuff, user sr(a)domain.com have(512M from dovecot-config): 524288000SS 836423205 8285 As you can see - quota reset to default value. In changes to version 1.2.6 I see - dovecot --exec-mail was broken. Is fixes to 1.2.6 touch userdb lookups from --exec-mail ? With 1.2.4 expire-tool works correct and I have no config changes to dovecot setup. If dovecot -n output is needed, please let me know. Thanks.

3 15

[Dovecot] Berlin talk - video or audio available?
by James Brown 25 Nov '09

25 Nov '09

Thanks Timo for putting up the .pdf and .ppt files for your talk at www.dovecot.org/talks . Is there a video or audio file of it? Thanks, James.

3 2

[Dovecot] new to dovecot
by Lars Nielsen 25 Nov '09

25 Nov '09

Hi there, I have installed debian with exim4 postgresql 8.3 and dovecot 1.0.15. I have the mail delivery part done, so when i send mail it gets delivered in ~/MailDir/ I have tried to authenticate via passwd and postgresql but with no luck. I have read a lot on google but i cannot get dovecot to give me the mails via pop3. Is there a tutorial somewhere i have missed? so far i have messed up my config like this : # 1.0.15: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/errors.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: pop3 pop3s login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_executable: /usr/lib/dovecot/pop3 mail_plugin_dir: /usr/lib/dovecot/modules/pop3 pop3_uidl_format: %08Xu%08Xv auth default: verbose: yes passdb: driver: pam userdb: driver: passwd regards Lars Nielsen

3 3

[Dovecot] mailbox count folders issues
by Nikita Koshikov 24 Nov '09

24 Nov '09

Hello list, I have one user, which have a lot of folders (not it is 414 without INBOX). When he tries to create one more folder with random name - the folder successfully created, but LIST command invokes out of memory to imap process. From the logs: Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Panic: data stack: Out of memory when allocating 268435472 bytes Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: *** glibc detected *** imap: double free or corruption (!prev): 0x0812ba00 *** Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: ======= Backtrace: ========= Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: /lib/libc.so.6[0xb7e8a714] Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: /lib/libc.so.6(cfree+0x9c)[0xb7e8bfcc] Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: imap(t_pop+0x7a)[0x80f0a1a] Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: imap(t_pop_check+0xf)[0x80f0b9f] Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: imap[0x80f199d] Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: imap[0x80f2285] Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: imap[0x80f1bd9] Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: imap[0x80f099d] Oct 26 15:26:38 IMAP(gozhda.a(a)domain.com): Error: Sending log messages too fast, throttling.. Oct 26 15:26:38 dovecot: Error: child 9497 (imap) killed with signal 6 (core dumps disabled) Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap[0x80f0e17] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap[0x80fccc8] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap[0x80efd3a] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap(buffer_write+0xd2)[0x80f0242] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap(buffer_append+0x26)[0x80f0366] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap(mail_transaction_log_append+0x5dc)[0x80d457c] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap[0x80c90d9] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap(mail_index_sync_commit+0xa5)[0x80cc625] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: /usr/lib/dovecot/imap/lib20_virtual_plugin.so[0xb7de7cee] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: /usr/lib/dovecot/imap/lib20_virtual_plugin.so(virtual_storage_sync_init+0x71c)[0xb7dea7cc] Oct 26 15:26:39 IMAP(gozhda.a(a)domain.com): Error: imap(mailbox_sync+0x35)[0x80b6335] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap(cmd_select_full+0x3d8)[0x8065088] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap(cmd_select+0x19)[0x80657e9] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap[0x8067a9c] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap[0x8067b35] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap(client_handle_input+0x2d)[0x8067ced] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap(client_input+0x5f)[0x80686af] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap(io_loop_handler_run+0xe0)[0x80fae60] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap(io_loop_run+0x20)[0x80fa2e0] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap(main+0x5ea)[0x807116a] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: /lib/libc.so.6(__libc_start_main+0xe5)[0xb7e35725] Oct 26 15:26:40 IMAP(gozhda.a(a)domain.com): Error: imap[0x80602b1] Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: ======= Memory map: ======== Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: 08048000-08129000 r-xp 00000000 08:02 385446 /usr/libexec/dovecot/imap Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: 08129000-0812a000 r--p 000e0000 08:02 385446 /usr/libexec/dovecot/imap Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: 0812a000-0812c000 rw-p 000e1000 08:02 385446 /usr/libexec/dovecot/imap Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: 0812c000-0bbbd000 rw-p 0812c000 00:00 0 [heap] Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: 92600000-92621000 rw-p 92600000 00:00 0 Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: 92621000-92700000 ---p 92621000 00:00 0 Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: b280d000-b2819000 r-xp 00000000 08:02 263779 /usr/lib/gcc/i686-pc-linux-gnu/4.3.4/libgcc_s.so.1 Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: b2819000-b281a000 r--p 0000b000 08:02 263779 /usr/lib/gcc/i686-pc-linux-gnu/4.3.4/libgcc_s.so.1 Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: b281a000-b281b000 rw-p 0000c000 08:02 263779 /usr/lib/gcc/i686-pc-linux-gnu/4.3.4/libgcc_s.so.1 Oct 26 15:26:41 IMAP(gozhda.a(a)domain.com): Error: b2822000-b7d88000 rw-p b2822000 00:00 0 Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7d88000-b7d90000 r--s 00000000 08:11 24109678 /data/mail/domain.com/gozhda.a/data/dovecot.index.cache Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7d90000-b7d95000 r--s 00000000 08:11 24109800 /data/mail/domain.com/gozhda.a/data/.Supplier.Furniture.Prima Ridhacitra.Inbox/dovecot.index.cache Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7d95000-b7d9a000 r--s 00000000 08:11 24117515 /data/mail/domain.com/gozhda.a/data/.Supplier.Furniture.Kappa Salotti.Outbox/dovecot.index.cache Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7d9a000-b7d9f000 r--s 00000000 08:11 24109096 /data/mail/domain.com/gozhda.a/data/.Supplier.Furniture.Keoma Salotti.Inbox/dovecot.index.cache Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7d9f000-b7da4000 r--s 00000000 08:11 24109729 /data/mail/domain.com/gozhda.a/data/.Supplier.Elements of illumination.Laber Agent.2 Outbox/dovecot.index.cache Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7da4000-b7da9000 r--s 00000000 08:11 24109097 /data/mail/domain.com/gozhda.a/data/.Supplier.Elements of illumination.Laber Agent.1 Inbox/dovecot.index.cache Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7da9000-b7dae000 r--s 00000000 08:11 24117749 /data/mail/domain.com/gozhda.a/data/.Structure of Agromat Company.Auto Logistics.1 Inbox/dovecot.index.cache Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7dae000-b7dbd000 r-xp 00000000 08:02 562992 /lib/libbz2.so.1.0.5 Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7dbd000-b7dbe000 r--p 0000e000 08:02 562992 /lib/libbz2.so.1.0.5 Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7dbe000-b7dbf000 rw-p 0000f000 08:02 562992 /lib/libbz2.so.1.0.5 Oct 26 15:26:42 IMAP(gozhda.a(a)domain.com): Error: b7dbf000-b7dd1000 r-xp 00000000 08:02 562990 /lib/libz.so.1.2.3 Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7dd1000-b7dd2000 r--p 00011000 08:02 562990 /lib/libz.so.1.2.3 Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7dd2000-b7dd3000 rw-p 00012000 08:02 562990 /lib/libz.so.1.2.3 Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7dd7000-b7dda000 r--s 00000000 08:11 24109083 /data/mail/domain.com/gozhda.a/data/dovecot.index.log Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7dda000-b7ddd000 r-xp 00000000 08:02 269577 /usr/lib/dovecot/lib20_zlib_plugin.so Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7ddd000-b7dde000 r--p 00002000 08:02 269577 /usr/lib/dovecot/lib20_zlib_plugin.so Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7dde000-b7ddf000 rw-p 00003000 08:02 269577 /usr/lib/dovecot/lib20_zlib_plugin.so Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7ddf000-b7dec000 r-xp 00000000 08:02 269941 /usr/lib/dovecot/lib20_virtual_plugin.so Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7dec000-b7ded000 r--p 0000c000 08:02 269941 /usr/lib/dovecot/lib20_virtual_plugin.so Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7ded000-b7dee000 rw-p 0000d000 08:02 269941 /usr/lib/dovecot/lib20_virtual_plugin.so Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7dee000-b7df1000 r-xp 00000000 08:02 272179 /usr/lib/dovecot/lib20_expire_plugin.so Oct 26 15:26:43 IMAP(gozhda.a(a)domain.com): Error: b7df1000-b7df2000 r--p 00002000 08:02 272179 /usr/lib/dovecot/lib20_expire_plugin.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7df2000-b7df3000 rw-p 00003000 08:02 272179 /usr/lib/dovecot/lib20_expire_plugin.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7df3000-b7df5000 r-xp 00000000 08:02 269836 /usr/lib/dovecot/lib11_trash_plugin.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7df5000-b7df6000 r--p 00001000 08:02 269836 /usr/lib/dovecot/lib11_trash_plugin.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7df6000-b7df7000 rw-p 00002000 08:02 269836 /usr/lib/dovecot/lib11_trash_plugin.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7df7000-b7e04000 r-xp 00000000 08:02 270039 /usr/lib/dovecot/lib10_quota_plugin.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7e04000-b7e05000 r--p 0000c000 08:02 270039 /usr/lib/dovecot/lib10_quota_plugin.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7e05000-b7e06000 rw-p 0000d000 08:02 270039 /usr/lib/dovecot/lib10_quota_plugin.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7e06000-b7e07000 rw-p b7e06000 00:00 0 Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7e07000-b7e1b000 r-xp 00000000 08:02 562206 /lib/libpthread-2.9.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7e1b000-b7e1c000 r--p 00013000 08:02 562206 /lib/libpthread-2.9.so Oct 26 15:26:44 IMAP(gozhda.a(a)domain.com): Error: b7e1c000-b7e1d000 rw-p 00014000 08:02 562206 /lib/libpthread-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7e1d000-b7e1f000 rw-p b7e1d000 00:00 0 Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7e1f000-b7f5c000 r-xp 00000000 08:02 563472 /lib/libc-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f5c000-b7f5e000 r--p 0013d000 08:02 563472 /lib/libc-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f5e000-b7f5f000 rw-p 0013f000 08:02 563472 /lib/libc-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f5f000-b7f62000 rw-p b7f5f000 00:00 0 Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f62000-b7f69000 r-xp 00000000 08:02 563080 /lib/librt-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f69000-b7f6a000 r--p 00006000 08:02 563080 /lib/librt-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f6a000-b7f6b000 rw-p 00007000 08:02 563080 /lib/librt-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f6b000-b7f6d000 r-xp 00000000 08:02 563473 /lib/libdl-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f6d000-b7f6e000 r--p 00001000 08:02 563473 /lib/libdl-2.9.so Oct 26 15:26:45 IMAP(gozhda.a(a)domain.com): Error: b7f6e000-b7f6f000 rw-p 00002000 08:02 563473 /lib/libdl-2.9.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f6f000-b7f70000 rw-p b7f6f000 00:00 0 Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f70000-b7f71000 r-xp 00000000 08:02 269571 /usr/lib/dovecot/lib20_autocreate_plugin.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f71000-b7f72000 r--p 00000000 08:02 269571 /usr/lib/dovecot/lib20_autocreate_plugin.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f72000-b7f73000 rw-p 00001000 08:02 269571 /usr/lib/dovecot/lib20_autocreate_plugin.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f73000-b7f75000 r-xp 00000000 08:02 270032 /usr/lib/dovecot/imap/lib11_imap_quota_plugin.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f75000-b7f76000 r--p 00001000 08:02 270032 /usr/lib/dovecot/imap/lib11_imap_quota_plugin.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f76000-b7f77000 rw-p 00002000 08:02 270032 /usr/lib/dovecot/imap/lib11_imap_quota_plugin.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f77000-b7f93000 r-xp 00000000 08:02 563474 /lib/ld-2.9.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f93000-b7f94000 r--p 0001c000 08:02 563474 /lib/ld-2.9.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: b7f94000-b7f95000 rw-p 0001d000 08:02 563474 /lib/ld-2.9.so Oct 26 15:26:46 IMAP(gozhda.a(a)domain.com): Error: bfb7f000-bfb94000 rw-p bffeb000 00:00 0 [stack] Oct 26 15:26:47 IMAP(gozhda.a(a)domain.com): Error: ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso] Oct 26 15:26:57 IMAP(gozhda.a(a)domain.com): Panic: data stack: Out of memory when allocating 268435472 bytes And so on... I have tried to grow mail_process_size from 256 to 512, but this didn't help. My question - is there some hardcoded limit for mail directories or it's a bug ? dovecot -n: # 1.2.6: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-gentoo-r4 i686 Gentoo Base System release 1.12.11.1 log_path: /var/log/dovecot/dovecot-error.log info_log_path: /var/log/dovecot/dovecot.log protocols: imaps managesieve ssl_cert_file: /etc/ssl/dovecot/imaps.crt ssl_key_file: /etc/ssl/dovecot/imaps.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_greeting: Server ready. login_processes_count: 20 login_max_processes_count: 512 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(managesieve): 10 first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_drop_priv_before_exec: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota trash expire zlib autocreate virtual mail_plugins(imap): quota imap_quota trash expire zlib autocreate virtual mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail imap_client_workarounds(imap): delay-newmail imap_client_workarounds(managesieve): namespace: type: private separator: / location: maildir:~/data inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: Company/ location: virtual:/var/mail/virtual:INDEX=MEMORY:LAYOUT=maildir++ list: yes lda: postmaster_address: postmaster(a)domain.com hostname: mail.domain.com mail_plugins: quota trash expire sieve virtual quota_full_tempfail: yes sendmail_path: /usr/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master log_path: /var/log/dovecot/dovecot-deliver.log info_log_path: /var/log/dovecot/dovecot-deliver.log global_script_path: /etc/dovecot/sieve/default.sieve sieve_global_dir: /etc/dovecot/sieve auth default: mechanisms: plain login default_realm: domain.com cache_size: 10240 cache_negative_ttl: 0 user: dovecot_auth master_user_separator: * worker_max_count: 50 passdb: driver: passwd-file args: /etc/dovecot/passdb/master.pwd master: yes passdb: driver: passwd-file args: /etc/dovecot/passdb/users.pwd passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-userdb-ldap.conf userdb: driver: passwd-file args: /etc/dovecot/passdb/users.pwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: mail group: dovecot_auth master: path: /var/run/dovecot/auth-master mode: 384 user: mail group: mail plugin: quota_warning: storage=90%% /etc/dovecot/plugins/quota_warning.sh 90 quota: maildir:Mailbox quota quota_rule: *:storage=500M quota_rule2: Trash:storage=10%% trash: /etc/dovecot/plugins/dovecot-trash.conf expire: Trash 30 Spam 30 expire_dict: proxy::expire autocreate: Drafts autocreate2: Sent autocreate3: Spam autocreate4: Trash autosubscribe: Drafts autosubscribe2: Sent autosubscribe3: Spam autosubscribe4: Trash sieve: ~/.dovecot.sieve sieve_dir: ~/sieve sieve_extensions: +notify sieve_before: /etc/dovecot/sieve/default.sieve dict: expire: sqlite:/etc/dovecot/plugins/expire.conf

3 20

[Dovecot] Newbee, some questions
by Spyros Tsiolis 24 Nov '09

24 Nov '09

Hello list, OK, I just registered with the list, so please be tolerant :-) I've been using another MTA for about, oh, I'd say nine years now. Due to reasons beyond me (mainly my clients demanding more for their buck / things like webmail etc.), I was forced to start searching for (always) open source alternatives. The last MTA was only POP3/SMTP. It does no webmail. It interfaces with other software with a lot of pain and difficulty. I'll cut to the chase. I would like to start using some kind of software that can do the following : 1. Do multiple domain handling. 2. Have a centralized user base 3. Have a centralized mail repository for each user (like exchange, only without the admin/maintenance pain that comes with it) 4. be able to do IMAP/POP3 and not SMTP/POP3 (or do I need all three of them ?) 5. Interface with things like web-based mail software (LAMP ?) Am I in the right place ? I would certainly like to think so. However, the feedback belongs to you . Thank you kindly for your hospitality and patience, S. Tsiolis

6 6

[Dovecot] shared mailboxes using namespaces in 1.2
by Alexander 'Leo' Bergolth 24 Nov '09

24 Nov '09

Hi! I've been using shared mailbox trees using maildir, unix permissions and separate namespaces per shared tree since dovecot 1.0. However now that I've upgraded to 1.2.8, I cannot create subfolders anymore. The server responds with "NO Invalid mailbox name: test/testsub". The hierarchy separator for the namespaces is / because I am mixing maildir and mbox namespaces and list=yes. The details: I am using a post-login script (attached) that detects all subfolders of /var/spool/mail/Shared for which the current user has at least read access. For every subfolder, it creates a separate namespace with the prefix Shared/<mailboxname>. The shared mailbox trees are in maildir format. If one of those namespace-prefixes is e.g. "Shared/sharedmailbox/", I am able to create "Shared/sharedmailbox/test" but trying to create "Shared/sharedmailbox/test/testsub" will fail with the above error. If I set the herarchy separator to '.' even creating "Shared/sharedmailbox/test" will fail. Any hints? Thanks, --leo -- e-mail ::: Leo.Bergolth (at) wu.ac.at fax ::: +43-1-31336-906050 location ::: IT-Services | Vienna University of Economics | Austria # 1.2.8: /etc/dovecot.conf # OS: Linux 2.6.27.12-170.2.5.fc10.i686.PAE i686 Fedora release 10 (Cambridge) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 100 mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_drop_priv_before_exec(default): yes mail_drop_priv_before_exec(imap): yes mail_drop_priv_before_exec(pop3): no mail_executable(default): /usr/local/sbin/dovecot-post-login.pl /usr/libexec/dovecot/imap mail_executable(imap): /usr/local/sbin/dovecot-post-login.pl /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 namespace: type: private separator: / location: mbox:~/mail:INBOX=/var/mail/%u inbox: yes list: yes subscriptions: yes lda: postmaster_address: postmaster(a)strike.wu-wien.ac.at auth default: mechanisms: plain gssapi passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix

2 10

[Dovecot] Slow IMAP Auth
by Jeff Duncan 24 Nov '09

24 Nov '09

Hello, I am experiencing IMAP authentication delays when a client first authenticates, or after the last auth timeout. There are only a handful of clients - less than 5 - using the server. I am using a mysql database and I have verified the PAM auth is commented out. Other than that I can't figure out what might be causing the slow authentication. The first time a client authenticates with SSL/CRAMD5 it takes almost 20 seconds. Does anyone have any suggestions? My config and version is below: mail:~# dovecot --version 1.1.11 mail:/usr/share/gallery2# dovecot -n # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.3 ext3 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 first_valid_uid: 6060 mail_privileged_group: mail mail_location: maildir:/var/vmail/%d/%n mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): autocreate quota imap_quota mail_plugins(imap): autocreate quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf passdb: driver: sql

2 2

[Dovecot] Error: read(/var/run/dovecot/dict-server) failed: Remote disconnected
by Lauryca Puyulik 24 Nov '09

24 Nov '09

Hello all, I have a problem with my mail configuration and I don`t know how to resolve this error (listed bellow): deliver(mymail(a)testtest.ro): Nov 11 09:07:54 Error: Internal quota calculation error dovecot: Nov 11 09:07:54 Error: dict: /etc/dovecot/dovecot-dict-quota.conf: 'username_field' missing dovecot: Nov 11 09:07:54 Error: dict: Failed to initialize dictionary 'quota1' deliver(mymail(a)testtest.ro): Nov 11 09:07:54 Error: read(/var/run/dovecot/dict-server) failed: Remote disconnected deliver(mymail(a)testtest.ro): Nov 11 09:07:54 Error: Internal quota calculation error dovecot: Nov 11 09:07:56 Error: dict: /etc/dovecot/dovecot-dict-quota.conf: 'username_field' missing dovecot: Nov 11 09:07:56 Error: dict: Failed to initialize dictionary 'quota1' My dovecot configuration is: dovecot -n # 1.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.27.7-9-pae i686 openSUSE 11.1 (i586) ext3 log_path: /var/log/dovecot.err info_log_path: /var/log/dovecot.info ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login first_valid_uid: 5000 last_valid_uid: 5000 mail_location: maildir:/home/vmail/%d/%n mail_debug: yes mail_plugins: quota imap_quota auth default: mechanisms: plain login user: vmail verbose: yes passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: prefetch socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail plugin: quota: dict:::proxy::quota1 quota_rule: *:storage=50M:messages=10000 acl: vfile:/etc/dovecot/acls quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80 dict: quota1: mysql:/etc/dovecot/dovecot-dict-quota.conf Another question that raise from these logs is what are the permissions for all files from /var/run/dovecot? In the master.cf file I have somthing like this: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -d ${recipient} Regarding this log : "dovecot: Nov 11 09:07:54 Error: dict: /etc/dovecot/dovecot-dict-quota.conf: 'username_field' missing", my dovecot-dict-quota.conf is correctly and that field exists. So...any idea? Thanks!

2 1

[Dovecot] Migrating existing local Maildir structure to dovecot server Maildir
by Halim Issa 23 Nov '09

23 Nov '09

Hello, I'm about to migrate a number of existing users who have been using POP3 with emails stored locally in KMail's Maildir format into an IMAP solution based on Dovecot. Will it be possible to simply move all the KDE Maildir folders from the local PCs to the Maildir folder on the IMAP server running Dovecot and then have the emails accessible on the server, or will this most likely mess up the Dovecot index files? If this causes index file trouble, is there any way to force a re-indexing of all these files, or is there another recommended way of migrating up to 7 years of email communication from local hosts to the IMAP server, for later putting them in folders? Thanks in advance! (PS. I noticed a few of the howto's on how to migrate to dovecot, but they only focus on moving from mbox to dovecot or similar, and not migrating existing Maildir emails to a new dovecot server... Any such pointers would be greatly appreciated :-)) -y1

4 10

[Dovecot] dovecot ignoring folder permissions on directory creation
by Peter 23 Nov '09

23 Nov '09

Ubuntu 8.04lts Dovecot 1.2.6 So, further to the 'deliver' problem posted yesterday I've also discovered another issue regarding permissions: files and directories are being created 0600/0700 by the IMAP and deliver process (depending on who gets there first!) preventing use of shared mailboxes. According to documentation: "When creating a new mailbox, Dovecot v1.2+ copies the permissions from the mailbox root directory." and "When creating new files inside a mailbox, Dovecot v1.2+ copies the read/write permissions from the mailbox's directory." (http://wiki.dovecot.org/SharedMailboxes/Permissions) So, with an empty directory of: drwxr-xr-x 3 root root 21 2009-11-16 13:36 /home drwxrwx--x 3 nobody maildir 21 2009-11-16 13:36 /home/mail I would expect a user logging in to have their mail directory created automatically with the same permissions (but not necessarily the same group). What I see post-login is: drwxrwx--x 3 nobody maildir 21 2009-11-16 13:42 /home/mail drwx------ 3 auser adomain 18 2009-11-16 13:42 /home/mail/adomain drwx------ 3 auser adomain 20 2009-11-16 13:42 /home/mail/adomain/auser drwx------ 5 auser adomain 4096 2009-11-16 13:42 /home/mail/adomain/auser/Maildir drwx------ 2 auser adomain 6 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/cur -rw------- 1 auser adomain 0 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot-acl-list -rw------- 1 auser adomain 156 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot.index.log -rw------- 1 auser adomain 17 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot-uidlist -rw------- 1 auser adomain 8 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot-uidvalidity -rw------- 1 auser adomain 0 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot-uidvalidity.4b0156e2 drwx------ 2 auser adomain 6 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/new drwx------ 2 auser adomain 6 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/tmp I've tried pre-creation of /home/mail/adomain, /home/mail/adomain/auser and /home/mail/adomain/auser/Maildir in each case with permissions 0770 but in each case subsequent subdirectories and files are 0700/0600. I've also tried use of a "dovecot-shared" file, but this also has no effect under any permutation I can create. Anyone else seen this?

2 1