- dovecot - dovecot.org

[Dovecot] Users with large (4GB) inboxes crippling dovecot
by robforrest 30 Jun '09

30 Jun '09

Hi all, I'm new here and would very much appreciate any help you can give me. We are running a rather outdated mail server that until recently has been running beautifully. Under the pretense of "it is ain't broke, don't fix it" it hasn't been updated so is running Fedora Core 4 and dovecot v0.99.14. What is happening is that as users log in (via thunderbird), they are shown the contents of their mailboxes. However, when they try and access a given email, they get no response even if they wait upwards of 10 minutes. I believe that the problem has arisen from their huge inboxes, several users have inboxes in excess of 4GB. Do any of you know how I could split these large mbox files down in to manageable chunks of 1GB? Please be aware that I only have remote access to the server over a modest internet connection. Thanks again for any suggestions. Rob -- View this message in context: http://www.nabble.com/Users-with-large-%284GB%29-inboxes-crippling-dovecot-… Sent from the Dovecot mailing list archive at Nabble.com.

16 28

[Dovecot] Recommended Groupware?
by it-dovecot＠ml.epigenomics.com 29 Jun '09

29 Jun '09

Hi, is there a recommended groupware (email + calendar + address book + syncing with mobile devices) on top of an existing dovecot installation? Most existing commercially supported groupwares come with their own mail storage engine. I would like to keep dovecot as the email storage engine because of the maildir format which greatly helps with backup & restore. Regards -- Robert Sander

3 2

[Dovecot] Dovecot Expire doesn't work
by Stef Simoens 29 Jun '09

29 Jun '09

Hello, I'm using dovecot and I want to use the "expire" plugin. However, it doesn't work, i.e. mails do not get deleted. I ran `/usr/sbin/dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool --test` and besides printing Info: stef/Trash: no messages left Info: stef/Spam: no messages left it doesn't do anything (especially not deleting e-mails). Obviously, in stef/Trash and stef/Spam, there are e-mails waiting to be deleted. I'm using dbox as mail storage; and use dbox:/var/mail/%u as mail_location in dovecot.conf. Furthermore, I'm running 1.1.16 on a gentoo PPC system. This is the output from `dovecot -n` # 1.1.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.29-gentoo-r2 ppc Gentoo Base System release 1.12.11.1 xfs listen: *, [::] ssl_cert_file: /etc/ssl/dovecot/server.pem ssl_key_file: /etc/ssl/dovecot/server.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login verbose_proctitle: yes mail_privileged_group: mail mail_location: dbox:/var/mail/%u mail_plugins: expire auth default: verbose: yes debug: yes passdb: driver: pam args: * userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs:Disk Quota expire: Trash 7 Spam 30 expire_dict: proxy::expire dict: expire: db:/var/lib/dovecot/expire.db A strace on `/usr/sbin/dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool --test` shows the following output: mkdir("/var/mail/root", 0770) = -1 EEXIST (File exists) stat64("/var/mail/root/Trash/dbox-Mails", 0xbfda2708) = -1 ENOENT (No such file or directory) write(2, "Info: stef/Trash: no messages lef"..., 35Info: stef/Trash: no messages left ) = 35 which explains why nothing happens (stat64("/var/mail/root/Trash/dbox-Mails", which is empty, it should not even exist, but it passes by a mkdir), but why does it want to check /var/mail/root and not /var/mail/%u (i.e. why no stat64(/var/mail/stef/Trash/dbox-Mails))? Thanks for your help and kind regards, -- Stef Simoens

4 14

[Dovecot] LDAP Plugin fails to build in 1.2.rc7
by Paul Howarth 29 Jun '09

29 Jun '09

Hi, The LDAP Plugin fails to build (it doesn't attempt to build it) in 1.2.rc7 because $have_ldap_plugin is checked before it's assigned in configure.in. Patch attached. This was not a problem in 1.2.rc6 and earlier versions. Cheers, Paul.

2 1

[Dovecot] v1.2.rc7 released
by Timo Sirainen 29 Jun '09

29 Jun '09

http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc7.tar.gz http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc7.tar.gz.sig I'll make RC releases daily now until v1.2.0 is released, which will be either on Monday or Wednesday. Please test as much as possible. * Removed configure --with-deliver, --with-pop3d and --disable-ipv6 parameters. + Improved permission related error messages. - mbox: Don't write garbage to mbox if message doesn't have a body. - virtual: Fixed saving messages with keywords. - virtual: Fixed infinite looping bug. - zlib: Fixed error handling.

3 3

[Dovecot] Dovecot v1.2rc6 deliver to shared folder fails
by Steffen Kaiser 29 Jun '09

29 Jun '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, out of curiosity I tested to deliver into a shared folder of another owner using Sieve. (Not that I intend to do so, but well ... ) Conf is attached. == Script require ["fileinto"]; fileinto "shared.testusr.test1.test2.test3"; == Dovecot logs: Jun 22 15:36:22 ux-2s11standby dovecot: deliver(user): acl vfile: file /home/testusr/test1/test2/test3/Maildir/dovecot-acl not found Jun 22 15:36:22 ux-2s11standby dovecot: deliver(user): Namespace shared.testusr/test1/test2/test3.: Permission lookup failed from /home/testusr/test1/test2/test3/Maildir Jun 22 15:36:22 ux-2s11standby dovecot: deliver(user): Namespace shared.testusr/test1/test2/test3.: Using permissions from /home/testusr/test1/test2/test3/Maildir: mode=0700 gid=-1 Jun 22 15:36:22 ux-2s11standby dovecot: deliver(user): dovecot-acl-list creation failed: safe_mkstemp(/home/testusr/test1/test2/test3/Maildir/temp.ux-2s11standby.25681.e8eb63ed74ac1dd2) failed: No such file or directory Jun 22 15:36:22 ux-2s11standby dovecot: deliver(user): sieve: msgid=<200906221336.n5MDaMGr025671(a)ux-2s11standby.inf.fh-bonn-rhein-sieg.de>: failed to store into mailbox 'testusr/test1/test2/test3': BUG: Unknown internal error Jun 22 15:36:22 ux-2s11standby dovecot: deliver(user): sieve: execution of script /home/user/.dovecot.sieve failed, but implicit keep was successful == LIST excerpt of user: * LIST (\Noselect \HasChildren) "." "shared.testusr" * LIST (\HasNoChildren) "." "shared.testusr.test1.test2.test3" * LIST (\HasNoChildren) "." "shared.testusr.INBOX" ACL of testusr: 4 getacl test1.test2.test3 * ACL "test1.test2.test3" "user" kxeilprwtscd "testusr" lrwstipekxacd Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBSj+MBHWSIuGy1ktrAQJBeggApjdThbPJwgTfDyxhSfirUfT56HmxMqFi zsLuHZvNqdY+lQ/cQh9q9gal3UwAbtdcG7f6UgT5p6FZfx87l08DOoLw8j0C3CPC EG3Dk5aAsljLwlbcI5g06hSv8qwydI9ij16nybxEcVMUwtYXALzLtpHSOh/bYr/y +GrvyGTi3wfRom4+guoXa3t6+Wjk8MBvz4aF+JdK691sivQGvhPEUwQsG3e2emSa iOyBguCTtzvYMy18j9PitqspunPPrXaypi+6HzjgYz02T0qo7TZWRyxkCwc6/S2H NEkXLgkjg1ao6uGa9svJvQkK5fl2mfjZXidjL1hGZBLeVWCcnCWVLg== =08gf -----END PGP SIGNATURE-----

2 2

[Dovecot] automated email setup and white/blacklists
by Mediawire - Alistair Campion 29 Jun '09

29 Jun '09

We are running a Red Hat Enterprise Linux environment with Dovecot IIMAP, Exim and mySQL 5.0.81, Apache 2.2.11 We are looking for several server side scripts: 1. Create a user account automatically at the completion of our registration process. i.e. username(a)ourdomain.com and existing MD5 password that is associated with his/her user account 2. Add a new user to an existing subscriber email whitelist (add buddy function) 3. Add an existing user to an existing subscriber email blacklist (block buddy function) Our preference is to receive access to a publicly available scripts. Alternatively, to come to a commercial arrangement with a party who has written or who is prepared to write the same. Regards Alistair Campion mediawirelogo_sm3 Voice : +61 411-148-400 Email: <mailto:alistair@txtbuddies.com> alistair(a)mediawire.tv Web: <http://www.buddirewards.com> www.buddirewards.com Web: <http://www.txtbuddies.com/> www.txtbuddies.com Web: <http://www.myofficebuddies.com> www.myofficebuddies.com

2 1

[Dovecot] sievec error: "fileinto require missing"
by Braden McDaniel 29 Jun '09

29 Jun '09

I'm getting this error when compiling .dovecot.sieve: $ /usr/libexec/dovecot/sievec .dovecot.sieve .dovecot.sievec Info: line 3: fileinto require missing Unable to parse script: script errors: line 3: fileinto require missing .dovecot.sieve just looks like this: $ cat .dovecot.sieve if header :contains ["List-Id"] ["dovecot.dovecot.org"] { fileinto "INBOX.dovecot"; stop; } I'm probably doing something silly; but I don't see how what I've done differs significantly from examples I've found. And googling for "fileinto require missing" just got me to the sievec source code. What might be the problem here? -- Braden McDaniel <braden(a)endoframe.com>

2 2

[Dovecot] 1.2rc5 Panic: file virtual-sync.c
by e-frog 28 Jun '09

28 Jun '09

mail.log: Jun 6 14:40:19 server dovecot: IMAP(user): Panic: file virtual-sync.c: line 502 (virtual_sync_mailbox_box_remove): assertion failed: (rec_count >= uid_count) Jun 6 14:40:19 server dovecot: IMAP(user): Raw backtrace: imap [0x80f0d21] -> imap [0x80f0da2] -> imap [0x80f06d9] -> /usr/lib/dovecot/modules/imap/lib20_virtual_plugin.so [0xb7ec36b4] -> /usr/lib/dovecot/modules/imap/lib20_virtual_plugin.so [0xb7ec4c7b] -> /usr/lib/dovecot/modules/imap/lib20_virtual_plugin.so(virtual_storage_sync_init+0x634) [0xb7ec5dc4] -> imap(imap_sync_init+0x54) [0x806fff4] -> imap(cmd_sync_delayed+0x24b) [0x807031b] -> imap(client_handle_input+0x1bc) [0x80679ac] -> imap(client_input+0x5f) [0x806817f] -> imap(io_loop_handler_run+0xe0) [0x80f99d0] -> imap(io_loop_run+0x20) [0x80f8e50] -> imap(main+0x5f5) [0x8070b85] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5) [0xb7ef8775] -> imap [0x805ff91] Jun 6 14:40:19 server dovecot: dovecot: child 13847 (imap) killed with signal 6 (core dumped) backtrace: GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... warning: Can't read pathname for load map: Input/output error. Reading symbols from /lib/tls/i686/cmov/libdl.so.2...Reading symbols from /usr/lib/debug/lib/tls/i686/cmov/libdl-2.9.so...done. done. Loaded symbols for /lib/tls/i686/cmov/libdl.so.2 Reading symbols from /lib/tls/i686/cmov/libc.so.6...Reading symbols from /usr/lib/debug/lib/tls/i686/cmov/libc-2.9.so...done. done. Loaded symbols for /lib/tls/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...Reading symbols from /usr/lib/debug/lib/ld-2.9.so...done. done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so Reading symbols from /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/lib/dovecot/modules/imap/lib20_expire_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib20_expire_plugin.so Reading symbols from /usr/lib/dovecot/modules/imap/lib20_fts_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib20_fts_plugin.so Reading symbols from /usr/lib/dovecot/modules/imap/lib20_virtual_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib20_virtual_plugin.so Reading symbols from /usr/lib/dovecot/modules/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib21_fts_squat_plugin.so Reading symbols from /lib/libgcc_s.so.1...done. Loaded symbols for /lib/libgcc_s.so.1 Core was generated by `imap [user 192.168.178.41]'. Program terminated with signal 6, Aborted. [New process 13847] #0 0xb8053424 in __kernel_vsyscall () (gdb) bt full #0 0xb8053424 in __kernel_vsyscall () No symbol table info available. #1 0xb7f0d6d0 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 resultvar = <value optimized out> pid = -1207693324 selftid = 13847 #2 0xb7f0f098 in *__GI_abort () at abort.c:88 act = {__sigaction_handler = {sa_handler = 0x935ee68, sa_sigaction = 0x935ee68}, sa_mask = {__val = {3215393416, 135195514, 3087272224, 0, 3215393536, 3215393524, 512, 0, 0, 3215393600, 3087472240, 134566395, 692, 0, 0, 0, 1, 135267902, 512, 1, 3215393524, 154529352, 69, 3215393652, 3215393496, 135197110, 154530076, 3215393524, 3215393528, 693, 154529384, 3086704259}}, sa_flags = 693, sa_restorer = 0x81062e9 <write_full+57>} sigs = {__val = {32, 0 <repeats 31 times>}} #3 0x080f0d35 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:160 backtrace = 0x935ea38 "imap [0x80f0d21] -> imap [0x80f0da2] -> imap [0x80f06d9] -> /usr/lib/dovecot/modules/imap/lib20_virtual_plugin.so [0xb7ec36b4] -> /usr/lib/dovecot/modules/imap/lib20_virtual_plugin.so [0xb7ec4c7b] -> "... #4 0x080f0da2 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0xb7ec6ab8 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfa703d4 "ap¦¦\001") at failures.c:440 No locals. #5 0x080f06d9 in i_panic (format=0xb7ec6ab8 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:207 No locals. #6 0xb7ec36b4 in virtual_sync_mailbox_box_remove (ctx=0x9632340, bbox=0x9374248, removed_uids=0x937427c) at virtual-sync.c:516 i = 3215393848 src = 0 dest = 135275874 uid = 154526136 vseq = 28 __PRETTY_FUNCTION__ = "virtual_sync_mailbox_box_remove" #7 0xb7ec4c7b in virtual_sync_backend_boxes (ctx=0x9632340) at virtual-sync.c:850 _data_stack_cur_id = 3 i = 10 ret = 0 #8 0xb7ec5dc4 in virtual_storage_sync_init (box=0x9373ba8, flags=MAILBOX_SYNC_FLAG_EXPUNGE) at virtual-sync.c:1445 sync_ctx = <value optimized out> ret = <value optimized out> #9 0x0806fff4 in imap_sync_init (client=0x936b188, box=0x9373ba8, imap_flags=IMAP_SYNC_FLAG_SAFE, flags=MAILBOX_SYNC_FLAG_EXPUNGE) at imap-sync.c:146 ctx = (struct imap_sync_context *) 0x958ff78 __PRETTY_FUNCTION__ = "imap_sync_init" #10 0x0807031b in cmd_sync_delayed (client=0x936b188) at imap-sync.c:579 cmd = <value optimized out> first_expunge = <value optimized out> first_nonexpunge = <value optimized out> __PRETTY_FUNCTION__ = "cmd_sync_delayed" #11 0x080679ac in client_handle_input (client=0x936b188) at client.c:724 ret = false remove_io = false handled_commands = true __PRETTY_FUNCTION__ = "client_handle_input" #12 0x0806817f in client_input (client=0x936b188) at client.c:748 ---Type <return> to continue, or q <return> to quit--- cmd = <value optimized out> output = (struct ostream *) 0x936b33c bytes = <value optimized out> __PRETTY_FUNCTION__ = "client_input" #13 0x080f99d0 in io_loop_handler_run (ioloop=0x93669b0) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x9366ab8 event = (const struct epoll_event *) 0x9366af8 list = (struct io_list *) 0x936b3c0 io = (struct io_file *) 0x936b398 tv = {tv_sec = 4, tv_usec = 187729} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #14 0x080f8e50 in io_loop_run (ioloop=0x93669b0) at ioloop.c:338 No locals. #15 0x08070b85 in main (argc=Cannot access memory at address 0x3617 ) at main.c:323 No locals.

2 6

Re: [Dovecot] Lots of pop3-logins
by V S Rao 28 Jun '09

28 Jun '09

> > > Doing a "ps aux" on my Slackware box, I have approx 100 PID's of "pop3-login's going on. This is a production mail server, but it is getting VERY low traffic. In fact, only 3 people can "pop3" into it. I've check their e-mail clients, and they are not checking mail any more often than every 5 minutes. > > > > > > This is a new installation and I've had the server up and running since Sunday. If it matters, I'm using Postfix for the MTA and using the Dovecot SASL library to AUTH SMTP. > > > > > > Is this a cause for concern? Why does Dovecot need this many processes? > > > > > > > >> Because dovecot preforks the *-login processes to speed-up the login. > > > > >> No need to worry. > > > > 100 login sessions for just 3 connections? That is not right, no matter what. > > >> No, login_processes_count matters. > > How? If my understanding is correct, you have extra 3 login processes created to cater to new connections. So with only 3 POP3 users, why should so many login processes be spawned? I can understand 10-15. But 100 definitely indicates either the processes are not dying or something else happening on the system which is causing such high number of login processes. The system definitely needs to be checked for some kind of attack, a rogue process running on the system or something else. > >> My idle box has 64 imap-login processes and no, I'm not under a >> dictionary attack :) I am not sure what your load is (user base, system config etc), but I will give you my typical load here. I run mail server for about 6000 users with a mix of 70% POP3 and 30% IMAP (thro webmail). And here are the typical stats (I run a script in the background collecting this data every 5 secs): pop3-logins:12 pop3-connections:8 IMAP-logins:7 IMAP-connections:11 I have read other opinions in this thread by Timo & others. And I am interested in a few things. So if you will indulge me, maybe it will be useful for others who face these kind of issues Timo Wrote: You can also just decrease login_process_max_count Wouldn't decreasing the login_process_max_count simply create more problems. Now users will start experiencing timeouts sooner than before, because whatever is causing the login processes to increase (attack, rogue process or whatever) will *always* be trying to login and genuine users will be denied login. So without knowing the root cause of the issue simply decreasing or increasing the login_process_max_count will lead to other problems. Correct me if I am wrong. Rodman Wrote: I'll go ahead and lower that limit to something that fits my usage better. No, I think leave that value to default and try and identify the root cause and prevent it. Noel Wrote: What would be nice is, an anti brute force option Yes, that would be nice. But consider a situation where the system is not under brute force attack, but for some reason the number of login processes keep on increasing by the hour. This would ultimately lead the system to deny connections to the users. Is there a way to track what is happening? strace would be too complicated for us field guys to work with. Any suggestions? Regards --Rao

4 4