- dovecot - dovecot.org

[Dovecot] New Dovecot server buildout review
by David Jonas 13 Nov '08

13 Nov '08

Hello Everyone, I have the opportunity to do a new mail system build out for about 20k email boxes over a few hundred domains. I already run a system like this, but this time I can do it right :). My thought on storage is to have a 12 drive JBOD system attached via SAS to a 3ware 9690SA raid controller. Drives would be RAID'd (10 or 5) to appear as one for message storage. Dovecot would run on that box and deliver directly from postfix. POP and IMAP connections would come in directly (no proxy). Postfix head boxes in front of this do anti-virus and spamassassin, so this box won't be doing any heavy crunching, just delivery and serving of messages. Does this sound reasonable? Is there details that I'm missing? An obvious bottleneck I'm overlooking? Is anyone running a similar config with success? It all sounds very standard, but I haven't run something like this before. Thanks for the help! David

1 0

[Dovecot] Moving mail between folders
by Ilo Lorusso 13 Nov '08

13 Nov '08

Hi, Ive just installed Dovecot and postfix and Ive created a whole bunch of folders and started moving my mail around. Ive noticed that it copies the mail to the folder I wish to move the mail to and leave the original message waiting to be purged in the original folder Is there a way to have dovecot delete it straight after it has been moved? as I don't think users are going to take well to this change? any help would be appreciated Thanks, Ilo.

3 2

[Dovecot] dovecot pop3 performance, what size installation
by Brandon Lamb 13 Nov '08

13 Nov '08

Hello, I was wondering if anyone could tell me their results and maybe help me get an idea how big our mail system installation and usage is. For dovecot pop3 and nfs backend, I am curious how many machines I should expect to need. Here are my stats for what I can tell. 5-7 connections per second average, 8-12 connections per second peak. 30-50 constant connections between 3 servers (8-20+) on each server. We are servicing about 14,000+ email accounts. These are just the pop3 login stats, a lot of users use both or imap through our webmail. My question I guess is whether this is on the small side, medium or larger side mail setup, and should I be thinking that only 1 or 2 servers should be able to handle the load. Right now I am splitting it between 3. Should a single quad core box be able to handle this? Not sure if this is a simple question or not. Im not including my dovecot -n just because this is more of a generic question.

1 0

[Dovecot] removing uid, index and cache files
by Lars Uhlmann 13 Nov '08

13 Nov '08

Since a couple of days we're facing a problem with dovecot/MUA and multiple appeareances of single mails. The mail is physical existant only once but outlook shows it twice or more times. Then after some minutes these multiple "virtual" mails just disappear. Because this happens with different MUAs (Outlook and Thunderbid) I assume dovecot causes the problem. All mail are received by »getmail« from outside via POP3 and delivered to the users local Maildir. This was working without problems for over a year now. Is it save to remove to following files (will dovecot rebuild them) from every users Maildir? dovecot.index dovecot.index.cache dovecot.index.log dovecot.index.log.2 dovecot-uidlist Thahks in advance, Lars

3 4

[Dovecot] Sieve authentication / directory issue after upgrade to 1.0.13.
by Drew Calcott 12 Nov '08

12 Nov '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi everyone, I have come across a problem after upgrading from 1.0.rc17 to 1.0.13 (debian builds 1.0.13 is from etch-backports). I initially upgraded as 1.0.rc17 isn't compiled with regex support, so vacation messages that were uploaded via horde were being rejected. (Everything else was working fine, just messages that required regex functions were failing). Horde is uploading the filters via pysieved, which is then in turn placing them in the directory of: - --------- /shared/spool/active/%d/%0.1u/%1.1u/%n/sieve/ingo - --------- At least, it was previously. Since upgrading, dovecot has changed the way it passes authentication details to pysieved and the domain is no longer included in the username, so the domain cannot be parsed and pysieved fails as it is unable to strip a value for %d. (as a quick aside, this isn't an issue with single domain servers as there is a "defaultdomain" option that will force the value for %d, however, since we have 9 domains to deal with, this isn't going to cut it). Prior to upgrade, authentication was passed as thus (= are a new line in case the formatting dies) - -------- ======= > 'AUTH\t1\tPLAIN\tservice=pysieved\tresp=YWNhbD* restofstring * ====== < OK\t1\tuser=acal030(a)sit.auckland.ac.nz\tuser=acal030\t\n' ===== Finished SASL authentication : {'username':'acal030(a)sit.auckland.ac.nz', 'result': 'OK'} ===== Plugin returned home :'/shared/spool/active/sit.auckland.ac.nz/a/c/acal030/' = Authenticated user acal030(a)sit.auckland.ac.nz - -------- Both user and user@domain were being passed and it was a matter of simple nagging of the pysieved guys to update their code to strip the required information. However, the new version is passing auth like this: - -------- ======= > 'AUTH\t1\tPLAIN\tservice=pysieved\tresp=YWNhbD* restofstring * ======= < 'OK\t1\tuser=acal030\n' ===== Finished SASL authentication : {'username': 'acal030', 'result': 'OK'} ===== Plugin returned home : '/shared/spool/active//a/c/acal030/' - ------- The only change to the dovecot config I have made is to add "allow_all_users=yes" to userdb static as the new version was a lot stricter about the passdb pam lookup not containing the user data (and failing completely as a result). In the dovecot logs themselves, the following lines were from the earlier build: - ------ Info: auth(default): client out: OK 1 user=acal030(a)sit.auckland.ac.nz user=acal030 Info: auth(default): master in: REQUEST 243 23994 1 Info: auth(default): master out: USER 243 acal030(a)sit.auckland.ac.nz home=/blah, mail=/blah etc. - ------ Compared to this from the new one: - ------ Info: auth(default): auth(acal030(a)sit.auckland.ac.nz,130.216.39.182): username changed acal030(a)sit.auckland.ac.nz -> acal030 Info: auth(default): client out: OK 1 user=acal030 Info: auth(default): prefetch(acal030,130.216.39.182): success Info: auth(default): master out: USER 2 acal030 home=/blah, mail=/blah etc. - ------ I am rather at the end of my tether with this, unfortunately. :( I have browsed through many wiki pages looking for a possible solution or config variable I may have missed, but I really am coming up dry. Cleaned up dovecot.conf is at: http://pastebin.com/m7f4303af Should anyone want strace logs or whatever, I'm more than happy to make with them. Thanks in advance for any assistance. Regards, - --- Drew Calcott Science IT University of Auckland (p) +64 9 373 7599 x84269 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkkaWWQACgkQD+yXTWfduLFGmACfW3XXNFLu8zhHUz8FeU+QqgmX pg4An3SdPh0OyWHGBe9k/qWzjqFRJmBl =fIMA -----END PGP SIGNATURE-----

1 1

[Dovecot] dovecot 1.2 link error
by Axel Schmalowsky 12 Nov '08

12 Nov '08

Hello list, I need/want to build imaptest -- and I can only build it against at least dovecot 1.2 . dovecot 1.2 actually builds just fine but at the end I get the following linker error: /bin/sh ../../libtool --tag=CC --mode=link gcc -std=gnu99 -O2 -pipe -std=gnu99 -Wall -ftree-dce -ftree-dse -ftree-loop-optimize -ftree-loop-linear -I/usr/lib/gcc/i386-redhat-linux/4.1.1/include -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -Wl,-z -Wl,compreloc -Wl,-z -Wl,norelro -o imap -export-dynamic cmd-append.o cmd-capability.o cmd-cancelupdate.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-enable.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-id.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o cmd-x-cancel.o client.o commands.o commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-search.o imap-sort.o imap-status.o imap-sync.o mail-storage-callbacks.o main.o ../../src/lib-storage/register/libstorage-register.a ../../src/lib-storage/list/libstorage_list.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-storage/libstorage.a ../../src/lib-index/libindex.a ../../src/lib-imap/libimap.a ../../src/lib-mail/libmail.a ../../src/lib-auth/libauth.a ../../src/lib-charset/libcharset.a ../../src/lib/liblib.a ../lib-dict/libdict.a ../lib/mountpoint.o -export-dynamic -ldl mkdir .libs gcc -std=gnu99 -O2 -pipe -std=gnu99 -Wall -ftree-dce -ftree-dse -ftree-loop-optimize -ftree-loop-linear -I/usr/lib/gcc/i386-redhat-linux/4.1.1/include -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -Wl,-z -Wl,compreloc -Wl,-z -Wl,norelro -o imap cmd-append.o cmd-capability.o cmd-cancelupdate.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-enable.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-id.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o cmd-x-cancel.o client.o commands.o commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-search.o imap-sort.o imap-status.o imap-sync.o mail-storage-callbacks.o main.o ../lib/mountpoint.o -Wl,--export-dynamic ../../src/lib-storage/register/libstorage-register.a ../../src/lib-storage/list/libstorage_list.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-storage/libstorage.a ../../src/lib-index/libindex.a ../../src/lib-imap/libimap.a ../../src/lib-mail/libmail.a ../../src/lib-auth/libauth.a ../../src/lib-charset/libcharset.a ../../src/lib/liblib.a ../lib-dict/libdict.a -ldl ../../src/lib-storage/register/libstorage-register.a(mailbox-list-register.o): In function `mailbox_list_register_all': mailbox-list-register.c:(.text+0x2d): undefined reference to `shared_mailbox_list' collect2: ld returned 1 exit status make[3]: *** [imap] Error 1 make[3]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3/src/imap' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3' make: *** [all] Error 2 does anyone have an idea as to how to get rid of it? thanks in advance ;) -- Freundliche Grüße / Kind regards Axel Schmalowsky Platform Engineer ___________________________________ domainfactory GmbH Oskar-Messter-Str. 33 85737 Ismaning Germany Telefon: +49 (0)89 / 55266-356 Telefax: +49 (0)89 / 55266-222 E-Mail: aschmalowsky(a)df.eu Internet: www.df.eu Registergericht: Amtsgericht München HRB 150294, Geschäftsführer Tobias Marburg, Jochen Tuchbreiter

2 2

[Dovecot] Dovecot master process
by Steven F Siirila 12 Nov '08

12 Nov '08

We are running into a situation where Dovecot master is simply trying to do too much. It some situations, we are finding that there are times in which it cannot service requests. Restarting Dovecot seems to help in these situations, possibly due to the fact that it no longer has to manage its THOUSANDS of file descriptors for pipes to the many imap/proxy processes that it uses for logging. Is there a way to turn off logging through the master process (in exchange for lesser security)? If not, would it be easy to have the master process do its logging using separate threads (which would help on some modern hardware)? Finally, would it be easy to delegate the task of logging to a dedicated process? We are still running Dovecot 1.0.0 at this time, on Solaris 10 servers. -- Steven F. Siirila Office: WBOB, 621F Internet Services E-mail: sfs(a)umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593

3 2

[Dovecot] Error: Maximum number of mail processes exceeded
by Antonio Casado Rodríguez 12 Nov '08

12 Nov '08

Hi, i don't know. Is normal login_max_processes_count > 1024?? Our environment is about 1700 users (imaps + thunderbird or imaps+horde). The server is RedHat Enterprise Linux 5.2 User logins different in a hour: # cat dovecot.info | grep 'Nov 11 10' | grep "login: Login" | cut -d'<' -f2 | cut -d'>' -f1 | sort | uniq | wc -l 685 Logins in a hour: # cat dovecot.info | grep 'Nov 11 10' | grep "login: Login" | wc -l 5749 Is normal?? Should i increment login_max_processes_count? # dovecot -n # 1.0.13: /etc/dovecot.conf log_path: /Correo/log/dovecot/dovecot.log info_log_path: /Correo/log/dovecot/dovecot.info protocols: imaps pop3 managesieve ssl_cert_file: /etc/pki/dovecot/certs/mycert.crt ssl_key_file: /etc/pki/dovecot/private/mycert.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_process_per_connection: no login_max_processes_count: 1024 first_valid_uid: 200 mail_location: maildir:%h/.. mail_executable(default): /usr/local/sbin/post-login-imap-dovecot mail_executable(imap): /usr/local/sbin/post-login-imap-dovecot mail_executable(pop3): /usr/local/sbin/post-login-pop3-dovecot mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 mail_plugin_dir(managesieve): /usr/lib64/dovecot/managesieve imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle imap_client_workarounds(managesieve): outlook-idle sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): ~/sieve sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve namespace: type: private separator: / location: maildir:%h/.. inbox: yes auth default: passdb: driver: pam userdb: driver: passwd plugin: quota: maildir:storage=1048576

2 2

Re: [Dovecot] Install Configuring and run.
by Marko Weber 12 Nov '08

12 Nov '08

Hello Thorsten , sorry then again ........ details: i got dspam working, it now scans incoming mails and tag them in the headers. X-DSPAM-Result: = Spam X-DSPAM-Confidence: = 0.9984 X-DSPAM-Probability: = 1.0000 X-DSPAM-Signature: = 1,491930ac25229173225906 X-DSPAM-Factors: 15, so far okay. i emerged dovecot-antispam. and thought its easy going , just paste the code snippet of man dovecot-antispam to the imap section in the dovecot.conf . but thats not all i think. i thought now, when moving a mail from incoming to SPAM something happens, but despam.dbug and /var/log/messages dont show anything happen. i did this in the dovecot.conf = mail_plugins = antispam mail_plugin_dir = /usr/lib/dovecot/imap plugin { antispam_trash = trash;Trash;Deleted Items;Deleted Messages antispam_spam = SPAM;Spam antispam_dspam_binary = /usr/bin/dspam antispam_dspam_args = --user;%u } but as told above , moving mails into folder SPAM or from SPAM to incoming dont causes any action the log.files when i retstart dovecot i got following output on screen = /etc/init.d/dovecot restart Warning: Growing pool 'settings' with: 8192 * Stopping dovecot ... [ ok ] Warning: Growing pool 'settings' with: 8192 * Starting dovecot ... Warning: Growing pool 'settings' with: 8192 ILoading modules from directory: /usr/lib/dovecot/imap WGrowing pool 'module loader' with: 2048 IModule loaded: /usr/lib/dovecot/imap/lib90_antispam_plugin.so IEffective uid=65534, gid=65534, home= WGrowing pool 'antispam-pool' with: 2048 [ ok ] dovecot is running after restart and fully working, accepting mails , sending mails all oke. dunno if i told before to you, i use postfix-dovecot-mysql setup, virtual users & domains if you need any other config file or info lemme know. i really want this nice tool to get working. thank you marko Thorsten Vollmer schrieb: > On Sun, 2008-11-09 at 15:15 +0100, Marko Weber wrote: > >> Hello Thorsten, >> i sorted out to get dspam working, >> but it tags too much mails as spam, even mials that are not spam, >> >> now thats the poinzt where dovecot-antispam comes in, >> now my idea is, that mails that get "spam" tag by dspam, >> to retrain by "dovecot-antispam". >> but i dont get thru it. >> maybe this is now the pont where you can help me ? >> > > Asking for help without providing any detail is rather pointless. > > Thorsten > >

2 2

[Dovecot] alternate passwd/shadow
by Jorg B. 11 Nov '08

11 Nov '08

I'm using an alternate password/shadow combo to authenticate IMAP users and I can't seen to get it working... I'm using: passdb shadow { args = /etc/dovecot/shadow } Can somebody please give me some hints on how to get this to work.... Thanks JB

2 3