November 2008 - dovecot

[Dovecot] dovecot 1.2 link error
by Axel Schmalowsky 12 Nov '08

12 Nov '08

Hello list, I need/want to build imaptest -- and I can only build it against at least dovecot 1.2 . dovecot 1.2 actually builds just fine but at the end I get the following linker error: /bin/sh ../../libtool --tag=CC --mode=link gcc -std=gnu99 -O2 -pipe -std=gnu99 -Wall -ftree-dce -ftree-dse -ftree-loop-optimize -ftree-loop-linear -I/usr/lib/gcc/i386-redhat-linux/4.1.1/include -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -Wl,-z -Wl,compreloc -Wl,-z -Wl,norelro -o imap -export-dynamic cmd-append.o cmd-capability.o cmd-cancelupdate.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-enable.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-id.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o cmd-x-cancel.o client.o commands.o commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-search.o imap-sort.o imap-status.o imap-sync.o mail-storage-callbacks.o main.o ../../src/lib-storage/register/libstorage-register.a ../../src/lib-storage/list/libstorage_list.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-storage/libstorage.a ../../src/lib-index/libindex.a ../../src/lib-imap/libimap.a ../../src/lib-mail/libmail.a ../../src/lib-auth/libauth.a ../../src/lib-charset/libcharset.a ../../src/lib/liblib.a ../lib-dict/libdict.a ../lib/mountpoint.o -export-dynamic -ldl mkdir .libs gcc -std=gnu99 -O2 -pipe -std=gnu99 -Wall -ftree-dce -ftree-dse -ftree-loop-optimize -ftree-loop-linear -I/usr/lib/gcc/i386-redhat-linux/4.1.1/include -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -Wl,-z -Wl,compreloc -Wl,-z -Wl,norelro -o imap cmd-append.o cmd-capability.o cmd-cancelupdate.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-enable.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-id.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o cmd-x-cancel.o client.o commands.o commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-search.o imap-sort.o imap-status.o imap-sync.o mail-storage-callbacks.o main.o ../lib/mountpoint.o -Wl,--export-dynamic ../../src/lib-storage/register/libstorage-register.a ../../src/lib-storage/list/libstorage_list.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-storage/libstorage.a ../../src/lib-index/libindex.a ../../src/lib-imap/libimap.a ../../src/lib-mail/libmail.a ../../src/lib-auth/libauth.a ../../src/lib-charset/libcharset.a ../../src/lib/liblib.a ../lib-dict/libdict.a -ldl ../../src/lib-storage/register/libstorage-register.a(mailbox-list-register.o): In function `mailbox_list_register_all': mailbox-list-register.c:(.text+0x2d): undefined reference to `shared_mailbox_list' collect2: ld returned 1 exit status make[3]: *** [imap] Error 1 make[3]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3/src/imap' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3' make: *** [all] Error 2 does anyone have an idea as to how to get rid of it? thanks in advance ;) -- Freundliche Grüße / Kind regards Axel Schmalowsky Platform Engineer ___________________________________ domainfactory GmbH Oskar-Messter-Str. 33 85737 Ismaning Germany Telefon: +49 (0)89 / 55266-356 Telefax: +49 (0)89 / 55266-222 E-Mail: aschmalowsky(a)df.eu Internet: www.df.eu Registergericht: Amtsgericht München HRB 150294, Geschäftsführer Tobias Marburg, Jochen Tuchbreiter

2 2

[Dovecot] Dovecot master process
by Steven F Siirila 12 Nov '08

12 Nov '08

We are running into a situation where Dovecot master is simply trying to do too much. It some situations, we are finding that there are times in which it cannot service requests. Restarting Dovecot seems to help in these situations, possibly due to the fact that it no longer has to manage its THOUSANDS of file descriptors for pipes to the many imap/proxy processes that it uses for logging. Is there a way to turn off logging through the master process (in exchange for lesser security)? If not, would it be easy to have the master process do its logging using separate threads (which would help on some modern hardware)? Finally, would it be easy to delegate the task of logging to a dedicated process? We are still running Dovecot 1.0.0 at this time, on Solaris 10 servers. -- Steven F. Siirila Office: WBOB, 621F Internet Services E-mail: sfs(a)umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593

3 2

[Dovecot] Error: Maximum number of mail processes exceeded
by Antonio Casado Rodríguez 12 Nov '08

12 Nov '08

Hi, i don't know. Is normal login_max_processes_count > 1024?? Our environment is about 1700 users (imaps + thunderbird or imaps+horde). The server is RedHat Enterprise Linux 5.2 User logins different in a hour: # cat dovecot.info | grep 'Nov 11 10' | grep "login: Login" | cut -d'<' -f2 | cut -d'>' -f1 | sort | uniq | wc -l 685 Logins in a hour: # cat dovecot.info | grep 'Nov 11 10' | grep "login: Login" | wc -l 5749 Is normal?? Should i increment login_max_processes_count? # dovecot -n # 1.0.13: /etc/dovecot.conf log_path: /Correo/log/dovecot/dovecot.log info_log_path: /Correo/log/dovecot/dovecot.info protocols: imaps pop3 managesieve ssl_cert_file: /etc/pki/dovecot/certs/mycert.crt ssl_key_file: /etc/pki/dovecot/private/mycert.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_process_per_connection: no login_max_processes_count: 1024 first_valid_uid: 200 mail_location: maildir:%h/.. mail_executable(default): /usr/local/sbin/post-login-imap-dovecot mail_executable(imap): /usr/local/sbin/post-login-imap-dovecot mail_executable(pop3): /usr/local/sbin/post-login-pop3-dovecot mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 mail_plugin_dir(managesieve): /usr/lib64/dovecot/managesieve imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle imap_client_workarounds(managesieve): outlook-idle sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): ~/sieve sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve namespace: type: private separator: / location: maildir:%h/.. inbox: yes auth default: passdb: driver: pam userdb: driver: passwd plugin: quota: maildir:storage=1048576

2 2

Re: [Dovecot] Install Configuring and run.
by Marko Weber 12 Nov '08

12 Nov '08

Hello Thorsten , sorry then again ........ details: i got dspam working, it now scans incoming mails and tag them in the headers. X-DSPAM-Result: = Spam X-DSPAM-Confidence: = 0.9984 X-DSPAM-Probability: = 1.0000 X-DSPAM-Signature: = 1,491930ac25229173225906 X-DSPAM-Factors: 15, so far okay. i emerged dovecot-antispam. and thought its easy going , just paste the code snippet of man dovecot-antispam to the imap section in the dovecot.conf . but thats not all i think. i thought now, when moving a mail from incoming to SPAM something happens, but despam.dbug and /var/log/messages dont show anything happen. i did this in the dovecot.conf = mail_plugins = antispam mail_plugin_dir = /usr/lib/dovecot/imap plugin { antispam_trash = trash;Trash;Deleted Items;Deleted Messages antispam_spam = SPAM;Spam antispam_dspam_binary = /usr/bin/dspam antispam_dspam_args = --user;%u } but as told above , moving mails into folder SPAM or from SPAM to incoming dont causes any action the log.files when i retstart dovecot i got following output on screen = /etc/init.d/dovecot restart Warning: Growing pool 'settings' with: 8192 * Stopping dovecot ... [ ok ] Warning: Growing pool 'settings' with: 8192 * Starting dovecot ... Warning: Growing pool 'settings' with: 8192 ILoading modules from directory: /usr/lib/dovecot/imap WGrowing pool 'module loader' with: 2048 IModule loaded: /usr/lib/dovecot/imap/lib90_antispam_plugin.so IEffective uid=65534, gid=65534, home= WGrowing pool 'antispam-pool' with: 2048 [ ok ] dovecot is running after restart and fully working, accepting mails , sending mails all oke. dunno if i told before to you, i use postfix-dovecot-mysql setup, virtual users & domains if you need any other config file or info lemme know. i really want this nice tool to get working. thank you marko Thorsten Vollmer schrieb: > On Sun, 2008-11-09 at 15:15 +0100, Marko Weber wrote: > >> Hello Thorsten, >> i sorted out to get dspam working, >> but it tags too much mails as spam, even mials that are not spam, >> >> now thats the poinzt where dovecot-antispam comes in, >> now my idea is, that mails that get "spam" tag by dspam, >> to retrain by "dovecot-antispam". >> but i dont get thru it. >> maybe this is now the pont where you can help me ? >> > > Asking for help without providing any detail is rather pointless. > > Thorsten > >

2 2

[Dovecot] alternate passwd/shadow
by Jorg B. 12 Nov '08

12 Nov '08

I'm using an alternate password/shadow combo to authenticate IMAP users and I can't seen to get it working... I'm using: passdb shadow { args = /etc/dovecot/shadow } Can somebody please give me some hints on how to get this to work.... Thanks JB

2 3

[Dovecot] dovecot-antispam crm114 config
by Peter Fern 11 Nov '08

11 Nov '08

Hi list, Does anyone have a working crm114 config for dovecot-antispam? I have mailreaver running perfectly otherwise, but it doesn't seem to be called correctly from dovecot-antispam - the css files show no change. Piping a message to the command... `/usr/share/crm114/mailreaver.crm --good -u /shared/domains/domain.tld/users/pfern/.crm/` works as expected, and the logs don't indicate anything useful that I can see as to why it isn't working from dovecot. Log follows: Nov 11 12:56:48 mx0 dovecot: imap-login: Login: user=<pfern(a)domain.tld>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, TLS Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): Loading modules from directory: /usr/lib64/dovecot/imap Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): Module loaded: /usr/lib64/dovecot/imap/lib90_antispam_plugin.so Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): Effective uid=xxxxx, gid=xxxxx, home=/shared/domains/domain.tld/users/pfern Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: plugin initialising (unknown) Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "trash" is trash folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "Trash" is trash folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "Deleted Items" is trash folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "-SPAM-" is spam folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "-UNSURE-" is unsure folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: reaver binary set to /usr/share/crm114/mailreaver.crm Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: reaver extra arg -u Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: reaver extra arg /shared/domains/domain.tld/users/pfern/.crm/ Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: signature header line is "X-CRM114-CacheID" Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): maildir: data=/shared/domains/domain.tld/users/pfern/.maildir:INDEX=/var/lib/dovecot/indexes/domain.tld/p/pfern Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): maildir++: root=/shared/domains/domain.tld/users/pfern/.maildir, index=/var/lib/dovecot/indexes/domain.tld/p/pfern, control=, inbox=/shared/domains/domain.tld/users/pfern/.maildir Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_unsure(INBOX.Noojee): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_trash(-UNSURE-): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_trash(INBOX.Noojee): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mail copy: from trash: 0, to trash: 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_spam(-UNSURE-): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_spam(INBOX.Noojee): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_unsure(-UNSURE-): 1 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mail copy: src spam: 0, dst spam: 0, src unsure: 1

3 4

[Dovecot] dovecot permissions
by Fernando 11 Nov '08

11 Nov '08

Hello list, I would like to configure POP3 email such that user "mark" (only) must be able to retrieve email from my machine using POP3 from within mydomain.com Any ideas?

1 1

[Dovecot] How to specify /var/spool/mail/m/i/mike
by Network Operations 11 Nov '08

11 Nov '08

I was wondering if somebody could tell me how I can tell dovecot (IMAP) to read users' mail boxes at /var/spool/mail/{1st char}/{2nd char}/username . For example: Mailbox for user 'mike' would be located at /var/spool/mail/m/i/mike 'karen' would be at /var/spool/mail/k/a/karen etc... Is this possible is version 1.1.6? Please advise. Thanks JB

2 1

Re: [Dovecot] Another dovecot-antispam plugin can't call dspam
by Eugene 11 Nov '08

11 Nov '08

Hi Johannes, > From: Johannes Berg <johannes(a)sipsolutions.net> >> > I just committed a fix to debugv(), can you try that? If you downloaded >> > the tarball, get this one: >> > http://git.sipsolutions.net/?p=dovecot-antispam.git;a=snapshot;h=HEAD;sf=tgz >> > >> > If you can confirm that works I'll make a new release. >> >> The fixed version works perfectly, thank you very much! > > And it prints the full command line to the syslog, I assume? Thanks for > testing! It solves the problem here as well =) Thanks for the update. Do you plan to implement 'out of band' dspam calling? BTW maybe there is no need for a separate 'queue' folder especially as we only need a message signature. I think it can be stored in some buffer array so as the dspam calls are made i.e. during idle time (or during final cleanup at the latest). Also I am attaching a couple of patches that might be useful. dspam-exec.c.patch adds debug-dumping of the dspam reply (it turned out quite useful not only for the stack corruption problem). Makefile.patch fixes the syntax to compile with gmake under FreeBSD 6.1 and also adjusts the installed plugin permissions. Best wishes Eugene

2 3

[Dovecot] NFS Unbreakable lock issues
by Rod Treweek 11 Nov '08

11 Nov '08

Hello All, We are struggling to find a solution to a problem we are encountering with a load-balanced email setup. Currently, we have a Coyote loadbalancer, and 3 Postfix/Dovecot nodes that then get their information from a mysql database. The problem is that after a couple weeks, we start seeing NFS locking issues occur, which then takes email completely down, requiring a site visit to basically do an interactive mode reboot to shut off NFS so that we can remount the filesystem again. We have our mailstore on an Aberdeen NAS which is accessed over NFS v. 4. Dovecot version 1.1.2 Here's the relevant mysql string: grep -v '^ *$#.*$\?$' dovecot-mysql.conf driver = mysql connect = host=X.X.X.X dbname=Something user=Something password=Something password_query = SELECT username as user, password, concat('/NFS1MAILDIR/mailSysV2/', maildir) as userdb_home, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as userdb_mail, 143 as userdb_uid, 143 as userdb_gid, concat('*:bytes=', floor(quota*1024)) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' user_query = SELECT concat('/NFS1MAILDIR/mailSysV2/', maildir) as home, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as mail, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as maildir, 143 AS uid, 143 AS gid, concat('*:bytes=', floor(quota*1024)) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' And here's what our configuration is on each of the nodes: dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf protocols: imap pop3 ssl_ca_file: /usr/local/etc/dovecot/certs/tdpserver.crt ssl_cert_file: /usr/local/etc/dovecot/certs/tdpserver.crt ssl_key_file: /usr/local/etc/dovecot/certs/tdpserver.key ssl_parameters_regenerate: 0 ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: postfix login_greeting: Something witty here.. login_process_per_connection: no login_max_connections: 512 max_mail_processes: 2048 mail_max_userip_connections: 50 verbose_proctitle: yes first_valid_uid: 69 last_valid_uid: 500 first_valid_gid: 69 last_valid_gid: 500 mail_access_groups: postfix mail_privileged_group: postfix mail_location: mbox:/NFS1MAILDIR/mailSysV2/%d/%u:INDEX=/usr/local/mail/indexes/%d/%1n/%n mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: login plain user: dovecot passdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf userdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: dovecot group: dovecot plugin: quota: dict:user::proxy::quota imap_quota: dict:user::proxy::quota quota_rule: *:storage=528576 dict: quota: mysql:/usr/local/etc/dovecot/dovecot-dict-quota.conf Any help you can offer is greatly appreciated, as well as opinions on any other 'validated' postfix/dovecot email enterprise design solutions. Thanks Very Much In Advance, R.T

1 0