- dovecot - dovecot.org

[Dovecot] Dovecot and Bogofilter
by Matthias-Christian Ott 21 Nov '08

21 Nov '08

Hi, on my small Xen-virtualised server with 48 MiB RAM I use Postfix and Dovecot, because the Debian administrators dislike qmail [1], which is in my opinion despite some maintainability and code quality issues a quite well designed software, because it mostly follows the UNIX principles. Postfix is not able to sort my E-Mail into different Maildir folders and after I looked at procmail's source code, I decided to use Dovecot's LDA, because it supports sieve via a plugin. All in all it worked after some tweaking and Dovecot is now responsible for authentication and delivery. Furthermore I want to setup a spam filter and due to the memory constraints I decided in favour of bogofilter (I made no real world tests, but the authors claim that it's fast and has a small memory footprint). My first idea was train bogofilter via a cronjob that runs bogofilter for each E-Mail in my spam folder and deletes them afterwards. Then I stumbled upon the dovecot antispam [2] plugin and quickly wrote a backend for bogofilter. During the development I realised that bogofilter has to update the X-Bogosity header of the reclassified E-Mails. Johannes Berg told me that he wasn't sure whether dovecot would be able to do this and recommended to ask this on the mailing list. An other problem is that each mail needs to be initially classified and due to the fact that sieve is not able to execute external programmes, deliver has to do this task. I'm currently thinking of possibilities to implement this, so far I came up with the following: 1. Write a generic pipe plugin which can execute an arbitrary number of programmes. The problem with this is that I'm not sure how to integrate this is in Dovecot's configuration file. I thought of something like this: pipe = prg1 | prg2 2. Write a bogofilter-specific plugin for this. Anyhow I would like to take this opportunity to criticise Dovecot for being a bloated (unnecessary abstractions, verbose, pseudo object-oriented, ...), non-suckless [3] and non-unixish (plugin architecture, monolithic design, ...) software which in return works quite well and stable so far. I appreciate any suggestions, ideas or criticism. I would really like to finish configuring my mail server as soon as possible. Regards, Matthias-Christian [1] http://smarden.org/pape/Debian/1215531259.4854_332.werc [2] http://johannes.sipsolutions.net/Projects/dovecot-antispam [3] http://www.suckless.org/common/

9 16

[Dovecot] nfs_flush_fcntl failed: No locks available
by Mark Zealey 21 Nov '08

21 Nov '08

Hi there, I've been seeing this error in our logs quite frequently on our nfs storage (v3): 2008-11-10T13:24:26+00:00 mail8 dovecot: IMAP(XXX(a)YYY.com): nfs_flush_fcntl: fcntl(/var/spool/mail/XXX/Maildir/dovecot.index.cache, F_RDLCK) failed: No locks available Which is because we don't run lockd on our servers. Why is dovecot trying to use fcntl() ? I explicitly set it to use dotlocks in the dovecot config: # 1.1.6: /etc/dovecot.conf # OS: Linux 2.6.18-92.el5 i686 CentOS release 5.2 (Final) base_dir: /var/run/dovecot/ protocols: imap pop3 mail_location: maildir:~/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock maildir_copy_preserve_filename: yes mbox_write_locks: dotlock This happens for both pop and imap (however more frequently with imap). Thanks, Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer

2 2

[Dovecot] For Configuration Help: per-user quota for virtual users.
by sales＠100n.org 21 Nov '08

21 Nov '08

Dear dovecot list: Could any experts help me on the configuration of per-user for dovecot on FreeBSD 7.x with postfix-2.5.4,1. I followed the howto of http://workaround.org/articles/ispmail-etch/, it is an excellent file, my mailserver worked very well. When I configured per-user quota plug-in, quota_rule with 20MB limits can not be overrided by the Mysql query statement, Although I followed the document at : http://wiki.dovecot.org/Quota. Below is the output of dovecot --version, dovecot -n and dovecot-sql.conf. Could any experts help me? Thanks in advance ! Best Regards, Forrest --------------------------------- ns1# dovecot --version 1.1.2 ns1# dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf protocols: imap pop3 pop3s imaps login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n/Maildir mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir quota_rule: *:storage=20M quota_rule2: Trash:storage=10M quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80 ns1# grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = mysql connect = host=127.0.0.1 dbname=****** user=****** password=******** default_pass_scheme = PLAIN-MD5 password_query = SELECT email as user, password FROM view_users WHERE email='%u'; user_query = select 5000 as uid, 5000 as gid, '/home/vmail/%d/%n' as home, \ concat('*:bytes=', quota_bytes) as quota_rule \ from email_quota where email = '%u'

2 1

[Dovecot] Problem witch dovecot-auth continue
by Grzegorz Zalewski 21 Nov '08

21 Nov '08

I`m forgot paste rest of the log: dovecot: 2008-11-07 10:16:44 Panic: auth(default): file auth-worker-server.c: line 54 (auth_worker_idle_timeout): assertion failed: (array_count(&conn->requests) == 0)

2 1

[Dovecot] Per User Quotas
by Peter Fraser 21 Nov '08

21 Nov '08

HI All Asking for a little patience and a bit of help here. I'm using dovecot-1.1.3_1 with postfix and squirrelmail. I have implemented a global quota successfully. That works fine. I want to now implement per user quotas. So far I have read the howto in the documentation and searched several threads but can't seem to get it working properly. My LDAP server is Windows 2003 Active Directory. Is there any documentation specific to AD that I could look at or any other doc that could help me? My last effort was to put this in dovecot-ldap.conf user_attrs = streetAddress=quota_rule4=*:storage=%$M ,=uid=1002,=gid=1002,=home=/home/vmail/%u and this in dovecot.conf in addition to the other quota rules. quota_rule4 = *:bytes=%$ I then put the quota in the streetAddress area of AD. I'd certainly appreciate any help. Thanks.

2 4

[Dovecot] make archive emails undeletable?
by Rob Nichols 21 Nov '08

21 Nov '08

I've been using dovecot for a year or two now, and really like it. I have a fairly simple setup, but I think it's time to get a little more advanced. I keep an "archive" of all my email, both sent and received. Every once in a while I get confused, and accidentally delete something from my archive. I also worry that I'll misconfigure a mail client some day and accidentally wipe out my "trash" folder. I would like some way to prevent deletion in several mailboxes. Is that possible? It looks like ACL could do this, but I can't quite figure out where to start. Any pointers would be greatly appreciated. Thanks, Rob

2 1

[Dovecot] Disconnecting without unbinding?
by Maykel Moya 21 Nov '08

21 Nov '08

Timo Please have a look at this short thread[1]. That message stops appearing whenever I shutdown dovecot. I'm using dovecot 1.0.15. dovecot-ldap.conf ----------------- dn = ... dnpass = ... ldap_version = 3 auth_bind = no base = ... pass_filter = ... pass_attrs = ... user_filter = ... user_attrs = ... default_pass_scheme = MD5-CRYPT user_global_uid = vmail user_global_gid = vmail Regards, maykel [1] http://www.openldap.org/lists/openldap-software/200811/msg00078.html --------------------------------------- Red Telematica de Salud - Cuba CNICM - Infomed

2 1

[Dovecot] Auth Issues - Urgent - Help!
by David Cunningham 21 Nov '08

21 Nov '08

After a few hours of running, I get tons of the following errors in my logs: dovecot: Oct 08 07:41:50 Error: auth(default): ldap(user(a)domain,x.x.x.x): Request queue is full I removed the username and IP, obviously. Any idea how to stop this? I have about 5 Thousand users using horde that login ever 1-5 minutes to refresh their page. I assume it is a setting, but I am confused as to why it doesn't happen almost right away. It seems to take some time to build up. Please help! This is taking my webmail system down hourly.

6 20

[Dovecot] Error message in logs since 1.1.6 upgrade
by Guy 21 Nov '08

21 Nov '08

Hi, I've got two imap boxes, one is running 1.1.5 and hasn't exhibited the error below, but the one that's been upgraded to 1.1.6 is showing them. Nov 14 16:06:31 mink dovecot: imap-login: Disconnected (no auth attempts): rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac If this isn't already a known error, is there any extra data I can collect that would help diagnose what's causing it? I haven't a clue where to start with this sort of debugging I'm afraid. Thanks Guy -- Don't just do something...sit there!

2 1

[Dovecot] sieve-body extension support for deliver LDA's sieve plugin
by BrunoM 21 Nov '08

21 Nov '08

Hello, I just read your message about sieve and body-extension in Dovecot. Do you have news on that topic? I just have to filter mails containing a particular text fragment, and I cannot do without sieve body, I think.. Thank you for any clue you'd be able to give me ! Regards, Bruno --- Hi Timo & Co, Is there any time frame for updating the deliver LDA's sieve plugin code to that from Cyrus IMAPd v2.3.x? I ask as I'm looking for the functionality of the sieve-body extension, as described here: http://www.ietf.org/internet-drafts/draft-ietf-sieve-body-06.txt This requirement has come up as we're upgrading from a Courier-IMAP/maildrop configuration that has some filtering based on message body content. As an aside, if that time frame is undefined or will be long, if I use maildrop instead as my LDA, will I loose the instant delivery notification via IMAP IDLE? Thanks very much, Scott

2 1

[Dovecot] %d in deliver
by Mark Zealey 21 Nov '08

21 Nov '08

Hi there, I run a system that has a lot of virtual users. We invoke deliver from exim and pass the directory to deliver into using the HOME environment variable, so deliver doesn't do any database lookups during the delivery process. The exim pipe environment is described at http://exim.org/exim-html-current/doc/html/spec_html/index.html#toc0239, but basically I'd like to know the domain as well as the user, however deliver doesn't seem to pick this up. Is there any way that you could extend deliver to make it either pick up the domain (or correct username) from the command line, but not do an authdb lookup; or get it to read the domain from an environment variable (or be able to print the contents of an arbitrary environment variable in a formatted string)? Thanks, Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer

2 1

[Dovecot] namespace public / namespace shared - question
by Michal Soltys 21 Nov '08

21 Nov '08

After looking through wiki/config/list I'm still not sure, what exactly is the difference between those two. Even all the examples in dovecot's wiki don't have a single "namespace shared" anywhere. And there's only short mention about the difference in dovecot.conf . Peeking into rfc2342 - would shared namespace relate to "Other Users' Namespace(s)" and public namespace to "Shared Namespace(s)" ? Does perhaps the difference only lie on the client side, depending on the namespace it's asking, while functionally it's the same from the perspective of dovecot ?

2 1

[Dovecot] userdb, Dovecot LDA not using mail_location config properly?
by k bah 21 Nov '08

21 Nov '08

I use Dovecot 1.0.5. I use LDAP for the user database and Dovecot LDA. --- dovecot.conf mail_location = maildir:/var/spool/mail/data/%Lu:INDEX=/var/spool/mail/index/%Lu auth default { mechanisms = plain (Note: TLS is used anyways..) userdb prefetch { } passdb ldap { # Path for LDAP configuration file, see doc/dovecot-ldap-example.conf args = /etc/dovecot/dovecot-ldap.conf_passdb (symlink do dovecot-ldap.conf) } userdb ldap { # Path for LDAP configuration file, see doc/dovecot-ldap-example.conf args = /etc/dovecot/dovecot-ldap.conf_userdb (symlink do dovecot-ldap.conf) } socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 user = maildeliver group = mail } } } --- dovecot-ldap.conf Q1: auth_bind_userdn (commented since it would avoid the use of passdb and userdb, right?) # auth_bind_userdn = ... # userdb user_filter = (&(objectclass=postfixuser)(mail=%u)) user_attrs = uid=user # passdb pass_filter = (&(objectclass=inetlocalmailrecipient)(uid=%u)) pass_attrs = uid=user,userPassword=password,uid=userdb_user --- mail log host postfix/smtpd[8923]: connect from localhost[127.0.0.1] host postfix/smtpd[8923]: 5B449EA2C6: client=localhost[127.0.0.1] host postfix/cleanup[8925]: 5B449EA2C6: message-id=<20081121103114.5B449EA2C6@host> host postfix/smtpd[8923]: disconnect from localhost[127.0.0.1] host postfix/qmgr[8894]: 5B449EA2C6: from=<sender(a)otherdomain.org>, size=368, nrcpt=1 (queue active) host deliver(person(a)mydomain.com): Loading modules from directory: /usr/lib/dovecot/modules/lda host deliver(person(a)mydomain.com): Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so host dovecot: auth(default): master in: USER 1 person(a)mydomain.com service=deliver host dovecot: auth(default): prefetch(person(a)mydomain.com): passdb didn't return userdb entries (#0) host dovecot: auth(default): ldap(person(a)mydomain.com): user search: base=dc=mydomain,dc=com scope=subtree filter=(&(objectclass=postfixuser)(mail=person(a)mydomain.com)) fields=uid host deliver(person(a)mydomain.com): auth input: person(a)mydomain.com (#1) host deliver(person(a)mydomain.com): auth input: user=person~mydomain.com host deliver(person(a)mydomain.com): auth input: uid=501 host deliver(person(a)mydomain.com): auth input: gid=12 (#2) host deliver(person(a)mydomain.com): maildir: data=/var/spool/mail/data/person@mydomain.com:INDEX=/var/spool/mail/index/person@mydomain.com (#3) host deliver(person(a)mydomain.com): maildir: root=/var/spool/mail/data/person(a)mydomain.com, index=/var/spool/mail/index/person(a)mydomain.com, control=, inbox= host dovecot: auth(default): master out: USER 1 person(a)mydomain.com user=person~mydomain.com uid=501 gid=12 host deliver(person(a)mydomain.com): msgid=<20081121103114.5B449EA2C6@host>: saved mail to INBOX host postfix/pipe[8929]: 5B449EA2C6: to=<person(a)mydomain.com>, relay=dovecot, delay=0.69, delays=0.19/0.02/0/0.48, dsn=2.0.0, status=sent (delivered via dovecot service) host postfix/qmgr[8894]: 5B449EA2C6: removed What I don't get is that since I use userdb (read mail log lines marked (#0-3) and the "mail_location" option from dovecot.conf), mail should be saved to "person~mydomain.com" and not "person(a)mydomain.com" on the disk(?). Q2: Did I misunderstood the meaning of userdb/mail_location, is that right (this behavior)? Q3: Is it misconfigured? I want to save mail on the disk to person~mydomain.com, when I get that right (save mail to what line #1 tells is "user"), I'll use mailRoutingAddress (my mailroutingaddress = person~mydomain.com(a)mydomain.com, mail_location would use %Ln). The passdb and userdb prefetch are working ok on the user is checking mail. thanks = PathMaker for Six Sigma Complete low-cost Six Sigma toolset. Equip your black and green belts. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=1198ebf9f950733925452d3… -- Powered by Outblaze

2 1

[Dovecot] CRAM-MD5 and proxy_maybe
by David Jonas 20 Nov '08

20 Nov '08

When using proxy_maybe CRAM-MD5 authentication fails when the connection is proxied. Is this expected behavior? Is proxy_maybe too simplified for this case? We're using SQL so I could rewrite the query with IFs to fake proxy_maybe and return the password as NULL and nologin as Y, but if it works that way couldn't it work with proxy_maybe? This works: password_query = \ SELECT NULL AS password, host, CONCAT(user,'@',domain) AS destuser \ 'Y' AS nologin, 'Y' AS nodelay, 'Y' AS proxy \ FROM accounts WHERE class='pop' AND domain='%d' This doesn't work if proxied and CRAM-MD5 auth: password_query = \ SELECT \ CONCAT(user,'@',domain) AS user, password, \ host, 'Y' AS proxy_maybe, \ target AS userdb_home, uid AS userdb_uid, gid AS userdb_gid \ FROM accounts WHERE \ class='pop' AND domain='%d' AND user='%n' \ LIMIT 1 Thanks, David

2 3

[Dovecot] Sieve RFC5229 support?
by list_dovecot＠bluerosetech.com 20 Nov '08

20 Nov '08

I'd like to take advantage of RFC5229 match variables (it would reduce the number of rules I have by an order of magnitude); however, the required extension isn't supported yet. Am I mistaken? If not, are there plans to support it?

2 1

[Dovecot] Unbreakable NFS locking issues...
by Rod Treweek 20 Nov '08

20 Nov '08

Hello All, We are struggling to find a solution to a problem we are encountering with a load-balanced email setup. Currently, we have a Coyote loadbalancer, and 3 Postfix/Dovecot nodes that then get their information from a mysql database. The problem is that after a couple weeks, we start seeing NFS locking issues occur, which then takes email completely down, requiring a site visit to basically do an interactive mode reboot to shut off NFS so that we can remount the filesystem again. We have our mailstore on an Aberdeen NAS which is accessed over NFS v. 4. Dovecot version 1.1.2 Here's the relevant mysql string: grep -v '^ *$#.*$\?$' dovecot-mysql.conf driver = mysql connect = host=X.X.X.X dbname=Something user=Something password=Something password_query = SELECT username as user, password, concat('/NFS1MAILDIR/mailSysV2/', maildir) as userdb_home, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as userdb_mail, 143 as userdb_uid, 143 as userdb_gid, concat('*:bytes=', floor(quota*1024)) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' user_query = SELECT concat('/NFS1MAILDIR/mailSysV2/', maildir) as home, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as mail, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as maildir, 143 AS uid, 143 AS gid, concat('*:bytes=', floor(quota*1024)) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' And here's what our configuration is on each of the nodes: dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf protocols: imap pop3 ssl_ca_file: /usr/local/etc/dovecot/certs/tdpserver.crt ssl_cert_file: /usr/local/etc/dovecot/certs/tdpserver.crt ssl_key_file: /usr/local/etc/dovecot/certs/tdpserver.key ssl_parameters_regenerate: 0 ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: postfix login_greeting: Something witty here.. login_process_per_connection: no login_max_connections: 512 max_mail_processes: 2048 mail_max_userip_connections: 50 verbose_proctitle: yes first_valid_uid: 69 last_valid_uid: 500 first_valid_gid: 69 last_valid_gid: 500 mail_access_groups: postfix mail_privileged_group: postfix mail_location: mbox:/NFS1MAILDIR/mailSysV2/%d/%u:INDEX=/usr/local/mail/indexes/%d/%1n/%n mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: login plain user: dovecot passdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf userdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: dovecot group: dovecot plugin: quota: dict:user::proxy::quota imap_quota: dict:user::proxy::quota quota_rule: *:storage=528576 dict: quota: mysql:/usr/local/etc/dovecot/dovecot-dict-quota.conf Any help you can offer is greatly, greatly appreciated, as well as opinions on any other 'validated' postfix/dovecot email enterprise design solutions. Thanks Very Much In Advance, R.T

6 13

[Dovecot] New message notification
by Juan Asensio Sánchez 19 Nov '08

19 Nov '08

Hi What is the best option to notify a user that a message has arrived? The intention is to write a script that connects to a jabber server and checks if the user is online, so then a message is sent to user notifying him that he has received a new message. The solution should be compatible with Sieve filtering, so the script should not be executed when the message is moved to the SPAM folder, or pass to the script an argument specifying the folder where the message has been saved. Regards and thanks in advance. Juan Asensio Sánchez - http://www.nutum.es

2 1

[Dovecot] Solving CVE-2008-4870
by Michal Hlavinka 19 Nov '08

19 Nov '08

Hi, we're trying to solve CVE-2008-4870 = rhbz#436287 = dovecot.conf is world readable - possible password exposure. This problem seems to be little more complicated than we thought. dovecot.conf can contain passphrase for ssl key, which is available for everyone since dovecot.conf has world readable permissions. (In CVE's description is note that it RHEL's/Fedora's problem, but it affects all systems imo) We was thinking about few ways how to fix it: 1) 0640 permissions for dovecot.conf - but it can became not readable for dovecot 2) 0640 root:mail and set deliver to group mail with sgid - possible security problem 3) don't store passphrase in dovecot.conf, just ask for it when dovecot's started - can hang boot process, not good As part of investigating, I've found dovecot is storing all variables in environment variables - it means even passphrase? I'm not completely sure, but all variables can be read via /proc/<pid>/environ (I don't know if it becomes readable in some circumstances.) Is there any plan to solve this problem? Cheers, Michal

3 3

[Dovecot] patch: list shared namespace
by Bernhard Herzog 19 Nov '08

19 Nov '08

Hi, I've been working on a patch for dovecot 1.2 from the Kolab branch (http://hg.intevation.org/kolab/dovecot-1.2_kolab-branch/) that implements listing of shared namespaces. I've got something that works in some basic way but is still missing some pieces. See the attached patch, which also contains some installation and configuration notes. Implementation notes: One of the main problems the patch addresses is getting a list of all users that have mailboxes the logged in user can see. The patch uses a dict to cache information about which users have at least one mailbox that is visible to other users. The dict doesn't cache which other users, though. The cache entry for a given user is updated whenever the dovecot-acl-list file in the maildir root directory is updated. This ties the implementation to a specific acl backend to an extent, but that shouldn't be a problem at the moment. Another problem is that namespaces for all those users have to be created. The patch does that in shared-storage.c when the shared storage is created. At this stage of development of the patch that works well enough, I think, but it might be better to update the namespaces whenever a list iterator is created. To avoid unnecessary coupling between the shared namespace code and the ACL plugin, the shared namespace code has a hook that it calls when it needs a list of all the users who may have mailboxes visible to the current user. The ACL plugin sets that hook and uses the dict to produce that list. This way, the ACL plugin depends on the shared namespace code but not the other way round and all the dict handling is in the ACL plugin. I'm not sure the new hook is really needed. The patch could perhaps just as well extend the acl_next_hook_mail_storage_created and acl_next_hook_mailbox_list_created functions to do the namespace creation when they're called for a shared storage or mailbox list. Problems: All of my tests so far involved a shared namespace of the form namespace shared { separator = / prefix = users/%%u/ location = maildir:.../var/mail/%%u:... subscriptions = no list = yes hidden = no } Also, let's assume two users, ford and arthur with ford's "INBOX/hhgttg" available to arthur as "users/ford/INBOX/hhgttg". Arthur may not list ford's INBOX, though. In the following the current user is always arthur. I found the following problems: - LIST response includes namespaces the user doesn't really have access to. E.g. if there's another user, zaphod who's made some mailbox available to somebody else, but not arthur, arthur still sees * LIST (\Noselect \HasChildren) "/" "users/zaphod" Not sure it's worth fixing this, though. - List with "%" doesn't list all intermediate mailboxes. On the one hand arthur sees this: x LIST "" "*" ... * LIST (\Noselect \HasChildren) "/" "users/ford" * LIST (\HasNoChildren) "/" "users/ford/INBOX/hhgttg" x OK List completed. OTOH, with "%" only this: x LIST "" "users/ford/%" x OK List completed. cyrus shows x LIST "" "users/ford/%" * LIST (\Noselect \HasChildren) "/" "users/ford/INBOX" x OK List completed. At least Kontact resp. KMail rely on this. - The dovecot-acl-list is not always rebuilt, even when it should have been, AFAICT. In particular, if the file exists but is empty, it's never updated, even when ACL later change. Maybe this is a bug in the Kolab branch. Cheers, Bernhard -- Bernhard Herzog | ++49-541-335 08 30 | http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück | AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

2 16

[Dovecot] Bug in 1.1.4: New line required in ACL files
by sleeper-＠gmx.net 19 Nov '08

19 Nov '08

Hello, just wanted to notify you about a bug i found in 1.1.4 ACL handling: Global ACLs are ignored, when there is no line break (i.e. "owner lr" is ignored while "owner lr\n" works). I didn't track this down to see if the same happens for per-user ACLs, but it should be quite obvious in the source anyways. Regards -- Sensationsangebot nur bis 30.11: GMX FreeDSL - Telefonanschluss + DSL für nur 16,37 Euro/mtl.!* http://dsl.gmx.de/?ac=OM.AD.PD003K11308T4569a

2 1

[Dovecot] Mail.app & Subscriptions
by Neil 19 Nov '08

19 Nov '08

Client: Mail.app v.3.5 Server: Dovecot 1.1.6 I've noticed that when I go to "Account Info" in Mail.app, and then to the "Subscription List" tab, Mail.app will spin for a bit, and then give up, without showing any folders and all the buttons are grayed out. Does anyone know if this a Mail.app issue or a Dovecot issue, if there're any work-arounds, and/or if this is something I should be concerned about? Thanks, Neil.

2 1

[Dovecot] Password authentication and character set
by Fredrik Grönqvist 19 Nov '08

19 Nov '08

Hi, I've searched in the wiki and in the mailinglist archives but haven't found anything about password character sets within the dovecot authentication deamon. My problem is that we have users with passwords containing scandinavian characters (äöå, umlauts) and the debug log shows that different clients send the password in different charsets. The passwords are stored in a Mysql table, if that makes any difference. Outlook Express with LATIN 1 (ISO-8859-1): Nov 18 16:56:39 resilar dovecot: auth-worker(default): sql(fgr-1,193.64.206.190): Password mismatch Nov 18 16:56:39 resilar dovecot: auth-worker(default): sql(fgr-1,193.64.206.190): MD5(<E4><E4>kk<F6>si<E4>) != '$1$xMPPHRdL$I0mrlPi5FMtwauSf20vjz0' MacMail UTF8: Nov 18 17:23:37 resilar dovecot: auth-worker(default): sql(fgr-1,193.64.206.190): Password mismatch Nov 18 17:23:37 resilar dovecot: auth-worker(default): sql(fgr-1,193.64.206.190): MD5(ääkkösiä12) != '$1$xMPPHRdL$I0mrlPi5FMtwauSf20vjz0' Is there a setting that "forces" the authentication daemon to convert the provided password to a specific charset before the comparison takes place, or how should one handle this? dovecot -n # 1.1.4: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s managesieve ssl_cert_file: /etc/ssl/certs/mail.crt ssl_key_file: /etc/ssl/private/mail.key ssl_cipher_list: ALL:!LOW disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_greeting: mail ready. login_process_per_connection: no mail_privileged_group: mail mail_location: maildir:~/mail mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve imap_client_workarounds(default): delay-newmail outlook-idle imap_client_workarounds(imap): delay-newmail outlook-idle imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): ~/ sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve auth default: mechanisms: plain login username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@+ verbose: yes debug: yes debug_passwords: yes worker_max_count: 50 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir Chears Fredrik -- ------------------------------------------------------------------------ Fredrik Grönqvist ------------------------------------------------------------------------

3 13

[Dovecot] pam_start() failed: system error
by Peter Orlowski 18 Nov '08

18 Nov '08

Hi, I'm using dovecot 1.1.3 on FreeBSD 6.3, x86, files are on NFS, except control and index files, which are local, on UFS2. It's moderately loaded, there are usually not more than 30 clients simultaneously. dovecot runs fine for 3-10 days, then people can't connect any more, and dovecot says: Nov 18 13:20:44 dizzy dovecot-auth: pam_ldap: ldap_simple_bind Can't contact LDAP server Nov 18 13:20:44 dizzy dovecot-auth: pam_ldap: reconnecting to LDAP server... Nov 18 13:20:44 dizzy dovecot-auth: pam_ldap: ldap_simple_bind Can't contact LDAP server Nov 18 13:20:44 dizzy dovecot-auth: pam_ldap: ldap_simple_bind Can't contact LDAP server Nov 18 13:20:44 dizzy dovecot-auth: pam_ldap: ldap_simple_bind Can't contact LDAP server Nov 18 13:21:46 dizzy dovecot: auth-worker(default): pam(xxxx,xxx.xxx.xxx.xxx): pam_start() failed: system error Nov 18 13:21:46 dizzy dovecot-auth: in openpam_load_module(): no pam_permit.so found Nov 18 13:22:12 dizzy dovecot-auth: in openpam_load_module(): no pam_login_access.so found Nov 18 13:22:31 dizzy dovecot-auth: in openpam_load_module(): no pam_unix.so found Nov 18 13:22:42 dizzy dovecot-auth: in openpam_load_module(): no /usr/local/lib/pam_ldap.so found After restarting dovecot things are back to normal. I have tried different settings for worker_max_count, and I had blocking=no in the passdb config until a few day ago; changing that didn't help either. Here's my current config: # 1.1.3: /usr/local/etc/dovecot.conf protocols: imaps pop3s ssl_cert_file: /etc/ssl/certs/mailitp-chain.pem ssl_key_file: /etc/ssl/certs/mailkey2.pem login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_location: mbox:~/mail/:INDEX=/srv/dovecot/indexes/%u.oldmail:INBOX=/var/mail/%u mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): zlib mail_plugins(imap): zlib mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: / prefix: NEWmail/ location: maildir:~/Maildir/:INDEX=/srv/dovecot/indexes/%u:CONTROL=/srv/dovecot/control/%u list: yes subscriptions: yes namespace: type: private separator: / location: mbox:~/mail/:INBOX=/var/mail/%u:INDEX=/srv/dovecot/indexes/%u.oldmail:CONTROL=/srv/dovecot/control/%u.oldmail inbox: yes list: yes subscriptions: yes auth default: worker_max_count: 20 passdb: driver: pam args: blocking=yes userdb: driver: passwd Greetings, -- Peter Orlowski

2 2

[Dovecot] MESSAGE Quota not RFC2087 compliant
by Braun, Martin 18 Nov '08

18 Nov '08

Hi, the configuration of my Dovecot 1.1.3 quota plugin looks like this: quota_rule = *:storage=1G quota_rule2 = *:messages=1337 this leads to the following GETQUOTAROOT response: 01 GETQUOTAROOT INBOX * QUOTAROOT "INBOX" "mbraun quota" * QUOTA "mbraun quota" (STORAGE 6553 1048576 MESSAGES 122 1337) 01 OK Getquotaroot completed. RFC2087 (http://www.faqs.org/rfcs/rfc2087.html) describes the response like as: STORAGE: Sum of messages' RFC822.SIZE, in units of 1024 octets MESSAGE: Number of messages As you can see, the response "MESSAGES" differs from the specified "MESSAGE" which leads to parsing issues on RFC compliant IMAP client implementations. Using *:message=1337 throws a configuration error on Dovecot startup. dovecot-1.1.6/src/plugins/quota/quota.h /* Number of messages. */ #define QUOTA_NAME_MESSAGES "MESSAGES" Greetings, Martin

2 1

[Dovecot] [PATCH] dovecot-1.2: fix build with Sun C compiler
by Andrey Panin 18 Nov '08

18 Nov '08

This small patch fixes dovecot-1.2 build with Sun C compiler.

1 0

[Dovecot] ManageSieve SECURITY hole: virtual users can edit scripts of other virtual users (all versions)
by Stephan Bosch 17 Nov '08

17 Nov '08

Hello, While updating the ManageSieve implementation to the latest draft specification I noticed a major omission in the way script names are handled. Essentially, script names are directly appended to the sieve storage directory path and suffixed with '.sieve'. This does not take the use of '../' in script names into account. Therefore, clever virtual users that know the directory structure of the server can read and edit script files of other virtual users with the same system uid. The added '.sieve' suffix prevents further security breach, because only sieve scripts are accessible this way. Note that of course any publicly accessible sieve script is also affected. I am sorry to report that this bug was introduced pretty much from the start, meaning that all versions of the ManageSieve patch/package are affected. To quickly resolve this issue, I provide patches against the existing releases and I release new versions for Dovecot v1.1 through v1.2. The security patches against the existing releases are very small and should therefore also apply to older versions or can be adjusted to apply cleanly with relative ease. The security patches are available as follows: http://www.rename-it.nl/dovecot/1.0/dovecot-1.0.15-managesieve-v9.3-securit… http://www.rename-it.nl/dovecot/1.0/dovecot-1.0.15-managesieve-v9.3-securit… http://www.rename-it.nl/dovecot/1.1/dovecot-1.1-managesieve-0.10.3-security… http://www.rename-it.nl/dovecot/1.1/dovecot-1.1-managesieve-0.10.3-security… http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.0-security… http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.0-security… The security patch for v1.0 is applied against the patched Dovecot tree, while patches for v1.1 and v1.2 are applied against the ManageSieve package. The new releases are available as follows (v1.1 and v1.2 versions have additional changes, read the NEWS files for more info): http://www.rename-it.nl/dovecot/1.0/dovecot-1.0.15-MANAGESIEVE-v9.4.diff.gz http://www.rename-it.nl/dovecot/1.0/dovecot-1.0.15-MANAGESIEVE-v9.4.diff.gz… http://www.rename-it.nl/dovecot/1.1/dovecot-1.1-managesieve-0.10.4.tar.gz http://www.rename-it.nl/dovecot/1.1/dovecot-1.1-managesieve-0.10.4.tar.gz.s… http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.1.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.1.tar.gz.s… Refreshed ManageSieve patches for v1.1 and v1.2 are available to avoid confusion, but an existing patched Dovecot should work fine. I hope package maintainers will quickly incorporate the security patches to get rid of this stupidity as soon as possible. Don't hesitate to notify me when there are problems! Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] Dovecot error with Symbian mail client
by jeeger＠thenybble.de 17 Nov '08

17 Nov '08

Greetings list, I have recently acquired an Nokia E71 (which comes with Symbian 3rd edition, feature pack 3 I believe). Accessing my emails has worked before, but now, I cannot connect to the mail server any longer. If I enable verbose_ssl, I get the following error in the log: SSL_accept() failed: error:140943F2:SSL routines:SSL3_READ_BYTES:sslv3 alert unexpected message [141.84.69.67] I cannot access my mail, the dialog just closes and the wireless connection ends. I am using dovecot version 1.0.13 and my config is # 1.0.13: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps ssl_cert_file: /etc/dovecot/dovecot.crt ssl_key_file: /etc/dovecot/dovecot.pem verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login auth default: passdb: driver: pam userdb: driver: passwd Thanks for your answers! Regards, Jan Seeger PS: I have tested the symbian client with gmail, and it works. So the problem is probably a bug in the communication between the symbian client and dovecot.

7 8

[Dovecot] store sieve scripts with maildir
by Samuel HAMEAU 17 Nov '08

17 Nov '08

Hi, I am using dovecot 1.0.10 and pysieved, in a master/slave cluster with ldap (auth_bind=yes). For conceptuals reasons, i would like to keep on the same partition the mailstore + sieve scripts. I have try to set "sieve" and "home" variables under the "plugin" section with an absolute path, and i have tried to override home variable in user_attrs (dovecot-ldap.conf) as well with an absolute path, but in vain. Is there a solution ? sam

3 6

[Dovecot] OT: Counting emails in IMAP folders
by Nigel Allen 17 Nov '08

17 Nov '08

Greetings I have a customer who has mail server running dovecot with an IMAP account (Customers) which contains hundreds of folders (one per customer). Looks like this: Customers Fred Smith and Co Joe Blogss Cust-1 Cust-n They have a requirement to report monthly on the total number of emails added to each customers' folder during the month. Basically I need to be able to run some kind of command line query that will give me each of the sub-folder names and the number of emails added to the folder for that month (or other user-specified time period). Any ideas please? TIA Nigel.

3 3

Re: [Dovecot] antispam plugin claims "antispam signature not found"
by Guillaume HILT 15 Nov '08

15 Nov '08

I have the same problem and i'm wondering how should i use this patch ? I'm not familiar with the patch command. Thanks. PS: Sorry for the empty mail Johannes Berg a écrit > On Tue, 2008-11-11 at 11:42 +0100, Johannes Berg wrote: > > >> Not sure, I personally think that moving them silently makes errors >> harder to diagnose. I'll add an option since then you can set this >> option (antispam_missing_signature = [error|move]) to move after you've >> tested and verified that it works just fine. >> > > Try this patch please, I have only compiled it so far. (there might be > rejects in the signature-log.c file unless you update to the current git > tree but you don't care about that) > > diff --git a/antispam.7 b/antispam.7 > index d07c1d0..e26db69 100644 > --- a/antispam.7 > +++ b/antispam.7 > @@ -108,6 +108,13 @@ plugin { > # mail signature (used with any backend requiring a signature) > antispam_signature = X-DSPAM-Signature > > + # action to take on mails without signature > + # (used with any backend requiring a signature) > + # (we recommend only setting this to 'move' after verifying that the > + # whole setup is working) > + # antispam_signature_missing = move # move silently without training > + antispam_signature_missing = error > + > # semicolon-separated list of Trash folders (default unset i.e. none) > # antispam_trash = > # antispam_trash = trash;Trash;Deleted Items > diff --git a/signature-log.c b/signature-log.c > index ab8cd6d..5b7b306 100644 > --- a/signature-log.c > +++ b/signature-log.c > @@ -99,7 +99,12 @@ int backend_handle_mail(struct mailbox_transaction_context *t, > return -1; > } > > - signature = signature_extract(t, mail); > + ret = signature_extract(t, mail, &signature); > + if (ret) > + return ret; > + > + if (!signature) > + return 0; > > switch (wanted) { > case CLASS_SPAM: > diff --git a/signature.c b/signature.c > index 7f9d83b..7ad29d6 100644 > --- a/signature.c > +++ b/signature.c > @@ -5,6 +5,7 @@ > #include "mail-storage-private.h" > > const char *signature_hdr = "X-DSPAM-Signature"; > +static int signature_nosig_ignore = 0; > > void signature_init(void) > { > @@ -12,6 +13,16 @@ void signature_init(void) > if (tmp) > signature_hdr = tmp; > debug("signature header line is \"%s\"\n", signature_hdr); > + > + tmp = get_setting("SIGNATURE_MISSING"); > + if (!tmp) > + tmp = "error"; > + if (strcmp(tmp, "move") == 0) { > + signature_nosig_ignore = 1; > + debug("will silently move mails with missing signature\n"); > + } else if (strcmp(tmp, "error") != 0) { > + debug("invalid signature_missing setting '%s', ignoring\n", tmp); > + } > } > > int signature_extract_to_list(struct mailbox_transaction_context *t, > @@ -23,10 +34,14 @@ int signature_extract_to_list(struct mailbox_transaction_context *t, > > signatures = get_mail_headers(mail, signature_hdr); > if (!signatures || !signatures[0]) { > - mail_storage_set_error(t->box->storage, > - ME(NOTPOSSIBLE) > - "antispam signature not found"); > - return -1; > + if (!signature_nosig_ignore) { > + mail_storage_set_error(t->box->storage, > + ME(NOTPOSSIBLE) > + "antispam signature not found"); > + return -1; > + } else { > + return 0; > + } > } > > while (signatures[1]) > @@ -42,23 +57,30 @@ int signature_extract_to_list(struct mailbox_transaction_context *t, > return 0; > } > > -const char *signature_extract(struct mailbox_transaction_context *t, > - struct mail *mail) > +int signature_extract(struct mailbox_transaction_context *t, > + struct mail *mail, const char **signature) > { > const char *const *signatures; > > signatures = get_mail_headers(mail, signature_hdr); > if (!signatures || !signatures[0]) { > - mail_storage_set_error(t->box->storage, > - ME(NOTPOSSIBLE) > - "antispam signature not found"); > - return NULL; > + if (!signature_nosig_ignore) { > + mail_storage_set_error(t->box->storage, > + ME(NOTPOSSIBLE) > + "antispam signature not found"); > + return -1; > + } else { > + *signature = NULL; > + return 0; > + } > } > > while (signatures[1]) > signatures++; > > - return signatures[0]; > + *signature = signatures[0]; > + > + return 0; > } > > void signature_list_free(struct siglist **list) > diff --git a/signature.h b/signature.h > index e25d1b5..1384924 100644 > --- a/signature.h > +++ b/signature.h > @@ -16,8 +16,8 @@ void signature_init(void); > int signature_extract_to_list(struct mailbox_transaction_context *t, > struct mail *mail, struct siglist **list, > enum classification wanted); > -const char *signature_extract(struct mailbox_transaction_context *t, > - struct mail *mail); > +int signature_extract(struct mailbox_transaction_context *t, > + struct mail *mail, const char **signature); > void signature_list_free(struct siglist **list); > > extern const char *signature_hdr; > > This message contains information that may be privileged or confidential and is the property of the Capgemini Group. It is intended only for the person to whom it is addressed. If you are not the intended recipient, you are not authorized to read, print, retain, copy, disseminate, distribute, or use this message or any part thereof. If you receive this message in error, please notify the sender immediately and delete all copies of this message.

2 4

Re: [Dovecot] [dspam-users] mysql fetch row error
by Marko Weber 15 Nov '08

15 Nov '08

Hi Steve, MTA = Postfix I have amavis - spamassassin - dspam installed. i think spamassassin scnas after dspam, cuase in the mail headers dspam comes at first. I use Dovecot as Imap Server OS = Gentoo Linux i put the config of dspam here = http://rafb.net/p/VCX8XO97.html if u need more confs just tell me , i can paste then marko Steve schrieb: > Hallo Marko > > This is not normal. DSPAM does not add the encoding. It must be something else you are using/doing to get that tagged with the encoding in front of every DSPAM tag. And I don't see the DSPAM signature in your header. This is not normal. If you have the other DSPAM header lines, then you should have the result as well. > > What MTA are you using? > How is the integration between MTA and DSPAM? > Do you have other filters running before and after DSPAM? > What IMAP server are you using? > What OS are you using? > Could you post your DSPAM config? > > > (Grüsse aus Zürich) > > // Steve > > -------- Original-Nachricht -------- > >> Datum: Sat, 15 Nov 2008 10:37:38 +0100 >> Von: Marko Weber <weber(a)zackbummfertig.de> >> An: "dspam-users(a)lists.nuclearelephant.com" <dspam-users(a)lists.nuclearelephant.com> >> Betreff: Re: [dspam-users] mysql fetch row error >> > > >> Hello Steve this is the "full" Header of a spam mail where the training >> also fails. >> withe the mysql fetch error............. >> >> marko >> >> >> Return-Path: <RoxieastronomerMyrick(a)fightingbobfest.org> >> X-Original-To: weber(a)salonwebserver.de >> Delivered-To: weber(a)salonwebserver.de >> Received: from localhost (localhost [127.0.0.1]) >> by salonwebserver.de (Postfix) with ESMTP id 02C8613BC09B >> for <weber(a)salonwebserver.de>; Fri, 14 Nov 2008 21:38:09 +0100 >> (CET) >> X-DSPAM-Result: =?iso-8859-1?Q?Spam=0D?= >> X-DSPAM-Confidence: =?iso-8859-1?Q?0.7177=0D?= >> X-DSPAM-Probability: =?iso-8859-1?Q?1.0000=0D?= >> ?iso-8859-1?Q?491de1b0254959695846858=0D?= >> X-DSPAM-Factors: 15, >> X-Virus-Scanned: amavisd-new at salonwebserver.de >> X-Spam-Flag: NO >> X-Spam-Score: 2.415 >> X-Spam-Level: ** >> X-Spam-Status: No, score=2.415 tagged_above=-1000 required=2.5 >> tests=[DNS_FROM_SECURITYSAGE=0.127, RCVD_IN_BL_SPAMCOP_NET=2.188, >> RDNS_DYNAMIC=0.1] >> Received: from salonwebserver.de ([127.0.0.1]) >> by localhost (kraftwerk1.salonwebserver.de [127.0.0.1]) >> (amavisd-new, port 10024) >> with ESMTP id nOQQilMNvp-o for <weber(a)salonwebserver.de>; >> Fri, 14 Nov 2008 21:38:07 +0100 (CET) >> Received: from zackbummfertig.de >> (static.243.42.46.78.clients.your-server.de [78.46.42.243]) >> (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) >> (No client certificate requested) >> by salonwebserver.de (Postfix) with ESMTPS id E86BD13BC078 >> for <weber(a)salonwebserver.de>; Fri, 14 Nov 2008 21:38:06 +0100 >> (CET) >> Received: from localhost (localhost [127.0.0.1]) >> by zackbummfertig.de (Postfix) with ESMTP id BC4BDECC067 >> for <weber(a)salonwebserver.de>; Fri, 14 Nov 2008 21:37:46 +0100 >> (CET) >> X-Virus-Scanned: amavisd-new at zackbummfertig.de >> Received: from zackbummfertig.de ([127.0.0.1]) >> by localhost (weberweb.zackbummfertig.de [127.0.0.1]) >> (amavisd-new, port 10024) >> with ESMTP id xr6ayW0lyDGC for <weber(a)salonwebserver.de>; >> Fri, 14 Nov 2008 21:37:43 +0100 (CET) >> Received: from rachel22b12579 (unknown [78.146.113.186]) >> by zackbummfertig.de (Postfix) with SMTP id 3E83CECC040 >> for <tbmarcom(a)acidbunker.de>; Fri, 14 Nov 2008 21:37:43 +0100 >> (CET) >> Date: Fri, 14 Nov 2008 20:38:01 +0000 >> From: Chrystal Huddleston <RoxieastronomerMyrick(a)fightingbobfest.org> >> Subject: gambling slot machines >> To: tbmarcom(a)acidbunker.de >> Message-id: <7686026460.20081111151378(a)fightingbobfest.org> >> Organization: fightingbobfest.org >> MIME-version: 1.0 >> Content-type: text/plain; charset=us-ascii >> Content-transfer-encoding: 7bit >> X-Priority: 3 (Normal) >> >> Steve schrieb: >> >>> Can you post the full header of the message in question? >>> >>> >>> -------- Original-Nachricht -------- >>> >>> >>>> Datum: Fri, 14 Nov 2008 23:18:39 +0100 >>>> Von: Marko Weber <weber(a)zackbummfertig.de> >>>> An: "dspam-users(a)lists.nuclearelephant.com" >>>> >> <dspam-users(a)lists.nuclearelephant.com> >> >>>> Betreff: Re: [dspam-users] mysql fetch row error >>>> >>>> >>> >>> >>>> Hi Steve, >>>> this sed thing dont worked for me...... sorry >>>> how i can get dspam working without this mysql fetch error ? >>>> u have any hints ? >>>> >>>> marko >>>> >>>> >>>> Steve schrieb: >>>> >>>> >>>>> -------- Original-Nachricht -------- >>>>> >>>>> >>>>> >>>>>> Datum: Fri, 14 Nov 2008 18:11:55 +0100 >>>>>> Von: Marko Weber <weber(a)zackbummfertig.de> >>>>>> An: "dspam-users(a)lists.nuclearelephant.com" >>>>>> >>>>>> >>>> <dspam-users(a)lists.nuclearelephant.com> >>>> >>>> >>>>>> Betreff: [dspam-users] mysql fetch row error >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> >>>>>> Hello to all in the Mailinglist, >>>>>> >>>>>> i installed dspam on our server and it works so far that incoming >>>>>> >> mails >> >>>>>> are tagged by dspam. >>>>>> i installed "dovecot-antispam" for retraining. >>>>>> when in try to retrain a mail i get this in the dspam.debug log = >>>>>> >>>>>> 9056: [11/14/2008 15:23:01] mysql_fetch_row() failed in >>>>>> >>>>>> >>>> _ds_get_signature >>>> >>>> >>>>>> in the /var/log/messages log i get this = >>>>>> >>>>>> Nov 14 15:29:25 kraftwerk1 imap: antispam: /usr/bin/dspam >>>>>> >>>>>> >>>> --source=error >>>> >>>> >>>>>> --class=spam --signature==?iso-8859-1?Q?491d76cb23581804284693=0D?= >>>>>> >> ... >> >>>>>> Nov 14 15:29:25 kraftwerk1 dspam[9189]: Signature retrieval for >>>>>> '=?iso-8859-1?Q?491d76cb23581804284693=0D?=' failed >>>>>> Nov 14 15:29:25 kraftwerk1 dspam[9189]: Unable to find a valid >>>>>> signature. Aborting. >>>>>> Nov 14 15:29:25 kraftwerk1 dspam[9189]: process_message returned >>>>>> >> error >> >>>>>> -5. dropping message. >>>>>> >>>>>> >>>>>> but when i search for the signatur 491d76cb23581804284693 in the >>>>>> >> mysql >> >>>>>> database i can find it there. >>>>>> >>>>>> what is this ?iso-8859-1?Q? , is this causing the error ? >>>>>> >>>>>> >>>>>> >>>>>> >>>>> This means, that the plugin developer used the signature from the body >>>>> >>>>> >>>> instead of the one found in the header. You can verify yourself what >>>> >> the >> >>>> proper signature would be. Just issue this small one liner in sed: >>>> >>>> >>>>> sed -e '/^$/q' -ne 's/^X\-DSPAM\-Signature: >>>>> >>>>> >>>> $\([1-9][0-9]*,$\{0,1\}$[a-f0-9]\{20,32\}$\)$/\1/p' >>>> >> /path/to/your/message >> >>>> >>>> >>>>> This should print out the proper signature DSPAM should receive from >>>>> >> the >> >>>>> >>>>> >>>> plugin. The iso-8859-1 part indicates to me that the message is taken >>>> >> from >> >>>> a iso8859-1 encoded message body. >>>> >>>> >>>>> >>>>> >>>>> >>>>>> do any1 need my dspam.conf , then i can paste it on web. >>>>>> >>>>>> thank for helping. >>>>>> >>>>>> marko >>>>>> >>>>>> >>>>>> >>>>>> >>>>> Steve >>>>> >>>>> >>>>> >>>>> >>>>> >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> >>>> >>>> >>> >>> >> >> > >

2 1

[Dovecot] Mailbox Hashing
by Justin Krejci 14 Nov '08

14 Nov '08

First off, the website documentation is really good for Dovecot but while reading I was not able to find anything pertaining to inbox hashing for Maildirs. I saw plenty about hashing the directories that the user mailboxes live in but nothing about specifically hashing an individual user's inbox directory itself. Is there any method for hashing the inbox automatically after say 5,000 messages are stored? Example $Maildir/in/0/message0 $Maildir/in/0/message1 $Maildir/in/0/message2 . $Maildir/in/0/message4999 $Maildir/in/1/message5000 $Maildir/in/1/message5001 etc I am not currently using Dovecot but am interested to know if this is available or does running with 20,000+ messages in a single inbox not affect the performance much? I have looked into other file system tuning techniques such as enabling ext3 dir_index or using ReiserFS (maybe not ReiserFS anymore). There will likely be 15,000 to 20,000 accounts spread out on one or more servers using a 6-drive RAID10 setup. Most accounts are not expected to have high message quantities but there will be lots of concurrent connections via pop and imap (and webmail imap). Any suggestions or feedback would be appreciated.

3 6

Re: [Dovecot] Install Configuring and run.
by Marko Weber 14 Nov '08

14 Nov '08

Hello Thorsten, i got "dovecot-antispam" working now. also moving mails now fully work. but retraining dont seems to work fully. emails that are delivered to mailbox are scanned with user "clamav" 28799: [11/13/2008 23:26:25] DSPAM Instance Startup 28799: [11/13/2008 23:26:25] input args: /usr/bin/dspam --stdout --deliver=spam,innocent --mode=tum --tokenizer=chained,noise --enable-signature-headers --user clamav 28799: [11/13/2008 23:26:25] pass-thru args: --tokenizer=chained,noise --enable-signature-headers 28799: [11/13/2008 23:26:25] processing user clamav 28799: [11/13/2008 23:26:25] uid = 105, euid = 105, gid = 449, egid = 1000 28799: [11/13/2008 23:26:25] loading preferences for user clamav 28799: [11/13/2008 23:26:25] Loading preferences for uid 1 i dont have a maildrop filter ready yet that move spam tagged mails into SPAM folder. all is delivered to "incoming". when i now move the mail to SPAM; this is done by user "postfix" 28917: [11/13/2008 23:40:17] DSPAM Instance Startup 28917: [11/13/2008 23:40:17] input args: /usr/bin/dspam --source=error --class=spam --signature==?iso-8859-1?Q?1,491930ac25229173225906=0D?= 28917: [11/13/2008 23:40:17] pass-thru args: 28917: [11/13/2008 23:40:17] processing user postfix 28917: [11/13/2008 23:40:17] uid = 207, euid = 207, gid = 207, egid = 1000 28917: [11/13/2008 23:40:17] loading preferences for user postfix 28917: [11/13/2008 23:40:17] Loading preferences for uid 6 28917: [11/13/2008 23:40:17] Loading preferences for uid 0 28917: [11/13/2008 23:40:17] Loading preferences for uid 0 28917: [11/13/2008 23:40:17] default preferences empty. reverting to dspam.conf preferences. 28917: [11/13/2008 23:40:17] Loading preferences from dspam.conf 28917: [11/13/2008 23:40:17] using /var/spool/dspam/opt-in/local/postfix.dspam as path 28917: [11/13/2008 23:40:17] using /var/spool/dspam/opt-out/local/postfix.nodspam as path 28917: [11/13/2008 23:40:17] sedation level set to: 0 28917: [11/13/2008 23:40:17] DSPAM Instance Shutdown. Exit Code: 0 Now when i move the mail again into incoming (also done by user postfix), the mail dont get tagged with "innocent" , it is still tagged "spam". How do i get it work all under "clamav" and why are the removed mails from spam to incoming not tagged with "inncoent" ? (do you need any logs?) thank you marko Thorsten Vollmer schrieb: > On Thu, 2008-11-13 at 21:30 +0100, Marko Weber wrote: > >> Sorry to ask, >> so if dovecot-antispam-20080829 dont work for me you mean i should >> install the latest from webpage ? >> > > Yes, dovecot-antispam-1.1 should be sufficient. I already sent you the > link to an updated ebuild. Please be more proactive. > > Thorsten > >

2 6

[Dovecot] Folder aliases
by Daniel L. Miller 14 Nov '08

14 Nov '08

I don't if this has been discussed before - or already implemented - but it would be great if I could define one or more "aliases" for a folder. A particular example might be "Sent" where different (badly-written) clients might have hard-coded "Sent" folder locations like "Sent", "Sent Items", "Sent Mail", "Mail Delivered", etc. - and I'd love to get those consolidated. It would also be nice to show a different set of folders based on the client - or if that's not possible (if the client doesn't identify itself as part of the login sequence) then somehow via login name - maybe by an extension? So where my usual login might be "user(a)domain.com", and that would continue to be supported as the default login, I could now have "user(a)domain.com+thunderbird", "user(a)domain.com+mobile", etc.? -- Daniel

6 10

Re: [Dovecot] Install Configuring and run.
by Marko Weber 13 Nov '08

13 Nov '08

Sorry to ask, so if dovecot-antispam-20080829 dont work for me you mean i should install the latest from webpage ? Thorsten Vollmer schrieb: > On Thu, 2008-11-13 at 00:24 +0100, Marko Weber wrote: > >> Hello Thorsten thank you for taking time. >> I recompiled with -debug, but i also had to set -syslog >> otherwise gentoo dont compile. it says then , "useflag syslog enabled >> needs flag debug also set" >> >> we proceed further in the list then ? >> > > Yes, once you have new results. > > If dovecot-antispam-20080829 does not yet work for you, please try the > latest version and re-enable debugging. > > Thorsten > >

1 0

[Dovecot] New Dovecot server buildout review
by David Jonas 13 Nov '08

13 Nov '08

Hello Everyone, I have the opportunity to do a new mail system build out for about 20k email boxes over a few hundred domains. I already run a system like this, but this time I can do it right :). My thought on storage is to have a 12 drive JBOD system attached via SAS to a 3ware 9690SA raid controller. Drives would be RAID'd (10 or 5) to appear as one for message storage. Dovecot would run on that box and deliver directly from postfix. POP and IMAP connections would come in directly (no proxy). Postfix head boxes in front of this do anti-virus and spamassassin, so this box won't be doing any heavy crunching, just delivery and serving of messages. Does this sound reasonable? Is there details that I'm missing? An obvious bottleneck I'm overlooking? Is anyone running a similar config with success? It all sounds very standard, but I haven't run something like this before. Thanks for the help! David

1 0

[Dovecot] Moving mail between folders
by Ilo Lorusso 13 Nov '08

13 Nov '08

Hi, Ive just installed Dovecot and postfix and Ive created a whole bunch of folders and started moving my mail around. Ive noticed that it copies the mail to the folder I wish to move the mail to and leave the original message waiting to be purged in the original folder Is there a way to have dovecot delete it straight after it has been moved? as I don't think users are going to take well to this change? any help would be appreciated Thanks, Ilo.

3 2

[Dovecot] dovecot pop3 performance, what size installation
by Brandon Lamb 13 Nov '08

13 Nov '08

Hello, I was wondering if anyone could tell me their results and maybe help me get an idea how big our mail system installation and usage is. For dovecot pop3 and nfs backend, I am curious how many machines I should expect to need. Here are my stats for what I can tell. 5-7 connections per second average, 8-12 connections per second peak. 30-50 constant connections between 3 servers (8-20+) on each server. We are servicing about 14,000+ email accounts. These are just the pop3 login stats, a lot of users use both or imap through our webmail. My question I guess is whether this is on the small side, medium or larger side mail setup, and should I be thinking that only 1 or 2 servers should be able to handle the load. Right now I am splitting it between 3. Should a single quad core box be able to handle this? Not sure if this is a simple question or not. Im not including my dovecot -n just because this is more of a generic question.

1 0

[Dovecot] removing uid, index and cache files
by Lars Uhlmann 13 Nov '08

13 Nov '08

Since a couple of days we're facing a problem with dovecot/MUA and multiple appeareances of single mails. The mail is physical existant only once but outlook shows it twice or more times. Then after some minutes these multiple "virtual" mails just disappear. Because this happens with different MUAs (Outlook and Thunderbid) I assume dovecot causes the problem. All mail are received by »getmail« from outside via POP3 and delivered to the users local Maildir. This was working without problems for over a year now. Is it save to remove to following files (will dovecot rebuild them) from every users Maildir? dovecot.index dovecot.index.cache dovecot.index.log dovecot.index.log.2 dovecot-uidlist Thahks in advance, Lars

3 4

[Dovecot] Sieve authentication / directory issue after upgrade to 1.0.13.
by Drew Calcott 12 Nov '08

12 Nov '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi everyone, I have come across a problem after upgrading from 1.0.rc17 to 1.0.13 (debian builds 1.0.13 is from etch-backports). I initially upgraded as 1.0.rc17 isn't compiled with regex support, so vacation messages that were uploaded via horde were being rejected. (Everything else was working fine, just messages that required regex functions were failing). Horde is uploading the filters via pysieved, which is then in turn placing them in the directory of: - --------- /shared/spool/active/%d/%0.1u/%1.1u/%n/sieve/ingo - --------- At least, it was previously. Since upgrading, dovecot has changed the way it passes authentication details to pysieved and the domain is no longer included in the username, so the domain cannot be parsed and pysieved fails as it is unable to strip a value for %d. (as a quick aside, this isn't an issue with single domain servers as there is a "defaultdomain" option that will force the value for %d, however, since we have 9 domains to deal with, this isn't going to cut it). Prior to upgrade, authentication was passed as thus (= are a new line in case the formatting dies) - -------- ======= > 'AUTH\t1\tPLAIN\tservice=pysieved\tresp=YWNhbD* restofstring * ====== < OK\t1\tuser=acal030(a)sit.auckland.ac.nz\tuser=acal030\t\n' ===== Finished SASL authentication : {'username':'acal030(a)sit.auckland.ac.nz', 'result': 'OK'} ===== Plugin returned home :'/shared/spool/active/sit.auckland.ac.nz/a/c/acal030/' = Authenticated user acal030(a)sit.auckland.ac.nz - -------- Both user and user@domain were being passed and it was a matter of simple nagging of the pysieved guys to update their code to strip the required information. However, the new version is passing auth like this: - -------- ======= > 'AUTH\t1\tPLAIN\tservice=pysieved\tresp=YWNhbD* restofstring * ======= < 'OK\t1\tuser=acal030\n' ===== Finished SASL authentication : {'username': 'acal030', 'result': 'OK'} ===== Plugin returned home : '/shared/spool/active//a/c/acal030/' - ------- The only change to the dovecot config I have made is to add "allow_all_users=yes" to userdb static as the new version was a lot stricter about the passdb pam lookup not containing the user data (and failing completely as a result). In the dovecot logs themselves, the following lines were from the earlier build: - ------ Info: auth(default): client out: OK 1 user=acal030(a)sit.auckland.ac.nz user=acal030 Info: auth(default): master in: REQUEST 243 23994 1 Info: auth(default): master out: USER 243 acal030(a)sit.auckland.ac.nz home=/blah, mail=/blah etc. - ------ Compared to this from the new one: - ------ Info: auth(default): auth(acal030(a)sit.auckland.ac.nz,130.216.39.182): username changed acal030(a)sit.auckland.ac.nz -> acal030 Info: auth(default): client out: OK 1 user=acal030 Info: auth(default): prefetch(acal030,130.216.39.182): success Info: auth(default): master out: USER 2 acal030 home=/blah, mail=/blah etc. - ------ I am rather at the end of my tether with this, unfortunately. :( I have browsed through many wiki pages looking for a possible solution or config variable I may have missed, but I really am coming up dry. Cleaned up dovecot.conf is at: http://pastebin.com/m7f4303af Should anyone want strace logs or whatever, I'm more than happy to make with them. Thanks in advance for any assistance. Regards, - --- Drew Calcott Science IT University of Auckland (p) +64 9 373 7599 x84269 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkkaWWQACgkQD+yXTWfduLFGmACfW3XXNFLu8zhHUz8FeU+QqgmX pg4An3SdPh0OyWHGBe9k/qWzjqFRJmBl =fIMA -----END PGP SIGNATURE-----

1 1

[Dovecot] dovecot 1.2 link error
by Axel Schmalowsky 12 Nov '08

12 Nov '08

Hello list, I need/want to build imaptest -- and I can only build it against at least dovecot 1.2 . dovecot 1.2 actually builds just fine but at the end I get the following linker error: /bin/sh ../../libtool --tag=CC --mode=link gcc -std=gnu99 -O2 -pipe -std=gnu99 -Wall -ftree-dce -ftree-dse -ftree-loop-optimize -ftree-loop-linear -I/usr/lib/gcc/i386-redhat-linux/4.1.1/include -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -Wl,-z -Wl,compreloc -Wl,-z -Wl,norelro -o imap -export-dynamic cmd-append.o cmd-capability.o cmd-cancelupdate.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-enable.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-id.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o cmd-x-cancel.o client.o commands.o commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-search.o imap-sort.o imap-status.o imap-sync.o mail-storage-callbacks.o main.o ../../src/lib-storage/register/libstorage-register.a ../../src/lib-storage/list/libstorage_list.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-storage/libstorage.a ../../src/lib-index/libindex.a ../../src/lib-imap/libimap.a ../../src/lib-mail/libmail.a ../../src/lib-auth/libauth.a ../../src/lib-charset/libcharset.a ../../src/lib/liblib.a ../lib-dict/libdict.a ../lib/mountpoint.o -export-dynamic -ldl mkdir .libs gcc -std=gnu99 -O2 -pipe -std=gnu99 -Wall -ftree-dce -ftree-dse -ftree-loop-optimize -ftree-loop-linear -I/usr/lib/gcc/i386-redhat-linux/4.1.1/include -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -Wl,-z -Wl,compreloc -Wl,-z -Wl,norelro -o imap cmd-append.o cmd-capability.o cmd-cancelupdate.o cmd-check.o cmd-close.o cmd-copy.o cmd-create.o cmd-delete.o cmd-enable.o cmd-examine.o cmd-expunge.o cmd-fetch.o cmd-id.o cmd-idle.o cmd-list.o cmd-logout.o cmd-lsub.o cmd-namespace.o cmd-noop.o cmd-rename.o cmd-search.o cmd-select.o cmd-sort.o cmd-status.o cmd-store.o cmd-subscribe.o cmd-thread.o cmd-uid.o cmd-unselect.o cmd-unsubscribe.o cmd-x-cancel.o client.o commands.o commands-util.o imap-expunge.o imap-fetch.o imap-fetch-body.o imap-search.o imap-sort.o imap-status.o imap-sync.o mail-storage-callbacks.o main.o ../lib/mountpoint.o -Wl,--export-dynamic ../../src/lib-storage/register/libstorage-register.a ../../src/lib-storage/list/libstorage_list.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-storage/libstorage.a ../../src/lib-index/libindex.a ../../src/lib-imap/libimap.a ../../src/lib-mail/libmail.a ../../src/lib-auth/libauth.a ../../src/lib-charset/libcharset.a ../../src/lib/liblib.a ../lib-dict/libdict.a -ldl ../../src/lib-storage/register/libstorage-register.a(mailbox-list-register.o): In function `mailbox_list_register_all': mailbox-list-register.c:(.text+0x2d): undefined reference to `shared_mailbox_list' collect2: ld returned 1 exit status make[3]: *** [imap] Error 1 make[3]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3/src/imap' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/root/compile/imaptest/current/dovecot-1.2.alpha3' make: *** [all] Error 2 does anyone have an idea as to how to get rid of it? thanks in advance ;) -- Freundliche Grüße / Kind regards Axel Schmalowsky Platform Engineer ___________________________________ domainfactory GmbH Oskar-Messter-Str. 33 85737 Ismaning Germany Telefon: +49 (0)89 / 55266-356 Telefax: +49 (0)89 / 55266-222 E-Mail: aschmalowsky(a)df.eu Internet: www.df.eu Registergericht: Amtsgericht München HRB 150294, Geschäftsführer Tobias Marburg, Jochen Tuchbreiter

2 2

[Dovecot] Dovecot master process
by Steven F Siirila 12 Nov '08

12 Nov '08

We are running into a situation where Dovecot master is simply trying to do too much. It some situations, we are finding that there are times in which it cannot service requests. Restarting Dovecot seems to help in these situations, possibly due to the fact that it no longer has to manage its THOUSANDS of file descriptors for pipes to the many imap/proxy processes that it uses for logging. Is there a way to turn off logging through the master process (in exchange for lesser security)? If not, would it be easy to have the master process do its logging using separate threads (which would help on some modern hardware)? Finally, would it be easy to delegate the task of logging to a dedicated process? We are still running Dovecot 1.0.0 at this time, on Solaris 10 servers. -- Steven F. Siirila Office: WBOB, 621F Internet Services E-mail: sfs(a)umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593

3 2

[Dovecot] Error: Maximum number of mail processes exceeded
by Antonio Casado Rodríguez 12 Nov '08

12 Nov '08

Hi, i don't know. Is normal login_max_processes_count > 1024?? Our environment is about 1700 users (imaps + thunderbird or imaps+horde). The server is RedHat Enterprise Linux 5.2 User logins different in a hour: # cat dovecot.info | grep 'Nov 11 10' | grep "login: Login" | cut -d'<' -f2 | cut -d'>' -f1 | sort | uniq | wc -l 685 Logins in a hour: # cat dovecot.info | grep 'Nov 11 10' | grep "login: Login" | wc -l 5749 Is normal?? Should i increment login_max_processes_count? # dovecot -n # 1.0.13: /etc/dovecot.conf log_path: /Correo/log/dovecot/dovecot.log info_log_path: /Correo/log/dovecot/dovecot.info protocols: imaps pop3 managesieve ssl_cert_file: /etc/pki/dovecot/certs/mycert.crt ssl_key_file: /etc/pki/dovecot/private/mycert.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login login_process_per_connection: no login_max_processes_count: 1024 first_valid_uid: 200 mail_location: maildir:%h/.. mail_executable(default): /usr/local/sbin/post-login-imap-dovecot mail_executable(imap): /usr/local/sbin/post-login-imap-dovecot mail_executable(pop3): /usr/local/sbin/post-login-pop3-dovecot mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 mail_plugin_dir(managesieve): /usr/lib64/dovecot/managesieve imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle imap_client_workarounds(managesieve): outlook-idle sieve_storage(default): sieve_storage(imap): sieve_storage(pop3): sieve_storage(managesieve): ~/sieve sieve(default): sieve(imap): sieve(pop3): sieve(managesieve): ~/.dovecot.sieve namespace: type: private separator: / location: maildir:%h/.. inbox: yes auth default: passdb: driver: pam userdb: driver: passwd plugin: quota: maildir:storage=1048576

2 2

Re: [Dovecot] Install Configuring and run.
by Marko Weber 12 Nov '08

12 Nov '08

Hello Thorsten , sorry then again ........ details: i got dspam working, it now scans incoming mails and tag them in the headers. X-DSPAM-Result: = Spam X-DSPAM-Confidence: = 0.9984 X-DSPAM-Probability: = 1.0000 X-DSPAM-Signature: = 1,491930ac25229173225906 X-DSPAM-Factors: 15, so far okay. i emerged dovecot-antispam. and thought its easy going , just paste the code snippet of man dovecot-antispam to the imap section in the dovecot.conf . but thats not all i think. i thought now, when moving a mail from incoming to SPAM something happens, but despam.dbug and /var/log/messages dont show anything happen. i did this in the dovecot.conf = mail_plugins = antispam mail_plugin_dir = /usr/lib/dovecot/imap plugin { antispam_trash = trash;Trash;Deleted Items;Deleted Messages antispam_spam = SPAM;Spam antispam_dspam_binary = /usr/bin/dspam antispam_dspam_args = --user;%u } but as told above , moving mails into folder SPAM or from SPAM to incoming dont causes any action the log.files when i retstart dovecot i got following output on screen = /etc/init.d/dovecot restart Warning: Growing pool 'settings' with: 8192 * Stopping dovecot ... [ ok ] Warning: Growing pool 'settings' with: 8192 * Starting dovecot ... Warning: Growing pool 'settings' with: 8192 ILoading modules from directory: /usr/lib/dovecot/imap WGrowing pool 'module loader' with: 2048 IModule loaded: /usr/lib/dovecot/imap/lib90_antispam_plugin.so IEffective uid=65534, gid=65534, home= WGrowing pool 'antispam-pool' with: 2048 [ ok ] dovecot is running after restart and fully working, accepting mails , sending mails all oke. dunno if i told before to you, i use postfix-dovecot-mysql setup, virtual users & domains if you need any other config file or info lemme know. i really want this nice tool to get working. thank you marko Thorsten Vollmer schrieb: > On Sun, 2008-11-09 at 15:15 +0100, Marko Weber wrote: > >> Hello Thorsten, >> i sorted out to get dspam working, >> but it tags too much mails as spam, even mials that are not spam, >> >> now thats the poinzt where dovecot-antispam comes in, >> now my idea is, that mails that get "spam" tag by dspam, >> to retrain by "dovecot-antispam". >> but i dont get thru it. >> maybe this is now the pont where you can help me ? >> > > Asking for help without providing any detail is rather pointless. > > Thorsten > >

2 2

[Dovecot] alternate passwd/shadow
by Jorg B. 12 Nov '08

12 Nov '08

I'm using an alternate password/shadow combo to authenticate IMAP users and I can't seen to get it working... I'm using: passdb shadow { args = /etc/dovecot/shadow } Can somebody please give me some hints on how to get this to work.... Thanks JB

2 3

[Dovecot] dovecot-antispam crm114 config
by Peter Fern 12 Nov '08

12 Nov '08

Hi list, Does anyone have a working crm114 config for dovecot-antispam? I have mailreaver running perfectly otherwise, but it doesn't seem to be called correctly from dovecot-antispam - the css files show no change. Piping a message to the command... `/usr/share/crm114/mailreaver.crm --good -u /shared/domains/domain.tld/users/pfern/.crm/` works as expected, and the logs don't indicate anything useful that I can see as to why it isn't working from dovecot. Log follows: Nov 11 12:56:48 mx0 dovecot: imap-login: Login: user=<pfern(a)domain.tld>, method=PLAIN, rip=xxx.xxx.xxx.xxx, lip=xxx.xxx.xxx.xxx, TLS Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): Loading modules from directory: /usr/lib64/dovecot/imap Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): Module loaded: /usr/lib64/dovecot/imap/lib90_antispam_plugin.so Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): Effective uid=xxxxx, gid=xxxxx, home=/shared/domains/domain.tld/users/pfern Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: plugin initialising (unknown) Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "trash" is trash folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "Trash" is trash folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "Deleted Items" is trash folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "-SPAM-" is spam folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: "-UNSURE-" is unsure folder Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: reaver binary set to /usr/share/crm114/mailreaver.crm Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: reaver extra arg -u Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: reaver extra arg /shared/domains/domain.tld/users/pfern/.crm/ Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: signature header line is "X-CRM114-CacheID" Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): maildir: data=/shared/domains/domain.tld/users/pfern/.maildir:INDEX=/var/lib/dovecot/indexes/domain.tld/p/pfern Nov 11 12:56:48 mx0 dovecot: IMAP(pfern(a)domain.tld): maildir++: root=/shared/domains/domain.tld/users/pfern/.maildir, index=/var/lib/dovecot/indexes/domain.tld/p/pfern, control=, inbox=/shared/domains/domain.tld/users/pfern/.maildir Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_unsure(INBOX.Noojee): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_trash(-UNSURE-): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_trash(INBOX.Noojee): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mail copy: from trash: 0, to trash: 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_spam(-UNSURE-): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_spam(INBOX.Noojee): 0 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mailbox_is_unsure(-UNSURE-): 1 Nov 11 12:56:56 mx0 dovecot: IMAP(pfern(a)domain.tld): antispam: mail copy: src spam: 0, dst spam: 0, src unsure: 1

3 4

[Dovecot] dovecot permissions
by Fernando 11 Nov '08

11 Nov '08

Hello list, I would like to configure POP3 email such that user "mark" (only) must be able to retrieve email from my machine using POP3 from within mydomain.com Any ideas?

1 1

[Dovecot] How to specify /var/spool/mail/m/i/mike
by Network Operations 11 Nov '08

11 Nov '08

I was wondering if somebody could tell me how I can tell dovecot (IMAP) to read users' mail boxes at /var/spool/mail/{1st char}/{2nd char}/username . For example: Mailbox for user 'mike' would be located at /var/spool/mail/m/i/mike 'karen' would be at /var/spool/mail/k/a/karen etc... Is this possible is version 1.1.6? Please advise. Thanks JB

2 1

Re: [Dovecot] Another dovecot-antispam plugin can't call dspam
by Eugene 11 Nov '08

11 Nov '08

Hi Johannes, > From: Johannes Berg <johannes(a)sipsolutions.net> >> > I just committed a fix to debugv(), can you try that? If you downloaded >> > the tarball, get this one: >> > http://git.sipsolutions.net/?p=dovecot-antispam.git;a=snapshot;h=HEAD;sf=tgz >> > >> > If you can confirm that works I'll make a new release. >> >> The fixed version works perfectly, thank you very much! > > And it prints the full command line to the syslog, I assume? Thanks for > testing! It solves the problem here as well =) Thanks for the update. Do you plan to implement 'out of band' dspam calling? BTW maybe there is no need for a separate 'queue' folder especially as we only need a message signature. I think it can be stored in some buffer array so as the dspam calls are made i.e. during idle time (or during final cleanup at the latest). Also I am attaching a couple of patches that might be useful. dspam-exec.c.patch adds debug-dumping of the dspam reply (it turned out quite useful not only for the stack corruption problem). Makefile.patch fixes the syntax to compile with gmake under FreeBSD 6.1 and also adjusts the installed plugin permissions. Best wishes Eugene

2 3

[Dovecot] NFS Unbreakable lock issues
by Rod Treweek 11 Nov '08

11 Nov '08

Hello All, We are struggling to find a solution to a problem we are encountering with a load-balanced email setup. Currently, we have a Coyote loadbalancer, and 3 Postfix/Dovecot nodes that then get their information from a mysql database. The problem is that after a couple weeks, we start seeing NFS locking issues occur, which then takes email completely down, requiring a site visit to basically do an interactive mode reboot to shut off NFS so that we can remount the filesystem again. We have our mailstore on an Aberdeen NAS which is accessed over NFS v. 4. Dovecot version 1.1.2 Here's the relevant mysql string: grep -v '^ *$#.*$\?$' dovecot-mysql.conf driver = mysql connect = host=X.X.X.X dbname=Something user=Something password=Something password_query = SELECT username as user, password, concat('/NFS1MAILDIR/mailSysV2/', maildir) as userdb_home, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as userdb_mail, 143 as userdb_uid, 143 as userdb_gid, concat('*:bytes=', floor(quota*1024)) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' user_query = SELECT concat('/NFS1MAILDIR/mailSysV2/', maildir) as home, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as mail, concat('maildir:/NFS1MAILDIR/mailSysV2/', maildir) as maildir, 143 AS uid, 143 AS gid, concat('*:bytes=', floor(quota*1024)) AS quota_rule FROM mailbox WHERE username = '%u' AND active = '1' And here's what our configuration is on each of the nodes: dovecot -n # 1.1.2: /usr/local/etc/dovecot.conf protocols: imap pop3 ssl_ca_file: /usr/local/etc/dovecot/certs/tdpserver.crt ssl_cert_file: /usr/local/etc/dovecot/certs/tdpserver.crt ssl_key_file: /usr/local/etc/dovecot/certs/tdpserver.key ssl_parameters_regenerate: 0 ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: postfix login_greeting: Something witty here.. login_process_per_connection: no login_max_connections: 512 max_mail_processes: 2048 mail_max_userip_connections: 50 verbose_proctitle: yes first_valid_uid: 69 last_valid_uid: 500 first_valid_gid: 69 last_valid_gid: 500 mail_access_groups: postfix mail_privileged_group: postfix mail_location: mbox:/NFS1MAILDIR/mailSysV2/%d/%u:INDEX=/usr/local/mail/indexes/%d/%1n/%n mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: login plain user: dovecot passdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf userdb: driver: sql args: /usr/local/etc/dovecot-mysql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: dovecot group: dovecot plugin: quota: dict:user::proxy::quota imap_quota: dict:user::proxy::quota quota_rule: *:storage=528576 dict: quota: mysql:/usr/local/etc/dovecot/dovecot-dict-quota.conf Any help you can offer is greatly appreciated, as well as opinions on any other 'validated' postfix/dovecot email enterprise design solutions. Thanks Very Much In Advance, R.T

1 0