- dovecot - dovecot.org

Re: [Dovecot] Sieve > Pigeonhole > external storage with LDAP or other data source available to dovecot
by Martin F. Foster 06 Jan '10

06 Jan '10

> On 5.1.2010, at 10.02, Martin F. Foster wrote: > > >> I am looking at porting and generalizing an old in-house patch that I'm using for the CMU Sieve plugin. It allows sieve script to test& lookup arguments from LDAP. >> > .. > >> Related work: >> >> 1. Pigeonhole low priority TODO would like to implement alternate >> script storage, eg: LDAP& SQL. I'm not immediately interested in >> alternate types of script storage, but for what I want to acheive, >> I need to sanely access at least an LDAP directory. >> 2. draft-ietf-sieve-external-lists >> (http://tools.ietf.org/html/draft-ietf-sieve-external-lists-01) >> proposes a mechanism to pull mailing list addresses from external >> storage mechanisms such as LDAP, ACAP or relational databases. I'm interested in this, but would like to extend this >> functionality beyond just lists as the example above demonstrates. >> > I haven't looked into that draft or thought much about this, but would doing the lookups via Dovecot's lib-dict be ok? That would of course need a dict-ldap backend implemented, but it would be a generic way to solve this, if its API is good enough. > After another day of looking into this, I believe that there are two concerns to be addressed: 1. dovecot implementation: how dovecot/pigeonhole provides access to these external sources in a sane way. I do like the dict interface for this, which could keep LDAP url's (or SQL queries, etc) out of sieve scripts, and into nicely compartementalized configuration files. Being very ldap focussed at my site, I hadn't looked at dict before today. 2. sieve language: an extension which would allow scripts to get information from an external source. I'm asking the draft-ietf-sieve-external-lists authors a few questions about this. The end result would be something like what follows: Dovecot implementation (proposed): ------------------------------------- <dovecot.conf> dict { dict_sieve = ldap:/etc/dovecot/dovecot-sieve-ldap.conf } plugin { # TODO: proxy this dict? sieve_extsrc = dict } </dovecot.conf> then I'm not sure how you specify multiple hosts with the dict-sql format, so I'm using the postfix convention. there's probably a better way for dovecot. <dovecot-sieve-ldap.conf> map { name = responder_mode server_host = ldap://server1.mycorp.com, ldap://server2.mycorp.com search_base = o=mailstuff query_filter = (&(objectclass=mailschema)(uid=%u)) result_attribute = responder_mode result_scope = sub bind = no version = 3 } map { name = responder_text server_host = ldap://server1.mycorp.com, ldap://server2.mycorp.com search_base = o=mailstuff query_filter = (&(objectclass=mailschema)(uid=%u)) result_attribute = responder_text result_scope = sub bind = no version = 3 } map { name = forward_keep server_host = ldap://server1.mycorp.com, ldap://server2.mycorp.com search_base = o=mailstuff query_filter = (&(objectclass=mailschema)(uid=%u)) result_attribute = mailForwardKeep result_scope = sub bind = no version = 3 } map { # in this case we can have many responses name = forward_addresses server_host = ldap://server1.mycorp.com, ldap://server2.mycorp.com search_base = o=mailstuff query_filter = (&(objectclass=mailschema)(uid=%u)) result_attribute = mailForwardAddress result_scope = sub bind = no version = 3 } </dovecot-sieve-ldap.conf> Sieve language: --------------------- then with proposed new functions of the sieve language (all names plucked out of my head 2hrs ago, would have to think about the semantics some more): 1. a “:list” argument that expects a string-list 2. a “:extsrc” argument that expects an <ext-name: string> and returns a string-list 3. a “:extsrc1” argument that expects an <ext-name: string> and returns a string 4. a new test that uses information that is not in the message, say “arbitrary [comparator] string string” (syntax needs work) sample uses in scripts are then: 1. redirect to a mailing list sourced from ldap (or wheverver): # mailForwardAddress attribute can be present >=0 times redirect :list :extsrc “dict:forward_addresses” 2. decide whether to keep or discard forwarded messages (eg: after the above rule) # mailForwardKeep attribute should only be present once, if at all if arbitrary :is :extsrc1 “dict:forward_keep” “TRUE” { keep; } 3. decide vacation action and text based in information in an ldap dir: # mailResponderMode & mailResponderText attrs should only be present once, if at all if arbitrary :is :extsrc1 “dict:responder_mode” “alwaysreply” { vacation :days 1 :extsrc1 “dict:responder_text"; } if arbitrary :is :extsrc1 “dict:responder_mode” “holiday” { vacation :days 30 :extsrc1 “dict:responder_text”; } ... where the "dict:mapname" syntax would be dovecot implementation specific. could also support the URL & TAG-URI schemes as proposed by draft-ietf-sieve-external-lists. This would allow query URLs as a more general case, using whatever's configured in /etc/ldap/ldap.conf (or whatever the platform's ldap client lib uses). Doing this does raise some resource consumption concerns, hence there should probably be a means of restricting external queries to global scripts only (or sieve_before, sieve_after), and a means of providing timeout values, etc. eg: if arbitrary :is :extsrc1 “ldap:///o=myorg?mailForwardKeep” “TRUE” { keep; } I'll keep on thinking about the design, staring intently at the dovecot sources and http://wiki.dovecot.org/Design for another couple days before attempting to write some code to test this. Feedback on the design of both the sieve language extension, & dovecot interface very appreciated. Cheers, -Martin Foster

1 0

[Dovecot] Failed IMAP Login Attempts in Logs
by Carlos Williams 06 Jan '10

06 Jan '10

I had a user telling me that they can't login to the Postfix email server via Webmail (RoundCube) and I decided to see if I could locate this issue in the logs and understand if the user was simply using a wrong password credential and or something more serious. More than likely the person is just using a wrong password but in search of this on my logs, I don't understand why Dovecot doesn't log failed login attempts. When I attempted to login with a wrong password, I show the following in my logs: [root@mail log]# cat /var/log/maillog | grep 'Jan 5' | grep -i 'dovecot' | grep -i 'carlos' Jan 5 11:00:13 mail dovecot: imap-login: Disconnected: user=<carlos>, method=PLAIN, rip=::ffff:192.168.0.10, lip=::ffff:192.168.0.10 Is there a log level or something I am not searching for that will allow me to see failed or invalid logins for Dovecot (IMAP)? Thanks!

3 2

[Dovecot] Sorting in IMAP list command?
by Ronald Johnson 05 Jan '10

05 Jan '10

Hi All, I'm running Dovecot 1.2.9 and have noticed the IMAP list command does not appear to send a sorted list of folders with list command. For example on our Cyrus server I get a sorted list of folders (with INBOX listed first): 2 list "" "*" * LIST (\Noinferiors) "/" "INBOX" * LIST (\HasNoChildren) "/" "CalProject" * LIST (\HasNoChildren) "/" "Deleted Messages" * LIST (\HasNoChildren) "/" "Drafts" ... while on our Dovecot server I get seemingly random listing: 2 list "" "*" * LIST (\HasNoChildren) "/" "lsf" * LIST (\HasNoChildren) "/" "mrg" * LIST (\HasNoChildren) "/" "studiosysadmins" * LIST (\HasNoChildren) "/" "Deleted Messages" * LIST (\HasNoChildren) "/" "TriTeam" * LIST (\HasNoChildren) "/" "systemupdates" * LIST (\HasNoChildren) "/" "bb" * LIST (\HasNoChildren) "/" "nagios" * LIST (\HasNoChildren) "/" "server" ... Is this intentional, or have I done something wrong? I didn't see any option in the dovecot.conf to set the behavior of the list output. Here is `dovecot -n`: # 1.2.9: /usr/local/etc/dovecot.conf # OS: Linux 2.6.18-164.6.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.4 (Tikanga) nfs protocols: imap imaps managesieve ssl_cert_file: /etc/pki/dovecot/certs/dovecot.pem ssl_key_file: /etc/pki/dovecot/private/dovecot.pem disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login mail_access_groups: BOLT mail_location: maildir:/var/dovecot/imap/%u/Maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugins(default): acl imap_acl autocreate mail_plugins(imap): acl imap_acl autocreate mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: Public/ location: maildir:/var/dovecot/imap/public:CONTROL=/var/dovecot/imap/%u/Maildir/public:INDEX=/var/dovecot/imap/%u/Maildir/public list: yes namespace: type: public separator: / prefix: Boltlogs/ location: maildir:/var/dovecot/imap/boltlogs/Maildir/:CONTROL=/var/dovecot/imap/%u/Maildir/public-boltlogs:INDEX=/var/dovecot/imap/%u/Maildir/public-boltlogs list: yes lda: postmaster_address: postmaster(a)example.com mail_plugins: sieve acl mail_plugin_dir: /usr/local/lib/dovecot/lda/ auth default: passdb: driver: pam userdb: driver: passwd plugin: acl: vfile sieve: /var/dovecot/imap/%u/home/.dovecot.sieve sieve_dir: /var/dovecot/imap/%u/home/sieve home: /var/dovecot/imap/%u/home autocreate: Trash autosubscribe: Trash Cheers, Ron

3 3

[Dovecot] Dovecot quota not working
by Bruno Guimarães Sousa 05 Jan '10

05 Jan '10

Hi everyone, I'm trying to make quota to work in dovecot 1.0.rc15 in a Debian machine. Setting the limit to 1GB and starting to fill up the mailbox and nothing stopped me. It just kept growing and nothing happened. Restarted the service and nothing. I had already exceeded the 1 GB limit and nothing happens, the mailbox still goes bigger and bigger... The *"check_quota"* plugin for squirrelmail shows "0.0% of 1.0GB" in my browser. 1GB is exactly what it is defined in dovecot.conf by maildir. Is it necessary to configure something in postfix? Details: # dovecot --version 1.0.rc15 # dovecot -n # /etc/dovecot/dovecot.conf IEffective uid=65534, gid=65534 ILoading modules from directory: /usr/lib/dovecot/modules/imap IModule loaded: /usr/lib/dovecot/modules/imap/lib01_quota_plugin.so IModule loaded: /usr/lib/dovecot/modules/imap/lib02_imap_quota_plugin.so log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login first_valid_uid: 0 first_valid_gid: 0 mail_privileged_group: users mail_location: mbox:/home/%u:INBOX=/var/mail/%u mail_debug: yes mmap_disable: yes mbox_read_locks: flock mbox_write_locks: flock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: pam userdb: driver: passwd regards, -- Bruno Guimarães Sousa www.ifba.edu.br PONTONET - DGTI - IFBA Ciência da Computação UFBA Registered Linux user #465914

3 3

[Dovecot] Managesieve and Dovecot from ATRPM - Still no luck
by Oli Schacher 05 Jan '10

05 Jan '10

Hi list I'm still trying to get managesieve running on centos x64 with the packages from atrpm. I used the 1.2.9 rpms (also rebuilt with the lastet managesieve patches) but I'm always getting the same error when trying to compile managesieve: ./configure --with-dovecot=/usr/lib64/dovecot/ --with-dovecot-sieve=/work/dovecot-1.2-sieve-0.1.14 (no errors) make gcc -DHAVE_CONFIG_H -I. -I../.. -I/usr/include/dovecot -I/usr/include/dovecot/src/lib -I/usr/include/dovecot/src/lib-dict -I/usr/include/dovecot/src/lib-mail -I/usr/include/dovecot/src/lib-auth -I/usr/include/dovecot/src/lib-index -I/usr/include/dovecot/src/lib-storage -DMODULEDIR=\""/usr/lib64/dovecot"\" -I../../src/lib-managesieve -I../../src/lib-sievestorage -I/work/dovecot-1.2-sieve-0.1.14 -I/work/dovecot-1.2-sieve-0.1.14/src/lib-sieve -std=gnu99 -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -I/usr/kerberos/include -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c mv -f .deps/main.Tpo .deps/main.Po make[3]: *** No rule to make target `/usr/include/dovecot/src/lib-storage/libstorage.a', needed by `managesieve'. Stop. make[3]: Leaving directory `/work/dovecot-1.2-managesieve-0.11.10/src/managesieve' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/work/dovecot-1.2-managesieve-0.11.10/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/work/dovecot-1.2-managesieve-0.11.10' make: *** [all] Error 2 I probably need a hit with the cluebat here... could someone give me step-by-step instructions or is it a bad idea to use those rpms in the first place or...? Thanks and happy new year! Oli

4 4

[Dovecot] fedora rpm for 2.0 beta?
by joakim＠verona.se 05 Jan '10

05 Jan '10

I'm looking for a spec/rpm file suitable for fedora 11/12, for dovecot and pidgenhole sieve. Has anyone done this yet? Otherwise I will attempt to the dovecot 1.2 spec files for f11. -- Joakim Verona

1 1

[Dovecot] Moving to hardlinks?
by David Abrahams 05 Jan '10

05 Jan '10

I just discovered that dovecot supports copying messages via hard-linking. I have a huge mailbox hierarchy of existing messages that I'd prefer to store that way. Is there a simple way to transform non-hard-linked storage to hard-linked? TIA, -- Dave Abrahams Meet me at BoostCon: http://www.boostcon.com BoostPro Computing http://www.boostpro.com

2 1

[Dovecot] managesieve : unable to authenticate with cram-md5
by Arnaud 05 Jan '10

05 Jan '10

Hi, Seem i switch my dovecot authentification to cram-md5 mecanism, i'am unable to authenticate to managesieve login. log: Dec 16 23:50:16 managesieve-login: Info: Disconnected (disconnected while authenticating): method=CRAM-MD5, rip=192.168.0.100, lip=192.168.0.50 dovecot -n : # 1.2.8: /etc/mailapp/dovecot/dovecot.conf # OS: Linux 2.6.22.8 x86_64 log_path: /var/log/dovecot.log protocols: imaps managesieve listen(default): * listen(imap): * listen(managesieve): *:2000 ssl_listen: *:993 ssl_cert_file: /etc/mailapp/dovecot/certs/dovecot.pem ssl_key_file: /etc/mailapp/dovecot/private/dovecot.pem disable_plaintext_auth: yes login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(managesieve): /usr/local/dovecot-manage-sieve/libexec/dovecot/managesieve-login login_greeting: Hello, have an account here ? login_process_per_connection: no verbose_proctitle: yes dotlock_use_excl: no fsync_disable: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(managesieve): /usr/local/dovecot-manage-sieve/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/local/dovecot/lib/dovecot/managesieve managesieve_logout_format(default): bytes=%i/%o managesieve_logout_format(imap): bytes=%i/%o managesieve_logout_format(managesieve): bytes (in=%i:out=%o) lda: postmaster_address: postmaster(a)adlx.net hostname: adlx.net mail_plugin_dir: /usr/local/dovecot/lib/dovecot/lda mail_plugins: sieve quota sendmail_path: /usr/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master log_path: /var/log/dovecot-deliver-errors.log info_log_path: /var/log/dovecot-deliver-infos.log auth default: mechanisms: cram-md5 passdb: driver: sql args: /etc/mailapp/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/mailapp/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 438 master: path: /var/run/dovecot/auth-master mode: 384 user: arnaud group: users plugin: quota: maildir:%n quota quota_rule: *:storage=1G sieve_before: /var/imap/before.sieve sieve: /var/imap/%n.sieve sieve_dir: /var/imap/%d/%n/sieve All works fine with plain authentification and managesieve. Perhaps someone have a workaround. I use thunderbird version 2.0.0.23 as MUA. Thanks for reading !

3 3

[Dovecot] architecture to handle 1000 messages per second?
by Bob Eastbrook 04 Jan '10

04 Jan '10

Can anyone describe an architecture which can handle 1000 IMAP or POP messages per second? Ideally, it would be hosted in the cloud and additional instances could be launched to handle additional load. Bob

8 12

[Dovecot] dovecot as lda
by denlistes＠altern.org 04 Jan '10

04 Jan '10

Hi, I would like to integrate dovecot as lda for the hosting control panel alternc (http://www.alternc.org) I manage to run it for the mail but not for the alias. The problem is that in the configuration of alternc, the mails are seen as aliases in the form user_domain.tld. In a second time, a match is made to see if an "real" alias exists. postmap -q test(a)lists.test.net mysql:/etc/postfix/mydomain.cf test-owner_lists.collectifs.net postmap -q test-owner_lists.test.net mysql:/etc/postfix/myalias.cf "| /var/lib/mailman/mail/mailman owner test" With my configuration, this part is no longer working and dovecot can not find the user: test(a)lists.test.net user unknown Any ideas ? Thanks Denis # main.cf virtual_alias_maps = proxy:mysql:/etc/postfix/myalias.cf, hash:/etc/aliases virtual_mailbox_domains = mysql:/etc/postfix/mydomain.cf virtual_mailbox_maps = proxy:mysql:/etc/postfix/myvirtual.cf virtual_transport = dovecot dovecot_destination_recipient_limit = 1 # master.cf dovecot unix - n n - - pipe flags=DRhu user=www-data:www-data argv=/usr/lib/dovecot/deliver -d $(recipient)

1 0