September 2010 - dovecot

[Dovecot] My "%%" variables in the namespace settings do not appear to be expanding.
by Kenneth Cope 02 Sep '10

02 Sep '10

Hello, I've been using the dovecot 1.2.x branch server software for a while now. With the advent of the 2.0.x branch going 'stable' I decided to attempt a migration and make use of some of the features that I've not needed before. One of these is the shared folder/namespace feature. No luck. I've hit a wall and can not determine the problem. At the moment it looks like a bug to me, but it may well be that I'm missing some related configuration, or file permission. I can not get the %% variable expansion in a namespace to work. What I end up with, on an IMAP connection is a directory named, for instance, '%h'. The same goes for any of the %% variables used at this point. My current set-up is 'not' the same as the current setup and I'm using virtual users that are not 'live' on the current system. I would really appreciate it if someone could cast an eye over my config and let me know if I've missed something obvious. Thanks. Kenneth Cope kenneth(a)CopeOnThe.net ---- I'm using a dovecot compiled with the following options: ./configure --prefix=/usr/local/dovecot-2.0.1 \ --enable-dependency-tracking INSTALL_DATA="install -c -p -m644" \ --docdir=/usr/local/dovecot-2.0.1/docs/ --disable-static \ --disable-rpath --with-nss --with-zlib --with-bzlib --with-libcap \ --with-ssl=openssl --with-ssldir=/usr/local/dovecot-2.0.1/etc/ssl \ --with-docs \ ---- The 'test' configuration is as follows: # > /usr/local/dovecot-2.0.1/bin/doveconf -n # 2.0.1: /usr/local/dovecot-2.0.1/etc/dovecot/dovecot.conf # OS: Linux 2.6.9-89.0.26.ELsmp i686 Red Hat Enterprise Linux ES release 4 (Nahant Update 8) auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 digest-md5 apop auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_ @& auth_username_format = %Lu auth_verbose = yes default_client_limit = 10000 default_internal_user = mail default_login_user = dovecot disable_plaintext_auth = no first_valid_gid = 12 first_valid_uid = 8 last_valid_gid = 12 last_valid_uid = 8 log_path = /usr/local/dovecot-2.0.1/dovecot.log login_log_format_elements = [%p:%e] %Us(%u) method=%m rip=%r:%b lip=%l:%a %c %k mail_debug = yes mail_location = maildir:%h/ mail_log_prefix = [%p] %Us(%u): mail_max_keyword_length = 30 mail_plugins = quota imap_quota zlib acl mailbox_idle_check_interval = 120 s namespace { inbox = yes location = prefix = separator = . type = private } namespace { hidden = yes inbox = no list = no location = prefix = INBOX separator = . type = private } namespace { list = children location = maildir:%%h:LAYOUT=maildir++:INDEX=~/shared.%Dn_%Dd prefix = shared/%n@%d. separator = . subscriptions = no type = shared } namespace { location = prefix = } passdb { args = scheme=CRYPT username_format=%u /usr/local/dovecot-2.0.1/auth/passwd.dovecot driver = passwd-file } plugin { acl = vfile:/usr/local/dovecot-2.0.1/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/usr/local/dovecot-2.0.1/var/lib/dovecot/shared-mailboxes mail_log_events = all mail_log_fields = uid, box, msgid, from, subject, size, vsize, flags mail_log_group_events = yes quota = maildir:User quota quota_rule = ?:storage=400M quota_rule2 = Trash:storage=+10% zlib_save = gz zlib_save_level = 9 } service auth-worker { user = $default_internal_user } service auth { unix_listener auth-userdb { group = dovecot mode = 0664 user = mail } user = $default_internal_user } service imap-login { inet_listener imap { port = 9143 } inet_listener imaps { port = 9993 ssl = yes } process_min_avail = 10 service_count = 1 } service imap { process_limit = 1024 vsz_limit = 268435456 } service lmtp { unix_listener lmtp { mode = 0666 } } service pop3-login { inet_listener pop3 { port = 9110 } inet_listener pop3s { port = 9995 ssl = yes } } service pop3 { process_limit = 1024 } ssl_cert = </etc/ssl/mail.cert ssl_key = </etc/ssl/mail.cert userdb { args = username_format=%u /usr/local/dovecot-2.0.1/auth/passwd.dovecot driver = passwd-file } verbose_ssl = yes protocol imap { imap_client_workarounds = delay-newmail imap_id_log = * imap_idle_notify_interval = 120 s imap_logout_format = bytes=%i/%o imap_max_line_length = 65536 mail_max_userip_connections = 40 mail_plugins = $mail_plugins imap_quota zlib imap_zlib imap_acl } protocol pop3 { mail_max_userip_connections = 40 mail_plugins = $mail_plugins zlib pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s bytes=%i/%o pop3_reuse_xuidl = yes pop3_save_uidl = yes pop3_uidl_format = %Mf } ---- The contents of .../var/run/dovecot # > ls -lA total 12 srw------- 1 root root 0 Aug 31 11:25 anvil srw------- 1 root root 0 Aug 31 11:25 anvil-auth-penalty srw------- 1 root root 0 Aug 31 11:25 auth-client srw------- 1 mail root 0 Aug 31 11:25 auth-login srw------- 1 root root 0 Aug 31 11:25 auth-master srw-rw-r-- 1 mail dovecot 0 Aug 31 11:25 auth-userdb srw------- 1 mail root 0 Aug 31 11:25 auth-worker srw------- 1 root root 0 Aug 31 11:25 config srw------- 1 root root 0 Aug 31 11:25 dict srw------- 1 root root 0 Aug 31 11:25 director-admin srw------- 1 root root 0 Aug 31 11:25 director-userdb srw-rw-rw- 1 root root 0 Aug 31 11:25 dns-client srw------- 1 root root 0 Aug 31 11:25 doveadm-server lrwxrwxrwx 1 root root 49 Aug 31 11:25 dovecot.conf -> /usr/local/dovecot-2.0.1/etc/dovecot/dovecot.conf drwxr-xr-x 2 root root 4096 Aug 31 11:25 empty srw-rw-rw- 1 root root 0 Aug 31 11:25 lmtp drwxr-x--- 2 root dovecot 4096 Aug 31 11:25 login -rw------- 1 root root 6 Aug 31 11:25 master.pid

3 10

[Dovecot] Segfault on dovecot 2.0.1 w/ACLs
by Michael M. Slusarz 02 Sep '10

02 Sep '10

* PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in as slusarz 5 LIST (SUBSCRIBED) "" (*) RETURN (SUBSCRIBED) * LIST (\Subscribed) "." "INBOX" [...] * LIST (\Subscribed) "." "Mileage Plus" Program received signal SIGSEGV, Segmentation fault. 0x00007ffff6d0cd61 in ?? () from /usr/lib/dovecot/modules/lib01_acl_plugin.so (gdb) bt full #0 0x00007ffff6d0cd61 in ?? () from /usr/lib/dovecot/modules/lib01_acl_plugin.so No symbol table info available. #1 0x00007ffff7b40eea in mailbox_list_iter_next () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #2 0x000000000040b209 in ?? () No symbol table info available. #3 0x000000000040c030 in cmd_list_full () No symbol table info available. #4 0x000000000040f9dd in ?? () No symbol table info available. #5 0x000000000040fab2 in ?? () No symbol table info available. #6 0x000000000040fcfd in client_handle_input () No symbol table info available. #7 0x000000000041059f in client_input () No symbol table info available. #8 0x00007ffff78d8e85 in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #9 0x00007ffff78d80f8 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #10 0x00007ffff78c76f3 in master_service_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #11 0x0000000000418791 in main () No symbol table info available. # 2.0.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35-ARCH x86_64 plugin { acl = vfile quota = maildir:User quota quota_rule = *:storage=10485769 } Can verify that disabling acl makes the segfault go away. michael

2 3

[Dovecot] [pigeonhole] Libraries not linked correctly
by pyther 02 Sep '10

02 Sep '10

Hello All I am trying to compile and use pigeonhole and I am experiencing the same exact problem that is stated here: http://dovecot.org/pipermail/dovecot/2010-August/051859.htm [root@mongo dovecot-2.0-pigeonhole-build]# ldd /usr/lib/dovecot/managesieve-login linux-gate.so.1 => (0xb777e000) libdovecot-login.so.0 => not found libdovecot.so.0 => not found libc.so.6 => /lib/libc.so.6 (0xb7622000) /lib/ld-linux.so.2 (0xb777f000) lt does not seem as if -Wl,-rpath -Wl,/usr/local/lib/dovecot is being appended to gcc -std=gnu99 -march=i686 -mtune=generic -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -o managesieve-login client.o client-authenticate.o managesieve-login-settings.o managesieve-proxy.o ../../src/lib-managesieve/libmanagesieve.a -ldovecot-login -L/usr/lib/dovecot -ldovecot -lrt ^^See: http://dovecot.org/pipermail/dovecot/2010-August/051907.html However, my lack of programming knowledge and skills prohibit me from trying to fix this myself. I am hoping some kind soul would be nice enough to fix it. Thank you!

2 1

[Dovecot] Dovecot - some more optimisations
by Len7hir 02 Sep '10

02 Sep '10

I did some more optimisation. Most performance hit in Dovecot do "for loop" in string operations. In one case (in message-parser.c) "for loop" has another "for" inside with the same variable used as iterator. This case is very hard to optimise by compiler. I do changes only in top functions listed in oprofile. Maybe I do more in future. Code was analysed and tested but it's hard to generate all cases. It's working well in production server (I'm monitoring). In istream-crlf.c I've changed one thing. When destination buffer is full after '\r' addition (to dest), It didn't skip '\n' in source buffer. I think this was buggy in earlier code, and '\n' was skipped (this piece of code is used very rare). Please check this out. This can help in huge e-mail systems :P And another problem. Why You use safe_memset instead of memset? Now this function have the largest impact in Dovecot performance. Another on list is t_push. Regards, Len7hir

2 5

[Dovecot] Passdb filter question - LDAP.
by Lauro Costa G. Borges 01 Sep '10

01 Sep '10

dovecot 1:1.2.9-1ubuntu6.1 ---- I don't know if I can solve this problem with Dovecot, or if it's an LDAP matter. I'm authenticating users with saslauthd/LDAP, and using Dovecot LDA. ---- dovecot.conf passdb ldap { args = /etc/dovecot/dovecot-ldap-passdb.conf } userdb prefetch { } # The userdb below is used only by deliver. userdb ldap { args = /etc/dovecot/dovecot-ldap-userdb.conf } ----- ----- dovecot-ldap-passdb.conf search base is dc=example,dc=org pass_filter = (&(objectclass=brPerson)(objectclass=inetOrgPerson)(mail=%u)) pass_attrs = userPassword=password,%u=user ----- ----- dovecot-ldap-userdb.conf search base is ou=%d,ou=mail,ou=services,dc=example,dc=org user_filter = (&(objectclass=nisMailAlias)(cn=%n)) user_attrs = rfc822MailMember=user,EmailQuota=quota_rule=*:storage=%$M ----- Here is how the LDAP tree is: ou=mail,ou=services,dc=example,dc=org ou=subdomain1.example.org,ou=mail,ou=services,dc=example,dc=org example entry under "ou=subdomain1.example.org" --- dn: cn=userfoo,ou=subdomain1,ou=mail,ou=services,dc=example,dc=org cn: userfoo edupersonprincipalname: WEMHVDEA-FUAOBAAA(a)example.org (some sort of unique identifier) emailquota: 512 objectclass: eduPerson objectclass: nisMailAlias rfc822mailmember: userfoo(a)subdomain1.example.org --- ou=people,dc=example,dc=org dn: uid=29859085900(a)example.org,ou=people,dc=example,dc=org uid: 29859085900(a)example.org eduPersonPrincipalName: WEMHVDEA-FUAOBAAA(a)example.org userPassword: {MD5}6ZoYxCjLONXyYIU2eJIuAw== objectClass: person objectClass: inetOrgPerson objectClass: eduPerson mail: 29859085900(a)example.org mail: userf(a)director.example.org mail: userfoo(a)dptoxyz.example.org mail: userfoo(a)subdomain1.example.org When delivering email, it must search under "services", for the proper "rfc822mailmember", which is the mailbox. When authenticating, there's where my problem is, I can't have ALL user e-mails under "ou=people", maybe just 1, so I need to search under "ou=services", there I have all user email addresses, and by using "edupersonPrincipalName", I want to point to the right location under "ou=people", where I have the user password. edupersonPrincipalName is the attribute present under "ou=services" and "ou=people" that links the entries. I tried to do it by changing passdb filter file, like this: pass_filter = (&(objectclass=eduPerson)(mail=%u)) pass_attrs = userPassword=userdb_password,eduPersonPrincipalName=userdb_user It works, but changes the username to the value of "edupersonprincipalname", and this changes the mailbox name. Dovecot accesses the wrong mailbox then (something like 29859085900(a)example.org) * My question is: is it possible to change the passdb filter, so it searches for somemail(a)sub1.example.org (under ou=services), then it gets the value of "edupersonprincipalname" (the unique identifier, present under "services" and "people"), and with that value, it looks under "people" the person with that identifier and validates the password. It would be a filter inside a filter, sort of. thanks, and sorry if this is a little offtopic. ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

2 3

[Dovecot] Filtering virtual mailbox using other virtual mailbox?
by Giovanni Giorgi 01 Sep '10

01 Sep '10

Hi All, my name is Giovanni and I am new to dovecot. I have installed version 2.0 the past week and I find it very powerful. I have started to play with the virtual mailbox plugin. I was unable to do a virtual mailbox filtering out the contents of other mailbox, for instance I have a virtual/spam mailbox which filter out all the spam thanks to spamassassin. This mailbox is virtual, its description is INBOX -Trash -Trash/* -Junk subject SPAM I'd like to do a simple virtual/ham mbox using this dovecot-virtual INBOX -virtual/spam to: jj(a)gioorgi.com but it seems not working. it does not filter the spam. It is possible to do such thing, or I am trying to do something not possible at all? Thank you (\__/) (='.'=) (")_(") Giovanni Giorgi jj(a)gioorgi.com

2 1

[Dovecot] Shared mail folders
by Ian macdonald 01 Sep '10

01 Sep '10

Hi All, I am trying to configure shared mail folders and have made some progress, however I am just stuck lack of experience I think. I have ubuntu 10.04 postfix and dovecot (working well) using dovecot deliver as LDA thunderbird reports that folders are shared flat file database has the shares My problem is I am missing something on the userdb I wish to use auth passwd as it is a small system of 20 system users I have the following from dovecot -n auth default: passdb: driver: pam userdb: driver: passwd I get the following IMAP(peter): userdb lookup: connect(/var/run/dovecot/auth-master) failed: No such file or directory dovecot: IMAP(peter): Namespace 'shared/': Could not lookup home for user ian I am lost and would be grateful for any help all the best Ian

2 1

[Dovecot] Virtual plugin speedup?
by Giovanni Giorgi 01 Sep '10

01 Sep '10

Hi, I am using the virtual plugin on divecot2. It seems a bit slow when accessing from my iPhone. How can I speed it up? The full text search plugin can help? Inviato da iPhone

2 1

[Dovecot] Help with Public Folder Configuration
by Joy 01 Sep '10

01 Sep '10

Dear All, I am trying to use Public Folder feature of dovecot but having some confusion with the configuration part as well as understanding the same. Here is output of doveconf -n which i think required to help me - mail_location = maildir:~/Maildir namespace { inbox = yes location = prefix = separator = . type = private } namespace { list = children location = maildir:/var/mail/public prefix = Public. separator = . subscriptions = no type = public } plugin { acl = vfile:/usr/local/dovecot/dovecot-acl/acl } after making this configuration i also created subfolder inside /var/mail/public which looks like following:- mail1:~# less /var/mail/public/ dovecot-acl-list .Public/ mail1:~# less /var/mail/public/.Public/Maildir/ cur/ new/ tmp/ I have changed default permission to [ chown -R vmail:vmail /var/mail ] on base public folder. Now I am able to see the public folder from webmail as well as from thunderbird but no display for .Public folder. I am expecting that .Public folder will be visible to all but no one will be allowed to delete and make any change in that folder, I am also using global ACL in my configuration. Please let me know what i am doing wrong because not getting any error in log, Correct me if i am understanding wrong. Thanks

2 1

[Dovecot] Broken SELECT ""/EXAMINE ""
by Michael M. Slusarz 01 Sep '10

01 Sep '10

a EXAMINE INBOX [...] a OK [READ-ONLY] Select completed. a EXAMINE "" a NO Empty mailbox name. [Should be in authenticated mode with no active mailbox. But...] a STATUS INBOX (UIDVALIDITY) * STATUS "INBOX" (UIDVALIDITY 1255685337) a OK [CLIENTBUG] Status on selected mailbox completed. a UNSELECT a OK Unselect completed. a STATUS INBOX (UIDVALIDITY) * STATUS "INBOX" (UIDVALIDITY 1255685337) a OK Status completed. Seeing a whole bunch of the CLIENTBUGs in the logs since IMP uses imapproxy and relies on the proxy to unselect the mailbox when a LOGOUT is caught. Thus, when we rebuild the connection on the next page connection, we assume that there is no active mailbox (we actually use LIST-STATUS to do folder polling, but we still use STATUS when we only need data on a single mailbox). imapproxy *should* really be using UNSELECT, but that looks like a different (imapproxy) bug. michael

5 5