- dovecot - dovecot.org

[Dovecot] deliver and stale NFS file handles
by Leon Meßner 20 Oct '09

20 Oct '09

Hello, since updating two of our backup mailservers from dovecot 1.1.16 to 1.2.4 i get the following errors from dovecot-deliver when receiving (smtp) mail. Oct 16 00:10:42 mail3 dovecot: deliver(user): write_full(/home/r/user/.temp.backupmail.22774.d17050a07b2108e8) failed: Stale NFS file handle Oct 16 00:10:42 mail3 dovecot: deliver(user): copy: i_stream_read() failed: Stale NFS file handle Oct 16 00:10:43 mail3 dovecot: deliver(user): msgid=<d0acb2021be1922ae2d35fbd6b09994c.squirrel(a)www.physik.tu-berlin.de>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-10-16 00:10:42] It nearly never happens with text/plain mails but _very_ often when mails have attachments of some different type. This is inside a 7.2-RELEASE-p2 FreeBSD jail. The NFS export is mounted from the machine that is running the jail. Locking with lockf works. Following is the output of `dovecot -n` from the mailserver. Please tell me if you need any further information. Thanks in Advance, Leon $ dovecot -n # 1.2.4: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE-p2 amd64 log_path: /var/log/dovecot.log protocols: imaps pop3s managesieve listen: mail3.physik.tu-berlin.de ssl_cert_file: /etc/private/backupmail.pem ssl_key_file: /etc/private/backupmail_privatekey.pem login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_processes_count: 6 login_max_processes_count: 256 verbose_proctitle: yes first_valid_uid: 200 first_valid_gid: 300 mail_privileged_group: mail mail_location: maildir:~/maildir mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): imap_client_workarounds(managesieve): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ location: mbox:~/mail list: yes subscriptions: yes lda: postmaster_address: postmaster(a)physik.tu-berlin.de log_path: info_log_path: mail_plugins: sieve quota_full_tempfail: yes sendmail_path: /usr/sbin/sendmail auth default: mechanisms: gssapi plain login username_format: %Lu krb5_keytab: /etc/mail3.krb5.keytab gssapi_hostname: backupmail worker_max_count: 120 passdb: driver: pam args: session=yes failure_show_msg=yes max_requests=100 dovecot userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 plugin: sieve: ~/.dovecot.sieve sieve_dir: ~/.sieve

4 4

[Dovecot] Unknown setting: driver
by Rodolfo González González 19 Oct '09

19 Oct '09

Hi, the conversion from courier was done without problems, but now I have a problem with my auth config. I followed the sql example included in the latest dovecot source, and put driver=mysql in dovecot.conf (outside any section), and now I get: --- Error: Error in configuration file /usr/local/etc/dovecot.conf line 50: Unknown setting: driver Fatal: Invalid configuration in /usr/local/etc/dovecot.conf Starting DovecotError: Error in configuration file /usr/local/etc/dovecot.conf line 50: Unknown setting: driver Fatal: Invalid configuration in /usr/local/etc/dovecot.conf --- So I'm lost... what's wrong? if I followed the example :o Then, another question: I had to go back to courier so my users still can work, but I already created the files using the migration script: do I need to rerun the migration script? or what do I need to do when I manage to fix the error above and run dovecot? Thanks.

3 2

[Dovecot] clarify 'type', 'executable' & 'path' in 2.0 master.conf?
by PGNet Dev 19 Oct '09

19 Oct '09

@2.0's master.conf, there's, e.g., service config { type= config executable =config unix_listener { path = config mode = 0666 } } can someone please explain function/usage for the 'type', 'executable' & 'path' fields? and, for any file paths, are the presumed to be _relative_ to the dovecot executable? in $PATH? can they accept full/absolute paths? thanks.

4 45

[Dovecot] Can't use string ("0") as a HASH ref while "strict refs" in use at /usr/local/sbin/courier-dovecot-migrate.pl line 300.
by Rodolfo González González 19 Oct '09

19 Oct '09

Hello, I need to migrate from courier-imap to dovecot. I'm trying to use courier-dovecot-migrate.pl to migrate the users' maildirs but I'm getting these messages: --- # courier-dovecot-migrate.pl --to-dovecot --recursive mydomain.com Testing conversion to Dovecot format Finding maildirs under mydomain.com mydomain.com/contact/./Maildir: No imap/pop3 uidlist files mydomain.com/someone/./Maildir/courierpop3dsizelist: Broken header: /1 9 Can't use string ("0") as a HASH ref while "strict refs" in use at /usr/local/sbin/courier-dovecot-migrate.pl line 300. --- The courierpop3dsizelist files have contents like this one: --- /1 9 1181869523.M278844P24357V000000000000080CI006E803B_0.email,S=1216:2, 1241 8 --- and it seems that the script is failing with all the maildirs with courierpop3dsizelist. I use courier-imap 4.6.0, access using pop3 causes no problems. Any hint on what's wrong is appreciated, thanks. Salut, Rodolfo.

2 3

[Dovecot] Detect client application
by Thu NGUYEN 19 Oct '09

19 Oct '09

Hello, Do you have any way to detect the client which is connecting to our IMAP server? I actually have an mail server which use dovecot but I just want to allow mobile device access to this server to get email, not desktop as Outlook, Thunderbird ... Thanks for your advice. -- Regards, Thu NGUYEN

4 6

[Dovecot] Dovecot deliver with AD LDAP userdb
by Mark Schaub 19 Oct '09

19 Oct '09

Good Afternoon, I have my virtual users stored in an Active Directory database. As far as mail info goes the 2 important fields are: mail (their primary email address) and otherMailbox (a multivalue attribute containing their mail aliases). Right now all email addresses belong in the same domain and there are no immediate plans to change this. If I use Postfix to do the lookups and delivery only using Dovecot for passdb Pam driver and a static userdb then everything delivers fine to mail and otherMailbox addresses. I have been working on switching over to Dovecot's deliver process in order to integrate sieve capability. I have configured userdb ldap and passdb ldap in Dovecot and have set up master and client sockets. Before I describe my problem let me show you my configuration (as I think the dovecot-ldap.conf in particular needs to be explained). Here are the important parts of dovecot.conf: auth default { socket listen { master { path = /usr/var/run/dovecot/auth-master mode = 0666 user = vmail group = vmail } client { path = /var/spool/postfix/private/auth mode = 0666 user = postfix group = postfix } } passdb ldap { args = /etc/dovecot-ldap.conf } userdb ldap { # Path for LDAP configuration file, see doc/dovecot-ldap-example.conf args = /etc/dovecot-ldap.conf } and my dovecot -n: lda: postmaster_address: postmaster(a)sau24.org mail_plugins: sieve auth default: mechanisms: plain login debug: yes passdb: driver: ldap args: /etc/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 438 user: postfix group: postfix master: path: /usr/var/run/dovecot/auth-master mode: 438 user: vmail group: vmail plugin: sieve: ~/.dovecot.sieve sieve_dir: ~/sieve sieve_storage: ~/sieve Further, here is my dovecot-ldap.conf: hosts = delldb.sau24.org:3268 base = dc=sau24, dc=org ldap_version = 3 dn = cn=Mail User,cn=Users,dc=sau24,dc=org dnpass = secret auth_bind = yes scope = subtree user_attrs = sAMAccountName=home=/home/vmail/%$,=uid=501,=gid=501 pass_attrs = sAMAccountName=user user_filter = (&(objectclass=person)(|(sAMAccountName=%n)(mail=%n@sau24.org)(otherMailbox=%n@sau24.org))) pass_filter = (&(objectclass=person)(|(sAMAccountName=%n)(mail=%n@sau24.org)(othermailbox=%n@sau24.org))) Now, you'll notice that the user_filter and pass_filter have the domain statically placed after the mail and othermailbox attributes. This reason for this is that this ldap configuration is used for both authentication purposes and local delivery, so its not always being passed the domain info (for authentication it gets the users IP address). Since all my users are on the same domain I can statically set this here. This setup authenticates users to imap and pop (users use their sAMAccountName as their username when they log in), and pulls their correct home directory. Checking mail is not a problem at all. Further, this setup will deliver mail correctly to mail addressed to the value in the "mail" attribute. The problem seems to be in the otherMailbox attribute, it cannot lookup the users sAMAccountName based off of the otherMailbox field. Here is what it looks like in the logs for mail sent to my "mail" attribute (mark.schaub(a)sau24.org) Oct 14 12:36:19 auth(default): Info: master in: USER 1 mark.schaub(a)sau24.org service=deliver Oct 14 12:36:19 auth(default): Info: ldap(mark.schaub(a)sau24.org): user search: base=dc=sau24, dc=org scope=subtree filter=(&(objectclass=user)(|(sAMAccountName=mark.schaub)(mail=mark.schaub@sau24.org)(otherMailbox=mark.schaub@sau24.org))) fields=sAMAccountName Oct 14 12:36:19 auth(default): Info: ldap(mark.schaub(a)sau24.org): result: sAMAccountName(home=/home/vmail/%$)=/home/vmail/mschaub Oct 14 12:36:19 auth(default): Info: master out: USER 1 mark.schaub(a)sau24.org home=/home/vmail/mschaub uid=501 gid=501 Oct 14 12:36:19 deliver(mark.schaub(a)sau24.org): Info: sieve: msgid=<6b71e3a70910140936v4e8cd6fdwd847a1721a9d9786(a)mail.gmail.com>: stored mail into mailbox 'INBOX' But this is what I get when I try to send to an address listed in my otherMailbox field (tech(a)sau24.org) Oct 14 12:30:58 auth(default): Info: master in: USER 1 tech(a)sau24.org service=deliver Oct 14 12:30:58 auth(default): Info: ldap(tech(a)sau24.org): user search: base=dc=sau24, dc=org scope=subtree filter=(&(objectclass=user)(|(sAMAccountName=tech)(mail=tech@sau24.org)(otherMailbox=tech@sau24.org))) fields=sAMAccountName Oct 14 12:30:58 auth(default): Info: ldap(tech(a)sau24.org): Unknown user Oct 14 12:30:58 auth(default): Info: master out: NOTFOUND 1 As a test I tried modifying my dovecot-ldap.conf to use different fields instead of otherMailbox. Sending to some of those attributes worked, others didnt. I could use the "sn" and "givenName" attributes, but "postalCode" and "title" would give the same error as otherMailbox. My question is this: is there something wrong with my configuration or can Dovecot only query certain fields in the user_attr string? Thanks, ~ Mark

4 7

[Dovecot] Released Sieve v0.1.13 for Dovecot v1.2.6
by Stephan Bosch 18 Oct '09

18 Oct '09

Hello Dovecot users, After about a month of silence, I finally release a new version of Pigeonhole Sieve. This release fixes problems in the multiscript support and improves the body extension further towards RFC compliance. The body extension still needs work, however, since some content types still give erroneous results. Changelog Sieve v0.1.13: + Body extension: implemented proper handling of the :raw transform and added various new tests to the test suite. However, :content "multipart" and :content "message/rfc822" are still not working. + Fixed race condition occuring when multiple instances are saving the same binary (patch by Timo Sirainen). + Test suite: added support for testing multiscript execution. - Made compiler more lenient towars missing CRLF at the end of the script in a hash comment. - Body extension: don't give SKIP_BODY_BLOCK flag to message parser, we want the body! (patch by Timo Sirainen). - Fixed handling of implicit side effects for multiscript execution. - Fixed bugs in multiscript support; subsequent keep actions were not always merged correctly and implicit side effects were not always handled correctly. - Fixed a segfault bug in the sieve-test tool occuring when compile fails. - Fixed segfault bug in action procesing. It was triggered while merging side effects in duplicate actions. - Fixed bug in the Sieve plugin that caused it to try to stat() a NULL path, yielding a 'Bad address' error. The release is available as follows: http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.13.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.13.tar.gz.sig Refer to http://pigeonhole.dovecot.org for more information. Have fun testing the new release and don't hesitate to notify me when there are problems. Releases for Dovecot v2.0 are still under development... Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] Convert to DBox
by Jeff Grossman 17 Oct '09

17 Oct '09

I am thinking of trying out dbox format. I am currently using maildir. Is it possible for me to switch just one user account to dbox while keeping all of my other users on maildir? If so, how would I go about doing that? Here is a copy of my dovecot -n: # 1.2.5: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30-1-amd64 x86_64 Debian squeeze/sid ext3 base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/certs/stikman-godaddy.crt ssl_key_file: /etc/ssl/private/stikman-godaddy.key disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: maildir:/home/vmail/%u mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)stikman.com mail_plugins: cmusieve sendmail_path: /usr/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login username_format: %Lu passdb: driver: pam userdb: driver: passwd args: uid=vmail gid=vmail home=/home/vmail/%u socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: sieve: sieve Thanks, Jeff

2 1

[Dovecot] Problems with Expire Plugin
by Jose Luis Marin Perez 16 Oct '09

16 Oct '09

Dear Sirs, I try to configure expire plugin to delete emails older than 7 days from the Papelera folder, but I do not see any information recorded in the expires table, although there are emails that were copied before and after configuring the plugin. dovecot -n # 1.1.16: /usr/local/etc/dovecot.conf Warning: There is no way to login to this server: disable_plaintext_auth=yes, ssl-disable=yes, no non-plaintext auth mechanisms. # OS: Linux 2.6.9-67.0.7.EL i686 CentOS release 4.6 (Final) log_path: /var/log/dovecot.log protocols: imap listen: *:10143 ssl_disable: yes login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login first_valid_uid: 89 last_valid_uid: 89 first_valid_gid: 89 last_valid_gid: 89 mail_uid: 89 mail_gid: 89 mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: quota imap_quota autocreate expire namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: passdb: driver: checkpassword args: /usr/vpopmail/bin/vchkpw /usr/local/bin/vchkpw-wrapper.sh userdb: driver: prefetch args: uid=89 gid=89 home=/usr/vpopmail/domains/%d/%u socket: type: listen master: path: /usr/local/var/run/dovecot/auth-master mode: 384 user: root group: root plugin: quota: maildir quota_rule: ?:storage=0 quota_rule2: Trash:ignore quota_rule3: Papelera:ignore expire: Papelera 7 Papelera/* 7 expire_dict: proxy::expire auth_socket_path: /usr/local/var/run/dovecot/auth-master autocreate: INBOX.Papelera autosubscribe: INBOX.Papelera dict: expire: mysql:/usr/local/etc/dovecot-dict-expire.conf /usr/local/etc/dovecot-dict-expire.conf connect = host=localhost dbname=expunge user=expireuser password=expirepass # v1.1 only: table = expires select_field = expire_stamp where_field = mailbox username_field = not_used mysql> describe expires; +--------------+--------------+------+-----+---------+-------+ | Field | Type | Null | Key | Default | Extra | +--------------+--------------+------+-----+---------+-------+ | mailbox | varchar(255) | | PRI | | | | expire_stamp | int(11) | | | 0 | | +--------------+--------------+------+-----+---------+-------+ mysql> select * from expires; Empty set (0.00 sec) May be missing some configuration to work? Thanks Jose Luis _________________________________________________________________ Discover the new Windows Vista http://search.msn.com/results.aspx?q=windows+vista&mkt=en-US&form=QBRE

3 28

[Dovecot] migrate courier to dovecot script - questions about directory structure
by Ross 16 Oct '09

16 Oct '09

Hi all, Im in the process of moving about 7000 users across from courier to dovecot. Both Maildir setups. The migration script works a treat, but I need a slight change to it. Couriers directory structure looks ike this: /home/vmail/<domain.com.au>/<username>/cur/ /home/vmail/<domain.com.au>/<username>/new/ /home/vmail/<domain.com.au>/<username>/tmp/ /home/vmail/<domain.com.au>/<username>/maildirsize /home/vmail/<domain.com.au>/<username>/courier* etc.. Dovecot looks like this: /home/vmail/<domain.com.au>/<username>/Maildir/cur/ /home/vmail/<domain.com.au>/<username>/Maildir/new/ /home/vmail/<domain.com.au>/<username>/Maildir/tmp/ So the issue is, there is an additional Maildir directory in the structure. Now the migration script works fine, however when the migration is completed, I have to manually add the Maildir directory into the structure, which is going to take a little too long :) Is there something in the script that can add this ? Is there a way to perhaps use the script to add the Maildir part ? My initial plan was to copy the entire /home/vmail/<domain.com.au>/* across to the dovecot server and run the migration script. However, without the Maildir directory in the structure it won't work. Has anyone run into this issue ? How did you solve it ? -- Regards Ross fatboy:/tmp# dovecot --version 1.0.15 fatboy:/tmp# dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:/var/vmail/%Ld/%Ln/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv namespace: type: private separator: . prefix: INBOX. inbox: yes auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/var/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir:storage=51200

2 2