January 2010 - dovecot

[Dovecot] expire plugin doesn't find mail location
by Roland Rosenfeld 19 Jan '10

19 Jan '10

Hi! After searching for hours now, I give up and have to ask here. I try to use the expire plugin but it always tries to expire my mails instead of the mails of the user. I read about the "Mail location setting problem (v1.1-v1.2) and configured a "mail" extra field in the userdb, but that doesn't have the effect I want. I have not idea, what I could try out more, so I ask here. My setup is the following: # 1.2.9: /usr/local/dovecot/etc/dovecot.conf # OS: SunOS 5.10 sun4v zfs syslog_facility: local6 protocols: imap pop3 managesieve listen(default): * listen(imap): * listen(pop3): * listen(managesieve): *:2000, *:4190 ssl: no disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/dovecot/libexec/dovecot/managesieve-login mail_uid: 2001 mail_gid: 2001 mail_location: maildir:/var/mailstore/%2Mn/%n/mail mail_debug: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/dovecot/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota expire mail_plugins(imap): quota imap_quota expire mail_plugins(pop3): quota expire mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/dovecot/lib/dovecot/managesieve pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u pop3_uidl_format(managesieve): %08Xu%08Xv namespace: type: private separator: / inbox: yes list: yes subscriptions: yes lda: postmaster_address: postmaster(a)netcologne.de hostname: mailstore20.netcologne.de mail_plugins: sieve quota expire auth_socket_path: /usr/local/dovecot/var/run/dovecot/auth-master auth default: master_user_separator: * verbose: yes debug: yes passdb: driver: passwd-file args: /usr/local/dovecot/etc/passwd.master pass: yes master: yes passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf socket: type: listen master: path: /usr/local/dovecot/var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir expire: INBOX 60 Spam 60 Papierkorb 60 Trash 1 expire_dict: proxy::expire dict: expire: mysql:/usr/local/dovecot/etc/dovecot-dict-expire.conf With the following dovecot-sql.conf: driver = mysql connect = host=localhost dbname=cyrus user=cyrus password=XXXX default_pass_scheme = CRYPT password_query = \ SELECT username, password, concat('*:storage=', quota) AS userdb_quota_rule, '/var/mailstore/%2Mn/%n' as userdb_home, 'maildir:/var/mailstore/%2Mn/%n/mail' as userdb_mail \ FROM passwd WHERE username='%n' user_query = \ SELECT concat('*:storage=', quota) AS quota_rule, '/var/mailstore/%2Mn/%n' as home, 'maildir:/var/mailstore/%2Mn/%n/mail' as mail \ FROM passwd WHERE username='%n' And this is dovecot-dict-expire.conf: connect = host=localhost dbname=dovecot user=dovecot password=XXXXXX map { pattern = shared/expire/$user/$mailbox table = expires value_field = expire_stamp fields { username = $user mailbox = $mailbox } } In user test's Trash folder there are mails that are older than 1 day and in dovecot.expires there is +----------+---------+--------------+ | username | mailbox | expire_stamp | +----------+---------+--------------+ | test | Trash | 1262779049 | +----------+---------+--------------+ But if I run /usr/local/dovecot/sbin/dovecot --exec-mail ext /usr/local/dovecot/libexec/dovecot/expire-tool.sh --test I get the following output: Info: Loading modules from directory: /usr/local/dovecot/lib/dovecot/imap Info: Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib10_quota_plugin.so Info: Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib20_expire_plugin.so Info: Quota root: name= backend=maildir args= Info: expire: pattern=INBOX type=expunge secs=5184000 Info: expire: pattern=Spam type=expunge secs=5184000 Info: expire: pattern=Papierkorb type=expunge secs=5184000 Info: expire: pattern=Trash type=expunge secs=86400 Info: auth input: quota_rule=*:storage=10000 Info: auth input: home=/var/mailstore/09/test Info: auth input: mail=maildir:/var/mailstore/09/test/mail Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Info: maildir: data=/var/mailstore/df/rrosenfeld/mail Info: maildir++: root=/var/mailstore/df/rrosenfeld/mail, index=, control=, inbox=/var/mailstore/df/rrosenfeld/mail Info: test/Trash: no messages left Info: test/Spam: stop, expire time in future: Sat Mar 6 12:35:10 2010 As you can see, it uses my username (rrosenfeld) instead of the username "test", whose mailbox should be expired. But while the above it printed to the console I get the following in the logfile: Jan 12 15:33:54 mailstore20 dovecot: [ID 583609 local6.info] dict: mysql: Connected to localhost (dovecot) Jan 12 15:33:54 mailstore20 dovecot: [ID 583609 local6.info] auth(default): master in: USER 1 test service=internal Jan 12 15:33:54 mailstore20 dovecot: [ID 583609 local6.info] auth(default): prefetch(test): passdb didn't return userdb entries, trying the next userdb Jan 12 15:33:54 mailstore20 dovecot: [ID 583609 local6.info] auth-worker(default): sql(test): SELECT concat('*:storage=', quota) AS quota_rule, '/var/mailstore/09/test' as home, 'maildir:/var/mailstore/09/test/mail' as mail FROM passwd WHERE username='test' Jan 12 15:33:54 mailstore20 dovecot: [ID 583609 local6.info] auth-worker(default): mysql: Connected to localhost (cyrus) Jan 12 15:33:54 mailstore20 dovecot: [ID 583609 local6.info] auth(default): master out: USER 1 test quota_rule=*:storage=10000 home=/var/mailstore/09/test mail=maildir:/var/mailstore/09/test/mail As you can see, the auth engine sees the request for the user "test". It also returns the correct home and mail attributes (the above messages were triggered by my expire call!). I tried out to comment out the mail_location from dovecot.conf to make sure that the mail attribute from userdb is used, but this has the effect, that dovecot expire does not know any mail location setting at all and tries some "home" directories and different mail storage formats while my setting mail=maildir:/var/mailstore/09/test/mail from the userdb is completely ignored: Info: Loading modules from directory: /usr/local/dovecot/lib/dovecot/imap Info: Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib10_quota_plugin.so Info: Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib20_expire_plugin.so Info: Quota root: name= backend=maildir args= Info: expire: pattern=INBOX type=expunge secs=5184000 Info: expire: pattern=Spam type=expunge secs=5184000 Info: expire: pattern=Papierkorb type=expunge secs=5184000 Info: expire: pattern=Trash type=expunge secs=86400 Info: auth input: quota_rule=*:storage=10000 Info: auth input: home=/var/mailstore/09/test Info: auth input: mail=maildir:/var/mailstore/09/test/mail Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Info: cydir: mailbox location not given Info: cydir: Couldn't create mail storage : Root mail directory not given Info: dbox: mailbox location not given Info: dbox: Couldn't create mail storage : Root mail directory not given Info: maildir: access(/var/mailstore/09/test/Maildir, rwx): failed: No such file or directory Info: maildir: couldn't find root dir Info: maildir: Couldn't create mail storage : Root mail directory not given Info: mbox: root exists (/var/mailstore/09/test/mail) Info: mbox: INBOX: access(/var/mail/test, rw) failed: No such file or directory Info: mbox: INBOX: access(/var/spool/mail/test, rw) failed: No such file or directory Info: mbox: INBOX defaulted to /var/mailstore/09/test/mail/inbox Info: fs: root=/var/mailstore/09/test/mail, index=, control=, inbox=/var/mailstore/09/test/mail/inbox Info: test/Trash: no messages left Info: test/Spam: stop, expire time in future: Sat Mar 6 12:35:10 2010 As you can see, expire tries to access different (default?) mailbox typies instead of simply using maildir:/var/mailstore/09/test/mail as defined in the userdb. So my main problem seems to be, that the mail attribute from the userdb is completely ignored in expire calls. But how do I fix this? Tschoeeee Roland -- Roland Rosenfeld - Content Delivery - NED - Technik NetCologne Gesellschaft für Telekommunikation mbH - HRB 25580, AG Köln Am Coloneum 9 50829 Köln Tel.: +49-221-2222-373 Fax: +49-221-2222-7373 Geschäftsführer: Werner Hanf, Karl-Heinz Zankel

2 2

[Dovecot] Dovecot-deliver sometimes fails when message set to discard via sieve
by Steve Wagner 19 Jan '10

19 Jan '10

Hi, sometimes mails that i discard via sieve gets delivered to my inbox and i can not figure out why. So i hope you can give me a hint. My setup is: I use a self compiled dovecot 1.2.4 with installed sieve and managesieve plugin. Incoming mails a processed by Postfix and the delivered to Procmail. Procmail invokes Spamassassin and discard all mails marked as spam. The other mails are passed to Dovecot deliver this way: :0 w | /opt/dovecot/libexec/dovecot/deliver For moving mails to subdirectorys this works always, but not for mails that are discard via Sieve. Examples are: if header :contains "List-Id" "git.vger.kernel.org" { if header :contains "Subject" "[ANNOUNCE]" { fileinto "Announce"; stop; } if header :contains "Subject" "[ANN]" { fileinto "Announce"; stop; } if header :contains "Subject" "[PATCH" { discard; stop; } fileinto "Lists.Git"; stop; } or if header :contains "Organization" "web.de" { discard; stop; } This often works, but sometimes it fails. Procmail reports then that deliver reported an error (but not which) and delivers them to my inbox. There are also no message in dovecots or dovecot delivers log file. Dose anybody have an idea? Steve

3 12

[Dovecot] How can I configure dovecot as gmail imap proxy
by Supratik Goswami 19 Jan '10

19 Jan '10

Hi, I want to configure dovecot as gmail imap proxy. If any system in my network wants to connect to imap.gmail.com,993 it has to go through the dovecot proxy. Is it possible to setup such environment with dovecot? If yes, can you please help me to configure my dovecot server. Warm Regards Supratik

3 2

[Dovecot] Update Dovecot index files on maildrop delivery?
by Kārlis Repsons 19 Jan '10

19 Jan '10

Hi all, is there some easy way to inform Dovecot about a new delivery, which has happened after postfix invoked maildrop, so the index files would be updated?

3 5

[Dovecot] Socket permission 432/384 and dovecot.conf
by Seba 19 Jan '10

19 Jan '10

Sorry for that question but: when you set in dovecot.conf this for example: socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } and you run "dovecot -n" you'll see client: path: /var/spool/postfix/private/auth mode: 432 I'm wondering about the mode "432" - how is this value calculated? Same for the auth/master socket socket - the value ist "384" and in dovecot.conf it's 0600. Thanks for any info. Seba

3 2

[Dovecot] Dovecot Proxy and environment variables
by BaQs 19 Jan '10

19 Jan '10

Dear list, First of all, I am French so excuse my bad english. I am currently using dovecot proxy feature, using sql backend. I "proxy" the imap/pop requests to another server, let's say server2. On server2, I use a script to keep up to date a "pop before smtp auth" database. I used mail_executable = /path/to/this/script.sh ... My problem is: the $IP environment variable on server2 is the proxy's IP. How could I give a variable from proxy to server2, or simply get the real client public IP ? Thanks a lot in advance for your answers Pierre. PS: let me also thank very much dovecot developers and community !

3 7

[Dovecot] No filelocking at "shared-mailboxes" dictionary?
by Peer Heinlein 19 Jan '10

19 Jan '10

Using imapsync I changed many ACLs on many accounts simultaneously in four concurrent IMAP-sessions. I started with an empty file "shared-mailboxes". But after the sync the file "shared-mailboxes" has been crashed. I found broken lines and I'm missing some entrys. Is it possible that there's no filelocking on that file? I used the ext3 filesystem. That's what shred-mailboxes looks like at the moment: shared/shared-box 1 shared/shared-boxes/user/user1.example.com/user2.example.com 1 .example.com/user5.example.com 1 hared/shared-boxes/user/user6.example.com/user4.example.c2442203233424^? 1 ser/user7.example.com/user2.example.com Peer dovecot -n: # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.27.39-0.2-default x86_64 openSUSE 11.1 (x86_64) protocols: imap imaps managesieve ssl_cert_file: /etc/ssl/old.pem ssl_key_file: /etc/ssl/old.pem shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_process_per_connection: no login_max_processes_count: 512 max_mail_processes: 1024 mail_max_userip_connections(default): 40 mail_max_userip_connections(imap): 40 mail_max_userip_connections(managesieve): 10 verbose_proctitle: yes mail_uid: vmail mail_gid: vmail mail_location: maildir:~/Maildir mail_executable(default): /usr/lib/dovecot/imap-usernamenmigration mail_executable(imap): /usr/lib/dovecot/imap-usernamenmigration mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota acl imap_acl mail_plugins(imap): quota imap_quota acl imap_acl mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib64/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib64/dovecot/modules/managesieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: shared separator: / prefix: zz_SHARED_ACCOUNTS/%%u/ location: maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u list: yes lda: postmaster_address: postmaster(a)iea-dpc.org mail_plugins: quota acl sieve mail_plugin_dir: /usr/lib64/dovecot/modules/lda quota_full_tempfail: yes auth default: mechanisms: plain login digest-md5 cram-md5 verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/dovecot/userdb userdb: driver: passwd-file args: /etc/dovecot/userdb userdb: driver: static args: uid=5001 gid=5001 socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail plugin: quota: maildir quota_rule: *:storage=102400 acl: vfile acl_shared_dict: file:/var/lib/dovecot/shared-mailboxes sieve: ~/.dovecot.sieve sieve_dir: ~/sieve -- Heinlein Professional Linux Support GmbH Linux: Akademie - Support - Hosting http://www.heinlein-support.de Tel: 030 / 40 50 51 - 0 Fax: 030 / 40 50 51 - 19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin

2 1

[Dovecot] Fail to handle . and - in mailaddresses
by Mika 18 Jan '10

18 Jan '10

Hi, I seem to have run into a bug. Dot and dash is allowed chars in mail addresses, so a ...---...@ should work. Filtered out domainname and IP's for security reasons. And yes this works with MDaemon as example. Setup is postfix using Dovecot for deliver. Version: 1.2.9 OS: Linux ADM64 (Ubuntu 8.04LTS) Tried to deliver mail to rfc compliant mail address ...---...@domain. # 1.2.9: /opt/dovecot/etc/dovecot.conf # OS: Linux 2.6.24-25-server i686 Ubuntu 8.04.3 LTS ext3 log_path: /var/log/dovecot protocols: imaps imap listen: 127.0.0.1 ssl_listen: :943 ssl_cert_file: /etc/ssl/certs/secure.crt ssl_key_file: /etc/ssl/private/secure.key login_dir: /opt/dovecot/var/run/dovecot/login login_executable: /opt/dovecot/libexec/dovecot/imap-login mail_gid: 1005 mail_location: maildir:/opt/vmail/%d/%n/Maildir lda: postmaster_address: postmaster(a)domain.com sendmail_path: /usr/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master log_path: /opt/vmail/dovecot-deliver.log auth default: mechanisms: plain login passdb: driver: pam passdb: driver: sql args: /opt/dovecot/etc/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/opt/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail >From Deliver logfile: deliver(...---...(a)domain.com): Jan 14 08:18:24 Info: msgid=<798c378b1001132318y4a027757m37a668f48730e6c(a)mail.gmail.com>: saved mail to INBOX # Does not seem to end up in any of the files in Maildir, new/tmp folders are empty. Maildir/cur# grep ...---...(a)domain.com * Maildir/cur# //Mika

2 2

[Dovecot] sieve: discarding vacation response
by wenjie zheng 18 Jan '10

18 Jan '10

Configuration: RHEL 5.3, Dovecot 2.0 beta1, dovecot-2.0-sieve (1week old) [wenjie@build dovecot2-2.0.beta1]$ telnet mail4a 24 Trying 172.19.1.74... Connected to mail4a.cloud.dev.mlsrvr.com (172.19.1.74). Escape character is '^]'. 220 mail4a Dovecot LMTP ready mail from:<testmail4a50(a)dev.p4nt5.com> 250 2.1.0 OK rcpt to:<testmail4a2(a)dev.p4nt5.com> 250 2.1.5 OK DATA 354 OK From: <testmail4a50(a)dev.p4nt5.com> To: foo Subject: hello Hello there . 250 2.0.0 <testmail4a2(a)dev.p4nt5.com> eMcYKg7gUEt8ewAA0TR52A Saved quit 221 2.0.0 Client quit Connection closed by foreign host. testmail4a2(a)dev.p4nt5.com has a local .dovecot.sieve file, which contains a vacation auto response. #begin require ["fileinto", "body", "vacation"]; vacation :days 1 text: I am away. . ; keep; #end In the log: Jan 15 15:38:07 mail4a dovecot: lmtp(31612, testmail4a2(a)dev.p4nt5.com) eMcYKg7gUEt8ewAA0TR52A: sieve: msgid=unspecified: discarding vacation response for message implicitly delivered to <testmail4a2(a)dev.p4nt5.com> Jan 15 15:38:07 mail4a dovecot: lmtp(31612, testmail4a2(a)dev.p4nt5.com) eMcYKg7gUEt8ewAA0TR52A: sieve: msgid=unspecified: stored mail into mailbox 'INBOX' Thanks, Wenjie

2 2

[Dovecot] Upgrade path questions
by Thomas M Goerger 18 Jan '10

18 Jan '10

Hi, We are currently running Dovecot v1.1.6 on our servers, and are contemplating an upgrade to 1.2, or 2.0 soon. We are wondering how many organizations are still running a 1.1 version of Dovecot, and if anyone has any thoughts on this transition. Have you upgraded from 1.1 to 1.2? What are your experiences with this? Have you upgraded from 1.1 to 2.0 directly? What are your experiences this way? We are also running an environment with both mbox and maildir formats. How many of you are running similarly, or are running solely maildir or mbox? We're just looking to gather information going forward, and anything you might be able to contribute would be very helpful. Thanks! ************************************************************************* * Tom Goerger - Email/Unix System Administrator * * * * University of Minnesota Email: tmg(a)umn.edu * * Operations, Infrastructure and Architecture Phone: 4-5804 * * Internet Services Office: 626J WBOB * * * *************************************************************************

4 3