- dovecot - dovecot.org

[Dovecot] pkgsrc-ing sieve and managesieve
by Edgar Fuß 24 Feb '09

24 Feb '09

I'm trying to integrate both the new sieve implementation and managesieve into pkgsrc. Managesieve seems to need some dovecot libraries that dovecot doesn't install (lib-storage/libstorage.a, lib-auth/libauth.a, lib-imap/libimap.a, lib-index/libindex.a, lib-mail/libmail.a, lib-charset/libcharset.a, lib-dict/libdict.a and lib-charset/libcharset.a). There seems to be no provision in pkgsrc for the build of a package needing the work directory of the build of another package. Would it make sense for dovecot to install those libraries?

2 1

[Dovecot] sieve-test again
by Ian P. Christian 23 Feb '09

23 Feb '09

I'm not sure what it is I'm doing wrong here, perhaps my 'test' mail is not in the format expected by sieve-test. The 'test' file is a file taken directly from a dovecot maildir - so is in the normal format of having headers, a new line, then the body. There is nothing exceptional about this email. Notice how the header below is 'innocent', however it appears that the test is ignoring this header. # grep DSPAM-Res test X-DSPAM-Result: Innocent # cat sievetest require ["regex", "fileinto","envelope","reject","vacation","relational","comparator-i;ascii-numeric"]; if header :contains "X-DSPAM-Result" "Innocent" { fileinto "moo"; stop; } # sieve-test -c ./sievetest ./test Performed actions: (none) Implicit keep: * store message in folder: INBOX Info: final result: success I don't think it's this header, but rather *all* headers, as the following check also appears to fail. if header :contains "To" "o" { fileinto "Spam"; stop; } Am I mis-using the tool? Thanks, Ian

2 3

[Dovecot] from postfix deliver to dovecot deliver
by Johan Hendriks 23 Feb '09

23 Feb '09

Hello all. I use dovecot in combination with postfix, postfixadmin for virtual users. Deliver to the mailbox now is done by postfix Now i want to enable quota's and therefor i need dovecot deliver. Can i just switch to dovecot deliver? Or must i first do some prrperations in the mailboxes. regards -- _______________________ *Johan Hendriks* *Schavemaker Transport* Tel: +31 (0)251 229098 Fax: +31 (0)251 212016 email: j.hendriks(a)schavemaker.com <mailto:j.hendriks@schavemaker.com> web: http://www.schavemaker.com _______________________ /Confidentiality Notice: The information in this document may be confidential. It is intended only for the use of the named recipient. If you are not the intended recipient, please notify me immediately and then delete this document. Do not disclose the contents of this document to any other person, nor take any copies. Violation of this notice may be unlawful. / _______________________

2 2

[Dovecot] lda catchall
by Stéphane Cottin 23 Feb '09

23 Feb '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm using dovecot lda in a qmail / vpopmail testing environnement. I would like to replace vpopmail lda with dovecot's one , because of quotas , sieve filers, indexing while delivering ... Everything is working great, except the catchall. If I want to bounce, a first line like "# bounce-no-mailbox" in the .qmail file works, without this line, emails to unknown addresses are deferred and stay in the queue, because they are deliverable for qmail, but not for dovecot lda. How can I set a catchall email address for dovecot lda ? thx Stéphane Cottin -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkmixCcACgkQNgQUYqHIqqvttQCfcNBLd9Qo06g5nMcrfZAwVlpv WegAnj7jIA/XFJWmt/2jkg1sxRYKRaI7 =JTTV -----END PGP SIGNATURE-----

1 0

[Dovecot] sieve-test issue
by Ian P. Christian 23 Feb '09

23 Feb '09

Hi all, I'm using a build of dovecot 1.2, and I'm seeing this: # ls -al 1235038385.M765212P13483.tch-mailstore1\,S\=3927\,W\=4017\:2\,S -rw------- 1 mail mail 3927 2009-02-19 10:13 1235038385.M765212P13483.tch-mailstore1,S=3927,W=4017:2,S (root@tch-mailstore1:/mailstore/mail/domain.net/i/ian/mail/.postini/cur) (2009-02-23 13:46:04) # sieve-test -c ../../../sieve/default.sieve 1235038385.M765212P13483.tch-mailstore1\,S\=3927\,W\=4017\:2\,S Fatal: Can't open mail stream as raw Can anyone suggest what this error means? Thanks, Ian

1 1

[Dovecot] v1.2.beta1 released
by Timo Sirainen 23 Feb '09

23 Feb '09

http://dovecot.org/releases/1.2/beta/dovecot-1.2.beta1.tar.gz http://dovecot.org/releases/1.2/beta/dovecot-1.2.beta1.tar.gz.sig Largest changes since v1.1 can be found from http://dovecot.org/doc/NEWS-1.2 Changes since alpha5: - Added support for ESORT extension (also SORT .. RETURN (PARTIAL) from CONTEXT=SORT that allows windowing SORT results) - pop3: If client idles for 10 seconds, commit transaction (allowing mbox to become unlocked). - crashfixes to virtual mailboxes - all kinds of bug fixes, error message improvements, etc. - http://dovecot.org/patches/1.2/stats-plugin.c may give some interesting statistics about commands There isn't really much left to do for v1.2.0 except some small fixing to shared mailbox code. And writing documentation for it..

3 6

[Dovecot] IMAP ACLs and global ACLs in v1.2
by Timo Sirainen 23 Feb '09

23 Feb '09

I just committed code for IMAP ACL support based on the code from Kolab people. I did quite large changes though. I also changed how global ACLs are handled. Previously local ACLs could override global ACLs, but now that users are able to modify the ACLs I think it should be the other way around. From what I've heard global ACLs are typically added for things like 1) disallowing user from doing something in specific mailboxes such as expunge messages, 2) giving a specific master user access to some mailboxes ONLY, such as voicemail. For 1) case a user really shouldn't be able to grant himself privileges back but still should be able to share the mailbox to others (so the global ACL should have 'a' privilege). For 2) case a user shouldn't be able to remove privileges from the voicemail. So now the user can freely update the local ACLs in whatever way he wants. But in the end if there are any global ACLs, all the local ACLs for those identifiers are ignored. Also local negative identifiers are ignored, so that e.g. global "user=foo lr" can't be disabled by a local "-user=foo lr" ACL. I guess I should update the Wiki ACL page about how exactly the ACLs are applied now that they're well in my memory. :) One thing I'm not really sure about is the "owner" handling. IMAP ACL specifications have no such concept. I think many/most other servers simply add a default ACL for the user name directly. It's a useful concept though, especially with the global ACLs. So currently Dovecot replies: x getacl inbox * ACL "inbox" "owner" lrwstiekxacd x OK Getacl completed. But should it just internally convert "owner" to "username" when replying? But then again if there's a separate rule directly for the "username" it breaks. Do any of the existing ACL-capable IMAP clients want to see the username in the ACL reply or can they handle "owner" just fine? Also what about global ACLs? The current code just lists them twice with local ACLs, which is definitely wrong: x getacl foo * ACL "foo" "xx" w "xx" lr "owner" lrwstiekxacd x OK Getacl completed. Perhaps the global ACLs could have a prefix character? Maybe '#'? Which reminds me, the current dovecot-acl file is mapped to IMAP ACLs like this: dovecot-acl : IMAP ACL - anyone : anyone - authenticated : authenticated - owner : owner - user=name : name - group=name : $name - group-override=name : !$name So all global ACLs would get the # prefix, like #anyone, #name, #!$name. Any thoughts? BTW. Listing shared mailboxes still doesn't work. I guess we'll see tomorrow if I still have energy to get that done.

6 14

[Dovecot] dovecot auth
by ben 23 Feb '09

23 Feb '09

Hi, I'm using dovecot with a passdb-file . When I login using : test(a)testdomain.com I notice dovecot strips off the domainname and looks up everything in front of the @ in his passdb-file... So I went on to configure the following in my dovecot.conf : auth_username_format = %u@%d restarted dovecot, but he still strips of the @ and the domainname ... LOG (sorry for f* up format) : dovecot: Feb 21 12:15:08 Info: auth(default): new auth connection: pid=24483 dovecot: Feb 21 12:15:12 Info: auth(default): client in: AUTH 1 PLAIN service=pop3 lip=195.207.136.102 rip=195.207.136.108 lport=110 rport=36132 resp=AGJlbkBpdHV4LmJlAHRlc3QxMjMu dovecot: Feb 21 12:15:12 Info: auth(default): passwd-file(test@testdomain.com@testdomain.com,195.207.136.108): lookup: user=test file=/opt/dovecot/etc/dovecot.passwd dovecot: Feb 21 12:15:12 Info: auth(default): passwd-file(test@testdomain.com@testdomain.com,195.207.136.108): unknown user dovecot: Feb 21 12:15:14 Info: auth(default): client out: FAIL 1 user=test(a)testdomain.com Can someone enlighten me on how to config it so he looks up "test(a)testdomain.com" fully ? thx

3 5

[Dovecot] Cant Receive Email from dovecot pop
by Linux Advocate 22 Feb '09

22 Feb '09

Guys, i am new to dovecot. I am not able to retrieve email from an account that i just setup. A. This is the output from /var/log.maillog. ........................................................... Feb 21 18:01:31 fwgw dovecot: auth(default): client in: AUTH 1 PLAIN service=POP3 lip=::ffff:60.54.174.146 rip=::ffff:60.50.250.8 resp=<hidden> Feb 21 18:01:31 fwgw dovecot: auth-worker(default): mysql: Connected to localhost (postfix) Feb 21 18:01:31 fwgw dovecot: auth-worker(default): sql(fizan,::ffff:60.50.250.8): query: SELECT password FROM mailbox WHERE username = 'fizan' Feb 21 18:01:31 fwgw dovecot: auth-worker(default): sql(fizan,::ffff:60.50.250.8): unknown user Feb 21 18:01:32 fwgw dovecot: auth(default): new auth connection: pid=3567 Feb 21 18:01:32 fwgw dovecot: auth(default): client out: FAIL 1 user=fizan Feb 21 18:01:32 fwgw dovecot: pop3-login: Aborted login: user=<fizan>, method=PLAIN, rip=::ffff:60.50.250.8, lip=::ffff:60.54.174.146 B. This is my /etc/dovecont.conf ............................................ ## Dovecot configuration file protocols = imap pop3 auth default { userdb sql { args = /etc/dovecot-mysql.conf } passdb sql { args = /etc/dovecot-mysql.conf } } first_valid_uid = 89 default_mail_env = maildir:/home/vmail/%d/%n # Debugging options auth_verbose = yes auth_debug = yes C. Error Message from the Email Client - Kmail ................................................................ I get a messge saying; "Could not Login to mail.mesara.biz. The password may be wrong. The server said authentication failed" D. Other info ............. I am running on a Centos 5.2 box , with postfix 2.3, dovecot 1.0.7, mysql 5.0.45 Pls help. Much appreciated. Regards. gomez

2 6

[Dovecot] TLS / Dovecot / POP3
by John Espiro 22 Feb '09

22 Feb '09

I am using Thunderbird 2.x as my client, Dovecot on the server (POP3 not IMAP). Currently I have in my conf file: protocols = pop3s pop3 ssl_disable = no ssl_cert_file = /usr/share/ssl/certs/dovecot.pem ssl_key_file = /usr/share/ssl/private/dovecot.pem ssl_parameters_file = /var/run/dovecot/ssl-parameters.dat disable_plaintext_auth = yes login = pop3 In Thunderbird, I have the email server setup to: - Port 110 - TLS Here's my question: If I change protocols = pop3s pop3 to protocols = pop3s I can no longer connect to my mail server via Thunderbird unless I setup Thunderbird to use SSL. Am I doing something wrong? Thanks, John

2 1

[Dovecot] LDAP documentation cleanups
by Timo Sirainen 22 Feb '09

22 Feb '09

I remember some people also complained how the LDAP documentation was messy. Here's my attempt at cleaning it up: http://wiki.dovecot.org/AuthDatabase/LDAP Anything still unclear? (Other than SSL/TLS setup. Someone who knows how it really works should write something there.)

1 0

[Dovecot] Problem with v1.1.10
by Cyrus Rahman 22 Feb '09

22 Feb '09

I've been using 1.1.8 successfully but tried out 1.1.10 this morning. I have a combination of system and virtual users. The system users were unaffected by the change, but the virtual users all lost access to their mail because their home directories, as interpreted by dovecot, moved from user@domain to user@user@domain. The location of the home directory is given to dovecot for virtual users using the static db as uid=vmail gid=vmail home=/var/vmail/%u mail=maildir:~/Inboxdir Were there any changes in this area that might have caused the problem? Cyrus dovecot -n output: # 1.1.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.1-RELEASE-p2 amd64 protocols: imaps managesieve ssl_cert_file: /etc/ssl/dovecot/certs/dovecot.pem ssl_key_file: /etc/ssl/dovecot/private/dovecot.pem login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(managesieve): no verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: mbox:~/.dovecot:INBOX=/var/mail/%u mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugins(default): expire quota imap_quota trash fts fts_squat antispam autocreate mail_plugins(imap): expire quota imap_quota trash fts fts_squat antispam autocreate mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(managesieve): dict_db_config: /usr/local/etc/dovecot-db.conf sieve_storage(default): sieve_storage(imap): sieve_storage(managesieve): ~/.sieve sieve(default): sieve(imap): sieve(managesieve): ~/.dovecot.sieve namespace: type: private separator: / prefix: #mbox/ inbox: yes hidden: yes subscriptions: yes namespace: type: private separator: / location: maildir:~/Maildir list: yes subscriptions: yes auth default: mechanisms: plain login username_format: %Lu passdb: driver: pam args: session=yes dovecot passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: passwd args: blocking=yes userdb: driver: static args: uid=vmail gid=vmail home=/var/vmail/%u mail=maildir:~/Inboxdir socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail

4 6

[Dovecot] dovecot 1.2 virtual folders question
by Robert Schetterer 22 Feb '09

22 Feb '09

Hi Timo is this possible a possible setup ? for downloading imap folders ( including inbox ) with pop3 controlled by a a dovecot-virtual file in usr/local/virtual/%d/%u/ with content something like that * -Trash -Trash/* -Sent -Sent/* -Drafts -Drafts/* all namespace private { separator = / prefix = "" location=maildir:/usr/local/virtual/%d/%u/:CONTROL=/usr/local/virtual/%d/%u/:INDEX=/usr/local/virtual/%d/%u/ inbox = yes subscriptions = yes list = yes } namespace private { prefix = virtual/ separator = / location = virtual:/usr/local/virtual/%d/%u:LAYOUT=maildir++ inbox = no } it doesnt work yet, but i am nearly sure that i havent understand http://wiki.dovecot.org/Plugins/Virtual perhaps you might bring me on the way background : i want to include a global sieve rule which sorts marked spam mails in a subfolder of inbox called Junk, so that users never can overide it and set perhaps an autoreply by an Sieve rule by incomming mail to inbox to make it possible that pop3 users may fetch sorted Spam mails outta the Junk folder too, i wanna use virtual setup folders Trash , Sent , Drafts are standart folders are standart and should be ignored with that -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 11

[Dovecot] DIGEST-MD5 user/realm mismatch with Postfix
by Darren Pilgrim 22 Feb '09

22 Feb '09

This is a follow-on to the "SQL field format for digest-md5?" thread. After some additional debugging, I've found the problem is a mismatch in what Dovecot expects and Postfix uses for the user and realm. For a username "user(a)example.com" and password "sekret", Dovecot expects: username = "user" realm = "example.com" but Postfix sends the checksum of: username = "user(a)example.com" realm = "" How do I fix this?

2 1

Re: [Dovecot] Concurrent POP3 Sessions Issues
by Timo Sirainen 22 Feb '09

22 Feb '09

Did you already solve this? If not, just mail the strace output to me privately and I'll take a look at it. On Fri, 2009-01-30 at 09:39 -0300, Mauricio López Riffo wrote: > Timo, > > What messages should be see? I execute the commands and shows a lot > of messages, i dont know what it means, i m not a programmer :) > > > Thanks > > ---- > > Mauricio López Riffo > Red Hat Certified Engineer > 804006455319519 > Netline Telecomunicaciones Chile > Los Conquistadores 2430, Providencia, Santiago. > Codigo Postal: 7530041 > Fono: +562 6560600 > Móvil: +569 90992366 > > > -----Mensaje original----- > > De: Timo Sirainen [mailto:tss@iki.fi] > > Enviado el: jueves, 29 de enero de 2009 20:46 > > Para: mauricio.lopez(a)netline.net; Dovecot Mailing List > > Asunto: Re: [Dovecot] Concurrent POP3 Sessions Issues > > > > On Jan 29, 2009, at 1:17 PM, Mauricio López Riffo wrote: > > > > > I have problems with dovecot + ldap + nfs, we could't have more than > > > 20 concurrent sessions of pop3, when user 21 comes, the auth process > > > takes more than 1 sec and is incresing (while most users arrives, more > > > delay in > > > autenticacion exists) and my customers complaint about the service. > > > We need > > > support about 200 concurrents pop3 users, here is my details > > > > Someone else was recently complaining about the same thing. Or was it you? > Anyway, > > dovecot-auth doesn't know how many users are logged in so if the problem > really is 21 > > *concurrent users* instead of n logins/ second, I find it highly unlikely > that the problem is > > with authentication. > > > > My guess is that this has something to do with NFS. Perhaps start Dovecot > with strace -tt -f > > dovecot and then when it's slowing down see what syscall it says is > blocking. >

1 0

[Dovecot] One Dovecot serving 2 domains - possible?
by k bah 22 Feb '09

22 Feb '09

I'm talking about Dovecot 1.0.x, since 1.1.x showed some problems on some of my servers. -- Is it possible to have Dovecot on one machine serving two different domains? How can I set the mailboxes root to one domain to /dir1/ and to the other domain to /dir2/ ? I want all mailboxes from one domain to reside on a different mailbox root. I use Dovecot LDA. Is is possible to set a LDAP config to one domain and another LDAP config to the other (the auth part, I wan't users to reside on different bases on my LDAP tree, so search bases need to be different) thanks in advance = Scrublade Wipers New, Heavy Duty, wiper design to remove bugs and road slime. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=2b9f0c9f1afcc5e7181028e… -- Powered by Outblaze

2 1

[Dovecot] auth-worker always opens PAM session
by Miguel Di Ciurcio Filho 21 Feb '09

21 Feb '09

I'm using Dovecot 1.1.7 on CentOS 5.2. I've changed my passdb from passwd to pam, it works fine, but I've found this messages on /var/log/secure: dovecot-auth: PAM adding faulty module: /lib64/security/pam_limits.so dovecot-auth: PAM unable to dlopen(/lib64/security/pam_limits.so) dovecot-auth: PAM [error: /lib64/security/pam_limits.so: failed to map segment from shared object: Cannot allocate memory] Latter I realized that my auth_process_size was 64. Changed it to 128 and problem solved. But I suspect that dovecot should not be opening sessions, because there is no session=yes on my passdb configuration. According to the docs: args = dovecot [session=yes] [setcred=yes] [failure_show_msg=yes] [cache_key=<key>] [<service name>] session=yes makes Dovecot open and immediately close PAM session. Some PAM plugins need this to work, such as pam_mkhomedir. I checked the source code in passdb-pam.c: struct pam_passdb_module { struct passdb_module module; const char *service_name, *pam_cache_key; unsigned int pam_setcred:1; unsigned int pam_session:1; unsigned int failure_show_msg:1; }; And this: /* -session for backwards compatibility */ if (strcmp(t_args[i], "-session") == 0 || strcmp(t_args[i], "session=yes") == 0) module->pam_session = TRUE; It seams to me that the session is going to be opened anyway, since pam_session is always TRUE. Regards, Miguel

2 3

[Dovecot] quota and dict quota
by Osvaldo Alvarez Pozo 21 Feb '09

21 Feb '09

Hi I am running dovecot with quota. as show in this part of dovecot.conf . protocols = imap pop3 protocol imap { mail_plugins = quota imap_quota imap_client_workarounds = outlook-idle delay-newmail } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = quota log_path = /var/log/dovecot-deliver.log info_log_path = /var/log/dovecot-deliver.log } Now I want to see the users's use of quota in postfixadmin, wich demende the use of dict quota. That is wath I do not understang. Can I have dict quota and mail_plugins=quota at the same time? How do I do? Thanks

2 5

[Dovecot] Dovecot 1.2.beta1 Backtrace POP3
by Steven King 21 Feb '09

21 Feb '09

I am testing out the new Dovecot 1.2.beta1 software. I am getting reports from people using POP3 that it randomly drops connections. Looking at the log file I see that the POP3 process they were connecting to panics and dumps a Raw bactrace. Below is a copy of the logs (IP addresses striped for security): dovecot: Feb 21 13:10:45 Info: auth(default): passwd-file(janna(a)jantics.com,x.x.x.x): lookup: user=janna(a)jantics.com file=/etc/postfix/passwd dovecot: Feb 21 13:10:45 Info: auth(default): master out: USER 3340 janna(a)jantics.com uid=1005 gid=102 home=/var/mail/vhosts/%d/%n quota=maildir quota_rule=*:storage=100M quota_rule2=Trash:storage=50M dovecot: Feb 21 13:10:45 Panic: POP3(janna(a)jantics.com): Trying to allocate 0 bytes dovecot: Feb 21 13:10:45 Error: POP3(janna(a)jantics.com): Raw backtrace: pop3 [0x80d18fc] -> pop3 [0x80d195a] -> pop3 [0x80d125b] -> pop3 [0x80db683] -> pop3(i_malloc+0x15) [0x80d5ee5] -> pop3(client_create+0x503) [0x805c573] -> pop3(main+0x3ce) [0x805e00e] -> /lib/libc.so.6(__libc_start_main+0xe0) [0xb7e39390] -> pop3 [0x805b7e1] dovecot: Feb 21 13:10:45 Error: child 26895 (pop3) killed with signal 6 dovecot: Feb 21 13:10:45 Info: pop3-login: Login: user=<janna(a)jantics.com>, method=PLAIN, rip=69.54.221.129, lip=x.x.x.x -- Steve King Network Engineer - Liquid Web, Inc. Cisco Certified Network Associate CompTIA Linux+ Certified Professional CompTIA A+ Certified Professional

2 2

[Dovecot] Maildir with INBOX and other folders at same level
by Seth Rhudy 21 Feb '09

21 Feb '09

Hello- I have set up Dovecot before and feel fairly comfortable with it but am having some issues with a new setup and have not been able to find a solution via Google or the list archives. I use offlineiimap to sync an IMAP account with an email provider. After the sync is complete, my ~/Maildir is set up with a folder called INBOX (with cur,new,tmp inside) and all my other folders set up at same level as INBOX (also with cur,new,tmp inside): ~/Maildir INBOX cur new tmp Otherfolder1 cur new tmp Otherfolder2 cur new tmp etc.. This email provider says that they use '/' as the IMAP folder separator so '.' can be used in folder names. Anyway, I am using Dovecot 1.0.15 on Debian Lenny and can't seem to get Dovecot to recognize this folder structure and display it in my MUA. In my dovecot.conf, I have: mail_location = maildir:~/Maildir When I fire up my MUA it connects fine but does not display anything -- the INBOX is empty and the other folders are not there. I have tried various configurations with the namespace private {} section but without success. What am I missing? Thank you in advance for your assistance.

2 2

[Dovecot] Sendmail + Deliver as an LDA probs
by ben 21 Feb '09

21 Feb '09

Hi, I'm having trouble setting up sendmail to be able to use dovecot deliver as an LDA... I don't want to be able to deliver mail locally, everything should go via deliver (virtual user setup)... And i'm confused about all the procmail/lda entry's in different sendmail config files... When using $# deliver -u testuser < testmail <-- he delivers my mail in the correct mailbox as stated in my dovecot passdb file homedir. So deliver is working fine ! ---- I used the dovecot.m4 from wiki.dovecot.org/LDA/sendmail sendmail.mc fragment (only lines affecting Local delivery) : DOMAIN(`blaat')dnl MODIFY_MAILER_FLAGS(`LOL', `-S')dnl FEATURE(`local_procmail')dnl define(`LOL_MAILER_PATH',`/usr/bin/procmail')dnl define(`PROCMAIL_MAILER_PATH',`/usr/bin/procmail')dnl dnl MAILER(`local')dnl MAILER(`smtp')dnl MAILER(`procmail')dnl MAILER(`dovecot')dnl dnl ------ blaat.m4 fragment : define(`LOCAL_MAILER_PATH',`/usr/bin/procmail') define(`PROCMAIL_MAILER_PATH',`/usr/bin/procmail') ------ more /usr/local/src/sendmail-x.x/cf/mailer/dovecot.m4 : ######################*****############## ### DOVECOT Mailer specification ### ##################*****################## Mdovecot, P=/opt/dovecot/libexec/dovecot/deliver, F=DFMPhnu9, S=EnvFromSMTP/HdrFromSMTP, R=EnvToSMTP/HdrFromSMTP, T=DNS/RFC822/X-Unix, A=deliver -d $u ------- virtusertable/virtusertable.db : test(a)testdomain.com blaatuser --------- aliases/aliases.db : blaatuser | /opt/dovecot/libexec/dovecot/deliver -d $u ---- sendmail.cw = empty ----- mailertable/mailertable.db : testdomain.com dovecot:dovecot ################# When I run #$ sendmail -bv test(a)testdomain.com sendmail gives : test(a)testdomain.com... deliverable: mailer local, user test (as a matter of fact the user test does exist on my machine, so what he does is stripping of the domainname and he delivers the mail in /var/spool/mqueue/test :-/ ) And I don't see anything in my deliver logfile of course... Help would be appreciated ! thx Ben

2 5

[Dovecot] v1.2.beta1 virtual plugin raw trace
by Robert Schetterer 21 Feb '09

21 Feb '09

Hi Timo, using 1.2 beta with virtual plugin testing parallel imap/pop3 download with dovecot-virtual virtual/INBOX -Trash -Trash/* all dovecot: Feb 11 07:03:08 Panic: POP3(.....@.....): file mailbox-list.c: line 420 (mailbox_list_iter_init_multiple): assertion failed: (*patterns != NULL) dovecot: Feb 11 07:03:08 Error: POP3(....@.....): Raw backtrace: pop3 [0x80ddb01] -> pop3 [0x80ddb82] -> pop3 [0x80dd529] -> pop3 [0x80a609c] -> pop3(mailbox_list_iter_init_namespaces+0xed) [0x80a623d] -> /usr/lib/dovecot/modules/pop3/lib20_virtual_plugin.so(virtual_config_read+0x706) [0xb7ddbec6] -> /usr/lib/dovecot/modules/pop3/lib20_virtual_plugin.so [0xb7ddda0b] -> /usr/lib/dovecot/modules/pop3/lib20_mail_log_plugin.so [0xb7de42ea] -> /usr/lib/dovecot/modules/pop3/lib10_quota_plugin.so [0xb7df014a] -> pop3(mailbox_open+0x52) [0x80a4772] -> pop3(client_create+0x16f) [0x805edcf] -> pop3(main+0x416) [0x8060e96] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe0) [0xb7e0b450] -> pop3 [0x805e3d1] as allready described * -Trash -Trash/* all produces Virtual mailbox loops: INBOX dovecot: Feb 11 07:02:00 Error: POP3(....@.....): Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2009-02-11 07:02:00] whatever i tried setup cant get virtual plugin to work as awaited -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 1

[Dovecot] location of temporary files in deliver
by Stuart Henderson 21 Feb '09

21 Feb '09

deliver has the following: -- -- -- /* After buffer grows larger than this, create a temporary file to /tmp where to read the mail. */ #define MAIL_MAX_MEMORY_BUFFER (1024*128) ... static struct istream *create_raw_stream(int fd, time_t *mtime_r) ... input = i_stream_create_seekable(input_list, MAIL_MAX_MEMORY_BUFFER, "/tmp/dovecot.deliver."); -- -- -- On most of my systems, /tmp is relatively small (a few hundred MB, and sometimes on ramdisk), and I like to use /var/tmp for larger temp space. I just had a problem where I exceeded the space available in /tmp while delivering a (multi recipient) message and had to modify the above line to use an alternative location, and recompile. Would it be appropriate to make this a configurable option instead? Thanks. Feb 3 15:14:51 mh1-pl7 deliver(169(a)example.com): write_full(/tmp/dovecot.deliver....) failed: No space left on device Feb 3 15:14:51 mh1-pl7 deliver(149(a)example.com): write_full(/tmp/dovecot.deliver....) failed: No space left on device Feb 3 15:14:51 mh1-pl7 deliver(opx-cc(a)example.com): write_full(/tmp/dovecot.deliver....) failed: No space left on device Feb 3 15:14:51 mh1-pl7 deliver(142(a)example.com): write_full(/tmp/dovecot.deliver....) failed: No space left on device Feb 3 15:14:51 mh1-pl7 deliver(165(a)example.com): write_full(/tmp/dovecot.deliver....) failed: No space left on device Feb 3 15:14:51 mh1-pl7 deliver(152(a)example.com): stat(/tmp/Dovecot Delivery Mail) failed: No space left on device Feb 3 15:14:51 mh1-pl7 deliver(152(a)example.com): msgid=<49885EB9.60706(a)example.com>: save failed to INBOX: BUG: Unknown internal error Feb 3 15:14:51 mh1-pl7 deliver(152(a)example.com): sieve runtime error: Keep: Generic Error Feb 3 15:14:51 mh1-pl7 deliver(152(a)example.com): sieve_execute_bytecode(/home/vmail/example.com/152/.dovecot.sievec) failed Feb 3 15:14:51 mh1-pl7 deliver(125(a)example.com): stat(/tmp/Dovecot Delivery Mail) failed: No space left on device Feb 3 15:14:51 mh1-pl7 deliver(125(a)example.com): msgid=<49885EB9.60706(a)example.com>: save failed to INBOX: BUG: Unknown internal error Feb 3 15:14:51 mh1-pl7 deliver(125(a)example.com): sieve runtime error: Keep: Generic Error Feb 3 15:14:51 mh1-pl7 deliver(125(a)example.com): sieve_execute_bytecode(/home/vmail/example.com/125/.dovecot.sievec) failed

2 1

[Dovecot] How many namespaces for several groups of shared mailboxes ?
by Thomas Hummel 21 Feb '09

21 Feb '09

Hello Timo, let's say you want to implement several distinct groups of shared mailboxes via one (several) public namespace(s) with dovecot-1.1.x/Maildir. For instance, team1, team2 and team3 work on different projects (project1, project2, project3). Obviously, as many public namespaces (#team1, #team2, #team3) would do the trick, but then, any user (including users who don't belong to any above team) would 'see' useless non-selectionable folders #team*. So my idea would be to create only one public namespace (#Public) into which I'd store directories team1, team2, team3, into which I'd put the needed shared mailboxes. Something like /courriel/boites/public/team1/.shared-project1/ /team2/.shared-project2/ /team3/.shared-project3/ with something like namespace public { separator = / prefix = '#Public/' location = maildir:/courriel/boites/public inbox = no hidden = no list = yes subscriptions = yes } I guess if unix right and ACL are set up correctly, other people would only see non-selectionable '#Public'. The only problem is the subscription file : my understanding is that you have only one subscription file per namespace. Maybe unless you specify something like location = maildir:/courriel/boites/public:CONTROL=<some user dependent location> But wouldn't that induce another problem : such a CONTROL directive would put dovecot-uidlist and dovecot-keywords in the same user dependent location. As I want to share the \Seen flag, I have to . put a dovecot-shared file . not specify INDEX (or at least, not to some user dependent location) So I would end up with . uid lists in some user dependant location (as a side effect of having several subscriptions files) . but indexes shared as uid is listed in index : wouldn't that be a problem ? thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 1

[Dovecot] trash plugin and LDA
by dovecot＠corwyn.net 21 Feb '09

21 Feb '09

I just switched from the default postfix LDA to the dovecot LDA, deliver, and am looking into what new features I have. The wiki references the trash plugin with imap. Can I also enable trash with the lda? Rick Rick Steeves http://www.sinister.net "The journey is the destination"

2 1

[Dovecot] Expire plugin does not delete expired mail
by Nicolas Letellier 21 Feb '09

21 Feb '09

Hello. I use expire plugin with dovecot 1.1.10. See my dovecot -n: # 1.1.10: /usr/local/etc/dovecot.conf # OS: FreeBSD 6.3-RELEASE-p9 i386 ufs syslog_facility: local6 protocols: imap imaps managesieve ssl_cert_file: /etc/ssl/mail/mail.domain.net.cert ssl_key_file: /etc/ssl/mail/mail.domain.net.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_user: dovecot-auth login_greeting: Domain mail server login_processes_count: 2 verbose_proctitle: yes first_valid_uid: 143 last_valid_uid: 143 first_valid_gid: 143 last_valid_gid: 143 mail_access_groups: mail mail_location: maildir:/var/mail/vmail/%u/ mail_debug(default): no mail_debug(imap): no mail_debug(managesieve): yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota mail_log expire mail_plugins(imap): quota imap_quota mail_log expire mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(managesieve): sieve(default): sieve(imap): sieve(managesieve): ~/dovecot.sieve auth default: mechanisms: plain login master_user_separator: * passdb: driver: passwd-file args: /usr/local/etc/dovecot.masterusers master: yes passdb: driver: sql args: /usr/local/etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: dovecot group: mail plugin: quota: maildir quota_rule: *:storage=1000M quota_rule2: Trash:storage=50M quota_warning: storage=80%% /usr/home/scripts/mail_quota-warning.sh 80 quota_warning2: storage=90%% /usr/home/scripts/mail_quota-warning.sh 85 quota_warning3: storage=95%% /usr/home/scripts/mail_quota-warning.sh 90 quota_warning4: storage=95%% /usr/home/scripts/mail_quota-warning.sh 95 sieve: /var/mail/vmail/%u/dovecot.sieve expire: Trash 7 Pubs 15 Junk 1 expire_dict: proxy::expire dict: expire: mysql:/usr/local/etc/dovecot/dovecot-dict-expire.conf The expire plugin works with mysql database. The mysql table is used, and expire_stamp are written on it: user1(a)domain.net/Trash 1234701558 user1(a)domain.net/Junk 1234386055 user2(a)domain.net/Trash 1234874172 user2(a)domain.net/Junk 1234400921 user1(a)domain.net/Pubs 1235576243 I launch /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool every 4 hours. For 3 days, no mails were deleted. However, I have date_stamp in mysql table. I dropped ALL my mails in Junk/Trash folder ; and delete all dovecot.index* in these folders. After, I restarted dovecot with expire plugin, and when a first mail arrived in one of these folder, a line is created in mysql table. But nothing is deleted in my Trash/Pubs/Junk folder. I'm waiting for 3 days. (first mail arrived in these folder on 2009/02/08). Any ideas? Have I to use cronjob/find to delete the expired mail? Regards, -- -Nicolas.

3 4

[Dovecot] Quota not reporting with getquotaroot
by dovecot＠corwyn.net 21 Feb '09

21 Feb '09

I'm running squirrelmail on top of dovecot, and noticed that some of my users display the quota (using the squirrelmail plugin check_quota) and some don't. So I did some digging. For those that do not display the quota, their account also doesn't provide any data with: . getquotaroot inbox * QUOTAROOT "inbox" . OK Getquotaroot completed. When I check the account /Maildir folder it has info in maildirsize 0S 12744423 10 334 1 483685 1 and when I delete the maildirsize file it recreates. any ideas? thx. Rick # 1.1.8: /etc/dovecot.conf # OS: Linux 2.6.18-92.el5 i686 Red Hat Enterprise Linux Server release 5.2 (Tikanga) ext3 ssl_cert_file: /etc/httpd/certs/agencymail_invtitle_com.crt ssl_key_file: /etc/httpd/certs/agencymail.invtitle.com.key.no.password login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_uid: 1015 mail_gid: 105 mail_location: maildir:/var/spool/mail/%d/%n/Maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle imap_client_workarounds(imap): delay-newmail outlook-idle imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: static socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vuser group: vuser plugin: quota: maildir quota_rule: *:storage=102400000 quota_rule2: Trash:storage=100M Rick Steeves http://www.sinister.net "The journey is the destination"

2 1

[Dovecot] NFS error, device busy
by Grandy Fu 21 Feb '09

21 Feb '09

> > On 2/16/2009 9:50 PM, Grandy Fu wrote: > >> > I am running dovecot 1.1.10 and 1.1.11 on Solaris 10, mailboxes are in >> > mbox format and served by Solaris 10 NFSv3, the dovecot cache is on >> > local disk. >> > >> > Some of my users always had above nfs error and their mailbox usually >> > very big, over 100M, 400M, or even 800M. >> > > Please don't put the entire error message in the subject. > > Sorry about that. > Please post output of dovecot -n and some logs exhibiting the problem. Here is some log entries. --------------- dovecot: Feb 19 10:07:02 Error: IMAP(user): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy dovecot: Feb 19 10:07:02 Error: IMAP(user): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy dovecot: Feb 19 10:07:02 Error: IMAP(user): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy dovecot: Feb 19 10:07:02 Error: IMAP(user): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy dovecot: Feb 19 10:07:02 Error: IMAP(user): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy dovecot: Feb 19 10:07:02 Error: IMAP(user): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy ------------------------------------- part of dovecot -n output --------------------------- # 1.1.11: /usr/local/.dovecot1111/etc/dovecot.conf # OS: SunOS 5.10 sun4u log_path: /var/log/dovecot protocols: imaps pop3s imap listen(default): *:143 listen(imap): *:143 listen(pop3): * ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): login_dir: /usr/local/.dovecot1111/var/run/dovecot/login login_executable(default): /usr/local/.dovecot1111/libexec/dovecot/imap-login login_executable(imap): /usr/local/.dovecot1111/libexec/dovecot/imap-login login_executable(pop3): /usr/local/.dovecot1111/libexec/dovecot/pop3-login mail_location: mbox:~/mail:INBOX=/var/mail/%u:INDEX=/localdisk/dovecot.cache/cache/%n mail_debug: yes mmap_disable: yes dotlock_use_excl: no mail_nfs_storage: yes lock_method: dotlock mbox_read_locks: dotlock mbox_write_locks: dotlock mbox_dotlock_change_timeout: 30 plugin: quota: fs:INBOX:user:mount=/var/mail quota2: fs:home:noenforcing:mount=/home ---------------------------------------------------- The problem happens to users' with their inbox over 100M and it happens randomly. Grandy

2 1

[Dovecot] Different protocols with different auth-types
by Morton.Trust 21 Feb '09

21 Feb '09

Hello, I have installed dovecot with MySQL in which the users are stored. Now I want to separate IMAP-Users from POP3-Users. So I added two columns to the user table (imap / pop3) which indicates, whether the user has access to IMAP or not. In order to get dovecot recognizing this separation I put the auth-config into the two protocol-sections and wrote two different dovecot-sql.conf-files. In the dovecot-sql-pop3.conf the query searches for pop3=1 and in the dovecot-sql-imap.conf it searches for imap=1. Done that, I expected POP3-Only-Users getting an error while trying to connect to the IMAP-service. But dovecot first tries to authenticate for IMAP and then uses the POP3-auth as fallback. How can I do this separation? Thanks a lot, Morton -- View this message in context: http://www.nabble.com/Different-protocols-with-different-auth-types-tp22085… Sent from the Dovecot mailing list archive at Nabble.com.

2 1

[Dovecot] dict quota
by Osvaldo Alvarez Pozo 20 Feb '09

20 Feb '09

Hi Actually I use quota. But I would like to use dict quota car with dict quota it is possible to view the used quota. But I do not understand the configuration off dict quota. if the quota is stored in mysql wich do I have to specify quota values in plugin section as chown in the dovecot web site? exemples: dict { quotadict = mysql:/etc/dovecot-dict-quota.conf } plugin { # v1.0: 10MB and 1000 messages quota limit quota = dict:storage=10240:messages=1000 proxy::quotadict # v1.1 + SQL: quota = dict:user::proxy::quotadict quota_rule = *:storage=10M:messages=1000 Thanks

2 1

[Dovecot] deliver
by Il Neofita 20 Feb '09

20 Feb '09

I am new and for sure I did something stupid I trying to use dovecot with sendmail but I am receiving this error teststat deliver(usertest): net_connect(/var/run/dovecot/auth-master) failed: Permission denied stat=Deferred: local mailer (/usr/libexec/dovecot/deliver) exited with EX_TEMPFAIL on send mail I added FEATURE(`local_procmail', `/usr/libexec/dovecot/deliver',`deliver -d $u') MODIFY_MAILER_FLAGS(`LOCAL', `-f') MAILER(procmail)dnl I am using the nis, but I do not think that this is the problem since I am able to login with imaps # 1.0.5: /etc/dovecot.conf protocols: imaps login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:/var/mail/newmail/%u:INDEX=/var/indexes/newmail/%u mail_debug: yes auth default: passdb: driver: pam args: session=yes dovecot userdb: driver: passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384

2 1

[Dovecot] ACL plugin when file in Maildir is not a directory
by Thomas Hummel 20 Feb '09

20 Feb '09

Hello Timo, On a production (by that I mean many users) dovecot-1.1.8/Maidir server where ACL plugin has been enabled, I ran on a log verbosity problem : For some reason (in fact, due to mbox -> Maildir migration script), some people have in their Maildir a .procmail.logfile file. The problem is that dovecot (or the ACL plugin) wants to find a dovecot-acl file in what it would like to be a directory, and then complains : dovecot: IMAP(xxxxxxxx): open(/courriel/boites/xxxxxxxx/.procmail.logfile/dovecot-acl) failed: Not a directory Such a behavior makes the log file grow too much too quickly. Note that my setup regarding log verbosity is at its minimal/default (except for proctitle) : verbose_ssl = no verbose_proctitle = yes auth_verbose = no mail_debug = no auth_debug = no auth_debug_passwords = no One more thing : would I have a log (or in what verbosity setup would I have one) line complaining about no-acl in the system wide acl directory : acl = vfile:/opt/dovecot/dovecot-acls:cache_secs=300 as a matter of fact, /opt/dovecot/dovecot-acls is empty for me (I don't need it for now). thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 1

[Dovecot] LDA dovecot with Postfix not workin :-(
by Thorsten Reiser 20 Feb '09

20 Feb '09

Hi, tried to use postfix with virtual users and dovecot imaps/imap pop3/pop3s workin fine lokal smtp too, but a remote host is not able to send mail Debian Etch uname -a Linux mail 2.6.18-6-xen-amd64 #virtual user vmail:x:5000:8::/home/vmail:/bin/sh #master.cf added dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/deliver -d ${recipient} #/var/log/mail.info Feb 19 12:37:51 mail postfix/master[6082]: daemon started -- version 2.3.8, configuration /etc/postfix Feb 19 12:37:58 mail postfix/smtpd[6106]: connect from XXX [XXX] Feb 19 12:37:58 mail postfix/smtpd[6106]: 9D150107C3C4: client=XXX [XXX], sasl_method=LOGIN, sasl_username=username(a)email.com thats all ...... here are my logs telnet localhost 25 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. 220 localhost ESMTP Postfix (Debian/GNU) ehlo localhost.com 250-localhost 250-PIPELINING 250-SIZE 10240000 250-VRFY 250-ETRN 250-AUTH PLAIN LOGIN 250-AUTH=PLAIN LOGIN 250-ENHANCEDSTATUSCODES 250-8BITMIME 250 DSN AUTH PLAIN aW5mb0BseC1ob3N0aW5nLmRlAGluZm9AbHgtaG9zdGluZy5kZQB0ZXN0 235 2.0.0 Authentication successful #master.cf added dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/deliver -d ${recipient} #postconf -n alias_maps = hash:/etc/aliases append_dot_mydomain = no biff = no broken_sasl_auth_clients = yes config_directory = /etc/postfix debug_peer_level = 10 debug_peer_list = 127.0.0.1 inet_interfaces = all mailbox_size_limit = 0 mydestination = mail.server.de, mail, localhost.localdomain, localhost myhostname = localhost mynetworks = 127.0.0.0/8 myorigin = /etc/mailname recipient_delimiter = + smtp_tls_note_starttls_offer = yes smtp_tls_session_cache_database = btree:${queue_directory}/smtp_scache smtp_use_tls = yes smtpd_banner = Mail ESMTP smtpd_helo_required = no smtpd_helo_restrictions = permit_mynetworks, reject_invalid_hostname, permit smtpd_recipient_restrictions = reject_unauth_pipelining, permit_sasl_authenticated, permit_mynetworks, reject_non_fqdn_recipient, reject_unknown_recipient_domain, reject_unauth_destination smtpd_sasl_auth_enable = yes smtpd_sasl_path = private/auth smtpd_sasl_type = dovecot smtpd_sender_restrictions = permit_sasl_authenticated, reject_non_fqdn_sender, reject_unknown_sender_domain smtpd_tls_CAfile = /etc/postfix/ssl/cacert.pem smtpd_tls_auth_only = no smtpd_tls_cert_file = /etc/postfix/ssl/smtpd.crt smtpd_tls_key_file = /etc/postfix/ssl/smtpd.key smtpd_tls_loglevel = 1 smtpd_tls_received_header = yes smtpd_tls_session_cache_database = btree:${queue_directory}/smtpd_scache smtpd_tls_session_cache_timeout = 3600s smtpd_use_tls = yes tls_random_source = dev:/dev/urandom unknown_local_recipient_reject_code = 550 virtual_gid_maps = static:8 virtual_mailbox_base = /home/vmail virtual_mailbox_domains = /etc/postfix/vhosts.txt virtual_mailbox_maps = hash:/etc/postfix/vmailbox virtual_minimum_uid = 100 virtual_transport = dovecot virtual_uid_maps = static:5000 #dovecot -n # /etc/dovecot/dovecot.conf log_path: /var/log/dovecot.info info_log_path: /var/log/dovecot.info log_timestamp: %d-%m-%Y %H:%M:%S protocols: imap pop3 imaps pop3s listen(default): *:10143 listen(imap): *:10143 listen(pop3): * disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting: Mail POP3/IMAP verbose_proctitle: yes first_valid_uid: 5000 last_valid_uid: 5000 first_valid_gid: 8 last_valid_gid: 8 mail_privileged_group: mail mail_location: maildir:/home/vmail/%d/%n mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh outlook-idle imap_client_workarounds(imap): delay-newmail netscape-eoh outlook-idle imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/dovecot/userdb userdb: driver: passwd-file args: /etc/dovecot/userdb socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 438 user: vmail group: mail

2 2

[Dovecot] v1.2 can't set ACL to empty string
by Sascha Wilde 20 Feb '09

20 Feb '09

Hi *, according to RfC4314 the rights argument to the setacl command might be an empty string ("zero right characters"): The third argument is a string containing an optional plus ("+") or minus ("-") prefix, followed by zero or more rights characters. existing clients (horde in particular) actually use this to remove all rights from an user. Currently dovecot 1.2 does not accept an empty rights string as argument to setacl. Bernhard Herzog will look into this. cheers sascha -- Sascha Wilde OpenPGP key: 4BB86568 http://www.intevation.de/~wilde/ http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

3 2

[Dovecot] over quota + antispam crash
by Stéphane Cottin 20 Feb '09

20 Feb '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I am using dovecot 1.1.11 , quota, imap_quota & antispam plugins. Dovecot crashes when saving a message to the Sent maildir and the account is over quota. gdb trace attached. Stéphane Cottin -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkmcQ1IACgkQNgQUYqHIqqsHYgCfdhLHt1KRQeoEOC5ddgFbD2mh 8UMAoIgXbD3ACqcKcftxUHeoPsgByp83 =V6Ch -----END PGP SIGNATURE----- GNU gdb 6.4.90-debian Copyright (C) 2006 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "x86_64-linux-gnu"...Using host libthread_db library "/lib/libthread_db.so.1". Attaching to program: /usr/lib/dovecot/imap, process 8619 Reading symbols from /lib/libdl.so.2...done. Loaded symbols for /lib/libdl.so.2 Reading symbols from /lib/libc.so.6...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux-x86-64.so.2...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so Reading symbols from /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so Reading symbols from /usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so...done. Loaded symbols for /usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so 0x00002af01c9af9ac in epoll_wait () from /lib/libc.so.6 (gdb) Signal Stop Print Pass to program Description SIGPIPE No Yes Yes Broken pipe (gdb) Signal Stop Print Pass to program Description SIGALRM No No Yes Alarm clock (gdb) Signal Stop Print Pass to program Description SIG32 No Yes Yes Real-time event 32 (gdb) Continuing. Program received signal SIGSEGV, Segmentation fault. 0x00002af01cd36a63 in antispam_save_init (t=0x5fe0c0, flags=MAIL_SEEN, keywords=0x0, received_date=-1, timezone_offset=0, from_envelope=0x0, input=0x601390, dest_mail=0x6014f8, ctx_r=0x5d92f0) at antispam-storage-1.1.c:170 170 (*ctx_r)->dest_mail = dest_mail; (gdb) #0 0x00002af01cd36a63 in antispam_save_init (t=0x5fe0c0, flags=MAIL_SEEN, keywords=0x0, received_date=-1, timezone_offset=0, from_envelope=0x0, input=0x601390, dest_mail=0x6014f8, ctx_r=0x5d92f0) at antispam-storage-1.1.c:170 ast = (struct antispam_internal_context *) 0x5fea60 asbox = (struct antispam_mailbox *) 0x5dff20 ret = -1 #1 0x0000000000457ce5 in mailbox_save_init (t=0x605cfa, flags=481489778, keywords=0x0, received_date=0, timezone_offset=1818845549, from_envelope=0x7265737520726f66 <Address 0x7265737520726f66 out of bounds>, input=0x601390, dest_mail=0x0, ctx_r=0x5d92f0) at mail-storage.c:728 No locals. #2 0x0000000000416289 in cmd_append_continue_parsing (cmd=0x5d9238) at cmd-append.c:330 uid2 = <value optimized out> msg = <value optimized out> sync_flags = <value optimized out> imap_flags = <value optimized out> uid_validity = <value optimized out> uid1 = <value optimized out> client = (struct client *) 0x5d8ec0 ctx = (struct cmd_append_context *) 0x5d92b0 args = (const struct imap_arg *) 0x5febb0 flags_list = <value optimized out> flags = MAIL_SEEN keywords_list = (const char * const *) 0x0 keywords = (struct mail_keywords *) 0x0 internal_date_str = 0x0 internal_date = -1 ret = <value optimized out> timezone_offset = 0 nonsync = true __PRETTY_FUNCTION__ = "cmd_append_continue_parsing" #3 0x0000000000416492 in cmd_append (cmd=0x5d9238) at cmd-append.c:502 storage = (struct mail_storage *) 0x5d87e8 box = <value optimized out> client = (struct client *) 0x5d8ec0 ctx = (struct cmd_append_context *) 0x5d92b0 mailbox = 0x5dd410 "Sent" #4 0x000000000041b45c in client_command_input (cmd=0x5d9238) at client.c:580 client = (struct client *) 0x5d8ec0 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #5 0x000000000041b512 in client_command_input (cmd=0x5d9238) at client.c:629 client = (struct client *) 0x5d8ec0 command = (struct command *) 0x0 __PRETTY_FUNCTION__ = "client_command_input" #6 0x000000000041bccf in client_handle_input (client=0x5d8ec0) at client.c:670 _data_stack_cur_id = 3 ret = <value optimized out> remove_io = <value optimized out> handled_commands = false #7 0x000000000041bef3 in client_input (client=0x5d8ec0) at client.c:725 cmd = <value optimized out> output = (struct ostream *) 0x5d9158 bytes = 488 __PRETTY_FUNCTION__ = "client_input" #8 0x000000000048ce48 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:203 ctx = <value optimized out> event = (const struct epoll_event *) 0x5d4fa0 list = (struct io_list *) 0x5d7c80 io = (struct io_file *) 0x5d7c40 tv = {tv_sec = 1799, tv_usec = 900117} events_count = <value optimized out> t_id = 2 msecs = <value optimized out> ret = 1 i = 0 call = <value optimized out> #9 0x000000000048bd1d in io_loop_run (ioloop=0x5d4d40) at ioloop.c:336 No locals. #10 0x0000000000423441 in main (argc=<value optimized out>, argv=0x0, envp=0x7fff8e3dbb58) at main.c:293 No locals. (gdb) Detaching from program: /usr/lib/dovecot/imap, process 8619

3 4

[Dovecot] Autocreate plugin
by Harry Lachanas 20 Feb '09

20 Feb '09

I've tried to use the autocreate plugin in order to autosubscribe users to public namespaces. namespace public { prefix = Public2/ separator = / location = maildir:/var/Public2:INDEX=~/Maildir/p-idx:CONTROL=~/Maildir/p-crtl hidden=no subscriptions=no inbox = no list=no } with plugin { autocreate = Spam autosubscribe = Spam autosubscribe1 = Public2/News autosubscribe2 = Public2/Shorewall } the plugin works alright with the Spam maildir, but not with the namespaces. Is this possible ??? Thanks Harry.

1 1

[Dovecot] deliver: Panic: file sieve-cmu.c: line 90 (unfold_header): assertion failed: (str[i] == ' ' || str[i] == '\t')
by Anton Yuzhaninov 19 Feb '09

19 Feb '09

I use dovecot-1.1.10 and dovecot-sieve-1.1.6 /usr/local/libexec/dovecot/deliver coredups several times per day with bt like this: (gdb) bt #0 0x0000000800a3a91c in kill () at kill.S:2 #1 0x0000000800a3a88a in __raise (s=6) at /usr/src/lib/libc/gen/raise.c:46 #2 0x0000000800a38f83 in abort () at /usr/src/lib/libc/stdlib/abort.c:65 #3 0x00000000004a7de5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:151 #4 0x00000000004a8777 in i_syslog_fatal_handler (type=Could not find the frame base for "i_syslog_fatal_handler". ) at failures.c:309 #5 0x00000000004a80ca in i_panic (format=Could not find the frame base for "i_panic". ) at failures.c:198 #6 0x0000000800e0b265 in unfold_header ( str=0x800c55a40 "\"firm ru\nÐ\217Ð\201Ð±ÐŒÂ¬Â® Ñ\236Ò\220Ð\216Â¬Â Ð±Ð²Ò\220Ð°Ð³\" <our_email@ example.ru>") at sieve-cmu.c:90 #7 0x0000000800e0b381 in unfold_multiline_headers (headers=0x800c55a30) at sieve-cmu.c:119 #8 0x0000000800e0b406 in getheader (v=0x7fffffffeab0, phead=0x800c5a160 "to", body=0x7fffffffc048) at sieve-cmu.c:132 #9 0x0000000800e1affc in eval_bc_test (interp=0x800c2d380, body_cache=0x0, m=0x7fffffffeab0, bc=0x800c5a000, ip=0x7fffffffc300) at bc_eval.c:541 #10 0x0000000800e1ac96 in eval_bc_test (interp=0x800c2d380, body_cache=0x0, m=0x7fffffffeab0, bc=0x800c5a000, ip=0x7fffffffd8e4) at bc_eval.c:445 #11 0x0000000800e1c131 in sieve_eval_bc (exe=0x800c240b0, is_incl=0, i=0x800c2d380, body_cache=0x0, sc=0x7fffffffeb60, m=0x7fffffffeab0, imapflags=0x7fffffffda20, actions=0x800c660f0, notify_list=0x800c13a40, errmsg=0x7fffffffda38) at bc_eval.c:1009 #12 0x0000000800e23ece in sieve_execute_bytecode (exe=0x800c240b0, interp=0x800c2d380, script_context=0x7fffffffeb60, message_context=0x7fffffffeab0) at script.c:868 #13 0x0000000800e0dee4 in cmu_sieve_run (namespaces=0x800c0b848, storage_r=0x7fffffffec98, mail=0x800c1d848, script_path=0x800c02d28 "/home/public/.dovecot.sieve", destaddr=0x7fffffffef3e "user_xxxxx", username=0x800c1ce35 "user_xxxxx", mailbox=0x4c581c "INBOX") at sieve-cmu.c:1038 #14 0x0000000800e0ae6d in cmusieve_deliver_mail (namespaces=0x800c0b848, storage_r=0x7fffffffec98, mail=0x800c1d848, destaddr=0x7fffffffef3e "user_xxxxx", mailbox=0x4c581c "INBOX") at cmusieve-plugin.c:81 #15 0x0000000000417d7f in main (argc=3, argv=0x7fffffffedc8) at deliver.c:1084 I log messages: deliver(user_xxxxx): Panic: file sieve-cmu.c: line 90 (unfold_header): assertion failed: (str[i] == ' ' || str[i] == '\t') -- Anton Yuzhaninov

2 2

[Dovecot] Effects of going read-only on dovecot & pop/imap clients
by Mark Zealey 19 Feb '09

19 Feb '09

Hi all, We need to set our filestore to read-only for quite a while, and I want to mitigate the effects for our clients. First issue; dovecot. If we just change the nfs mounts to read-only, dovecot complains: 2009-02-19T14:03:19+00:00 mail2 dovecot: pop3-login: Login: user=<test2(a)markandruth.co.uk>, method=PLAIN, rip=10.15.10.95, lip=10.15.10.102:11002 2009-02-19T14:03:19+00:00 mail2 dovecot: POP3(test2(a)markandruth.co.uk): open() failed with file /var/spool/mail/supplier_2/ma/rk/an/markandruth.co.uk/te/st/2_/test2/Mai ldir/dovecot.index.log: Read-only file system 2009-02-19T14:03:19+00:00 mail2 dovecot: POP3(test2(a)markandruth.co.uk): open(/var/spool/mail/supplier_2/ma/rk/an/markandruth.co.uk/te/st/2_/test 2/Maildir/dovecot-uidlist.lock) failed: Read-only file system 2009-02-19T14:03:19+00:00 mail2 dovecot: POP3(test2(a)markandruth.co.uk): file_dotlock_create(/var/spool/mail/supplier_2/ma/rk/an/markandruth.co.u k/te/st/2_/test2/Maildir/dovecot-uidlist) failed: Read-only file system 2009-02-19T14:03:19+00:00 mail2 dovecot: POP3(test2(a)markandruth.co.uk): Couldn't init INBOX: Internal error occurred. Refer to server log for more information. [2009-02-19 14:03:19] 2009-02-19T14:03:19+00:00 mail2 dovecot: POP3(test2(a)markandruth.co.uk): Mailbox init failed bytes=0/95, top=0/0, retr=0/0, del=0/0, size=0 Even when I use :INDEX=MEMORY, it's still complaining about creating .lock's or uidlist files and just issuing internal errors. Is there any way to make dovecot just do as much as it can under the circumstances ie allow read access to mails? Also, has anyone got experience of how clients handle mailboxes being read-only? My guess is that pop clients would probably break and download the same messages over and over? Thanks, Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer

2 3

[Dovecot] UNSUBSCRIBE
by Eric B. Schorvitz, Ph.D. 19 Feb '09

19 Feb '09

2 1

[Dovecot] limiting authentication failures
by Eric B. Schorvitz, Ph.D. 19 Feb '09

19 Feb '09

In my log files I occasionally get a huge number of Dovecot authentication failures (see clip below). I wanted to know if there's a way to limit the number of times an IP address can attempt to authenticate, if there's a way to have a timeout between attempted authentications, or if there is a way to limit authentication attempts by a specific username within a certain period of time. My current solution is to permanently block the specific IP, an IP range, or an entire country from accessing my server AFTER I notice the huge number of authentication failures. This is too ad-hoc a process and was hoping dovecot has something more proactive built in. Thank you in advance for spending time considering this inquiry, Eric --------------------- pam_unix Begin ------------------------ dovecot: Authentication Failures: rhost=::ffff:200.111.39.219 : 764 Time(s) root: 25 Time(s) mysql: 6 Time(s) smmsp: 6 Time(s) --SNIP-- Unknown Entries: check pass; user unknown: 764 Time(s) ---------------------- pam_unix End ------------------------- --------------------- Connections (secure-log) Begin ------------------------ **Unmatched Entries** dovecot-auth: pam_succeed_if(dovecot:auth): error retrieving information about user info dovecot-auth: pam_succeed_if(dovecot:auth): error retrieving information about user info dovecot-auth: pam_succeed_if(dovecot:auth): error retrieving information about user info dovecot-auth: pam_succeed_if(dovecot:auth): error retrieving information about user info --SNIP--

2 1

[Dovecot] sieve filters
by Ian P. Christian 19 Feb '09

19 Feb '09

Hi all, I'm trying to figure out a way of filtering mail from a commercial anti-spam platform. Unfortunately you need to compare part of one header against part of another header. I figured I could solve this using sieve variables and pattern matching, however I'm having little luck and don't know how to debug sieve issues. # example headers: must compare 0.00799 against 1:0000 (the 2nd number in the 2nd header) # X-pstn-levels: (S: 0.00799/98.42547 CV:99.9000 FC:95.5390 LC:95.5390 R:95.9108 P:95.9108 M:97.0282 C:98.6951 ) # X-pstn-settings: 3 (1.0000:1.0000) s cv gt3 gt2 gt1 r p m c if header :matches "X-pstn-levels" "(S: */*" { set "score" "${1}"; if header :matches "X-pstn-settings" " ? (*:*) *" { fileinto "somewhere"; } } The first if appears to match, as if I move the fileinto up there it works - however it doesn't work as it shown here. Can anyone suggest why? Can I achieve what I'm trying to do with sieve? How can I go about debugging scripts? Thanks, Ian

2 2

[Dovecot] kerberos trying to obtain credentials for wrong machine
by Nikolay Shopik 19 Feb '09

19 Feb '09

Hi, I'm currently trying to configure Dovecot to use kerberos. My KDC is Windows 2003 and I successful generated keytab file for Dovecot machine. Problem is when I'm trying to use GSSAPI it told me Obtaining credentials for imap@debian5 - and of course this fails because debian5 isn't KDC, it should look for imap/debian5.inblock.local(a)INBLOCK.LOCAL. What I'm missing?

2 1

[Dovecot] Time moved backwards ....
by Harry Lachanas 18 Feb '09

18 Feb '09

OK.. So I synced the clock.... and got .... dovecot: Time just moved backwards by 1 seconds. I'll sleep now until we're back in present. http://wiki.dovecot.org/TimeMovedBackwards ( The first time I did this the clock moved backwards 2 hours after a timezone change and dovecot suicided ) I think I understand the concept ... However a mail server should probably be synchronized to the local time ..... Suggestions ...??? Harry.

8 10

[Dovecot] mbox snarf plugin + idle
by Jonathan Siegle 18 Feb '09

18 Feb '09

I'm having a problem with mbox snarf not looking at /var/spool/mail/ when in idle mode thus never giving me a RECENT line even though there are new messages in /var/spool/mail/ . Here are the imap commands to reproduce the problem: 1 login userid password 2 select inbox 3 idle When I run "select inbox" it does see my messages in /var/spool/mail/ and moves them over fine. When I truss the process, I see it only running stat calls on my "mbox- snarf" file. To get new messages I issue DONE, CLOSE, and SELECT INBOX. I'm not sure why it is reporting alpha5 two lines below. I did an hg pull just the other day and see 1.2.beta1 in the output of hg tags. # /usr/ladmin2/sbin/dovecot -n # 1.2.alpha5: /usr/ladmin2/etc/dovecot.conf Warning: fd limit 2000 is lower than what Dovecot can use under full load (more than 4224). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: AIX 3 0001112AD300 syslog_facility: local0 protocols: imap listen: *:2222 ssl: no disable_plaintext_auth: no login_dir: /usr/ladmin2/var/run/dovecot/login login_executable: /usr/ladmin2/libexec/dovecot/imap-login login_greeting: Dovecot ready. login_processes_count: 30 max_mail_processes: 4096 mail_location: mbox:%h/new:INBOX=/var/spool/mail/14/%u mmap_disable: yes dotlock_use_excl: no mbox_write_locks: fcntl mbox_lazy_writes: no mail_plugins: mbox_snarf imap_client_workarounds: delay-newmail auth default: mechanisms: plain gssapi krb5_keytab: /etc/krb5/dovecot.keytab gssapi_hostname: $ALL verbose: yes debug: yes passdb: driver: pam userdb: driver: passwd plugin: mbox_snarf: /gpfs/inbox/14/%u Thanks, Jonathan

2 2

Re: [Dovecot] from postfix deliver to dovecot deliver
by dovecot＠corwyn.net 18 Feb '09

18 Feb '09

you're using maildir? (I only ask because I am). In that case, no making the change doesn't require changes in the mailboxes. I made the appropriate changes (just a few days ago) to main.cf and I was good to go. Rick At 08:01 AM 2/18/2009, Johan Hendriks wrote: >Hello all. >I use dovecot in combination with postfix, postfixadmin for virtual users. >Deliver to the mailbox now is done by postfix >Now i want to enable quota's and therefor i need dovecot deliver. >Can i just switch to dovecot deliver? >Or must i first do some prrperations in the mailboxes. > >regards >-- >_______________________ >*Johan Hendriks* >*Schavemaker Transport* > >Tel: +31 (0)251 229098 >Fax: +31 (0)251 212016 >email: j.hendriks(a)schavemaker.com <mailto:j.hendriks@schavemaker.com> >web: http://www.schavemaker.com >_______________________ >/Confidentiality Notice: The information in this document may be >confidential. It is intended only for the use of the named recipient. >If you are not the intended recipient, please notify me immediately >and then delete this document. Do not disclose the contents of this document >to any other person, nor take any copies. Violation of this notice >may be unlawful. / >_______________________

1 0

[Dovecot] assertion failed
by Ian P. Christian 18 Feb '09

18 Feb '09

Does anyone know what might cause this? # dovecot --version 1.1.7 Feb 17 18:21:51 imap-proxy-temp dovecot: Panic: auth(default): file passdb-cache.c: line 121 (passdb_cache_lookup_credentials): assertion failed: (*scheme_r != NULL || *password_r == NULL) Feb 17 18:21:51 imap-proxy-temp dovecot: auth(default): Raw backtrace: dovecot-auth [0x42c0ea] -> dovecot-auth [0x42c143] -> dovecot-auth [0x42b7f6] -> dovecot-auth [0x41acb6] -> dovecot-auth(auth_request_lookup_credentials+0x6f) [0x411cdf] -> dovecot-auth [0x416caf] -> dovecot-auth(auth_request_handler_auth_continue+0xc9) [0x4128e9] -> dovecot-auth [0x40e40a] -> dovecot-auth(io_loop_handler_run+0xf8) [0x42fb48] -> dovecot-auth(io_loop_run+0x1d) [0x42ea4d] -> dovecot-auth(main+0x2f7) [0x416367] -> /lib/libc.so.6(__libc_start_main+0xda) [0x7f83990e54ca] -> dovecot-auth [0x40cdba] Feb 17 18:21:51 imap-proxy-temp dovecot: child 20579 (auth) killed with signal 6

2 4

[Dovecot] Maildir hierarchy sep bug ?
by Thomas Hummel 17 Feb '09

17 Feb '09

Hello Timo, I'm experiencing the following different behaviors with dovecot-1.1.8/Maildir. My Maildir hierarchy separator is the "." (dot) character. My namespaces, when I use them, separator is "/". When I run the server without any namespaces, I can create mailboxes named something like first.name which, of course, are shown to the client as first/ (non selectionnable) first/name For instance in Mutt, if I save a message (the "s" key) from first.name(a)some.domain dovecot happilly creates the .first.name/ Maildir But if I create a public Namespace, then I have to create a private default namespace as well and the server doesn't behave the same way : They're set up like this : namespace private { separator = / prefix = location = maildir:/courriel/boites/%u:CONTROL=/courriel/meta/%u:INDEX=/var/dovecot/indexes/%1u/%u inbox = yes hidden = no list = yes subscriptions = yes } namespace public { separator = / prefix = '#Foo/' location = maildir:/courriel/boites/public/foo inbox = no hidden = yes list = no subscriptions = no } Then users cannot create mailboxes with a dot in it : Character not allowed in mailbox name: '.' which seems normal but can be confusing since, a user used to saving his mail in first.name (in Mutt for instance) wouldn't be able to do so anymore if the server goes from the first to the second setting described above. Granted, a user which does so, probably doesn't do what he thinks he does (he probably thinks he save his message in a folder named "first.name" while instead he actually saves it in a subfolder of "first" named "name"). Still it can be confusing. Is that difference of behavior normal ? Which is the correct behavior ? And is there still no way (except to patch the source) to allow dots in mailbox names in Maildir ? Thanks. -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

2 7

[Dovecot] Error: IMAP(user): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy
by Grandy Fu 17 Feb '09

17 Feb '09

Hi, I am running dovecot 1.1.10 and 1.1.11 on Solaris 10, mailboxes are in mbox format and served by Solaris 10 NFSv3, the dovecot cache is on local disk. Some of my users always had above nfs error and their mailbox usually very big, over 100M, 400M, or even 800M. Grandy

2 1

[Dovecot] dbox redesign
by Timo Sirainen 17 Feb '09

17 Feb '09

This is about how to implement multiple msgs/file dbox format. The current v1.1's one msg/file design would stay pretty much the same and it would be compatible with this new design. dbox directories with multiple msgs/file would be like: ~/dbox/storage/ has the actual mail data for all mailboxes ~/dbox/mailboxes/ has subdirectories containing mailboxes and their indexes Also since dbox supports already the single msg per file, those files would be stored in the mailboxes/ directory. So the idea would be that either you use multiple msgs per file using a global storage, or you use single msg per file without a global storage (or it's also possible to be in a mixed setup with some mails in storage/ and some in mailboxes/, mainly to allow migration between those configurations). The storage/ directory would have a new "map index" which is a regular dovecot index (dovecot.index and dovecot.index.log). So the mailbox index would point to mails using an intermediary "map UID". This way if mails are moved to another file only the map index needs to be updated. GUID would be a globally unique 128 bit ID for messages. So if map indexes get corrupted for any reason it's possible to rebuild it by finding the mails using GUIDs. v1.1 dbox has this "dbox.index" file which I was originally planning on using with multiple msgs/file. It had complex file range locking stuff. Now I'm thinking that it's pretty much useless. The only reason for its existence with the new design is for listing metadata for files converted from Maildir. Map index record would contain: - 32 bit map UID - 8 bit flags (MAIL_DELETED flag = message marked as expunged) - 8 bit unused wasted space - 16 bit refcount - 32 bit file sequence - 32 bit file offset --> total 128 bits/msg Mailbox index: - IMAP UID, flags, keywords, etc. - 32 bit map UID - 128 bit GUID dbox file metadata: - 128 bit GUID - size, vsize, received time, saved time, etc. - initial mailbox name (if all indexes get trashed, we can still figure out at least one mailbox where to put the mail. copies would get lost though.) (- no map UID, no imap UID) How to save a message with multiple msgs/file: 1. Find dbox file where to append to: 1.1. Look up the last message from map index 1.2. Is the file "too old"? (or doesn't exist at all) - Yes -> Create new dbox file 1.3. Is the file "too large"? - Yes -> Look at the previous file (one sequence less) and goto 1.2. 1.4. Try to lock the file. - Fail -> Look at prev file and goto 1.2. Now we have a locked/new dbox file where we can write to. Because 1.4. step only tries to lock the file, there's no waiting on locks. This also means that if e.g. two processes are writing new messages rapidly they may be appending actively to two different files. I don't think that's a problem, better than waiting for locks. 2a) We're using an existing file and we need to find the append offset. Since we found the file by finding the last msg in the file, we also know the last message's offset. I wasn't really planning on saving the message sizes in the index file, so to get the append offset I guess it needs to do an extra read on the last msg's header to find the size and skip over it. Hmm. Or would it be less disk I/O to store the size on the index so it could be found directly? I'm not really sure.. In any case, after we find the append offset, check to see if it's at EOF. If not, that means that either another process just saved a new message there or a process crashed previously and left garbage lying around. Refresh the map index to see if this file+offset exists in it. If not, truncate the file and just continue writing there. If it exists, figure out the new append offset and see again if the file limit would be reached. If the file would become too large, unlock the file and goto step 1. 2b) We're writing to a new file. No need to worry about anything in 2a) 3. Write the message and its metadata to dbox file (including generated 128 bit GUID). 4. Assign map UIDs for the written mails and write APPEND records to map index's transaction log. The record would contain the map UID, file seq, offset, refcount=1. The transaction is saved with a "weak" flag (wonder if there's a better name for this) and its offset is remembered. - If we're creating a new dbox file, it's assigned the file seq and rename()d to the final file name while the map index is locked. 5. Write APPEND record to mailbox index's transaction log with IMAP UID, map UID and GUID (and flags, keywords, etc). 6. Write "commit offset=x" record where x is the offset remembered in step 4. This marks the 4's weak transaction as being fully finished. 7. dbox file is unlocked (if we weren't creating a new file). When reading the index and we see a weak transaction without a commit record, call a resolve() function in dbox code. It finds the dbox file in the weak transaction and tries to lock it. If it can't lock it, it (probably) means that there's still a process that's going to finish the save. If a locking succeeded, run a fixup code that goes through all files that are referenced in weak transactions and makes sure all the refcounts and such are valid. Then it writes commit records for each such transaction. Copying can be done by locking source dbox file, writing a weak "refcount++" transaction and continuing from saving step 5. The only step I can think of where there's a small problem is if data is written to dbox file, then process dies, but no saving is attempted to the same file later. The data is left there as garbage until maybe some day later when a message is expunged from that file and cleanup code notices that there's extra data. I thought about reordering steps so that the records are written to map index first, but that's less efficient when writing multiple messages, because each one would need to be saved separately to the map index (where each save would be lock + fstat (+ read) + write + unlock). This is probably a rare problem which doesn't really matter.. Expunging: The "expunge" and "cleanup to remove deleted space" are separate steps. Preferably the cleanup would be done when the server is "less busy", but I guess it could also be configured to happen either immediately or during logout (or once an hour or so). 1. Write "want to expunge" record to mailbox's transaction log. 2. Write a weak "refcount--" to map index's transaction log. 3. Write "expunged" record to mailbox's transaction log. 4. Write "commit" for the weak refcount--. (The two-stage want-to-expunge(1)/expunged(3) is already done for maildir/mbox also.) I was also thinking maybe this could be just 3 steps without a weak transaction. Especially since without a fsync() between 2 and 3 there's really no guarantee about the order in which 2 and 3 happen. And fsync()s are kind of annoying. But then again if that isn't done and it crashes between 2 and 3 the expunge is tried again later which now decrements the refcount again. If the message's original refcount was 1 it would now be negative. That's not really a problem. More problematic is if the message had been copied to another mailbox and refcount=2, now the refcount would be 0 and the message in the other mailbox would get unexpectedly lost. Not good. Space deletion cleanup: 1. Check from map index header to see there are any refcount=0 mails. Although having this step probably requires some annoying dbox-specific code in index handling code. I guess I'll have to see later if there's a non-horribly-ugly way to do this. 2. Go through all records in the map index. Get a list of files that have refcount=0 records. Also make a copy of file seq+offsets and sort them (so at step 3 we can easily find what mails exist). 3. For each file that has refcount=0 records: 3.1. Try to lock the file. -> Fail: Skip to next file. Either someone's appending to it or cleaning it up already. 3.2. Refresh map index. Add any newly added records to the sorted records list (rare). 3.2. Find the first refcount=0 mail. 3.3. Copy all mails after that with refcount>0 to a new file. 3.4. Lock map index, assign new file seq for the new file, rename() it, for each mail we just copied, using a weak transaction write the seq +offset updates to map index's transaction log. Unlock map index. 3.5. Depending on if first refcount=0 mail was the first mail, either unlink() the file or ftruncate() it. 3.6. Write "commit" record to finish the weak transaction. That's a bit inefficient when cleaning up multiple dbox files, but I'm not sure if there's a much better way unless the map index is locked for the entire time. Since the copying might take a while, a long map index lock is bad since it prevents messages from being saved. Reading mails can be done without locking. But since a file can be truncated unexpectedly, the code must be able to find the new file and offset in that situation and continue reading from there. If the message we were reading was just expunged+cleaned up, the client will have to be just disconnected. Since the cleanup shouldn't normally happen immediately after expunge, this should happen rarely/never. Oh and about all these new temp files that are created. When dbox is opened the dir is stat()ed and if its atime is older than 1 week (currently hardcoded) it readdir()s through the dir to see if there are any old temp* files and then unlinks them. With the new design flags/keywords would never be written to actual dbox files. This helps with backups and also avoids the horribleness of having to increase metadata area. To avoid complete data loss due to index corruption (which really shouldn't be happening nowadays), the indexes are also once in a while backed up to e.g. dovecot.index.backup file. If Dovecot detects missing/broken index, it uses this backup copy to rebuild the index as well as it can. I'm also wondering if it's better for each mailbox to have its separate dovecot.index.cache file or if there should be one cache file for the map index. The upside with one index is that if a mail is copied there's no need to duplicate its cached data. The downside is that I'm worried it would cause more disk I/O, since mailboxes are typically accessed separately, so it might be better that the cache data for one mailbox is stored together rather than all around one bigger cache file.

5 7

[Dovecot] Changing level an error logs at
by Thomas M Goerger 17 Feb '09

17 Feb '09

Hi, I'd like to change the log levels of a few of the errors that Dovecot throws. Our servers throw errors at the console above the 'Error' level, and there are a few that I'd like to change to 'Warn' so that they don't do so. Has anyone out there attempted this and can give me a few pointers? Or is there a doc somewhere about how to do this? Thanks, ************************************************************************* * Tom Goerger - Email/Unix System Administrator * * * * University of Minnesota Email: tmg(a)umn.edu * * Operations, Infrastructure and Architecture Phone: 4-5804 * * Internet Services Office: 626J WBOB * * * *************************************************************************

3 3