September 2007 - dovecot

[Dovecot] dovecot 1.1alpha6 deliver+quota bugs
by Andrew Garner 22 Sep '07

22 Sep '07

I was playing around with dovecot-1.1 and maildir++ quotas, and ran into a reproducible error with indexing. This only seems to be a problem for new maildirs. If I send a message without the quota plugin on, and "seed" the index/control files, future deliveries with the quota plugin seem to succeed without errors. Version: 1.1alpha6 OS: Debian etch/x86 (ext3 filesystem) # dovecot -n # 1.1.alpha6: /etc/dovecot/dovecot.conf login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_location: maildir:~/Maildir mail_debug: yes mmap_disable: yes lock_method: dotlock mail_executable: /usr/lib/dovecot/gdbhelper /usr/lib/dovecot/imap mail_plugins: quota imap_quota auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir quota_rule: *:storage=102400 Here's the deliver-log from a "fresh" Maildir (just ~/Maildir/{cur,new,tmp}): deliver(example(a)example.com): Sep 21 18:39:48 Info: Loading modules from directory: /usr/lib/dovecot/modules/lda deliver(example(a)example.com): Sep 21 18:39:48 Info: Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so deliver(example(a)example.com): Sep 21 18:39:48 Info: auth input: example(a)example.com deliver(example(a)example.com): Sep 21 18:39:48 Info: auth input: home=/home/vmail/domains/example.com/example deliver(example(a)example.com): Sep 21 18:39:48 Info: auth input: uid=1014 deliver(example(a)example.com): Sep 21 18:39:48 Info: auth input: gid=1014 deliver(example(a)example.com): Sep 21 18:39:48 Info: Quota rule: root= mailbox= storage=102400kB messages=0 deliver(example(a)example.com): Sep 21 18:39:48 Info: maildir: data=/home/vmail/domains/example.com/example/Maildir deliver(example(a)example.com): Sep 21 18:39:48 Info: maildir++: root=/home/vmail/domains/example.com/example/Maildir, index=, control=, inbox=/home/vmail/domains/example.com/ex ample/Maildir deliver(example(a)example.com): Sep 21 18:39:48 Error: uid_validity mismatch in file /home/vmail/domains/example.com/example/Maildir/dovecot.list.index.uidmap: 1190399988 != 0 deliver(example(a)example.com): Sep 21 18:39:48 Error: Corrupted mailbox list index file /home/vmail/domains/example.com/example/Maildir/dovecot.list.index.uidmap: dir_size is s maller than record count deliver(example(a)example.com): Sep 21 18:39:48 Error: Internal quota calculation error deliver(example(a)example.com): Sep 21 18:39:48 Info: msgid=<1989.0003.0000@server011>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2007-09-21 18:39:48] Turning off the quota plugin will allow the delivery to succeed: deliver(example(a)example.com): Sep 21 18:42:08 Info: auth input: example(a)example.com deliver(example(a)example.com): Sep 21 18:42:08 Info: auth input: home=/home/vmail/domains/example.com/example deliver(example(a)example.com): Sep 21 18:42:08 Info: auth input: uid=1014 deliver(example(a)example.com): Sep 21 18:42:08 Info: auth input: gid=1014 deliver(example(a)example.com): Sep 21 18:42:08 Info: maildir: data=/home/vmail/domains/example.com/example/Maildir deliver(example(a)example.com): Sep 21 18:42:08 Info: maildir++: root=/home/vmail/domains/example.com/example/Maildir, index=, control=, inbox=/home/vmail/domains/example.com/ex ample/Maildir deliver(example(a)example.com): Sep 21 18:42:08 Info: msgid=<1989.0003.0000@server011>: saved mail to INBOX Turning quota back on has a temporary complaint about uidvalidity: deliver(example(a)example.com): Sep 21 18:44:17 Info: Loading modules from directory: /usr/lib/dovecot/modules/lda deliver(example(a)example.com): Sep 21 18:44:17 Info: Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so deliver(example(a)example.com): Sep 21 18:44:17 Info: auth input: example(a)example.com deliver(example(a)example.com): Sep 21 18:44:17 Info: auth input: home=/home/vmail/domains/example.com/example deliver(example(a)example.com): Sep 21 18:44:17 Info: auth input: uid=1014 deliver(example(a)example.com): Sep 21 18:44:17 Info: auth input: gid=1014 deliver(example(a)example.com): Sep 21 18:44:17 Info: Quota rule: root= mailbox= storage=102400kB messages=0 deliver(example(a)example.com): Sep 21 18:44:17 Info: maildir: data=/home/vmail/domains/example.com/example/Maildir deliver(example(a)example.com): Sep 21 18:44:17 Info: maildir++: root=/home/vmail/domains/example.com/example/Maildir, index=, control=, inbox=/home/vmail/domains/example.com/ex ample/Maildir deliver(example(a)example.com): Sep 21 18:44:17 Error: uid_validity mismatch in file /home/vmail/domains/example.com/example/Maildir/dovecot.list.index.uidmap: 1190400128 != 119 0400088 deliver(example(a)example.com): Sep 21 18:44:17 Warning: /home/vmail/domains/example.com/example/Maildir/dovecot.list.index: Desync: uid_validity changed 1190400088 -> 119040012 8 deliver(example(a)example.com): Sep 21 18:44:17 Info: msgid=<1e2f.0003.0000@server011>: saved mail to INBOX But then it's pretty happy: deliver(example(a)example.com): Sep 21 18:45:36 Info: Loading modules from directory: /usr/lib/dovecot/modules/lda deliver(example(a)example.com): Sep 21 18:45:36 Info: Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so deliver(example(a)example.com): Sep 21 18:45:36 Info: auth input: example(a)example.com deliver(example(a)example.com): Sep 21 18:45:36 Info: auth input: home=/home/vmail/domains/example.com/example deliver(example(a)example.com): Sep 21 18:45:36 Info: auth input: uid=1014 deliver(example(a)example.com): Sep 21 18:45:36 Info: auth input: gid=1014 deliver(example(a)example.com): Sep 21 18:45:36 Info: Quota rule: root=mailbox= storage=102400kB messages=0 deliver(example(a)example.com): Sep 21 18:45:36 Info: maildir: data=/home/vmail/domains/example.com/example/Maildir deliver(example(a)example.com): Sep 21 18:45:36 Info: maildir++: root=/home/vmail/domains/example.com/example/Maildir, index=, control=, inbox=/home/vmail/domains/example.com/example/Maildir deliver(example(a)example.com): Sep 21 18:45:36 Info: msgid=<1e42.0003.0000@server011>: saved mail to INBOX But once I hit the quota limit, I get an assertion failure: deliver(example(a)example.com): Sep 21 18:57:12 Info: Loading modules from directory: /usr/lib/dovecot/modules/lda deliver(example(a)example.com): Sep 21 18:57:12 Info: Module loaded: /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so deliver(example(a)example.com): Sep 21 18:57:12 Info: auth input: example(a)example.com deliver(example(a)example.com): Sep 21 18:57:12 Info: auth input: home=/home/vmail/domains/example.com/example deliver(example(a)example.com): Sep 21 18:57:12 Info: auth input: uid=1014 deliver(example(a)example.com): Sep 21 18:57:12 Info: auth input: gid=1014 deliver(example(a)example.com): Sep 21 18:57:12 Info: Quota rule: root= mailbox= storage=102400kB messages=0 deliver(example(a)example.com): Sep 21 18:57:12 Info: maildir: data=/home/vmail/domains/example.com/example/Maildir deliver(example(a)example.com): Sep 21 18:57:12 Info: maildir++: root=/home/vmail/domains/example.com/example/Maildir, index=, control=, inbox=/home/vmail/domains/example.com/example/Maildir deliver(example(a)example.com): Sep 21 18:57:13 Info: msgid=<1ed0.0003.0000@server011>: save failed to INBOX: Quota exceeded deliver(example(a)example.com): Sep 21 18:57:13 Info: msgid=<1ed0.0003.0000@server011>: Rejected: Quota exceeded deliver(example(a)example.com): Sep 21 18:57:13 Panic: file index-mail-headers.c: line 590 (index_mail_get_raw_headers): assertion failed: (ret != -1) deliver(example(a)example.com): Sep 21 18:57:13 Error: Raw backtrace: /usr/lib/dovecot/deliver [0x80d3165] -> /usr/lib/dovecot/deliver(i_fatal+0) [0x80d33ac] -> /usr/lib/dovecot /deliver [0x8091eb1] -> /usr/lib/dovecot/deliver(index_mail_get_first_header+0x2b) [0x8092258] -> /usr/lib/dovecot/deliver(mail_get_first_header+0x30) [0x80be839] -> /usr/lib/ dovecot/deliver(deliver_get_return_address+0x23) [0x8058f9a] -> /usr/lib/dovecot/deliver(mail_send_rejection+0x36) [0x805b428] -> /usr/lib/dovecot/deliver(main+0xb53) [0x805a9eb] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7e40ea8] -> /usr/lib/dovecot/deliver [0x8058241]

2 1

Re: [Dovecot] Broken header (Jon)
by damien chambe - EGS 21 Sep '07

21 Sep '07

Jon <jonem(a)spray.se> a écrit : | Hi, I just upgraded to version 1.0.5 hoping to get rid of a problem that | made Thunderbird download all mails from time to time. I now see this | error (below). Does anyone know what it means? | | Error: IMAP(user): | /mail2/home/user/.Maildir/.Folders.Persons.Foldername/dovecot-uidlist: | Broken header (uidvalidity = 0, next_uid=10) | | Error: IMAP(user): ||/mail2/home/user/.Maildir/.Folders.2005/dovecot-uidlist: Broken header |(uidvalidity = 0, next_uid=1186) | Mails are stored in userhomedirs that are located on a NFS export. Hi Try to sync the clocks between your NFS server and your Dovecot server. Damien -- Cordialement, Damien Chambe Service informatique EGS - Groupe Laurent 42 bld jules janin - BP 240 - 42006 Saint Etienne Cedex 1 Tel : 04 77 49 48 16 / Fax : 04 77 49 48 45 Site institutionnel : http://www.groupe-laurent.com Site catalogue : http://ecat.groupe-laurent.com

1 0

[Dovecot] POP3 message not deleted
by Gabriele Fergola 21 Sep '07

21 Sep '07

Hi, i start today my new mail server with dovecot with about 2000 User on it. i don't know if it's a problem or not but when a client connect in pop3 the message keep on the server. Sep 21 10:53:37 cnetmbox dovecot: pop3-login: Login: user=<XXXXXX(a)XXXXXX.it>, method=PLAIN, rip=XXX.XXX.XXX.XXX, lip=XXX.XXX.XXX.XXX Sep 21 10:53:37 cnetmbox dovecot: POP3(XXXXXXXXXX(a)XXXXXXXX.it): Disconnected: Logged out top=0/0, retr=0/0, del=0/1, size=2595 Thank you for help Workino

2 3

[Dovecot] quota reporting and mail.app
by Mike Horwath 20 Sep '07

20 Sep '07

Hi everyone. I can't get mail.app to report back correct quota information using mail.app and dovecot (though it works with courier-imap). I am looking at migrating away from courier-imap to dovecot but this issue is something I need to have resolved <somehow>. Thunderbird is fine and reports back good info on either connection. I am off to read RFCs (can't I just read the sendmail book again? Might be easier...) to see what should really be done. Courier: [4:17pm] 341 [~]:gold% telnet imap-server 143 Trying 216.250.xxx.xxx... Connected to imap-server. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 UIDPLUS CHILDREN NAMESPACE THREAD=ORDEREDSUBJECT THREAD=REFERENCES SORT QUOTA IDLE ACL ACL2=UNION STARTTLS] Courier-IMAP ready. Copyright 1998-2005 Double Precision, Inc. See COPYING for distribution information. . login testaccount(a)domain.com passwordsRfun . OK LOGIN Ok. . GETQUOTAROOT "INBOX" * QUOTAROOT "INBOX" "ROOT" * QUOTA "ROOT" (STORAGE 14 665600) . OK GETQUOTAROOT Ok. . logout * BYE Courier-IMAP server shutting down . OK LOGOUT completed Connection closed by foreign host. Dovecot: [4:17pm] 342 [~]:gold% telnet imap-server 1143 Trying 216.250.xxx.xxx... Connected to imap-server. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS QUOTA STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. . login testaccount(a)domain.com passwordsRfun . OK Logged in. . GETQUOTAROOT "INBOX" * QUOTAROOT "INBOX" "" * QUOTA "" (STORAGE 13 665600) . OK Getquotaroot completed. . logout * BYE Logging out . OK Logout completed. Connection closed by foreign host. -- Mike Horwath drechsau(a)iphouse.net ipHouse - Welcome home!

5 7

[Dovecot] SASL from remote server
by Daniel L. Miller 20 Sep '07

20 Sep '07

Is there a way, using Dovecot and Postfix, to use SASL from a remote server? Since it appears the communication uses Unix sockets, does this mean it is restricted to local services only? I have a two-server configuration, where my firewall also runs the mail gateway/filter (Postfix + ASSP). My internal server has Postfix + Dovecot. Right now I have my internal server configured to use Dovecot SASL, but the external server is still using the Courier authdaemon against the LDAP database. -- Daniel

4 5

[Dovecot] Running a script when a mail arrives
by Dennis Becker 20 Sep '07

20 Sep '07

Hi, I'm trying to execute a script when a mail arrives in a given user's mailbox. Something like .dovecot.sieve. The reason I'm not using sieve itself is that I need to do stuff on mail arrival, which is beyond sieve's features. So is there a way to tell dovecot to run a script when a mail arrives in a certain mailbox? Optionally a solution to forward the whole mail to a script would be good too. -- Dennis Becker

6 6

[Dovecot] Multiple Quota "ignore=" in Dovecot 1.0.x?
by Rich at Whidbey Telecom 20 Sep '07

20 Sep '07

Any chance that multiple "ignore=" statements cab be specified for a quota in Dovecot 1.0.x? We know this is possible in 1.1, but won't be able to update until it's stable. We've tried: quota = maildir:storage=256000:ignore=Junk:ignore=Trash and quota = maildir:storage=256000:ignore=Junk,Trash However, only "Junk" is ignored, and email can't be deleted when the mailbox is full. Thanks! Rich

2 1

[Dovecot] Dovecot ignoring reject_code & delay_warning_time settings
by Radim Hejc 20 Sep '07

20 Sep '07

Hello, hope guys someone can help me i have installed mailserver according this tutorial http://johnny.chadda.se/2007/04/15/mail-server-howto-postfix-and-dovecot-wi… which is linked from dovecot maunal pages Using Debian Etch 4.1 amd64, Postfix 2.3.8, Dovecot v1.0.rc15 , have tried also 32bit version with same result Everything works great except when i send mail to non-existing user in existing domain Dovecot is ignoring Postfix main.cf values delay_warning_time = 4h and unknown_local_recipient_reject_code = 550 And is sending error message ca every two hours for 4 days like : Out: 220 mailserver2.mydomain.tld ESMTP Postfix (Debian/GNU) In: EHLO mail.otherdomain.tld Out: 250- mailserver2.mydomain.tld Out: 250-PIPELINING Out: 250-SIZE 10240000 Out: 250-VRFY Out: 250-ETRN Out: 250-STARTTLS Out: 250-AUTH PLAIN Out: 250-AUTH=PLAIN Out: 250-ENHANCEDSTATUSCODES Out: 250-8BITMIME Out: 250 DSN In: STARTTLS Out: 220 2.0.0 Ready to start TLS In: EHLO mail.otherdomain.tld Out: 250- mailserver2.mydomain.tld Out: 250-PIPELINING Out: 250-SIZE 10240000 Out: 250-VRFY Out: 250-ETRN Out: 250-AUTH PLAIN Out: 250-AUTH=PLAIN Out: 250-ENHANCEDSTATUSCODES Out: 250-8BITMIME Out: 250 DSN In: MAIL From:<rh(a)tvujweb.cz> SIZE=704 Out: 250 2.1.0 Ok In: RCPT To:<non_existing_user(a)existingdomain.net> Out: 451 4.3.0 <non_existing_user(a)existingdomain.net>: Temporary lookup failure In: QUIT Out: 221 2.0.0 Bye I have googled out somewhere parameter for dovecot.conf unknown_address_reject_code = 550 , but Dovecot is not taking this one. Is Dovecot using Postfix paramteres delay_warning_time = and unknown_local_recipient_reject_code = ?? Assuming not, becauase Postfix is delivering over Dovecot, as defined in postfix/master.conf dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/deliver -d $(recipient) So how can i set this two parameters ?? Thanks in advance for any hint Radim -- Radim Hejc

1 0

[Dovecot] documentation for developers
by Boris Lorbeer 20 Sep '07

20 Sep '07

Hi there, I have two questions: - Is there a dovecot documentation for developers (apart from the source itself)? - In the site I am concerned with, it happens very often that one mail is delivered to hundreds of recipients. Since almost all of the mailboxes are situated on the same filesystem, the mail is delivered by just saving it once and establishing hardlinks from the mail directories of all the other recipients to this one mail. My question now is: can dovecot's lda "deliver" be configured to deliver mail to more than one recipients and to use the hardlink method just described? Boris -- Dipl. Phys. Boris Lorbeer science + computing ag Senior IT Consultant Chausseestr. 14 email B.Lorbeer(a)science-computing.de 10115 Berlin, Germany phone +49(0)30 2007697-16 www.science-computing.de fax +49(0)30 2007697-11 -- Vorstand/Board of Management: Dr. Bernd Finkbeiner, Dr. Florian Geyer, Dr. Roland Niemeier, Dr. Arno Steitz, Dr. Ingrid Zech Vorsitzender des Aufsichtsrats/ Chairman of the Supervisory Board: Prof. Dr. Hanns Ruder Sitz/Registered Office: Tuebingen Registergericht/Registration Court: Stuttgart Registernummer/Commercial Register No.: HRB 382196

3 2

[Dovecot] 'r' flag in ACL stomping on 'l' flag effect
by Phil Edwards 19 Sep '07

19 Sep '07

We're using Dovecot 1.0.3, and I'm setting up some shared IMAP folders. The eventual goal is to do the standard "learn as spam" / "learn as ham" type of setup, with some cron jobs to do the message extractions. But there's one minor twist: the "learn as ham" folder will need to be write-only for users. (I'll either create a fake user with read access to extract the mail for sa-learn, or do some local filesystem access, etc. A problem for a future day.) The issue is that some of the mail being misclassified might contain sensitive information. So users should be able to copy messages into that folder, but not list or read other messages. (Yes, they will be removed from the folder by the future sa-learn script, don't worry.) I can get normal operation with the ACL plugin and a global ACL file: # "TestTwo" mailbox acl file: authenticated lrwik * OK Dovecot ready. 1 login ........ 1 OK Logged in. 2 list "" * * LIST (\Noselect \HasChildren) "." "Testing/" * LIST (\HasNoChildren) "." "Testing/TestTwo" * LIST (\HasNoChildren) "." "Testing/TestOne" 2 OK List completed. 3 select "Testing/TestTwo" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 0 EXISTS * 0 RECENT * OK [UIDVALIDITY 1189458953] UIDs valid * OK [UIDNEXT 1] Predicted next UID 3 OK [READ-WRITE] Select completed. Now, I change the TestTwo acl file to read authenticated lwik but can no longer subscribe to the folder: 1 login ........ 1 OK Logged in. 2 list "" * * LIST (\Noselect \HasChildren) "." "Testing/" * LIST (\HasNoChildren) "." "Testing/TestTwo" * LIST (\HasNoChildren) "." "Testing/TestOne" 2 OK List completed. 3 subscribe "Testing/TestTwo" 3 NO Permission denied According to http://wiki.dovecot.org/ACL, the 'l' flag means "Mailbox is visible in mailbox list. Mailbox can be subscribed to." but the second part of that statement is not actually happening. Is this a misunderstanding on my part, or a bug? -- Phil Edwards

2 4