- dovecot - dovecot.org

[Dovecot] Quota Messages
by Hermann wacker 13 Jul '07

13 Jul '07

Hi @all, First: I'm sorry when my english isn't understandable, please just ask if I messed things up. I switched from Cyrus to Dovecot (Cyrus was on Debian Sarge, Dovecot is now on a Etch) and I'm quite happy with it. There is just one thing that I'm missing in Dovecot. in Cyrus when users reached 90% of their Quota, a message popped up in their Mailclients, telling them to clean up their Mailboxes. Dovecot delivers the quotausage to the Client (I can see in my Thunderbird a small Statusbar), but when you don't look carefully, you will mostly miss the point where you can delete the messages without having a fight with the quotalimit (because mails in trash using the quota). At the moment I'm using "quota = fs" so there is no good way to keep the trash out of the quotathing and that's not the point of my question. The question is: Is there a way where Dovecot (or Postfix) inform the user that his quota is reaching its limit? Or maybe the postmaster, thats not important. The important thing is a way where my mailsystem tells somebody that quotas are reaching their limits. Greetings from Germany Hermann Wacker Dovecot Version: 1.0.rc15 Postfix Version: 2.3.8-2+b1 quotaconf: # /etc/dovecot/dovecot.conf IEffective uid=65534, gid=65534 ILoading modules from directory: /usr/lib/dovecot/modules/imap IModule loaded: /usr/lib/dovecot/modules/imap/lib01_quota_plugin.so IModule loaded: /usr/lib/dovecot/modules/imap/lib02_imap_quota_plugin.so log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_extra_groups: mail mail_location: maildir:%h/mails mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: shadow userdb: driver: passwd

2 1

[Dovecot] Quota exceeded messages
by Frank Church 13 Jul '07

13 Jul '07

When I try to move messages between folders I get 'Quota exceeded' messages. I installed dovecot without any major configuration and accounts are created with PostfixAdmin. Is there some common setting that I must be missing? Version in use is 1.0 rc26 - Frank

3 7

[Dovecot] Patches to log imap bandwidth?
by Jason Fesler 13 Jul '07

13 Jul '07

Anyone patch dovecot to syslog bytes transfered during a session or anything of that sort? I'm trying to track down imap bandwidth spikes, and unfortunately the uid (according to ipfw) for the imap port spikes is 0. (Presumably FreeBSD's ipfw accounting is based on who started the app instead of the effective user id?) -- Jason Fesler, email/jabber <jfesler(a)gigo.com> resume: http://jfesler.com "Give a man fire, and he'll be warm for a day; set a man on fire, and he'll be warm for the rest of his life."

2 2

[Dovecot] Today's stable hg pull destroyed dovecot...
by Ralf Hildebrandt 13 Jul '07

13 Jul '07

I performed a hg pull today for 1.0.1 and after recompilation my log was flooded with: Jul 12 10:29:21 postamt dovecot: IMAP(kxx4): UID larger than next_uid in file /home/k/j/kxx4/Maildir/dovecot-uidlist (6 >= 0) Jul 12 10:29:21 postamt dovecot: IMAP(rexxxes): UID larger than next_uid in file /home/r/e/rexxxes/Maildir/dovecot-uidlist (1 >= 0) Jul 12 10:29:21 postamt dovecot: IMAP(sxxkim): Maildir /home/s/i/sxxkim/Maildir sync: UIDVALIDITY changed (1184228955 -> 3086699759) and people were reporting "the IMAP server closing and dropping connections". I then downloaded 1.0.1 from the webpage, rebuilt and the problems are gone. Now I'm getting those: Jul 12 10:33:10 postamt dovecot: IMAP(blxxe): Corrupted index cache file /home/b/l/blxxe/Maildir/dovecot.index.cache: indexid changed Somethin amiss with the index code? -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de Those who would give up essential liberty to purchase a little temporary safety deserve neither liberty nor safety. -- Benjamin Franklin, 1759

2 1

[Dovecot] v1.1 status and benchmarks
by Timo Sirainen 13 Jul '07

13 Jul '07

v1.1 plans have changed a bit. I'll release v1.1.alpha1 soon and hope to have a stable v1.1 in a month or two. The rest of the features that didn't make it into v1.1 will go to v1.2. I'll write more about this when v1.1 alpha is released. I also did a bit of benchmarking. v1.1's performance improvements are looking pretty great, it seems to be twice as fast as v1.0. v1.0: Maildir, dovecot-1.0 hg + inotify dotlock wait patch, mmap_disable=yes v1.1: Maildir, dovecot hg, mmap_disable=no cydir: Cydir, dovecot hg, mmap_disable=no 1 client -------- ./imaptest logout=0 seed=1 secs=10 clients=1 Logi List Stat Sele Fetc Fet2 Stor Dele Expu Appe 100% 50% 50% 100% 100% 100% 50% 100% 100% 100% 30% 5% v1.0: 1 1221 1179 1 2420 3458 323 1934 2419 2552 v1.1: 1 2606 2597 1 5221 7352 688 4181 5221 5489 cydir: 1 4495 4534 1 8960 12786 1216 7224 8959 9434 10 clients ---------- ./imaptest logout=0 seed=1 secs=10 clients=10 Logi List Stat Sele Fetc Fet2 Stor Dele Expu Appe 100% 50% 50% 100% 100% 100% 50% 100% 100% 100% 30% 5% v1.0: 10 2058 2102 10 4157 6019 1426 3348 4157 4391 v1.1: 10 5029 5072 10 10064 14352 3176 8092 10064 10624 cydir: 10 6332 6393 10 12664 17965 3958 10154 12663 13336

5 11

[Dovecot] NFS cache flush tester
by Timo Sirainen 13 Jul '07

13 Jul '07

http://dovecot.org/tools/nfstest.c I wrote a test utility that tests different ways to flush NFS attribute cache and data cache. Please test in your NFS setup and show me the results, so I can make Dovecot v1.1 works well with NFS. Run the test several times (3 should be enough) to make sure the output stays the same, because the attribute cache flushes might incorrectly say "OK". And of course attribute cache must not be disabled for this test to work. If you have other ideas how to flush either cache please tell me and I'll update the test utility. I'd like to have a way to flush the cache without having the NFS client send anything to server. Unfortunately all of the below ways do that. Results for Linux v2.6.15 and v2.6.18: Info: Testing attribute cache.. Info: Attr cache flush fchown(-1, -1): failed Info: Attr cache flush fchown(uid, gid): OK Info: Attr cache flush fchmod(mode): OK Info: Attr cache flush chown(-1, -1): failed Info: Attr cache flush chown(uid, gid): OK Info: Attr cache flush chmod(mode): OK Info: Testing data cache.. Info: data cache: Appends weren't noticed (ret = 0) Info: - Attribute cache flush helped Info: data cache (no caching): failed Info: data cache (attr cache): failed Info: data cache (lockf()): OK Info: data cache (flock(shared)): OK Info: data cache (flock(exclusive)): OK

7 25

[Dovecot] Problem with Dovecot SASL in Postfix
by Chris McMacken 12 Jul '07

12 Jul '07

I'm trying to configure my postfix server to use Dovecot as an SASL server and running into some problems. My server supports a couple of domain, I have multiple user/password files for multiple domains to make the files a little easier to manage. Not sure if this question should belong in the dovecot mailing list or the postfix one, but here goes anyway. I have everything configured to use CRAM-MD5 authentication, including my mail client. Here the auth section of my dovecot conf. auth default { mechanisms = plain cram-md5 passdb passwd-file { # Path for passwd-file args = /usr/local/etc/dovecot/%d/passwd } userdb passwd-file { # Path for passwd-file args = /usr/local/etc/dovecot/%d/passwd } user = root # It's possible to export the authentication interface to other programs: socket listen { client { # The client socket is generally safe to export to everyone. Typical use # is to export it to your SMTP server so it can do SMTP AUTH lookups # using it. path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } heres a sample line from one of the passwd files: chrism:{CRAM-MD5}a67a65704086a046b3f875d1eaac8cb5c6fd13406507fead30d9bcb1bf… and to login through SASL I am trying to use the username chrism(a)example.com when I use the full email address like this to login like this I get this output into my postfix log: Jul 10 18:46:59 mail postfix/smtpd[57343]: connect from unknown[12.244.148.123] Jul 10 18:46:59 mail postfix/smtpd[57343]: NOQUEUE: reject: RCPT from unknown[12.244.148.123]: 554 5.7.1 <chrism(a)gmail.com>: Relay access denied; from=<chrism(a)example.com> to=<chrism(a)gmail.com> proto=ESMTP helo=<[192.168.1.14]> Jul 10 18:47:00 mail postfix/smtpd[57343]: disconnect from unknown[12.244.148.123] (not actually using example.com but I changed it here) heres my smtpd_recipient_restricitons from postconf smtpd_recipient_restrictions = permit_mynetworks, reject_unauth_destination, permit_sasl_authenticated so when I use the full user name (chrism(a)example.com) it doesn't appear to even attempt logging into the sasl server. If I change it to simply chrism, heres the output: Jul 10 18:50:36 mail postfix/smtpd[57356]: connect from unknown[12.244.148.123] Jul 10 18:50:38 mail postfix/smtpd[57356]: warning: unknown[12.244.148.123]: SASL CRAM-MD5 authentication failed: PDI3NjU4MTE4NDExMTQzN0BtYWlsPg== Jul 10 18:50:39 mail postfix/smtpd[57356]: lost connection after AUTH from unknown[12.244.148.123] Jul 10 18:50:39 mail postfix/smtpd[57356]: disconnect from unknown[12.244.148.123] if I put my user name in as chrism and don't add the @example.com it tried to login but it can't login. anyone have any ideas?

2 1

[Dovecot] 1.0.1: corrupt index on fresh mailbox, ideas?
by Troy Engel 12 Jul '07

12 Jul '07

A new employee started today, when logging into his new mailbox this morning during a walk-through I got a nasty server error response in Thunderbird - something I never see, DC runs smooth as butter for us. Checking the server log I see this: == snip == dovecot: Jul 09 09:38:54 Error: IMAP(xxxxxxx): Maildir /home/x/xxxxxxx/Maildir sync: UIDVALIDITY changed (1183406107 -> 1183999134) dovecot: Jul 09 09:39:06 Error: IMAP(xxxxxxx): Corrupted transaction log file /var/spool/dovecot/indexes/x/xxxxxxx/.INBOX/dovecot.index.log.2: invalid indexid (1183406107 != 1183999146) dovecot: Jul 09 09:39:06 Error: IMAP(xxxxxxx): Corrupted index cache file /var/spool/dovecot/indexes/x/xxxxxxx/.INBOX/dovecot.index.cache: indexid changed == snip == Some facts that make this a strange occurrence: 1) new IMAP mailbox, only one email was in it that I had sent last week (boilerplate Welcome email) 2) was working perfectly fine on Friday when I set things up (Thunderbird and SquirrelMail) and tested with the same client laptop and same Thunderbird 3) nothing bad happened with the servers over the weekend, all is tip-top - no restarts, reboots, nothing. 4) DC does use NFS mounted maildirs, but there is only one DC accessing any maildir - no other servers touch ~/Maildir/. mmap is disabled. What could be a reason for this index to have gotten corrupted? This is the first time I've had an index go corrupt out of all the users, so I'd like to try and track down the cause of this... thx, -te == dovecot -n == # 1.0.1: /etc/dovecot.conf log_path: /var/log/dovecot.log protocols: imap imaps listen: * ssl_cert_file: /opt/SSL/server.pem ssl_key_file: /opt/SSL/server.pem login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_process_per_connection: no mail_location: maildir:~/Maildir:INDEX=/var/spool/dovecot/indexes/%1u/%u mmap_disable: yes namespace: type: private separator: . prefix: INBOX. inbox: yes auth default: cache_size: 4096 cache_ttl: 7200 passdb: driver: pam args: cache_key=%u dovecot userdb: driver: passwd args: blocking=yes == end == -- Troy Engel | Systems Engineer Fluid, Inc | http://www.fluid.com

5 12

[Dovecot] Fixing lda user_query error introduces new fault in mail delivery
by Frank Church 12 Jul '07

12 Jul '07

I was getting these errors below and after fixing it delivery errors were introduced dovecot/error_log ============== dovecot: Jul 11 06:19:28 Error: auth-worker(default): sql(user(a)domain.com): User query failed: Table 'postfix.users' doesn't exist deliver(user(a)domain.com): Jul 11 06:19:28 Error: BUG: Unexpected input from auth master: FAIL 1 dovecot: Jul 11 06:21:41 Error: auth-worker(default): sql(admin(a)achimota.com,127.0.0.1): User query failed: Table 'postfix.users' doesn't exist ============== It turns out that using prefetch with dovecot lda required a user_query in dovecot/sql.conf I fixed it by adding this query to dovecot/sql.conf user_query = SELECT concat('/var/vmail/', maildir) as home, 601 as uid, 12 as gid FROM mailbox WHERE username = '%u' AND active = '1' This resulted in a new mailbox /var/vmail/domain.com/user(a)domain.com being created when although /var/vmail/domain.com/user already exists and is what the query returns It seems that prior to that when the query was failing the mail was properly delivered somehow by dovecot, but fixing it created a new problem. It appears that the mail_location = maildir:/var/vmail/%d/%u in dovecot.conf could be related as %u is user(a)domain.com Is there a fix for this? Does the deliver line in postfix/master.cf need to be adjusted in some way I will probably have to disable the user_query and restart for the time being dovecot version - 1.0rc26 Here is dovecot.conf =============== ssl_cert_file = /etc/pki/dovecot/certs/abc.domain.net.crt ssl_key_file = /etc/pki/dovecot/private/abc.domain.net.key ssl_ca_file = /etc/pki/dovecot/certs/ca-bundle.crt mail_location = maildir:/var/vmail/%d/%u mail_extra_groups = mail first_valid_uid = 601 last_valid_uid = 601 maildir_copy_with_hardlinks = yes protocol imap { mail_plugins = quota imap_quota imap_client_workarounds = outlook-idle delay-newmail } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { postmaster_address = postmaster(a)domain.net mail_plugins = quota log_path = /var/log/dovecot/deliver.log info_log_path = /var/log/dovecot/deliver.log } auth default { mechanisms = plain passdb sql { args = /etc/dovecot/sql.conf } userdb prefetch { } userdb sql { args = /etc/dovecot/sql.conf } user = nobody socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = mail } client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = mail } } } dict { } plugin { quota = maildir:storage=10240:messages=1000 acl = vfile:/etc/dovecot/acls trash = /etc/dovecot/trash.conf } dovecot/sql.conf ============== default_pass_scheme = PLAIN-MD5 driver = mysql connect = host=localhost dbname=postfix user=dovecot password=password password_query = SELECT username as user, password, concat('/var/vmail/', maildir) as userdb_home, concat('maildir:/var/vmail/', maildir) as userdb_mail, 601 as userdb_uid, 12 as userdb_gid, concat('dirsize:storage=', cast(quota as char)) AS userdb_quota FROM mailbox WHERE username = '%u' AND active = '1' user_query = SELECT concat('/var/vmail/', maildir) as home, 601 as uid, 12 as gid FROM mailbox WHERE username = '%u' AND active = '1' dovecot line in postfix/master.cf ======================= # Dovecot LDA dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/local/libexec/dovecot/deliver -d ${recipient} - Frank

2 1

[Dovecot] Can Wiki entry on dovecot LDA/deliver be clarified?
by Frank Church 11 Jul '07

11 Jul '07

Hi guys, I am having some problems relating to this "Fixing lda user_query error introduces new fault in mail delivery" and I'd like to know if the above wiki comment holds even if a user_query is configured to return the correct mail folder. According to this LDA delivers only to the mail_location setting. Does that mean that it will stick to the value in dovecot.conf or will the value returned in the query override it? This appears to be the problem I am experiencing with the previous thread. >From wiki entry at wiki.dovecot.org/LDA ============================ Problems with deliver Currently deliver doesn't support namespaces. The mails can be delivered only to mailboxes specified by the mail_location setting. If you are using prefetch userdb, keep in mind that deliver does not make a password query and thus will not work if -d parameter is used. The UserDatabase/Prefetch page explains how to fix this. ================================== Any ideas? - Frank

1 1