- dovecot - dovecot.org

[Dovecot] How to stop POP clients from downloading mail after directory corruption
by Frank Church 15 Jul '07

15 Jul '07

Transferring my email from a Courier server, as well as some corruption in my dovecot installation caused all POP mails to be downloaded again. I surmised that the dovecot-uidlist file was not present in the first instance, and was probably out of sync in the second. Is there a way to do some reindexing and uid-list regeneration that can stop the problem from occurring? - Frank

2 1

[Dovecot] More Descriptive Logging Needed
by Joseph D. Wagner 15 Jul '07

15 Jul '07

(Everything herein refers to dovecot-1.0.1.) I'm sorry to say that I've been having troubles with dovecot. While attempting to troubleshoot them, I've found the existing logs to be lacking. In particular, I've had a lot of difficulty with the client<->server connection disconnecting, but the only message I get in the logs is "Disconnected". After dissecting the code a bit, I've found quite a number of places where the code will close the connection logging nothing more than the word "Disconnected", or worse, it will not specify a reason in which case the code in client_destroy() will log the default "Disconnected". Because of this, isolating the offending code has been a bit difficult. (I realize the problem may lie with the client, but I cannot even begin to program a work around until I isolate the exact place and cause of failure.) In an attempt to change the logging to be more descriptive myself, I already changed src/imap/cmd-fetch.c:85 on my own copy of dovecot from: client_disconnect(cmd->client, "Disconnected"); to: client_disconnect(cmd->client, "Disconnected in FETCH"); This makes the logging both more descriptive and more in line with other parts of code, like src/imap/cmd-append.c:50 which already say: client_destroy(client, "Disconnected in APPEND"); As luck would have it, my problem was not in the FETCH command. I'm now looking at the client_read() function in src/imap-login/client.c:318-334. If I'm reading the code right, then "i_stream_read(client->input)" returning "-1" means that the socket/stream is already disconnected, right? In other words, some function attempted to read off of a socket/stream that was already closed, right? If so, shouldn't the client_read() function not have been called in the first place? Please let me know if I'm wrong. I've been banging my head against the wall trying to make sense of all the different code. Any assistance you can offer would be appreciated. Joseph D. Wagner

2 1

[Dovecot] problem with subscriptions file version 1.0.1
by Liz 13 Jul '07

13 Jul '07

Hello, I am currently working on a patch to add IMAPdir support to dovecot. (For those who do not know, IMAPdir is exactly like Maildir except that instead of having a folder .foo it would just be foo. The advantage is that the file system is slightly easier to search through without the dot in front of the folders.) The first thing I did was get the configuration file working for Maildir. So I know that the problem has nothing to do with the configuration file. Next I looked through the actual source code to find any place where a dot might be added to the beginning of a folder. It transpired that there is a constant, MAILDIR_FS_SEP_S, which is assigned the value ".". I deleted all the occurrences of this constant, compiled the source code again, and ran into a rather interesting problem. When I try to create a new folder through Thunderbird on a separate machine, the folder is not visible unless I restart Thunderbird. I checked on the machine acting as a server and the folder is created and the subscriptions file is updated, and the dot at the beginning is indeed absent. So I see no reason why this should not work. If I had deleted some of the constants that ought not have been deleted, the subscriptions file would not be readable at all and I would not be able to see the folder when Thunderbird restarts. If there were some sort of deadlock going on with the subscriptions file, one would think that it would not be caused by deleting the constants. I would have run into the problem before editing any of the source code. I know for fact that the only thing different about my source code and the code available for downloading is the deleted constants. If anyone has any ideas, please let me know. If you need more information, please feel free to prompt me for it because I have no idea what might be useful that I have not already provided. Regards, Elizabeth Bermel

2 3

[Dovecot] telnet to dovecot not creating mbox
by Andy Fadich 13 Jul '07

13 Jul '07

Hi, Whenever I create a new email user, telnet fails until an email is sent to that user to create his mbox. This is the error that it gives. Anyone know how to fix this? I could create the email account script to touch the users mbox, but I havn't needed to do this in the past with ipop3d and dovecot on a different server. [root@mail log]# telnet localhost 110 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. user testact +OK pass +OK Logged in. -ERR Internal error occurred. Refer to server log for more information. [2007-07-13 10:37:15] Connection closed by foreign host. Jul 13 10:33:43 mail dovecot: pop3-login: Login: user=<testact>, method=PLAIN, rip=::ffff:127.0.0.1, lip=::ffff:127.0.0.1, secured Jul 13 10:33:43 mail dovecot: POP3(testlol): open(/var/spool/mail/testact, O_CREAT) failed: Permission denied Jul 13 10:33:43 mail dovecot: POP3(testlol): access() failed with mbox file /var/spool/mail/testact: No such file or directory Jul 13 10:33:43 mail dovecot: POP3(testlol): stat() failed with mbox file /var/spool/mail/testact: No such file or directory Jul 13 10:33:43 mail dovecot: POP3(testlol): Couldn't init INBOX: Internal error occurred. Refer to server log for more information. [2007-07-13 10:33:43] Jul 13 10:33:43 mail dovecot: POP3(testlol): Mailbox init failed top=0/0, retr=0/0, del=0/0, size=0 Andy

3 2

[Dovecot] Today's hg pull doesn't compile
by Ralf Hildebrandt 13 Jul '07

13 Jul '07

I get: Making all in auth make[3]: Entering directory /usr/src/dovecot/src/auth' rm -f libpassword.a ar cru libpassword.a mycrypt.o password-scheme.o password-scheme-md5crypt.o password-scheme-otp.o password-scheme-rpa.o ranlib libpassword.a gcc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-sql -I../../src/lib-settings -I../../src/lib-ntlm -I../../src/lib-otp -DAUTH_MODULE_DIR=\""/usr/local/lib/dovecot/auth"\" -DPKG_LIBEXECDIR=\""/usr/local/libexec/dovecot"\" -std=gnu99 -fstack-protector -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT auth-request.o -MD -MP -MF .deps/auth-request.Tpo -c -o auth-request.o auth-request.c auth-request.c: In function ‘is_ip_in_network’: auth-request.c:874: error: ‘const union <anonymous>’ has no member named ‘ip6’ auth-request.c:875: error: ‘union <anonymous>’ has no member named ‘ip6’ make[3]: *** [auth-request.o] Error 1 make[3]: Leaving directory /usr/src/dovecot/src/auth' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory /usr/src/dovecot/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory /usr/src/dovecot' make: *** [all] Error 2 -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de Any technology sufficiently advanced is indistinguishable from magic.

2 2

[Dovecot] Maildir and Windows NFS server
by Julian Jimenez 13 Jul '07

13 Jul '07

Hi, I want to migrate form Courier to Dovecot. The problem is that our NFS server is a Windows server. We use Debian stable (Etch) and maildir. With Courier, we need to compile from the source, changing the parameter MDIRSEP from ":" to ";", because Windows cannot handle files with this character in their name. Anyone knows the name of the parameter in Dovecot that I need to change to do the same? Thanks in advance. Julián

2 1

[Dovecot] Dovecot login failing
by Richard Ellis 13 Jul '07

13 Jul '07

Fedora 7 Dovecot version 1.0.1 Hi All, I've been using a combination of getmail/Dovecot/Squirrelmail for a while now and its all been fine. However, last week when trying to demonstrate how to use Squirrelmail to my wife, her login failed. I then tried mine, which I had used many times before and it also fails. Looking in the logs, Dovecot appears to be trying to add a domain name against the login, instead of just checking that user against the UNIX logins of my machine. I thought at first this was because when I'm away from home, I use a no-ip address to access my mailserver, but it also fails when I'm in the house, or even on the server console. dovecot: Jul 12 12:04:56 Info: imap-login: Aborted login: user=< rick(a)servehttp.com>, method=PLAIN, rip=::ffff:127.0.0.1, lip=::ffff: 127.0.0.1, secured dovecot: Jul 12 12:10:00 Info: pop3-login: Login: user=<rick>, method=PLAIN, rip=::ffff:127.0.0.1, lip=::ffff:127.0.0.1, secured Anybody any idea how to rectify this? I can't see an option in the /etc/dovecot.conf file to stop it and using auth_default_realm = doesn't seem to make any difference. If I telnet into dovecot using my local username and password, it works fine. Any advice would be most welcome before I break it fiddling. Thanks Rik -- The Truth is out there, does anyone have the URL?

5 5

[Dovecot] v1.0.2 release candidate
by Timo Sirainen 13 Jul '07

13 Jul '07

http://dovecot.org/tmp/dovecot-1.0.2-rc.tar.gz Unless someone finds something broken, I'll release v1.0.2 in a few days. The most important changes since v1.0.1: * dbox isn't built anymore by default. It will be redesigned so it shouldn't be used. + Maildir: Support reading dovecot-uidlist (v3) files created by Dovecot v1.1. - Maildir: "UIDVALIDITY changed" errors could happen with newly created mailboxes - If "INBOX." namespace was used, LIST returned it with \HasNoChildren which caused some clients not to show any other mailboxes. - Maildir++ quota: If multiple processes were updating maildirsize at the same time, we failed with "Unknown error". - IMAP: IDLE didn't actually disconnect client after 30 minutes of inactivity. - LDAP passdb/userdb was leaking memory - deliver: %variables in plugin {} weren't expanded

4 9

[Dovecot] Monitoring Recomendations
by Dehnert James Sr 13 Jul '07

13 Jul '07

I have a client that I have installed Dovecot 1.0.1 for is having some performance issues. Especially when using IMAP from various Outlook clients. I have TLS installed and all the IMAP connections are secured. I'm wondering is anyone has any recommendations for monitoring dovecot performance. I'd like to try and nail down where the real performance issues are. I suspect outlook, but I want to eliminate Dovecot as the cause of any problems, or, if I have a problem with Dovecot, I want to identify any issues I can and fix them. Thanks, Zeke -- James "Zeke" Dehnert mailto:jdehnert@norcalnetworks.com Phone: +1 707.546.6620 x602 Fax: +1 707.324.8043 "Life is racing, everything else is just waiting"

4 4

[Dovecot] dovecot sieve notify mailto
by Kupor Laszlo 13 Jul '07

13 Jul '07

Hello, I try to migrate to dovecot-lda from procmail, but some script can't run under lda cmusieve plugin. dovecot version: dovecot-1.0(debian) revelant config dovecot.conf: protocol lda { postmaster_address = postmaster(a)wizard.dunanet.hu hostname = wizard.dunanet.hu mail_plugin_dir = /usr/lib/dovecot/modules/lda #sendmail_path = /usr/lib/sendmail auth_socket_path = /var/run/dovecot/auth-master mail_plugins = cmusieve } .forward | "/usr/lib/dovecot/deliver" .dovecot.sieve (revelant part) require ["fileinto","notify"]; ... ... notify :method "mailto" :options "9141141(a)sms1.pgsm.hu" :id "test" :message; if true { keep; } ... I can compile with sievec, deliver also can compile to .dovecot.sievec (no errors) i can decompile with sieved: 1935: NOTIFY METHOD({6}mailto) ID({5}willy) OPTIONS {20}9141141(a)sms1.pgsm.hu PRIORITY(13) MESSAGE({17}$from$: $subject$) 1954: IF (ends at 1957)true 1957:JUMP 1960 1959: KEEP full len is: 1960 But notification does not work.. Jul 3 17:50:38 WiZARD deliver(willy): Loading modules from directory: /usr/lib/dovecot/modules/lda Jul 3 17:50:38 WiZARD deliver(willy): Module loaded: /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so Jul 3 17:50:38 WiZARD deliver(willy): mbox: data=/home/willy/mail/:INBOX=/var/mail/willy Jul 3 17:50:38 WiZARD deliver(willy): mbox: root=/home/willy/mail, index=/home/willy/mail, inbox=/var/mail/willy Jul 3 17:50:38 WiZARD deliver(willy): cmusieve: Using sieve path: /home/willy/.dovecot.sieve Jul 3 17:50:38 WiZARD deliver(willy): cmusieve: Executing script /home/willy/.dovecot.sievec Jul 3 17:50:38 WiZARD postfix/smtpd[15234]: disconnect from donci.dunanet.hu[62.77.204.40] Jul 3 17:50:38 WiZARD deliver(willy): msgid=<Pine.LNX.4.62.0707031750280.28802(a)donci.dunanet.hu>: saved mail to INBOX Jul 3 17:50:38 WiZARD deliver(willy): sieve runtime error: Notify: Generic Error Jul 3 17:50:38 WiZARD postfix/local[15239]: B31B419746C: to=<willy(a)wizard.dunanet.hu>, relay=local, delay=0.1, delays=0.07/0/0/0.02, dsn=2.0.0, status=sent (delivered to command: /usr/lib/dovecot/deliver) I always get sieve runtime error: Notify: Generic Error Fileinto, and redirect works fine, but notify does not. I try "dovecot-sieve-1-0-64a7986b5e55.tar.bz2" without success. Please help debug "Generic Error". Thanks, Udv.: Willy -- PGP GNUPG/1.0 ID = 5BFA0D36 Kupor Laszlo Attila <willy(a)dunanet.hu> Key fingerprint = 3F68 9483 5B65 8E2F CD30 5326 50F9 5A33 5BFA 0D36

3 5

[Dovecot] Quota Messages
by Hermann wacker 13 Jul '07

13 Jul '07

Hi @all, First: I'm sorry when my english isn't understandable, please just ask if I messed things up. I switched from Cyrus to Dovecot (Cyrus was on Debian Sarge, Dovecot is now on a Etch) and I'm quite happy with it. There is just one thing that I'm missing in Dovecot. in Cyrus when users reached 90% of their Quota, a message popped up in their Mailclients, telling them to clean up their Mailboxes. Dovecot delivers the quotausage to the Client (I can see in my Thunderbird a small Statusbar), but when you don't look carefully, you will mostly miss the point where you can delete the messages without having a fight with the quotalimit (because mails in trash using the quota). At the moment I'm using "quota = fs" so there is no good way to keep the trash out of the quotathing and that's not the point of my question. The question is: Is there a way where Dovecot (or Postfix) inform the user that his quota is reaching its limit? Or maybe the postmaster, thats not important. The important thing is a way where my mailsystem tells somebody that quotas are reaching their limits. Greetings from Germany Hermann Wacker Dovecot Version: 1.0.rc15 Postfix Version: 2.3.8-2+b1 quotaconf: # /etc/dovecot/dovecot.conf IEffective uid=65534, gid=65534 ILoading modules from directory: /usr/lib/dovecot/modules/imap IModule loaded: /usr/lib/dovecot/modules/imap/lib01_quota_plugin.so IModule loaded: /usr/lib/dovecot/modules/imap/lib02_imap_quota_plugin.so log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_extra_groups: mail mail_location: maildir:%h/mails mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: passdb: driver: shadow userdb: driver: passwd

2 1

[Dovecot] Quota exceeded messages
by Frank Church 13 Jul '07

13 Jul '07

When I try to move messages between folders I get 'Quota exceeded' messages. I installed dovecot without any major configuration and accounts are created with PostfixAdmin. Is there some common setting that I must be missing? Version in use is 1.0 rc26 - Frank

3 7

[Dovecot] Patches to log imap bandwidth?
by Jason Fesler 13 Jul '07

13 Jul '07

Anyone patch dovecot to syslog bytes transfered during a session or anything of that sort? I'm trying to track down imap bandwidth spikes, and unfortunately the uid (according to ipfw) for the imap port spikes is 0. (Presumably FreeBSD's ipfw accounting is based on who started the app instead of the effective user id?) -- Jason Fesler, email/jabber <jfesler(a)gigo.com> resume: http://jfesler.com "Give a man fire, and he'll be warm for a day; set a man on fire, and he'll be warm for the rest of his life."

2 2

[Dovecot] Today's stable hg pull destroyed dovecot...
by Ralf Hildebrandt 13 Jul '07

13 Jul '07

I performed a hg pull today for 1.0.1 and after recompilation my log was flooded with: Jul 12 10:29:21 postamt dovecot: IMAP(kxx4): UID larger than next_uid in file /home/k/j/kxx4/Maildir/dovecot-uidlist (6 >= 0) Jul 12 10:29:21 postamt dovecot: IMAP(rexxxes): UID larger than next_uid in file /home/r/e/rexxxes/Maildir/dovecot-uidlist (1 >= 0) Jul 12 10:29:21 postamt dovecot: IMAP(sxxkim): Maildir /home/s/i/sxxkim/Maildir sync: UIDVALIDITY changed (1184228955 -> 3086699759) and people were reporting "the IMAP server closing and dropping connections". I then downloaded 1.0.1 from the webpage, rebuilt and the problems are gone. Now I'm getting those: Jul 12 10:33:10 postamt dovecot: IMAP(blxxe): Corrupted index cache file /home/b/l/blxxe/Maildir/dovecot.index.cache: indexid changed Somethin amiss with the index code? -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de Those who would give up essential liberty to purchase a little temporary safety deserve neither liberty nor safety. -- Benjamin Franklin, 1759

2 1

[Dovecot] v1.1 status and benchmarks
by Timo Sirainen 13 Jul '07

13 Jul '07

v1.1 plans have changed a bit. I'll release v1.1.alpha1 soon and hope to have a stable v1.1 in a month or two. The rest of the features that didn't make it into v1.1 will go to v1.2. I'll write more about this when v1.1 alpha is released. I also did a bit of benchmarking. v1.1's performance improvements are looking pretty great, it seems to be twice as fast as v1.0. v1.0: Maildir, dovecot-1.0 hg + inotify dotlock wait patch, mmap_disable=yes v1.1: Maildir, dovecot hg, mmap_disable=no cydir: Cydir, dovecot hg, mmap_disable=no 1 client -------- ./imaptest logout=0 seed=1 secs=10 clients=1 Logi List Stat Sele Fetc Fet2 Stor Dele Expu Appe 100% 50% 50% 100% 100% 100% 50% 100% 100% 100% 30% 5% v1.0: 1 1221 1179 1 2420 3458 323 1934 2419 2552 v1.1: 1 2606 2597 1 5221 7352 688 4181 5221 5489 cydir: 1 4495 4534 1 8960 12786 1216 7224 8959 9434 10 clients ---------- ./imaptest logout=0 seed=1 secs=10 clients=10 Logi List Stat Sele Fetc Fet2 Stor Dele Expu Appe 100% 50% 50% 100% 100% 100% 50% 100% 100% 100% 30% 5% v1.0: 10 2058 2102 10 4157 6019 1426 3348 4157 4391 v1.1: 10 5029 5072 10 10064 14352 3176 8092 10064 10624 cydir: 10 6332 6393 10 12664 17965 3958 10154 12663 13336

5 11

[Dovecot] NFS cache flush tester
by Timo Sirainen 13 Jul '07

13 Jul '07

http://dovecot.org/tools/nfstest.c I wrote a test utility that tests different ways to flush NFS attribute cache and data cache. Please test in your NFS setup and show me the results, so I can make Dovecot v1.1 works well with NFS. Run the test several times (3 should be enough) to make sure the output stays the same, because the attribute cache flushes might incorrectly say "OK". And of course attribute cache must not be disabled for this test to work. If you have other ideas how to flush either cache please tell me and I'll update the test utility. I'd like to have a way to flush the cache without having the NFS client send anything to server. Unfortunately all of the below ways do that. Results for Linux v2.6.15 and v2.6.18: Info: Testing attribute cache.. Info: Attr cache flush fchown(-1, -1): failed Info: Attr cache flush fchown(uid, gid): OK Info: Attr cache flush fchmod(mode): OK Info: Attr cache flush chown(-1, -1): failed Info: Attr cache flush chown(uid, gid): OK Info: Attr cache flush chmod(mode): OK Info: Testing data cache.. Info: data cache: Appends weren't noticed (ret = 0) Info: - Attribute cache flush helped Info: data cache (no caching): failed Info: data cache (attr cache): failed Info: data cache (lockf()): OK Info: data cache (flock(shared)): OK Info: data cache (flock(exclusive)): OK

7 25

[Dovecot] Problem with Dovecot SASL in Postfix
by Chris McMacken 12 Jul '07

12 Jul '07

I'm trying to configure my postfix server to use Dovecot as an SASL server and running into some problems. My server supports a couple of domain, I have multiple user/password files for multiple domains to make the files a little easier to manage. Not sure if this question should belong in the dovecot mailing list or the postfix one, but here goes anyway. I have everything configured to use CRAM-MD5 authentication, including my mail client. Here the auth section of my dovecot conf. auth default { mechanisms = plain cram-md5 passdb passwd-file { # Path for passwd-file args = /usr/local/etc/dovecot/%d/passwd } userdb passwd-file { # Path for passwd-file args = /usr/local/etc/dovecot/%d/passwd } user = root # It's possible to export the authentication interface to other programs: socket listen { client { # The client socket is generally safe to export to everyone. Typical use # is to export it to your SMTP server so it can do SMTP AUTH lookups # using it. path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } heres a sample line from one of the passwd files: chrism:{CRAM-MD5}a67a65704086a046b3f875d1eaac8cb5c6fd13406507fead30d9bcb1bf… and to login through SASL I am trying to use the username chrism(a)example.com when I use the full email address like this to login like this I get this output into my postfix log: Jul 10 18:46:59 mail postfix/smtpd[57343]: connect from unknown[12.244.148.123] Jul 10 18:46:59 mail postfix/smtpd[57343]: NOQUEUE: reject: RCPT from unknown[12.244.148.123]: 554 5.7.1 <chrism(a)gmail.com>: Relay access denied; from=<chrism(a)example.com> to=<chrism(a)gmail.com> proto=ESMTP helo=<[192.168.1.14]> Jul 10 18:47:00 mail postfix/smtpd[57343]: disconnect from unknown[12.244.148.123] (not actually using example.com but I changed it here) heres my smtpd_recipient_restricitons from postconf smtpd_recipient_restrictions = permit_mynetworks, reject_unauth_destination, permit_sasl_authenticated so when I use the full user name (chrism(a)example.com) it doesn't appear to even attempt logging into the sasl server. If I change it to simply chrism, heres the output: Jul 10 18:50:36 mail postfix/smtpd[57356]: connect from unknown[12.244.148.123] Jul 10 18:50:38 mail postfix/smtpd[57356]: warning: unknown[12.244.148.123]: SASL CRAM-MD5 authentication failed: PDI3NjU4MTE4NDExMTQzN0BtYWlsPg== Jul 10 18:50:39 mail postfix/smtpd[57356]: lost connection after AUTH from unknown[12.244.148.123] Jul 10 18:50:39 mail postfix/smtpd[57356]: disconnect from unknown[12.244.148.123] if I put my user name in as chrism and don't add the @example.com it tried to login but it can't login. anyone have any ideas?

2 1

[Dovecot] 1.0.1: corrupt index on fresh mailbox, ideas?
by Troy Engel 12 Jul '07

12 Jul '07

A new employee started today, when logging into his new mailbox this morning during a walk-through I got a nasty server error response in Thunderbird - something I never see, DC runs smooth as butter for us. Checking the server log I see this: == snip == dovecot: Jul 09 09:38:54 Error: IMAP(xxxxxxx): Maildir /home/x/xxxxxxx/Maildir sync: UIDVALIDITY changed (1183406107 -> 1183999134) dovecot: Jul 09 09:39:06 Error: IMAP(xxxxxxx): Corrupted transaction log file /var/spool/dovecot/indexes/x/xxxxxxx/.INBOX/dovecot.index.log.2: invalid indexid (1183406107 != 1183999146) dovecot: Jul 09 09:39:06 Error: IMAP(xxxxxxx): Corrupted index cache file /var/spool/dovecot/indexes/x/xxxxxxx/.INBOX/dovecot.index.cache: indexid changed == snip == Some facts that make this a strange occurrence: 1) new IMAP mailbox, only one email was in it that I had sent last week (boilerplate Welcome email) 2) was working perfectly fine on Friday when I set things up (Thunderbird and SquirrelMail) and tested with the same client laptop and same Thunderbird 3) nothing bad happened with the servers over the weekend, all is tip-top - no restarts, reboots, nothing. 4) DC does use NFS mounted maildirs, but there is only one DC accessing any maildir - no other servers touch ~/Maildir/. mmap is disabled. What could be a reason for this index to have gotten corrupted? This is the first time I've had an index go corrupt out of all the users, so I'd like to try and track down the cause of this... thx, -te == dovecot -n == # 1.0.1: /etc/dovecot.conf log_path: /var/log/dovecot.log protocols: imap imaps listen: * ssl_cert_file: /opt/SSL/server.pem ssl_key_file: /opt/SSL/server.pem login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_process_per_connection: no mail_location: maildir:~/Maildir:INDEX=/var/spool/dovecot/indexes/%1u/%u mmap_disable: yes namespace: type: private separator: . prefix: INBOX. inbox: yes auth default: cache_size: 4096 cache_ttl: 7200 passdb: driver: pam args: cache_key=%u dovecot userdb: driver: passwd args: blocking=yes == end == -- Troy Engel | Systems Engineer Fluid, Inc | http://www.fluid.com

5 12

[Dovecot] Fixing lda user_query error introduces new fault in mail delivery
by Frank Church 12 Jul '07

12 Jul '07

I was getting these errors below and after fixing it delivery errors were introduced dovecot/error_log ============== dovecot: Jul 11 06:19:28 Error: auth-worker(default): sql(user(a)domain.com): User query failed: Table 'postfix.users' doesn't exist deliver(user(a)domain.com): Jul 11 06:19:28 Error: BUG: Unexpected input from auth master: FAIL 1 dovecot: Jul 11 06:21:41 Error: auth-worker(default): sql(admin(a)achimota.com,127.0.0.1): User query failed: Table 'postfix.users' doesn't exist ============== It turns out that using prefetch with dovecot lda required a user_query in dovecot/sql.conf I fixed it by adding this query to dovecot/sql.conf user_query = SELECT concat('/var/vmail/', maildir) as home, 601 as uid, 12 as gid FROM mailbox WHERE username = '%u' AND active = '1' This resulted in a new mailbox /var/vmail/domain.com/user(a)domain.com being created when although /var/vmail/domain.com/user already exists and is what the query returns It seems that prior to that when the query was failing the mail was properly delivered somehow by dovecot, but fixing it created a new problem. It appears that the mail_location = maildir:/var/vmail/%d/%u in dovecot.conf could be related as %u is user(a)domain.com Is there a fix for this? Does the deliver line in postfix/master.cf need to be adjusted in some way I will probably have to disable the user_query and restart for the time being dovecot version - 1.0rc26 Here is dovecot.conf =============== ssl_cert_file = /etc/pki/dovecot/certs/abc.domain.net.crt ssl_key_file = /etc/pki/dovecot/private/abc.domain.net.key ssl_ca_file = /etc/pki/dovecot/certs/ca-bundle.crt mail_location = maildir:/var/vmail/%d/%u mail_extra_groups = mail first_valid_uid = 601 last_valid_uid = 601 maildir_copy_with_hardlinks = yes protocol imap { mail_plugins = quota imap_quota imap_client_workarounds = outlook-idle delay-newmail } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { postmaster_address = postmaster(a)domain.net mail_plugins = quota log_path = /var/log/dovecot/deliver.log info_log_path = /var/log/dovecot/deliver.log } auth default { mechanisms = plain passdb sql { args = /etc/dovecot/sql.conf } userdb prefetch { } userdb sql { args = /etc/dovecot/sql.conf } user = nobody socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = mail } client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = mail } } } dict { } plugin { quota = maildir:storage=10240:messages=1000 acl = vfile:/etc/dovecot/acls trash = /etc/dovecot/trash.conf } dovecot/sql.conf ============== default_pass_scheme = PLAIN-MD5 driver = mysql connect = host=localhost dbname=postfix user=dovecot password=password password_query = SELECT username as user, password, concat('/var/vmail/', maildir) as userdb_home, concat('maildir:/var/vmail/', maildir) as userdb_mail, 601 as userdb_uid, 12 as userdb_gid, concat('dirsize:storage=', cast(quota as char)) AS userdb_quota FROM mailbox WHERE username = '%u' AND active = '1' user_query = SELECT concat('/var/vmail/', maildir) as home, 601 as uid, 12 as gid FROM mailbox WHERE username = '%u' AND active = '1' dovecot line in postfix/master.cf ======================= # Dovecot LDA dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/local/libexec/dovecot/deliver -d ${recipient} - Frank

2 1

[Dovecot] Can Wiki entry on dovecot LDA/deliver be clarified?
by Frank Church 11 Jul '07

11 Jul '07

Hi guys, I am having some problems relating to this "Fixing lda user_query error introduces new fault in mail delivery" and I'd like to know if the above wiki comment holds even if a user_query is configured to return the correct mail folder. According to this LDA delivers only to the mail_location setting. Does that mean that it will stick to the value in dovecot.conf or will the value returned in the query override it? This appears to be the problem I am experiencing with the previous thread. >From wiki entry at wiki.dovecot.org/LDA ============================ Problems with deliver Currently deliver doesn't support namespaces. The mails can be delivered only to mailboxes specified by the mail_location setting. If you are using prefetch userdb, keep in mind that deliver does not make a password query and thus will not work if -d parameter is used. The UserDatabase/Prefetch page explains how to fix this. ================================== Any ideas? - Frank

1 1

[Dovecot] target doesn't allow inferior mailboxes
by Adam Williams 11 Jul '07

11 Jul '07

Using Seamonkey as my email client, and IMAP to check mail. If I create a new IMAP folder, and then delete it, I get the error: The current command did not succeed. The mail server responded: Target mailbox doesn't allow inferior mailboxes. Tried a google search, didn't really come up with anything. I have rw permissions on /home/awilliam/Mail/* and delete the files fine using rm -rf /home/awilliam/Mail/whatever and editing the folder out of .subscriptions. Any ideas? [root@roark ~]# dovecot --version 1.0.1 [root@roark ~]# dovecot -n # 1.0.1: /etc/dovecot.conf login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: mbox:~/Mail/:INBOX=/var/spool/mail/%u mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam userdb: driver: passwd

3 3

[Dovecot] About a simultaneous session of Dovecot(IMAP)
by Takateru Ueda 11 Jul '07

11 Jul '07

The construction of the mail server with Postfix+Dovecot(IMAP) is examined. ・The number of mailboxes is about 1000. ・The reception protocol uses IMAP and the Maildir form. ・OS is Redhat Enterprise Linux ES4. ・MUA uses Outlook Express. ・Postfix and Dovecot use latest Ver. In the above-mentioned environment, it is understanding person. how much the number of maximum sessions (number of people) that can be used at the same time becomes from MUA (When grounds of the calculation are understood, it is the best. )

2 2

[Dovecot] Connecting to dovecot/imap without a password
by Don Russell 11 Jul '07

11 Jul '07

I have written a script that connects (localhost) to the dovecot/imap server and performs various maintenance on my mail, by folder..... deleting old stuff, keeping the n most recent, that sort of crap, er good stuff. :-) My script is written in php (I use the various imap_* functions), and it connects to the imap server running on the same machine... is there a way to connect to the server without having to specify my user name and password? I was thinking there may be some form of "implied" logon if a request from user "don" requests to log on to user "don", then there's no need for a password check, when the connection is via localhost. That way I don't have to deal with userid/password related issues. :-) Thanks

2 2

[Dovecot] postfix pipe to deliver, null_sender.
by Erland Nylend 11 Jul '07

11 Jul '07

Hello, I just noticed a problem on our servers .. If I send myself a bounce, like this: | [en@mailserver ~]$ telnet localhost 25 | Trying 127.0.0.1... | Connected to localhost.localdomain (127.0.0.1). | Escape character is '^]'. | 220 mailserver ESMTP Postfix | helo foo | 250 mailserver | mail from: <> | 250 2.1.0 Ok | rcpt to: my(a)mail.address.tld | 250 2.1.5 Ok | data | 354 End data with <CR><LF>.<CR><LF> | testing | . | 250 2.0.0 Ok: queued as 673072767C | quit | 221 2.0.0 Bye | Connection closed by foreign host. Then the resulting mail message I get, has this header: | Return-Path: <MAILER-DAEMON> | Delivered-To: my(a)mail.address.tld | Received: from foo (localhost.localdomain [127.0.0.1]) | by mailserver (Postfix) with SMTP id 673072767C | for <my(a)mail.address.tld>; Wed, 11 Jul 2007 13:36:07 +0200 (CEST) | Message-Id: <20070711113611.673072767C@mailserver> | Date: Wed, 11 Jul 2007 13:36:07 +0200 (CEST) | From: MAILER-DAEMON | To: undisclosed-recipients:; It seems that postfix changes the return-path, and I dont see why it would do something like that. The bounce is not a bounce anymore, and if a user fetches the mail with e.g. fetchmail, and it cannot be delivered, then the bounce will be bounced, to MAILER-DAEMON .. My master.cf entry looks like this: dovecot unix - n n - - pipe flags=DRhu user=atmail:atmail argv=/usr/local/dovecot/libexec/dovecot/deliver -d ${recipient} If I add null_sender= , then that resolves it: dovecot unix - n n - - pipe flags=DRhu user=atmail:atmail null_sender= argv=/usr/local/dovecot/libexec/dovecot/deliver -d ${recipient} What do other postfix/dovecot-users do? Will this change break anything? I cannot see why empty null_sender isn't default .. so I'm wondering if there is something I've missed. Should we update the examples on http://wiki.dovecot.org/LDA/Postfix to include empty null_sender? -- Erland Nylend

1 0

[Dovecot] [Patch] Samba's proposed "ntlm_auth + winbind" support for dovecot-auth
by Dmitry Butskoy 11 Jul '07

11 Jul '07

The Samba team recommends to use their "ntlm_auth" command line helper for "NTLM" and "GSS-SPNEGO" authentication. This helper interacts with the Samba's winbind daemon, and this way can authenticate users against NT or Active Directory windows domain. Currently Dovecot can do "NTLM" authentication too, but just "locally" (against a local or sql database etc.). I've made a patch (attached), which adds "ntlm_auth" (or "winbind") support for Dovecot. The idea is to add two new authentication mechanisms: "mech_winbind_ntlm" and "mech_winbind_spnego". Both are coded in one additional file, "mech-winbind.c". An option "auth_ntlm_use_winbind" specifies whether to use the current implementation of ntlm, or do it by the "ntlm_auth" helper. "GSS-SPNEGO" always performed by the helper. Normally, "ntlm_auth" is invoked once, for all further requests. Such a way, "ntlm_auth helper from the Samba package, interacting with the Samba's winbind daemon", is used now by Squid, Apache and AFAIK some other applications. It is "strongly recommended" by the Samba team, and was already proposed even in this maillist 3 year ago (see f.e. http://www.dovecot.org/list/dovecot/2004-September/004775.html ). I hope there are no any serious performance issues for such a "complex way" -- f.e. with our web proxy, using this way, ~200 users do not feel any actual delays etc. I've successfully tested this patch with NTLM against AD domain. This patch can considerably improve the situation of "Email client on Windows desktop under Windows domain, but imap/pop at UNIX server". Currently, windows users have to specify their "login/password" for email accounts manually. There is an "SPA" (Secure Password Authentication) alternative for them, where just the desktop's login is used transparently, but it cannot be used now, because Dovecot cannot perform NTLM against, say, Active Directory domain. Since "dovecot-auth" daemon can be utilized by MTA as well (Postfix and other), the support of "ntlm_auth" in Dovecot can satisfy both SMTP and IMAP servers at UNIX side, and solve the issue completely. Questions and requests: - I try to code things most close to used style, i.e. using Dovecot's memory-management and io-pipe routines etc., but could someone look at it and check whether I've missed something or not? - Perhaps some names (of routines, modules) could be chosen better? - Maybe some other options should be implemented, i.e. "auth_winbind_helper_ntlm" and "auth_winbind_helper_spnego" to specify the helper's cmdline exactly ? - Currently I strip domain part of the username returned, i.e. from "DOMAIN\user" just to "user". Maybe better add some option "auth_winbind_strip_domain" for this? Certainly, it will be fine if someone else check it more, especially for "GSS-SPNEGO" which I cannot test for a while. Regards, Dmitry Butskoy http://www.fedoraproject.org/wiki/DmitryButskoy

2 6