- dovecot - dovecot.org

[Dovecot] errors in dovecot-uidlist
by Erland Nylend 14 Jun '07

14 Jun '07

We have migrated a mailsystem to postfix/dovecot, using the courier migrate script, and we have run into a problem with dovecot-uidlist. The messages are not listed in the correct order .. This is an example dovecot-uidlist -file: 1 1177585200 49 22 1179084774.P7191Q0M321163.webmail1,S=8245:2,S 24 1179377823.P15932Q0M835219.smtp1,S=3462:2,S 25 1179668346.P23942Q0M941365.webmail1,S=4820357:2,S 31 1179864561.P22903Q0M433768.smtp2,S=3306:2,S 34 1180344355.P25491Q0M17232.smtp2,S=5111:2,S 35 1180454170.P14932Q0M841649.smtp2,S=2024:2, 36 1168867750.H82058P20971.smtp1:2,SR 37 1170339716.H537368P4032.smtp1:2,S 38 1171291025.H352867P8785.smtp2:2,SR 39 1171357049.H141820P2105.smtp1:2,SR 40 1171460195.H933928P14324.smtp1:2,SR 41 1171616121.H812220P27503.smtp2:2,SR 42 1171872919.H950768P16201.smtp1:2,S 43 1173694618.H330094P23347.smtp1:2,S 44 1175238705.H589518P693.smtp1:2,SR 45 1176800600.H716261P10514.smtp1:2,SR 46 1177615732.H355340P10418.webmail1:2,SR 47 1180471524.P30985Q0M109430.smtp2,S=16621 48 1180597849.P8169Q0M990486.smtp1,S=33326 As you can see, the unix timestamps are descending between uid 35 and uid 36 .. and this causes problems if we intend to make webmail access the messages through imap. (it expects to receive the messages sorted by when they were received) Is there any way I can sort the list accourding to the unix timestamps, and still make it transparent to the pop3/imap clients? I would prefer a solution that does not involve users downloading allready downloaded messages via pop3. -- Erland Nylend

2 3

[Dovecot] 1.0.1 release candidate 3
by Timo Sirainen 14 Jun '07

14 Jun '07

http://dovecot.org/tmp/dovecot-1.0.1rc3.tar.gz Looks like I managed to do a lot of changes today. So I'll wait a few more days before v1.0.1 release. The important changes since rc2: + deliver: Added -e parameter to write rejection error to stderr and exit with EX_NOPERM instead of sending the rejection by executing sendmail. + dovecot --log-error logs now a warning, an error and a fatal - APPEND / SEARCH: If internaldate was outside valid value for time_t, we returned BAD error for APPEND and SEARCH never matched. With 64bit systems this shouldn't have happened. With 32bit systems the valid range is usually for years 1902..2037. See ChangeLog for more.

8 9

[Dovecot] Updating Folders in Mail box
by Wade Smart 13 Jun '07

13 Jun '07

Im looking on the dovecot documentation about how to update the folder structure. I had some computer problems so I back up my mail and when I reinstalled I got rid of a bunch of unused old mail. But now when I open my mail client it still things all of those folders are still there. Im looking for how to update the file on what is and isnt there. wade

5 5

[Dovecot] Domain part / auth_username_format
by Robert Coup 13 Jun '07

13 Jun '07

Hey folks, I want to authenticate a pop3 user without a domain part and then use the domain part to specify a Maildir subfolder to grab messages from. So, this was my attempt: # use the domain part to access a subfolder mail_location = maildir:/mail/%n/Maildir/%d # strip of the domain part for authentication purposes auth_username_format = %n login: testuser@.INBOX.SubFolder Authentication of testuser works great, but mail_debug shows me that the domain-part (%d) is empty when expanding mail_location. Any bright ideas? Rob :) [ Dovecot 1.0.rc15, Debian Sarge, PAM auth. ]

2 2

[Dovecot] No auto-conversion of .customflags?
by Christian Balzer 13 Jun '07

13 Jun '07

Hello, I'm in the process of migrating 0.99 dovecot maildir boxes to a pair of new machine. These servers were running the stable (etch) 1.0rc15 package of dovecot until yesterday and existing .customflags files were correctly converted to dovecot-keywords. Yesterday I upgraded to the (finally, thanks to who did this) 1.0.0 etch backports package and since then freshly migrated boxes get this error: --- Jun 12 09:48:06 mb11 dovecot: IMAP(username): stat(/longandboringpath/username/.customflags/cur) failed: Not a directory --- Firstly, I thought Linux was one of the OS' that had a free dir stat, but I guess I could have just hallucinated that. But more importantly, obviously .customflags does NOT get converted anymore and thus shows up in IMAP LIST commands. Since I doubt that the backport people did change anything in the code I suppose that this is a genuine 1.0.0 problem which probably should be addressed for the upcoming 1.0.1 release. Regards, Christian -- Christian Balzer Network/Systems Engineer NOC chibi(a)gol.com Global OnLine Japan/Fusion Network Services http://www.gol.com/

2 3

[Dovecot] 1.0.1 release candidate 2
by Timo Sirainen 13 Jun '07

13 Jun '07

I'll release v1.0.1 in a day or two, but it would be nice to get some testing before the release to see if I managed to break something after the Mercurial conversion. And did I forget something that should be fixed for v1.0.1? http://dovecot.org/tmp/dovecot-1.0.1rc2.tar.gz Changes since v1.0.0: * deliver: If Return-Path doesn't contain user and domain, don't try to bounce the mail (this is how it was supposed to work earlier too) * deliver: %variables in mail setting coming from userdb aren't expanded anymore (again how it should have worked). The expansion could have caused problems if paths contained any '%' characters. + Print Dovecot version number with dovecot -n and -a - Trying to start Dovecot while it's already running doesn't anymore wipe out login_dir and break the running Dovecot. - maildir: Fixed "UID larger than next_uid" errors which happened sometimes when dovecot-uidlist file didn't exist but index files did (usually because mailbox didn't have any messages when it was selected for the first time) - maildir: We violated maildir spec a bit by not having keyword characters sorted in the filename. - maildir: If we don't have write access to cur/ directory, treat the mailbox as read-only. This fixes some internal error problems with trying to use read-only maildirs. - maildir: Deleting a symlinked maildir failed with internal error. - mbox: pop3_uidl_format=%m wasn't working right - mbox: If non-filesystem quota was enabled, we could have failed with "Unexpectedly lost From-line" errors while saving new messages - mysql auth: %c didn't work. Patch by Andrey Panin - COPY: We sent "Hang in there.." too early sometimes and checked it too often (didn't break anything, but was slower than needed). - deliver: Postfix's sendmail binary wasn't working with mail_debug=yes - Don't corrupt ssl-parameters.dat files when running multiple Dovecot instances. - Cache compression caused dovecot.index.cache to be completely deleted with big endian CPUs if 64bit file offsets were used (default) - Fixed "(index_mail_parse_header): assertion failed" crash

5 12

[Dovecot] Help with new syslog errmsgs
by Stewart Dean 12 Jun '07

12 Jun '07

I am bringing more people onto Dovecot...and am beginning to see syslog error messages I've never seen before...what are they/are they critical? 1 =========================== > Jun 12 09:53:21 mercury mail:err|error dovecot: IMAP(gregory): Corrupted index c > ache file /var/dcndx/gregory/.imap/INBOX/dovecot.index.cache: indexid changed This has the same date stamp as the user's change date on his .subscriptions...which he created by copying his UWIMAP .mailboxlist from a login prompt. Is this what happens when the user with active sessions overwrites/creates the .subscriptions file? 2 =========================== > Jun 12 11:32:36 mercury mail:err|error dovecot: IMAP(gregory): UIDVALIDITY chang > ed (1100532544 -> 1178155834) in mbox file /home/hcrc/gregory/mail/Sent Have no idea what this is about...... -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 2

[Dovecot] Phantom message using mixed namespaces
by Ian R. Justman 12 Jun '07

12 Jun '07

Hi, all. At home, I have a mailbox where mbox is the default (for inbox and some smaller mailboxes) and all my lists are in a Maildir format. I'm building a mailstore server at work where I want to use Maildir as the default mailstore, but I want to keep mbox on the side to aid in archiving messages. My configs are as follows for mail location and namespaces: Home: mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace private { separator = / inbox = yes hidden = no prefix = "mbox/" location = mbox:~/mail:INBOX=/var/mail/%u } namespace private { separator = / prefix = "Maildir/" location = maildir:~/Maildir } Work: mail_location = maildir:~/Maildir namespace private { separator = / inbox = yes prefix = "Maildir/" location = maildir:~/Maildir } namespace private { separator = / hidden = no prefix = "mbox/" location = mbox:~/mail } Here's the thing: My home mailbox server looks the way it should, offering me "mbox" and "Maildir" names to expand for more mailboxes. Work on the other hand, by and large, works as well (in fact, I based its config on the home machine's config with some slight changes). However, strange things started happening the moment I did a "mkdir ~/mail" while I was at the machine's prompt to make ready for an mbox repository. My mail program nearly immediately shows a "phantom message" in the main inbox. If I try to select this "phantom message", the mailer goes into a very tight loop (I've tried this with Seamonkey and T'bird with the same results. I get cycles of these in the log: Jun 12 11:29:14 (censored) dovecot: imap-login: Login: user=<xxxx>, method=PLAIN, rip=x.x.x.x, lip=y.y.y.y Jun 12 11:29:14 (censored) dovecot: IMAP(xxx): FETCH for mailbox INBOX UID 3 got too little data: 0 vs 512 Jun 12 11:29:14 (censored) dovecot: IMAP(xxxx): Disconnected: Disconnected I'm running the Dovecot 1.0.0 under FreeBSD 4.11 (work) (I can't run anything later on this machine, strangely enough; I haven't tried any of the later releases since updating the BIOS recently, however) and 1.0.rc17 under Ubuntu Feisty (home). If I need to provide more info, please let me know. I'd also be interested to know if it's something dumb I'm doing or if it perhaps may be a bug. Thanks! --Ian.

2 2

[Dovecot] New experimental XEXEC plugin status
by Marc Perkel 12 Jun '07

12 Jun '07

No to long ago I proposed an experimental extension to the IMAP protocol to allow IMAP to execute extername server side code and talk to email plugins to create custom client/server applications over an existing authenticated IMAP connection. I am happy to say they we have working code. It's not quite ready to download yet but we do have some life happening. I have started to document it on the Dovecot wiki here. http://wiki.dovecot.org/Plugins/xexec I'm looking to see if I can generate some interest in this. XEXEC Plugin XEXEC is an experimental non-standard extension to the IMAP protocol that allows you to run and server side application and have it communicate with email plugins (Thunderbird) allowing custom client/server applications to communicate over an existing authenticated IMAP channel. The email client sends the XEXEC command with the name of the server side module that it wishes to run along with parameters to pass to the server. Here are some examples: XEXEC blacklist add joe(a)example.com XEXEC whitelist del joe(a)example.com XEXEC changepassword MyNewPassword XEXEC forwardmail myaccount(a)yahoo.com Uses for XEXEC The XEXEC can be used to run anything but in theory it should be used for client server applications that relate to email or groupware applications like calendars and contact lists. Its main purpose is to allow email clients to set server side settings over the existing authenticated channel without having the user have to log in separately using a different application to control user settings. Examples of possible usage includes: * Setting server side white lists and black lists * Changing the password for the email account * Allowing users to set email forwarding preferences * Allowing users to set vacation messages * Allowing users to exclude email from specific countries or language character sets * Allowing users to control server side spam filter settings * Server Side Calendar and Group Contact Applications like MS Exchange has * SMTP over IMAP for sending outgoing email without separate SMTP settings * Setting rules for server side folder delivery. * Setting text message alerts to cell phones for important email notification Wouldn't it be nice if you could change your email password i your email client and have it set the new password on the server at the same time? This would eliminate the need to change the server and client passwords separately. Or imagine sending outgoing email without having to configure SMTP. You just set up the incoming email and the outgoing email works as well. Or wouldn't you like to do some of the fancy tricks that Microsoft Exchange Servers do without having to use Exchange? It is our hope that this experimental protocol will lead to significant expansion of IMAP functionality. About this Plugin This plugin is the idea of Marc Perkel of Junk Email Filter <http://www.junkemailfilter.com> who hired Nicolas Boullis ( nicolas.boullis(a)free.fr <mailto:nicolas.boullis@free.fr>) to write the code. I (Marc Perkel marc(a)perkel.com <mailto:marc@perkel.com>) am trying to get the concept out there in some sort of working form with the idea that it will catch on. Hopefully other people who find this concept useful will build on the idea, do it right, and perhaps some variation of this concept will eventually become a standard. Status This plugin is a nonstandard experimental extension to the IMAP protocol. It is offered as a proof of concept and it is my hope that it will catch on in some form and make it into the IMAP officially. At this point there is nothing on the client side to talk to anything on the server side. So this code is presently useless until more development is done. Configuration To activate and configure this plugin you have to first add it to your dovecot.conf file. You can do so as follows: protocol imap { mail_plugins = xexec } Then to add applications you specify the module name and map it to a server side executable program. xexec = module:executable Here are some examples: plugin { xexec = blacklist:/usr/local/dovecot/blacklist.sh %u xexec2 = whitelist:/usr/local/dovecot/whitelist.sh %u xexec3 = average:/usr/local/dovecot/average xexec4 = smtp:/usr/local/dovecot/smtp } The idea is that the module name will be a reference to an executable and will hide what is happening on the server. When the command XEXEC module <parameters> is passed then the server will run the executable and pass the parameters to the executable. Interacting with XEXEC A typical session with XEXEC might look like this. * OK Dovecot ready. 001 login marc(a)perkel.com password 001 OK Logged in. 002 xexec blacklist add joe(a)example.com * OK Adding joe(a)example.com to server side blacklist for marc(a)perkel.com 002 OK command exited successfully 003 xexec changepassword MyNewPassword * OK New Password set Sucessfully for marc(a)perkel.com 003 OK command exited successfully Many of the details of how everything will work under different conditions have yet to be developed. Download and Installation Coming Soon! License This software and the concepts behind is are free. No patent or copyrights are asserted on the concept. This is a gift to the world community. Code is released under GPL2. Help Needed We could use some help with this project. We haven't even started writing any client side code. We are looking for sharp people with good ideas to help develop this concept in a way that will eventually lead to becoming part of the standard. We envision that certian commands to do ordinary universal stuff (password, smpt, whit list, black list, forwarding) will become standardized so that features to set server side settings can become part of standard email applications.

1 0

[Dovecot] Warning about NFS but using local fs for INDEX
by Herbert Gasiorowski 12 Jun '07

12 Jun '07

I am playing around with dovecot and want to use local filesystem for indexing. But whenever I open a new imap connection the following warning is shown: Apr 30 10:14:42 beira dovecot: Mailbox indexes in /app/home/gasi are in NFS mount. You must set mmap_disable=yes to avoid index corruptions. If you're sure this check was wrong, set nfs_check=no. /app/home is a NFS mounted filesystem, but I want dovecot to use /export/dovecot/gasi for indexing (See namespaces below). I shurely can follow the hints(nfs_check=no), but I am not shure if I did something wrong or maybe someday will change the configuration and forget to enable the nfs check. dovecot version: dovecot-1.0-1.2.rc15.el5 on CentOS 5.0 (with all updates). [root@beira etc]# dovecot -n # /etc/dovecot.conf syslog_facility: local6 login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 namespace: type: private separator: / location: mbox:~/Mail:INBOX=/var/spool/mail/%u:INDEX=/export/dovecot/%u inbox: yes namespace: type: private separator: / prefix: #home-tmp/ location: mbox:~:INDEX=/export/dovecot/%u auth default: passdb: driver: pam args: imap userdb: driver: passwd

2 2