May 2008 - dovecot - dovecot.org

[Dovecot] MBOX to Maildir preserving the UIDL (outlook-tested, no redownloading)
by Horn Wijaya 09 May '08

09 May '08

TESTED AND RUNNING, MIGRATING from MBOX to MAILDIR, PRESERVE UID and OUTLOOK sees the email as downloaded. I hope this helps a lot of people out there. Feel free to post this somewhere else too. By: Horn Wijaya (hwijaya(a)nodens.biz) 8th May 2008 I have been searching for weeks for a foolproof method to migrate all my users mbox to maildir/dovecot without having the pain of downloading all emails again, especially for heavy users. It would cause frustration to thousands of my users. So.... eventually I found out why Outlook will keep downloading the emails despite all the configuration done in the dovecot.conf. Apparently the UID is generated realtime. When it first generated, it took the time the process runs. Before I migrate, here's the email sample which I have downloaded to my outlook (and keep email on server), and then I use telnet to pop to get the uidl list. +OK POP3 localhost.localdomain v2003.83rh server ready user ***** +OK User name accepted, password please pass ***** +OK Mailbox open, 444 messages uidl +OK Unique-ID listing follows 1 47b1303d00004c2d 2 47b1303d00004c2e 3 47b1303d00004c2f ... 47b1303d = 1202794557 = 12 Feb 2008 13:35:57 the date and time the mbox was created 00004c2d = 19501 the IMAP counter so far.... sequently added as you could see with email #2 and email #3 Then I switch my POP server to dovecot, and migrate my MBOX to Maildir, and I do a telnet to get the UIDL +OK Dovecot ready. user ***** +OK pass ***** +OK Logged in. uidl +OK 1 4822815000000001 2 4822815000000002 3 4822815000000003 ... 48228150 = 1210220880 = NOW 00000001 = counter starts at 1 No wonder outlook sees the emails are NOT-DOWNLOADED-YET status. Then I ponder for another few days and the key is in the dovecot-uidlist...... How to fill it with the correct info.... and there's a way. Which I hope useful for converter developer, and could be implemented in the next version of the converter. Here's the step I do to reach my objective which is to get UID 47b1303d00004c2d in the first email: 1. mb2md-3.20.pl -s /var/mail/hwijaya -d home/hwijaya/Maildir/ that's converting 444 emails from mbox to 444 files in the Maildir/cur folder 2. cd /home/hwijaya/Maildir/cur 3. grep IMAPbase * and I get 1210219860.000000.mbox:2,S:X-IMAPbase: 1202794557 19944 The last 2 strings are the KEY to the ORIGINAL UID 4. So in order to prepare the environment to fool it, some calculations are needed: How do we get 19501 as the first counter? as expected in the first POP TEST above: 19944 - 444 emails + 1 = 19501 5. cd /home/hwijaya/Maildir 6. echo '3 V1202794557 N19501' > dovecot-uidlist 7. DONE....... pop it via outlook and nothing will be downloaded, after pop or imap is processed, the dovecot-uidlist is auto-filled, index auto generated. Proof: +OK Dovecot ready. user ***** +OK pass ***** +OK Logged in. uidl +OK 1 47b1303d00004c2d 2 47b1303d00004c2e 3 47b1303d00004c2f ... I assume the same method could be used for individual folders in the imap (under .mailboxlist or .subscriptions) Please do let us know if there's any cases/environment that it won't work. Thanks very much, and a big migration job is in front of me now... ------------------------------------------ Warmest Regards From: Horn Wijaya Consultant hwijaya(a)nodens.biz http://www.nodens.biz/ Nodens Solutions Pte Ltd "where there is freedom in your choice"

3 6

[Dovecot] [Q] IMAP update message header?
by Roderick A. Anderson 08 May '08

08 May '08

More about IMAP, less about Dovecot. This is more an IMAP question than specifically about Dovecot. Sorry to ask here but I've been researching, reading and lurking with no answer so far. What I'm doing is running reports as a user from a remote system to provide a list of messages (Sender/From, Subject, Date, size) in a specific folder(?). In one case it isn't even a Dovecot based server so I only have access as a client. (Though I use Dovecot on several other systems and will need this capability for them.) When a message in the folder has been reported I'd like to add a X-Header-??? indicating that the message has been reported so the next time through it isn't reported again. (After the message is X days old it is deleted.) These reports are run using Perl and I've tried most every CPAN module available but haven't figured out how to change/add a header then save the message back. So far I haven't been able to determine if this is even possible by reading the RFCs. Is there a method as a client from a remote system to make changes to a message then save it back? What is the IMAP verb, command, etc. to do this? Or if there are Perl programmers on the list a brief description (or code) for doing this? TIA (and sorry for the off topic posting), Rod --

6 13

Re: [Dovecot] How do I increase the fd limit on OS X?
by Jerry Yeager 08 May '08

08 May '08

On May 8, 2008, at 1:04 AM, dovecot-request(a)dovecot.org wrote: > > > Message: 6 > Date: Wed, 7 May 2008 13:17:44 -0700 > From: Rob Frohne <rob.frohne(a)wallawalla.edu> > Subject: [Dovecot] How do I increase the fd limit on OS X? > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Message-ID: <1210191465.19769.5.camel(a)frohro-d600.wwc.edu> > Content-Type: text/plain > > Hi All, > > I just upgraded to the new 1.1rc5 from 1.0 that I had been using and > it > advised me to increase the file descriptor limit. I'm not sure how to > do this. There is a command built into tcsh that allows me to do this > called limit, but sudo limit 4224 doesn't work, and usually dovecot is > started from the rc.local file if I recall right, and I'm not sure how > to set this up from there. Any advice. > > Thanks, > > Rob > -- > Rob Frohne <rob.frohne(a)wallawalla.edu> > Walla Walla University > > > Try this your_prompt_$ sudo sysctl -w kern.maxfiles=65536 your_prompt_$ sudo sysctl -w kern.maxfilesperproc=32768 You will be asked for your admin password. This will allow you to test things and see if it works better. The changes will revert to the system pre-defines when you re-boot or restart. IIRC, there is a master setting (unchangeable without recompiling OS X) that will not allow you to go over 65536, but I may be mistaken about that. For a permanent change, add the following lines to the /etc/sysctl.conf file: or the /etc/sysctl-macosxserver.conf file for Mac OS X Server You may have to create the file, especially if you are the only user. (Make sure that only root has access to this file!!!!!!) kern.maxfiles=65536 # System-wide limit kern.maxfilesperproc=32768 # Per-process limit This Is ONLY For OS X 10.3 or later. For earlier versions you need to use /etc/rc which was so long ago that I do not recall all of the commands (sorry). HTH, Jerry

1 0

[Dovecot] How do I increase the fd limit on OS X?
by Rob Frohne 08 May '08

08 May '08

Hi All, I just upgraded to the new 1.1rc5 from 1.0 that I had been using and it advised me to increase the file descriptor limit. I'm not sure how to do this. There is a command built into tcsh that allows me to do this called limit, but sudo limit 4224 doesn't work, and usually dovecot is started from the rc.local file if I recall right, and I'm not sure how to set this up from there. Any advice. Thanks, Rob -- Rob Frohne <rob.frohne(a)wallawalla.edu> Walla Walla University

2 1

Re: [Dovecot] thunderbird sane config (OT)
by Moser 08 May '08

08 May '08

Charles Marcus schrieb: > On 5/7/2008, rosenfield.albert(a)gmail.com (rosenfield.albert(a)gmail.com) > wrote: >> (Background: I'm currently experiencing that Thunderbird does not work >> against Postfix/Dovecot because the wizard interface for setting up an >> account does not accept TLS-only servers. Users just sit there with a >> broken Thunderbird, not knowing what to do :-/.) you can do it. > It would be nice if you had the ability to access the Advanced Options > when setting up a new account in TBird, but currently you don't... Not true! simple way: Just change the default config TB create your account from with the settings you need. You can find the file under your program dir i.e. C:\Programme\Mozilla Thunderbird\defaults\pref Compare the defaults to your working set of setting and change them accordingly. You can activate TLS or CRAM-MD5 and so an. You can also predefine LDAP servers etc. more elaborated way: Mozilla Mission Contol: -> http://developer.mozilla.org/en/docs/MCD,_Mission_Control_Desktop_AKA_AutoC… Hope it helps! Hans

2 1

[Dovecot] thunderbird sane config (OT)
by rosenfield.albert＠gmail.com 08 May '08

08 May '08

Does anyone have any experience putting together a sane config for Thunderbird in an automated fashion? Automated meaning "simple to distribute to users". -- (Background: I'm currently experiencing that Thunderbird does not work against Postfix/Dovecot because the wizard interface for setting up an account does not accept TLS-only servers. Users just sit there with a broken Thunderbird, not knowing what to do :-/.) (PS: Also, giving everybody a GMail-like threaded interface per default would be cool.) (PPS: If anything good comes up, I plan to put this in fx the Dovecot wiki.)

5 7

[Dovecot] pop/imap session
by Tomasz 08 May '08

08 May '08

Hello, Can dovecot log pop/imap session, and notify(by sending mail) admin in case of errors? Something like notify_classes in postfix. Regards Tomasz

4 5

[Dovecot] [bug] bit of a clearer error message desired - Can't load CA file... : Success
by Daniel Black 07 May '08

07 May '08

Not the clearest of error messages. A successful cannot load. May 7 21:05:29 10.10.10.213 dovecot: child 21500 (login) returned error 89 May 7 21:05:29 10.10.10.213 dovecot: child 21501 (login) returned error 89 May 7 21:05:29 10.10.10.213 dovecot: child 21502 (login) returned error 89 May 7 21:05:29 10.10.10.213 dovecot: child 21503 (login) returned error 89 May 7 21:05:29 10.10.10.213 dovecot: child 21505 (login) returned error 89 May 7 21:05:29 10.10.10.213 dovecot: pop3-login: Can't load CA file /etc/dovecot/all.der: Success May 7 21:05:29 10.10.10.213 dovecot: imap-login: Can't load CA file /etc/dovecot/all.der: Success /etc/dovecot/all.der was generated by concatinating the following (all in der format) http://www.cacert.org/certs/root.der http://www.cacert.org/certs/class3.der http://crl.cacert.org/revoke.crl http://crl.cacert.org/class3-revoke.crl # dovecot --version 1.0.10 reiserfs filesystem # uname -a Linux mail.cacert.org 2.6.22-vs2.2.0.7-gentoo #1 SMP Mon May 5 20:21:30 EST 2008 x86_64 GNU/Linux # dovecot -n # 1.0.10: /etc/dovecot/dovecot.conf protocols: imaps pop3s imap pop3 ssl_ca_file: /etc/dovecot/all.der ssl_cert_file: /etc/ssl/certs/ssl-cert-community-cacert.pem ssl_key_file: /etc/ssl/private/ssl-cert-community-cacert.key ssl_verify_client_cert: yes verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting: You want mail? Well hurry up. first_valid_uid: 5000 mail_location: maildir:~/Maildir mail_read_mmaped: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format: %08Xu%08Xv auth default: mechanisms: plain login verbose: yes debug: yes debug_passwords: yes ssl_require_client_cert: yes ssl_username_from_cert: yes passdb: driver: pam args: session=yes mail userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix -- Daniel Black -- Proudly a Gentoo Linux User. Gnu-PG/PGP signed and encrypted email preferred http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x76677097 GPG Signature D934 5397 A84A 6366 9687 9EB2 861A 4ABA 7667 7097

2 1

[Dovecot] Clarification wanted on mail_access_groups vs. mail_privileged_group
by Mark Sapiro 07 May '08

07 May '08

I have just upgraded to dovecot 1.0.13. All the documentation I can find in the example .conf file and the NEWS and ChangeLog files seems to say that the mail_privileged_group = mail setting is all I should need to make dovecot use group mail to create dotlock files. My understanding from what I read is that mail_privileged_group is used to set the group used while creating dotlock files in (in my case) /var/spool/mail, and mail_access_groups is used to set the group used to actually access the mailbox. In my case, /var/spool/mail is group 'mail and group writable/searchable drwxrwxr-x 2 root mail 4096 May 7 08:35 /var/spool/mail and the individual mailboxes are owned by the respective users. So it seems that I would need "mail_privileged_group = mail" do be able to create dotlock files in /var/spool/mail, and that I would not need any mail_access_groups as the users can access their own mailboxes. But this doesn't work. With "mail_privileged_group = mail" and mail_access_groups unset, I get May 6 12:48:54 sbh16 dovecot: POP3(xxx): file_lock_dotlock() failed with mbox file /var/spool/mail/xxx: Permission denied Yet with "mail_access_groups = mail" and mail_privileged_group unset, it works with no problem. Is my understanding wrong? Is the documentation wrong? Is the implementation wrong? Or is there just something wierd in my case (possibly pop3_lock_session = yes)? # dovecot -n # 1.0.13: /usr/local/etc/dovecot.conf protocols: pop3 pop3s ssl_cert_file: /etc/postfix/grizz-cert.pem ssl_key_file: /etc/postfix/grizz-key.pem login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/pop3-login mail_access_groups: mail mail_location: /var/spool/mail/%u mbox_write_locks: fcntl dotlock mail_executable: /usr/local/libexec/dovecot/pop3 mail_plugin_dir: /usr/local/lib/dovecot/pop3 pop3_lock_session: yes pop3_uidl_format: %08Xu%08Xv auth default: mechanisms: plain apop login worker_max_count: 5 passdb: driver: passwd-file args: /usr/local/etc/dovecot.passwd passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 2

[Dovecot] Error in dovecot-auth logging
by Antonio Casado Rodríguez 07 May '08

07 May '08

Hi, i have this in /var/log/messages May 7 09:29:59 blade25 dovecot-auth: pam_ldap: ldap_result Timed out May 7 09:29:59 blade25 dovecot-auth: pam_ldap: ldap_result Can't contact LDAP server but i defined log_path and info_log_path in dovecot.conf "dovecot -n not show different values for "protocol lda"? Regards # dovecot -n # 1.0.10: /etc/dovecot.conf log_path: /Correo/log/dovecot/dovecot.log info_log_path: /Correo/log/dovecot/dovecot.info protocols: imaps pop3 managesieve ssl_cert_file: /etc/pki/dovecot/certs/mycert.crt ssl_key_file: /etc/pki/dovecot/private/mycert.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_executable(managesieve): /usr/libexec/dovecot/managesieve-login first_valid_uid: 200 mail_location: maildir:%h/.. mail_executable(default): /usr/local/sbin/post-login-imap-dovecot mail_executable(imap): /usr/local/sbin/post-login-imap-dovecot mail_executable(pop3): /usr/local/sbin/post-login-pop3-dovecot mail_executable(managesieve): /usr/libexec/dovecot/managesieve mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 mail_plugin_dir(managesieve): /usr/lib64/dovecot/managesieve namespace: type: private separator: / location: maildir:%h/.. inbox: yes auth default: passdb: driver: pam userdb: driver: passwd plugin: quota: maildir:storage=1048576

2 1