October 2007 - dovecot

[Dovecot] Errata: dovecot + ldap + virtual mailbox: building mail location path
by Claudio Strizzolo 21 Oct '07

21 Oct '07

Hi all again, I've just realized that I did a bad cut&paste in my previous mail, then I rewrite my request. I apologize. I am trying to set up my dovecot configuration using LDAP and virtual mailboxes. I succeeded in authenticating the users correctly with LDAP, but have problems with referencing the correct mail location directory. I manage several domains. The mailboxes are stored under separate directories for each domain: /mail/vmail/domains/writers.com/William.Shakespeare/ /mail/vmail/domains/writers.com/Jack.London/ /mail/vmail/domains/painters.com/Pablo.Picasso/ /mail/vmail/domains/painters.com/Vincent.VanGogh/ Now, I supposed I could build the path by setting the common part of the paths as mail_location into dovecot.conf: mail_location = maildir:/mail/vmail/domains/%h passdb ldap { args = /etc/dovecot-ldap.conf } userdb ldap { args = /etc/dovecot-ldap.conf } userdb prefetch { } and getting the variable part ("domain/user", i.e. writers.com/Jack.London) from the userdb in dovecot-ldap.conf: auth_bind = yes auth_bind_userdn = mail=%u,vd=%d,o=hosting,dc=example,dc=com ldap_version = 3 base = o=hosting,dc=example,dc=com deref = never scope = subtree user_attrs = mail,,mailbox,mail,, user_filter = (&(objectClass=VirtualMailAccount)(accountActive=TRUE)(mail=%u)) pass_attrs = mail=user,userPassword=password,mailbox=userdb_home,mail=userdb_uid,mail =userdb_mail pass_filter = (&(objectClass=VirtualMailAccount)(accountActive=TRUE)(mail=%u)) default_pass_scheme = CRYPT In the LDAP database the fields are something like: mail = Jack.London(a)writers.com mailbox = writers.com/Jack.London uid = Jack.London However, the above does not work. Here is an extract from the log: Oct 16 15:57:07 mymail.example.com dovecot: auth(default): ldap(Jack.London@writers.com,::ffff:127.0.0.1): user search: base=o=hosting,dc=example,dc=com scope=subtree filter=(&(objectClass=VirtualMailAccount)(accountActive=TRUE)(mail=Jack.London(a)writers.com)) fields=mail,mailbox,mail Oct 16 15:57:07 mymail.example.com dovecot: IMAP(Jack.London(a)writers.com): Ambiguous mail location setting, don't know what to do with it: writers.com/Jack.London/ (try prefixing it with mbox: or maildir:) Oct 16 15:57:07 mymail.example.com dovecot: IMAP(Jack.London(a)writers.com): Failed to create storage with data: writers.com/Jack.London Any hints? BTW, I am trying to prefetch, as you see, but I am not sure that works too. Thanks in advance Claudio

2 1

Re: [Dovecot] Problem searching with thunderbird
by Jon Essen-Moller 21 Oct '07

21 Oct '07

Hi, Resending this. Does anyone have a clue? -------------- I downloaded the updated files and now I also upgraded to beta2 as you released late last night. Good work maintaining dovecot I have to say. :-) Unfortunately  I still can't search using thunderbird. I get no errors in the log now but thunderbird doesn't find any messages. I have tried updating the index (in thunderbird) but still no messages found. It worked prior to updating. What could the reason be? Best Regards - Jon ps. I also now tried searching in Squirrelmail aswell. Didn't work. ds.

2 1

[Dovecot] Incomplete Subject Line
by Bernhard Schmidt 21 Oct '07

21 Oct '07

Hi, since upgrading from 1.0.5 to latest 1.1-hg I get an incomplete subject line for mails autogenerated by one of our systems in the message list (Thunderbird and mutt). When I open the mail the subject line is intact. It appears that the system is using multiline subjects. Example Subject: =?ISO-8859-1?B?SG9zdG1hc3RlcjogMDAwMDEwNjM1OiBOYW1lc2U=?= =?ISO-8859-1?B?cnZlcjogTmV1dmVyZ2FiZSBvZGVyIMRuZGVydW5n?= is printed as Subject: Hostmaster: 000010635: Namese in the Message list and correctly decoded as Subject: Hostmaster: 000010635: Nameserver: Neuvergabe oder Änderung when viewing the message. Bug? Regards, Bernhard

2 4

[Dovecot] Namespace Question
by Jeff Grossman 21 Oct '07

21 Oct '07

I installed 1.1Beta2 over 1.0.5 last night. My 1.0.5 setup was running with no problems at all. Stupid me overwrote my dovecot.conf file with a vanilla one. I know I know, backup!!! I am pretty sure my old dovecot.conf file did not specify any namespaces, but I could be mistaken. My Thunderbird and Squirrelmail are working fine on the new 1.1Beta2 setup. But, my smartphone running Windows Mobile 5.0 does not see the inbox or my folders. Does anybody know what might be different between 1.0.5 and 1.1Beta2 in regards to pocket outlook? This is on a Gentoo system. Here is my dovecot-n output. apple dovecot # dovecot -n # 1.1.beta2: /etc/dovecot/dovecot.conf protocols: imap imaps pop3 pop3s listen: [::] ssl_cert_file: /etc/ssl/dovecot/server.pem ssl_key_file: /etc/ssl/dovecot/server.key ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_location: maildir:%h/.maildir mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: passdb: driver: pam args: * userdb: driver: passwd Thanks, Jeff

4 10

[Dovecot] Migration Issues UW-POP3
by Albert E. Whale 21 Oct '07

21 Oct '07

I am migrating from UW's POP3 server (mbox), to Dovecote (mbox -> maildir). Anyway, I am concerned about the Logging details offered by Dovecot, as I manage several details from the logging information provided by UW's Syslog information. Here's a sample of the UW information: Oct 7 22:08:39 ns6 ipop3d[15432]: pop3 service init from 66.207.133.233 Oct 7 22:08:39 ns6 ipop3d[15432]: Auth user=aewhale host=ns.ABS-CompTech.com [66.207.133.233] nmsgs=0/0 Oct 7 22:08:39 ns6 ipop3d[15432]: Logout user=aewhale host=ns.ABS-CompTech.com [66.207.133.233] nmsgs=0 ndele=0 The first time I connected to the server to test the information, I got the following: Oct 7 20:22:17 ns6 dovecot: Dovecot v1.0.rc26 starting up Oct 7 20:22:37 ns6 dovecot: pop3-login: Login: user=<aewhale>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured Oct 7 20:23:44 ns6 dovecot: POP3(aewhale): Disconnected: Logged out top=0/0, retr=0/0, del=0/800,size=1576887 None of the other connections reported information about the mailbox or the connections. Here is what I see: Oct 7 20:39:14 ns6 dovecot: pop3-login: Disconnected: method=PLAIN, rip=66.207.133.233, lip=66.207.133.228 Oct 7 20:59:42 ns6 dovecot: pop3-login: Disconnected: method=LOGIN, rip=71.162.15.2, lip=66.207.133.228 Oct 7 21:39:12 ns6 dovecot: pop3-login: Disconnected: method=LOGIN, rip=66.207.133.233, lip=66.207.133.228 Oct 7 21:39:42 ns6 dovecot: pop3-login: Disconnected: method=LOGIN, rip=71.162.15.2, lip=66.207.133.228 I never see the POP3 or Login messages any more. Can someone tell me why? Is this not correctly working on my server yet? -- Albert E. Whale, CHS CISA CISSP Sr. Security, Network, Risk Assessment and Systems Consultant ------------------------------------------------------------------------ ABS Computer Technology, Inc. <http://www.ABS-CompTech.com> - Email, Internet and Security Consultants SPAMZapper <http://www.Spam-Zapper.com> - No-JunkMail.com <http://www.No-JunkMail.com> - *True Spam Elimination*.

2 1

[Dovecot] potential maildir folder rename bug
by pod 21 Oct '07

21 Oct '07

Admittedly not a common situation but: MAIL=maildir:~/tmp/dovecot/Maildir ./src/imap/imap * PREAUTH [CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS] Logged in as pod 01 LIST "" * * LIST (\HasNoChildren) "." "INBOX" 01 OK List completed. 02 CREATE a 02 OK Create completed. 03 LIST "" * * LIST (\HasNoChildren) "." "a" * LIST (\HasNoChildren) "." "INBOX" 03 OK List completed. 04 RENAME a a.b 04 OK Rename completed. 05 LIST "" * * LIST (\HasNoChildren) "." "a.b.b" * LIST (\HasNoChildren) "." "INBOX" 05 OK List completed. I was expecting to wind up with two folders "INBOX" and "a.b". Instead I got "INBOX" and "a.b.b". I think the problem is that ".a" gets renamed in the filesystem to ".a.b" before src/lib-storage/index/maildir/maildir-storage.c rename_subfolders() is called, which then finds ".a.b", assumes "b" was a subfolder of "a" so renames it. The following may or may not be an appropriate fix. It certainly feels rather ad hoc and I've not thought too deeply about other circumstances where this code is called. I'd certainly appreciate a second opinion. diff -r 8d6433652a33 src/lib-storage/index/maildir/maildir-storage.c --- a/src/lib-storage/index/maildir/maildir-storage.c Sun Sep 30 18:03:17 2007 +0300 +++ b/src/lib-storage/index/maildir/maildir-storage.c Mon Oct 01 20:13:27 2007 +0100 @@ -937,6 +937,10 @@ static int rename_subfolders(struct inde t_push(); old_listname = t_strconcat(oldname, names[i], NULL); + if (strcmp(old_listname, newname) == 0) { + t_pop(); + continue; + } new_listname = t_strconcat(newname, names[i], NULL); oldpath = maildir_get_path(storage, old_listname); newpath = maildir_get_path(storage, new_listname);

2 1

[Dovecot] API problem (noob)
by Lars Stavholm 21 Oct '07

21 Oct '07

I'm a bit of a newbie, especially when it comes to dovecot internals, but nevertheless, I need some help: I'm working on a dovecot plugin, and I would like to copy a mail message from the mail store out to a temporary file, less a few headers: static const char *const exclude_headers[] = { "X-DSPAM-Signature" } strcpy(fname, mktemp(fname)); fd = creat(fname, 0600); mail_get_stream(mail, NULL, NULL, &input); output = o_stream_create_fd_file(fd, 0, TRUE); input = i_stream_create_header_filter(input, HEADER_FILTER_EXCLUDE | HEADER_FILTER_NO_CR, exclude_headers, N_ELEMENTS(exclude_headers), null_header_filter_callback, NULL); o_stream_send_istream(output, input); But all I get in the temp file is the message body, i.e. no headers at all. What am I doing wrong here? My understanding (or hope:) of what the function i_stream_create_header_filter() is supposed to do might not be accurate: I was hoping that it would exclude the aforementioned headers, but leave the rest of the headers as is. Any help appreciated /Lars

2 1

[Dovecot] Mailformat
by Jon Essen-Moller 21 Oct '07

21 Oct '07

Hi, When saving a message as draft from Thunderbird and later opens it with squrrelmail i get all the html code. Also do mails from Google calander and som others give a warning (in Squirrelmail) that they ar badly formated) This after upgrading to 1.1beta2. Any ideas? Best Regards - Jon -- Jon Essen-Moller http://tenka.se

3 2

[Dovecot] Better flagging of errors on logs?
by Francisco Reyes 21 Oct '07

21 Oct '07

Last night dovecot died because of time changed backward. I noticed that the line from dovecot read Oct 9 01:00:44 mailstore16 dovecot: Time just moved backwards by 132 seconds. This might cause a lot of problems, so I'll just kill myself now. Shouldn't such lines have the word "Error" or "Fatal"? If I set the log_path = to a file, will syslog messages still be generated?

2 1

[Dovecot] Dovecot raw backtrace when copying to folder
by Julian Cowley 21 Oct '07

21 Oct '07

Seeing a problem with a certain user causing dovecot to crash when copying mail to a folder. This looks similar to a bug someone on the mailing list posted recently. Since the backtrace mentions the index, I tried deleting all of the index files for the user (including subfolders) but it had no effect. Seems that the bug still happens when creating the index for the first time. Unfortunately, I can't pin down if there is a particular message causing the problem but I'll see if I can track it using strace. Lines are broken for clarity. This is dovecot 1.0.5 on CentOS 4.5. Sep 27 16:41:42 cookie dovecot: imap-login: Login: user=<user@domain>, method=PLAIN, rip=::ffff:xx.xx.xx.xx, lip=::ffff:yy.yy.yy.yy, TLS Sep 27 16:41:53 cookie dovecot: IMAP(user@domain): Trying to allocate 0 bytes Sep 27 16:41:53 cookie dovecot: IMAP(user@domain): Raw backtrace: imap [0x80ad7d4] -> imap [0x80ad239] -> imap [0x80b5624] -> imap(i_malloc+0x1b) [0x80b0e1b] -> imap [0x8083037] -> imap [0x80833e6] -> imap(index_storage_search_init+0xf4) [0x80836f4] -> imap(cmd_copy+0x145) [0x8056d15] -> imap(cmd_uid+0x7c) [0x805a74c] -> imap [0x805b2d5] -> imap [0x805b25e] -> imap(_client_input+0x8c) [0x805b43c] -> imap(io_loop_handler_run+0x169) [0x80b3e09] -> imap(io_loop_run+0x28) [0x80b3178] -> imap(main+0x49f) [0x806384f] -> /lib/tls/libc.so.6(__libc_start_main+0xd3) [0x506de3] -> imap [0x8055db1] Sep 27 16:41:53 cookie dovecot: child 26079 (imap) killed with signal 6

4 9