May 2009 - dovecot - dovecot.org

[Dovecot] mailutil?
by Timo Sirainen 08 May '09

08 May '09

dbox format needs at least two tools: 1. Expunging only marks the message having refcount=0. The actual disk space is freed only after calling a tool pointing to the user's dbox dir. 2. Ability to force index resync/rebuild in case it doesn't figure out itself that there's something wrong. I'm starting to think about building a more generic mailutil tool, maybe something similar to what UW-IMAP has. So two questions: - What should the tool be called? Probably not mailutil to avoid confusion. doveutil? dovemail? dovetool? mailtool? - Is there any functionality you'd like it to do?

10 15

[Dovecot] Imap notifications in IDLE
by Jarosław Przybyłowicz 07 May '09

07 May '09

Hi, could you please tell me if there is a way, to make dovecot notify my mail client of new messages in inbox subfolders? I'm using fdm to fetch mails into maildir and proper subfolders. So far, when idleing mozilla gets a notification when new message arrives in INBOX, but if mail is fetched into other folder I have to click on it to see if there is a new message. I've checked thunderbird imap log to check if this is dovecot or TB issue. Is there any way to force dovecot to monitor other folders? Regards, V

5 6

Re: [Dovecot] authentication to IMAP
by punit_j 07 May '09

07 May '09

Hi Daniel, What version of dovecot supports this feature ? I am using dovecot-0.99.11-8.EL4 and gives error : - Starting Dovecot Imap: Fatal: Error in configuration file /etc/dovecot.conf line 495: Unknown setting: master_user_separator Here is what i added : auth_master_user_separator = * auth default { passdb passwd-file { args = /root/passwd.masterusers master = yes } passdb shadow { } userdb passwd { } } Regards, Punit

3 2

[Dovecot] Exim And Dovecot SASL
by Andrew Holway 07 May '09

07 May '09

Hi all, I have been trying to get this to work a couple of ways, please take a look at the links below.http://wiki.dovecot.org/HowTo/EximAndDovecotSASLhttp://rafb.net/p/ipH… rejects every time but if I uncomment;auth_executable = /usr/lib/dovecot/dovecot-auth then thunderbird will ask me for a password but does not agree with me on it.I have dovecot set up to use the unix usernames and passwordsThanks,Andrew  

2 2

[Dovecot] authentication to IMAP
by punit_j 07 May '09

07 May '09

HI All, Is there a way to do admin authentication for a normal user in dovecot IMAP ? I have a user using PAM to store password in /etc/shadow file. I need to authenticate the user in IMAP using that password. I tried using : - I tried all combinations as below [root@mail ~]# cat /etc/shadow| grep -i ajay ajay.lal:CM730q8foSA9A:13545:0:99999:7::: [root@mail ~]# telnet 0 143 Trying 0.0.0.0... Connected to 0 (0.0.0.0). Escape character is '^]'. * OK dovecot ready. a1 login ajay.lal CM730q8foSA9A a1 NO Authentication failed. a1 login ajay.lal "{crypt}CM730q8foSA9A" a1 NO Authentication failed. Also i tried [root@mail ~]# perl -MMIME::Base64 -e 'print encode_base64("\0ajay.lal\0{crypt}CM730q8foSA9A");' AGFqYXkubGFsAHtjcnlwdH1DTTczMHE4Zm9TQTlB [root@mail ~]# telnet 0 143 Trying 0.0.0.0... Connected to 0 (0.0.0.0). Escape character is '^]'. * OK dovecot ready. a1 AUTHENTICATE PLAIN + AGFqYXkubGFsAHtjcnlwdH1DTTczMHE4Zm9TQTlB a1 NO Authentication failed. My dovecot server does PLAIN authentication as can auth_mechanisms = plain Is there a way to do PLAIN auth with crypt password or any means of doing admin authentication on behalf of normal user ? Regards, Punit

2 1

[Dovecot] Solr FTS issues (Was fts-solr plugin issue (Marked invalid))
by Dror Matalon 06 May '09

06 May '09

Hi, Sorry for the change of thread, I just signed up to the list so I couldn't reply to the earlier message. Let me clarify the issue that Nikolai was describing. We're running dovecot 1.1.11 and solr 1.4. The issue is quite simple. 1. I run a search. 2. Dovecot sends a list of emails to solr 3. Solr starts indexing them 4. Solr runs into a "bad" email and we get: SEVERE: java.io.IOException: Mark invalid org.apache.solr.common.SolrException log SEVERE: java.io.IOException: Mark invalid at java.io.BufferedReader.reset(BufferedReader.java:485) at org.apache.solr.analysis.HTMLStripReader.restoreState(HTMLStripReader.java:171) at org.apache.solr.analysis.HTMLStripReader.read(HTMLStripReader.java:728) at org.apache.solr.analysis.HTMLStripReader.read(HTMLStripReader.java:742) at java.io.Reader.read(Reader.java:123) at org.apache.lucene.analysis.CharTokenizer.next(CharTokenizer.java:109) at org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:159) at org.apache.lucene.index.DocFieldConsumersPerField.processFields(DocFieldConsumersPerField.java:36) at org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:234) at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:765) ... 5. All the above email messages that were indexed are rolled back, and we're stuck. I think that the solution should be simple too :-). When solr runs into a bad email, it should just ignore it and keep indexing. This seems much more robust since the emails are coming from a variety of sources, and we can assume that some of them are going to generate badly formated emails. Seems like having a few bad emails not indexed is much better than the current situation of a bad email stopping all searching. I don't understand the architecture enough between fts, fts_solr and solr to know where this should be solved. Ideally, it would be a simple directive to solr. Regards, Dror ----- Dror Matalon President Zapatec Inc 866 522-7941 X 704 1700 MLK Way Berkeley, CA 94709 http://www.6zap.com http://twitter.com/drormata http://www.zapatec.com

1 0

[Dovecot] [OT] two-way IMAP synchronization
by Wolfram Schlich 06 May '09

06 May '09

Hi, I am looking for a tool that does a true two-way synchronization (synchronization of expunges/deletes) of IMAP mailboxes, kind of a mixture of unison and imapsync. Does anyone have any ideas how to accomplish that? TIA. -- Regards, Wolfram Schlich <wschlich(a)gentoo.org> Gentoo Linux * http://dev.gentoo.org/~wschlich/

2 3

Re: [Dovecot] Some POP3 questions
by Nikolai Derzhak 06 May '09

06 May '09

By the way, you can download ready to use open-source mail, calendar, contacts, etc: http://www.6zap.com. I'am sysadm in this project and we use dovecot to. On Wed, 05/06/2009 at 5:28pm, "Brandon Lamb" <brandonlamb(a)gmail.com> wrote: > On Wed, May 6, 2009 at 7:23 AM, Brandon Lamb <brandonlamb(a)gmail.com> wrote: >> On Wed, May 6, 2009 at 5:25 AM, Kenneth Kalmer <kenneth.kalmer(a)gmail.com> >> wrote: >>> On Tue, May 5, 2009 at 11:39 PM, Timo Sirainen <tss(a)iki.fi> wrote: >>> >>>> On Tue, 2009-05-05 at 23:32 +0200, Kenneth Kalmer wrote: >>>>>>> * NFS server which is the same server that houses single Courier-IMAP >>>>>>> installation (Gentoo, 3GB memory) >>>>>>> * 2x Postfix instances delivering to NFS >>>>>>> >>>>>> >>>>>> NFS may be problematic. Dovecot expects a perfectly working NFS setup, >>>>>> which seems to be a bit rare to find. http://wiki.dovecot.org/NFS >>>>>> >>>>> >>>>> Just for the record, dovecot will be access the mail directly on the >>>> disks, >>>>> it will be the LDA's on the postfix instances coming in over NFS. I'm >>>>> reading the NFS again to make sure I understand the risks >>>> >>>> If the LDA is Dovecot deliver, it's the same problem since it also >>>> updates index/control files that cause the problems. But if you're using >>>> something else that does nothing but write the maildir files, then it's >>>> fine. >>>> >>> >>> I'm looking to use the Dovecot LDA so the caches are updated and the >>> filenames are correct, to get good POP3 performance. >>> >>> I'm looking forward to giving Dovecot a go, but I'll rig up a staging >>> environment first. >>> >>> Thanks for the encouraging responses everyone. >>> >>> Best >>> >>> -- >>> Kenneth Kalmer >>> kenneth.kalmer(a)gmail.com >>> http://opensourcery.co.za >>> @kennethkalmer >> >> I moved from a 4 gig nfs server with eight mailheads running exim as >> lda, courier imap/pop3 (over nfs) to an 8 gig nfs server and moved to >> dovecot imap/pop3 running directly on the nfs server and dropped to >> four mailheads running exim with dovecot lda. >> >> At first I tried to keep my imap/pop3 services running on the 4 >> mailheads but over nfs had major weird 500 load spikes randomly, >> moving these to the nfs server solved all of that. The 4 mailheads >> still deliver to maildir over nfs using dovecot as lda. I have been >> pleasantly pleased. Our webmail app in our old setup used to take >> 10-30 seconds to load and now it is instantaneous. Some of it might be >> from upgrading hardware, but I definitely had a HUGE noticeable >> difference and you couldnt convince me to go back. >> >> We did have about a week of sucktastic traffic and my support >> department hating me because all our pop3 leave-messages-on-server >> users had to redownload all their mail, but it was worth the headache. >> Dovecot is just too sweet, with its performance and plugins to ever >> have to even think about a choice between it or software X. >> >> Just my $0.02 > > Oh yea, and I just recently discovered the virtual mailbox plugin and > fell even more in love. I am developing a Gmail clone inhouse for our > new webmail (we're an ISP). It is cool plugins like this that make me > glad I switched to Dovecot. Being able to consolidate various Deleted, > Trash, Deleted Items, Deleted Mails folders all into a single > virtual/Trash folder is GREAT. Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0

[Dovecot] Some POP3 questions
by Kenneth Kalmer 06 May '09

06 May '09

Hi everyone Been spending the whole day on the wiki and in the list archives on using dovecot for POP3 mail. I'd like to present my findings and ask for some feedback. Our current software setup: * Courier-IMAP running POP3/IMAP * Postfix MTA * MySQL backend for user and login info As for the system layout, it looks like this: * NFS server which is the same server that houses single Courier-IMAP installation (Gentoo, 3GB memory) * 2x Postfix instances delivering to NFS * Mail directory structure: /mail/e/ex/example.com/user Usage: * Currently reaching in excess of 1,200 concurrent connections, traffic roughly 36GB per day * 90% POP3 (mostly pop+delete), 10% IMAP * ~170GB of mail on disk Current problems experienced: * Massive load averages (>500) * Memory exhaustion (3GB) * Server looses network connectivity (related to massive loads) I've got a new server ready for action, well after mail directories have been rsync'd over. Will have 8GB of memory and much fast discs. I'm looking at giving Dovecot + Postfix/LDA a go. From my research today it seems that running a POP server without LDA (or without the W=(\d+) filename field) is a futile business. I'm running Gentoo, and the stable release in portage is currently dovecot 1.1.7, with 1.1.14 being available but masked. Long stories short, will Dovecot with the Postfix/LDA give performance equal than Courier-IMAP or improved (because of the cached message sizes)? Kind regards -- Kenneth Kalmer kenneth.kalmer(a)gmail.com http://opensourcery.co.za @kennethkalmer

5 9

[Dovecot] fts-solr plugin issue (Marked invalid)
by Nikolai Derzhak 06 May '09

06 May '09

---------- Forwarded message ---------- From: "Nikolai Derzhak" <nikolai(a)6zap.com> To: "Timo Sirainen" <tss(a)iki.fi> CC: "Dovecot Mailing" <dovecot(a)dovecot.org> Date: 05/05/2009 3:01pm Subject: Re: [Dovecot] fts-solr plugin issue (Marked invalid) On Mon, 05/04/2009 at 6:23pm, "Timo Sirainen" <tss(a)iki.fi> wrote: > On May 4, 2009, at 10:16 AM, Nikolai Derzhak wrote: > >> OK. Concentrating problem in one question. >> How to ignore "bad" message and index next one in indexing procedure >> (fts plugin) ?. >> Now, one "error 500" from solr and dovecot (# 1.1.11: /etc/dovecot/ >> dovecot.conf >> # OS: Linux 2.6.21.7-2.fc8xen i686 Ubuntu 8.04.2 ext3 >> ) stop and each next search query repeat the story. > > Maybe simply using 1.1.14 would help? I already fixed one Solr issue: http:// > hg.dovecot.org/dovecot-1.1/rev/678c3252a454 > I've merge back this commit to 1.1.11 code, cause this is my request about special chars ;). > If that's not the problem, it would help to have one of those mails > that breaks it. Yes. Now i have two new issue: 1. "Content-Type:" header in mail wrong - so it's TEXT/mspowerpoint for example, but it's binary *.ppt file. 2. many html from repository change-set(many commit's to html) in text/plain mail In both cases we have "Error 500" from solr (HTMLStripReader class) (in solr log: "Marked inlalid"). And in both cases we can not detect this in dovecot code (or it's hard to do). So for now i need some method to ignore "bad" messages. Because we can not catch all variants, but indexing die on first error like this. Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0