- dovecot - dovecot.org

Re: [Dovecot] fts-solr plugin issue (Marked invalid)
by Nikolai Derzhak 05 May '09

05 May '09

Send mail body with wrong Content-Type. If put this in maildir indexing raise 500 error. If fix Content-Type to "application/octet-stream" all OK. Because TEXT/*; content dovecot try to index and solr raise 500, on each search. On Tue, 05/05/2009 at 3:01pm, "Nikolai Derzhak" <nikolai(a)6zap.com> wrote: > On Mon, 05/04/2009 at 6:23pm, "Timo Sirainen" <tss(a)iki.fi> wrote: >> On May 4, 2009, at 10:16 AM, Nikolai Derzhak wrote: >> >>> OK. Concentrating problem in one question. >>> How to ignore "bad" message and index next one in indexing procedure >>> (fts plugin) ?. >>> Now, one "error 500" from solr and dovecot (# 1.1.11: /etc/dovecot/ >>> dovecot.conf >>> # OS: Linux 2.6.21.7-2.fc8xen i686 Ubuntu 8.04.2 ext3 >>> ) stop and each next search query repeat the story. >> >> Maybe simply using 1.1.14 would help? I already fixed one Solr issue: http:/ >> / >> hg.dovecot.org/dovecot-1.1/rev/678c3252a454 >> > I've merge back this commit to 1.1.11 code, cause this is my request about > special chars ;). > >> If that's not the problem, it would help to have one of those mails >> that breaks it. > Yes. Now i have two new issue: > 1. "Content-Type:" header in mail wrong - so it's TEXT/mspowerpoint for > example, but it's binary *.ppt file. > 2. many html from repository change-set(many commit's to html) in text/plain > mail > > In both cases we have "Error 500" from solr (HTMLStripReader class) (in solr > log: "Marked inlalid"). > And in both cases we can not detect this in dovecot code (or it's hard to do) > . > So for now i need some method to ignore "bad" messages. > Because we can not catch all variants, but indexing die on first error like > this. > > > > Powered by the 6zap. Sign up at http://www.6zap.com for an account that > provides advanced e-mail, calendar and contacts capabilities. Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0

Re: [Dovecot] fts-solr plugin issue (Marked invalid)
by Nikolai Derzhak 05 May '09

05 May '09

On Mon, 05/04/2009 at 6:23pm, "Timo Sirainen" <tss(a)iki.fi> wrote: > On May 4, 2009, at 10:16 AM, Nikolai Derzhak wrote: > >> OK. Concentrating problem in one question. >> How to ignore "bad" message and index next one in indexing procedure >> (fts plugin) ?. >> Now, one "error 500" from solr and dovecot (# 1.1.11: /etc/dovecot/ >> dovecot.conf >> # OS: Linux 2.6.21.7-2.fc8xen i686 Ubuntu 8.04.2 ext3 >> ) stop and each next search query repeat the story. > > Maybe simply using 1.1.14 would help? I already fixed one Solr issue: http:// > hg.dovecot.org/dovecot-1.1/rev/678c3252a454 > I've merge back this commit to 1.1.11 code, cause this is my request about special chars ;). > If that's not the problem, it would help to have one of those mails > that breaks it. Yes. Now i have two new issue: 1. "Content-Type:" header in mail wrong - so it's TEXT/mspowerpoint for example, but it's binary *.ppt file. 2. many html from repository change-set(many commit's to html) in text/plain mail In both cases we have "Error 500" from solr (HTMLStripReader class) (in solr log: "Marked inlalid"). And in both cases we can not detect this in dovecot code (or it's hard to do). So for now i need some method to ignore "bad" messages. Because we can not catch all variants, but indexing die on first error like this. Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0

[Dovecot] Maildir bugs
by Timo Sirainen 05 May '09

05 May '09

I just found out that when using deliver or saving mails with IMAP APPEND command there was all kinds of race condition bugs that could cause e.g.: dovecot-uidlist: Duplicate file entry at line 18: 1241457213.M690227P32531.host,W=3359:2,T (uid 170019 -> 170020) And who knows what else. If you've run into those problems, these patches should help: http://hg.dovecot.org/dovecot-1.1/rev/6bbe27c32cb8 http://hg.dovecot.org/dovecot-1.1/rev/003bebac2c76 http://hg.dovecot.org/dovecot-1.1/rev/96c8632775df They are pretty large though, hopefully won't break anything. But at least my stress tests can no longer break it. I'll probably release v1.1.15 RC in a few days so at least some people can try to break it before the final v1.1.15 :)

1 0

[Dovecot] questions about compiling Sieve plugin
by MercuryShadow 04 May '09

04 May '09

I'm using the info on the wiki to try to compile the sieve plugin for dovecot on a server running Debian Etch, but I'm getting nowhere because I'm stuck trying to find the directory to use in the "--with-dovecot=" argument when running the configure script. The wiki says: Compilation is identical among the CMUSieve and the new Sieve plugin. Use --with-dovecot=<path> to point to dovecot-config file's directory. There are two possibilities where this could exist: 1. If you configured Dovecot with --enable-header-install, you'll have dovecot-config installed in $prefix/lib/dovecot/ directory. 2. Compiled Dovecot sources' root directory. The problem is that there is no such file called "dovecot-config" on the server, and dovecot was installed from the Debian repositories, not compiled. There is no /usr/lib/dovecot or /usr/local/lib/dovecot. I figured that, as is the case with many Debian packages, the libraries needed to compile would be included in a "dovecot-dev" package, but I checked and there is no such package in the Debian repos. Does anyone know what I need to do in order to get this plugin compiled? -- View this message in context: http://www.nabble.com/questions-about-compiling-Sieve-plugin-tp23285989p232… Sent from the Dovecot mailing list archive at Nabble.com.

2 8

[Dovecot] Problem with BODYSTRUCTURE (wrong charset)
by Craig Craig 04 May '09

04 May '09

Hi, I've changed a program that fetches mail via IMAP from an Exchange Server to use our Dovecot machine. But now I'm experiencing strange problems with seem to be caused by a wrong BODYSTRUCTURE answer that causes wrong charset handling. When fetchting the BODYSTRUCTURE I see this: Dovecot: 88 UID fetch 32 (BODYSTRUCTURE) * 1 FETCH (UID 32 BODYSTRUCTURE ("text" "plain" ("charset" "us-ascii") NIL NIL "7bit" 725664 9385 NIL NIL NIL NIL)) 88 OK Fetch completed. Exchange: 90 UID fetch 10 (BODYSTRUCTURE) * 2 FETCH (BODYSTRUCTURE (("TEXT" "PLAIN" ("charset" "iso-8859-1") NIL NIL "QUOTED-PRINTABLE" 2784 47 NIL NIL NIL)("IMAGE" "JPEG" ("name" "197254.jpg") NIL NIL "BASE64" 498806 NIL ("attachment" ("filename" "197254.jpg")) NIL)("IMAGE" "JPEG" ("name" "197254_1.jpg") NIL NIL "BASE64" 188424 NIL ("attachment" ("filename" "197254_1.jpg")) NIL)("IMAGE" "JPEG" ("name" "197254_2.jpg") NIL NIL "BASE64" 31878 NIL ("attachment" ("filename" "197254_2.jpg")) NIL)("TEXT" "PLAIN" ("name" "pix.xml") NIL NIL "QUOTED-PRINTABLE" 2934 49 NIL ("attachment" ("filename" "pix.xml")) NIL)("TEXT" "PLAIN" ("CHARSET" "US-ASCII") NIL NIL "7BIT" 0 1 NIL ("attachment" NIL) NIL) "mixed" ("Message-ID:" "<d2788bc14788ff16e67e63941937c1e1(a)foo.de>" "boundary" "000XMAIL000") NIL NIL) UID 10) 90 OK FETCH completed. Mail contents were: [...] To: blah(a)foo.de Subject: Pictures From: blah2(a)foo.de CC: Errors-To: blah2(a)foo.de Sender: foobar(a)foo.de MIME-Version: 1.0 Content-Type: multipart/mixed; Message-ID:=<d2788bc14788ff16e67e63941937c1e1(a)foo.de>; boundary="000XMAIL000" Message-Id: <20090504120233.58AFC346FC(a)foo.de> Date: Mon, 4 May 2009 14:02:33 +0200 (CEST) --000XMAIL000 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: Quoted-Printable <?xml version=3D"1.0" encoding=3D"ISO-8859-1" ?> <foo> [...] --000XMAIL000 Content-Type: image/jpeg; name="197254.jpg" Content-Transfer-Encoding: Base64 Content-Disposition: attachment; filename="197254.jpg" [...] --000XMAIL000 Content-Type: text/plain; name="pix.xml" Content-Transfer-Encoding: Quoted-Printable Content-Disposition: attachment; filename="pix.xml" <?xml version=3D"1.0" encoding=3D"ISO-8859-1" ?>=0D <blah>=0D [...] Here is my dovecot -n output: # 1.1.14: /etc/dovecot/dovecot.conf # OS: Linux 2.6.21-gentoo-r1 i686 Gentoo Base System release 1.12.11.1 ext3 log_path: /var/log/dovecot protocols: imap imaps pop3 pop3s listen: [::] ssl_cert_file: /etc/ssl/dovecot/server.pem ssl_key_file: /etc/ssl/dovecot/server.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_privileged_group: vmail mail_location: maildir:/var/mail/%d/%n mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 auth default: mechanisms: plain login digest-md5 cram-md5 rpa apop username_translation: AaBbCcDdEeFfGgHhIiJjKkLlMmNnOoPpQqRrSsTtUuVvWwXxYyZz verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/passwd.dovecot userdb: driver: passwd-file args: /etc/passwd.dovecot socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: root group: vmail So is this a parsing error in dovecot or was the Exchange Server just parsing incorrect MIME-Headers?! Any hint would be appreciated... Thanks in advance, Craig

2 1

Re: [Dovecot] fts-solr plugin issue (Marked invalid)
by Nikolai Derzhak 04 May '09

04 May '09

OK. Concentrating problem in one question. How to ignore "bad" message and index next one in indexing procedure (fts plugin) ?. Now, one "error 500" from solr and dovecot (# 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.21.7-2.fc8xen i686 Ubuntu 8.04.2 ext3 ) stop and each next search query repeat the story. I've explored fts, and ftp-solr directories in src, without success for now. Timo, you understand code much bettter, can you help me and point to place in code, or probably create some patch, if possible ?. On Fri, 05/01/2009 at 5:56pm, "Nikolai Derzhak" <nikolai(a)6zap.com> wrote: > Hi. > > We user ftp-solr plugin and have problem with solr-1.3+ > with HTMLStripWhitespaceTokenizerFactory (Solr schema in attachments). > In some maildir's present messages with wrong "Content-Type: " fields in > attachments. > For example: > " > Content-Type: TEXT/mspowerpoint; name="Zapatec_6zap_netvibes_1.ppt" > " > Indexing for this messages is stop with "fts_solr: Indexing failed: 500 > Internal Server Error". > In solr log is: > " > SEVERE: java.io.IOException: Mark invalid > at java.io.BufferedReader.reset(BufferedReader.java:485) > " > (mail list with discussion: http://markmail.org/message/2fnfiwygvehjngyr# > query:SEVERE%3A%20java.io.IOException%3A%20Mark%20invalid%20lucene+page:1+ > mid:2fnfiwygvehjngyr+state:results) > > Look's like dovecot try to index attachments like this. > Also for some messages we have same error. > Dovecot stop indexing of box and each search we have lag and CPU load on > server. > > So we need to make dovecot more "stable" to this error. > For first time , will be good, just ignore problematic messages with error > from solr. > > Let's discuss this issue, because this is general problem. > We ready to explore code where needed , etc. > > Regards, > Nikolai > > Powered by the 6zap. Sign up at http://www.6zap.com for an account that > provides advanced e-mail, calendar and contacts capabilities. Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

3 2

Re: [Dovecot] fts-solr plugin issue (Marked invalid)
by Nikolai Derzhak 04 May '09

04 May '09

On Mon, 05/04/2009 at 5:36pm, "Rui Carneiro" <rui.carneiro(a)portugalmail.net> wrote: > I do not have sure if I understood your problem correctly. > > Are you trying to index attachments from messages? Or Dovecot is indexing > some "bad" parts and you just do not know why? > Read first post, please, with description. But in sum: when dovecot try to index some mail's, that solr tokenizer not eat (error 500, Marked invalid), dovecot stop indexing of box and retry attempts in each next search with same result. > Regards, > Rui Carneiro > -- > Portugalmail, Comunicações S.A. > www.portugalmail.net > > Citando Nikolai Derzhak <nikolai(a)6zap.com>: > >> OK. Concentrating problem in one question. >> How to ignore "bad" message and index next one in indexing procedure (fts >> plugin) ?. >> Now, one "error 500" from solr and dovecot (# 1.1.11: >> /etc/dovecot/dovecot.conf >> # OS: Linux 2.6.21.7-2.fc8xen i686 Ubuntu 8.04.2 ext3 >> ) stop and each next search query repeat the story. >> I've explored fts, and ftp-solr directories in src, without success for now. >> >> Timo, you understand code much bettter, can you help me and point to place >> in >> code, >> or probably create some patch, if possible ?. Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

2 1

[Dovecot] login_max_processes_count and logs
by Dominique Fournier 04 May '09

04 May '09

Hello, Our server reach today the login_max_processes_count. Dovecot works well and don't accept any new connection. But it doesn't log anything about this problem : we are blind why the connection is refused for the clients. Could you add a log when the connection limit is reached or (maybe better) a log with the occupation for the beginning of each connection ? Thanks Dom Dovecot version 1.0.15 on Debian AMD64

3 3

[Dovecot] Strange virtual users issues
by Ovi C 02 May '09

02 May '09

Hi i'm using dovecot with virtual users from a postgresql database backend on a Debian Lenny system. I'm using qmail as MTA. Mostly everything seems to work ok , except the fact that the mail delivered never reaches virtual user's INBOX. Here's the dovecot config: dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap ssl_disable: yes login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_greeting: Server ready to process requests. login_process_per_connection: no max_mail_processes: 512 verbose_proctitle: yes first_valid_gid: 61 last_valid_gid: 2003 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: quota autocreate imap_client_workarounds: outlook-idle delay-newmail auth default: mechanisms: plain login digest-md5 passdb: driver: pam passdb: driver: passwd passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 user: root group: mail plugin: quota: maildir acl: vfile:/etc/dovecot-acls trash: /etc/dovecot-trash.conf lazy_expunge: .EXPUNGED/ .DELETED/ .DELETED/.EXPUNGED/ autocreate: Trash autocreate2: Spam The setup is as follows: I've created a system user named vmail in /home with a group also called vmail. The virtual users are created in /home/vmail/username when i configure an account from thunderbird. If I send an message from a virtual user to an system user everythings is ok. The system user get's the mail in his Maildir. But if I send a message from the system user to the virtual user the MTA's log says that the message has been delivered but it never reaches virtual user's INBOX. Here's a snip from logs both qmail's and dovecot's: cat /var/log/qmail.log status: local 0/10 remote 0/20 new msg 155041 info msg 155041: bytes 263 from <caretaker@localhost.> qp 4560 uid 1000 starting delivery 1: msg 155041 to remote akkersson@localhost. status: local 0/10 remote 1/20 new msg 155147 info msg 155147: bytes 438 from <caretaker@localhost.> qp 4563 uid 64011 starting delivery 2: msg 155147 to local akkersson@localhost status: local 1/10 remote 1/20 delivery 1: success: 127.0.0.1_accepted_message./Remote_host_said:_250_ok_1241272738_qp_4563/ status: local 1/10 remote 0/20 end msg 155041 delivery 2: deferral: status: local 0/10 remote 0/20 cat /var/log/dovecot.log dovecot: 2009-05-02 16:30:46 Info: Dovecot v1.0.15 starting up dovecot: 2009-05-02 16:30:46 Info: auth(default): pgsql: Connected to maildb dovecot: 2009-05-02 16:32:00 Info: IMAP(akkersson): Loading modules from directory: /usr/lib/dovecot/modules/imap dovecot: 2009-05-02 16:32:00 Info: IMAP(akkersson): Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so dovecot: 2009-05-02 16:32:00 Info: IMAP(akkersson): Module loaded: /usr/lib/dovecot/modules/imap/lib11_autocreate_plugin.so dovecot: 2009-05-02 16:32:00 Info: IMAP(akkersson): Effective uid=2003, gid=61, home=/home/vmail/akkersson dovecot: 2009-05-02 16:32:00 Info: IMAP(akkersson): maildir: data=/home/vmail/akkersson/Maildir dovecot: 2009-05-02 16:32:00 Info: IMAP(akkersson): maildir: root=/home/vmail/akkersson/Maildir, index=/home/vmail/akkersson/Maildir, control=, inbox= dovecot: 2009-05-02 16:32:00 Info: imap-login: Login: user=<akkersson>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured dovecot: 2009-05-02 16:58:11 Info: IMAP(akkersson): Disconnected: Logged out but akkersson's INBOX is empty.. Any hints ??

1 0

[Dovecot] deliver_log_format not working with 1.2.rc3?
by Anton Dollmaier 01 May '09

01 May '09

Hi list, just a small issue with deliver_log_format. Although, the parameter is altered in the config and is correctly shown with "dovecot -n", deliver uses only its default log_format. > root@terra:~# dovecot -n | grep -e deliver -e "^#" > # 1.2.rc3: /etc/dovecot/dovecot.conf > # OS: Linux 2.6.26-1-686 i686 Debian 5.0.1 > deliver_log_format: %m:%$:%f:%s this is from a recent mail: > deliver(antondollmaier(a)aditsystems.de): 2009-04-30 16:13:45 Info: sieve: msgid=<20090430141309.GN16305(a)katherina.student.utwente.nl>: stored mail into mailbox 'Dovecot-List' Subject and From are obviously not logged. Any hints? thanks in advance. best regards, Anton

2 1

[Dovecot] mbox-snarf plugin and istream-mail-stats.c revision 9000:b02c642b4e51
by Jonathan Siegle 01 May '09

01 May '09

I'm getting this error: May 1 09:09:30 tr27n12.aset.psu.edu syslog: PSU mbox-snarf name is INBOX May 1 09:09:30 tr27n12.aset.psu.edu dovecot: Panic: IMAP(tstem38): file istream-mail-stats.c: line 75: assertion failed: (ret != -1 || stream->istream.eof || stream->istream.stream_errno != 0) Will this error go away before the general 1.2 release? Thanks, Jonathan

2 4

Re: [Dovecot] Slow connections with POP3 service
by V S Rao 01 May '09

01 May '09

Great. Thank you so much for responding. It hangs at Tying 127.0.0.1 The funny part is that one day it works fine and the next day it just hangs. And its not that the service is completely unresponsive. If 200 users try to connect, 10 get through and are able to download. However which 10 get through depends on luck! Its been going on for the past one week and really driving me crazy. I have changed everthing including the server, but the problem persists. How do I get a clue where the problem is? Am badly in need of help here. Regards V S Rao. ----- Original Message ----- From: "Timo Sirainen" <tss(a)iki.fi> To: "V S Rao" <viriyala(a)yahoo.com> Cc: dovecot(a)dovecot.org Sent: Wednesday, April 29, 2009 11:23:37 PM GMT +05:30 Chennai, Kolkata, Mumbai, New Delhi Subject: Re: [Dovecot] Slow connections with POP3 service On Tue, 2009-04-28 at 00:12 -0700, V S Rao wrote: > Even a telnet to localhost on port 110 is very very slow. Which part of it exactly is slow? For example in a typical pop3 connection you have: Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. user xyz +OK pass asd +OK Logged in. Like is it hanging after "Trying", "Connected", "pass", .. ?

2 1

[Dovecot] dovecot v 1.1.11 3 part cert from godaddy problems.
by Terry Moore 01 May '09

01 May '09

Problem, Unable to identifie smtp.solutions.com as a trusted site. with thunderbird, and MS outbreak is failing too. server works great with the dialog box being clicked over and over. part of the info in the cert. Object Identifier (2 5 4 5 ) = 07969287 CN = Go Daddy Secure Certification Authority OU = http://certificates.godaddy.com/repository O = GoDaddy.com, Inc. L = Scottsdale ST = Arizona C = US dovecot.conf ssl_cert_file = /NFS/exim/new.pem ssl_key_file = /NFS/exim/smtp.solutions.com.key { created the req for cert with this key on this server } inside the new.pem smtp.solutions.com.crt ( paid $29 for this ) gd-class2-root.crt gd_intermediate.crt I have tried many tests about 5 hours worth using the ssl_ca_file and pointing it to different files I have from godaddy. and various combinations of things I found on the net. can anybody provide a cookie cutter here do this: with a godaddy $29 dollar ssl cert.. to get this dovecot server running.. { by the way I have great luck in apache with these things.. } thanks in advance Terry

2 2

[Dovecot] Timeout leak with dovecot version dovecot1.2(8985:f43bebab3dac)
by jsiegle＠psu.edu 01 May '09

01 May '09

This is 64bit AIX 5.3. Looking through previous versions of dovecot, I see this warning. I didn't realize this was something bad until today. My environment uses mbox/mbox-snarf plugin. The message in the logs is: local0.log.20090429:Apr 29 12:41:16 hostname dovecot: IMAP(jsiegle): Timeout leak: 1100054c0 In dbx(the AIX debugger) I see: $ dbx imap Type 'help' for help. reading symbolic information ... (dbx) gotoi 0x1100054c0 Goto address is not within current function or block. (set $unsafegoto to override) (dbx) set $unsafegoto (dbx) gotoi 0x1100054c0 stopped in cmd-append. at 0x1100054c0 0x1100054c0 (???) 00000001 Invalid opcode. (dbx) where cmd-append.() at 0x1100054c0 If you need more info, don't hesitate to ask. Thanks, Jonathan

3 6

[Dovecot] fts-solr plugin issue (Marked invalid)
by Nikolai Derzhak 01 May '09

01 May '09

Hi. We user ftp-solr plugin and have problem with solr-1.3+ with HTMLStripWhitespaceTokenizerFactory (Solr schema in attachments). In some maildir's present messages with wrong "Content-Type: " fields in attachments. For example: " Content-Type: TEXT/mspowerpoint; name="Zapatec_6zap_netvibes_1.ppt" " Indexing for this messages is stop with "fts_solr: Indexing failed: 500 Internal Server Error". In solr log is: " SEVERE: java.io.IOException: Mark invalid at java.io.BufferedReader.reset(BufferedReader.java:485) " (mail list with discussion: http://markmail.org/message/2fnfiwygvehjngyr#query:SEVERE%3A%20java.io.IOEx…) Look's like dovecot try to index attachments like this. Also for some messages we have same error. Dovecot stop indexing of box and each search we have lag and CPU load on server. So we need to make dovecot more "stable" to this error. For first time , will be good, just ignore problematic messages with error from solr. Let's discuss this issue, because this is general problem. We ready to explore code where needed , etc. Regards, Nikolai Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0

[Dovecot] (no subject)
by Nikolai Derzhak 01 May '09

01 May '09

Hi. We user ftp-solr plugin and have problem with solr-1.3+ with HTMLStripWhitespaceTokenizerFactory (Solr schema in attachments). In some maildir's present messages with wrong "Content-Type: " fields in attachments. For example: " Content-Type: TEXT/mspowerpoint; name="Zapatec_6zap_netvibes_1.ppt" " Indexing for this messages is stop with "fts_solr: Indexing failed: 500 Internal Server Error". In solr log is: " SEVERE: java.io.IOException: Mark invalid at java.io.BufferedReader.reset(BufferedReader.java:485) " (mail list with discussion: http://markmail.org/message/2fnfiwygvehjngyr#query:SEVERE%3A%20java.io.IOEx…) Look's like dovecot try to index attachments like this. Also for some messages we have same error. Dovecot stop indexing of box and each search we have lag and CPU load on server. So we need to make dovecot more "stable" to this error. For first time , will be good, just ignore problematic messages with error from solr. Let's discuss this issue, because this is general problem. We ready to explore code where needed , etc. Regards, Nikolai Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0

Re: [Dovecot] How do I get my mail from fetchmail into dovecot?
by Michael Steinbeck-Reeves 01 May '09

01 May '09

> Message: 1 > Date: Thu, 30 Apr 2009 00:27:46 +0200 > From: Andreas Ntaflos <daff(a)dword.org> > Subject: Re: [Dovecot] How do I get my mail from fetchmail into > dovecot? > > I have dovecot (with squirrel mail etc.) running without any problems > > but cannot understand how to get e-mail from a pop server into > > dovecot. I have fetchmail configured to pick up the mail from the > > pop3 server but don't understand how to get it from there into my > > dovecot mbox structure. > > My advice: forget Fetchmail and use Getmail [1] instead. Getmail does > everything Fetchmail does, only better. The documentation is excellent, > the author (and mailinglist) very responsive should you run into > problems you can't seem to solve on your own and I believe there exist > a number of HOWTOs on how to setup Getmail with Dovecot. Not that it's > very difficult, though. Thanks, I have changed over and your diagrams made it much more obvious what is actually going on. > I myself have such a "mail hamster" setup running just fine, which I > mentioned a few weeks ago on this list [2]. You might find that post > helpful. > > The general idea is to use Getmail to poll the remote mail servers (I > poll two POP servers and three IMAP-SSL servers), retrieve messages, > optionally scan them for viruses and spam and then hand them over to > your local Dovecot server using Dovecot's LDA "deliver". See [3] for a > nice picture :) If you skip virus and spam scanning the configuration > for a single remote IMAP server boils down to: > > ~/.getmail/remote_imap_server.rc: > > [options] > verbose = 0 > read_all = false > > [retriever] > type = SimpleIMAPSSLRetriever > server = address_of_remote_imap_server > username = username_on_remote_server > password = password_on_remote_server > > [destination] > type = MDA_external > path = /usr/local/libexec/dovecot/deliver > > The destination part tells getmail to call the "deliver" program > (without any commandline options) with the retrieved message. Dovecot > then does the rest. That seems simple - thanks. Do I just put a list of retrievers, one after the other with a single destination following that and let dovecot sort out the destinations? The only thing I don't understand and can't find/understand in the documentation is how to tell the LDA where to put my e-mails. I have mails to several addresses mixed up in several POP3 boxes and need to sort them out and deliver them based on the target address. e.g. michael@domain1 and michael@domain2 go to my box etc. I can't see where I identify the addresses and allocate the appropriate storage area. Thanks, Michael

3 4

[Dovecot] core dumps disabled?
by Ralf Hildebrandt 01 May '09

01 May '09

Apr 30 18:12:48 postamt dovecot: dovecot v1.1.14 starting up (core dumps disabled) Uh, how do I enable them? -- Ralf Hildebrandt Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.computerbeschimpfung.de #!/bin/sh cat <<EOF | dc -e "[lila/sulila%Plusili0<y]sy?si256salyx" 403736150440747681954588245935305944858835839713675044439128476844672\ 007875165788798502153167817380873133828163530564 EOF

4 4

[Dovecot] Installed include files
by Timo Sirainen 01 May '09

01 May '09

Currently when using configure --enable-header-install and doing make install the include files get installed to their own subdirectories, like: /usr/local/include/dovecot/src/lib/ /usr/local/include/dovecot/src/lib-mail/ ..etc.. But using that is kind of annoying, because you have to give -I paths to all of them with their full directories. The worst thing about that is that it requires having some kind of a --with-dovecot=path configure parameter. It would be nice if you could simply do: CPPFLAGS=-I/usr/local/include/dovecot ./configure Just like for any other include option. But that's not really possible. One possible way to fix it would be to just install all the .h files to a single directory, /usr/local/include/dovecot/ and make sure there aren't any conflicts (there currently are a few). But whis would make it more difficult to find out what files are related. Another possibility would be to put the subdir paths to all #include lines. Such as #include "lib-mail/mail-types.h" instead of just #include "mail-types.h". This seems kind of annoying to use, but would it be clearer? I'm not really sure. Anyone have any thoughts?

1 0

[Dovecot] Case sensitive oddity when mail delivered.
by dovecot＠corwyn.net 01 May '09

01 May '09

Currently running Postfix/Dovecot1.1.8 with mysql storing the user data and delivering to folders as determined by dovecot using dovecot's "deliver" as defined in postfix's master.cf Mail location is determined by mail_location = maildir:/var/spool/mail/%d/%n/Maildir If I have an account user1(a)example.com it works just fine. However, when mail is sent to USER1(a)EXAMPLE.COM it also delivers, but ends up creating a new file structure so I end up with /var/spool/mail/example.com/user1 (with lower case mail in it) and /var/spool/mail/EXAMPLE.COM/USER1 (with uppercase mail in it) which is decidedly not good. Looks to me like wherever %d and %n are pulled from is pulled out of the email, but not lower-cased. Any ideas where I would look to change this value before the email is delivered to the mailbox? Thx. rick Rick Steeves http://www.sinister.net "Life is like a sausage: The more you pack into it, the longer it gets"

3 7

[Dovecot] How to call a script when an E-Mail will moved in a folder?
by Luca Bertoncello 30 Apr '09

30 Apr '09

Hi, list! I use Dovecot 1.1.14 at work. It is configured to manage IMAP and IMAPs. Exim is the MTA of the Network. Of course, I installed SpamAssassin and ClamAV to check all incoming E-Mails. An, of course, some E-Mail marked as Spam are Ham and some E-Mail marked as Ham are Spam... To teach SpamAssassin I create for every user two folder: "DochSpam" (for Spam E-Mails not marked) and "FalscheSpam" (for Ham E-Mails marked as Spam). Every hour a cronjob search for E-Mails in these folders and call sa-learn to teach SpamAssassin. All run perfectly, but I'd like to modify this method and call automatically the script when the user move an E-Mail to DochSpam or FalscheSpam. I searched in Google, but I cannot found any useful link... How can I trigger an action (script calling) based on event (E-Mail will be moved to a folder) in Dovecot? Thanks for your help! Luca Bertoncello (lucabert(a)lucabert.de)

4 3

[Dovecot] 1 Dovecot proxy to 2 real IMAP servers
by Proskurin Kirill 30 Apr '09

30 Apr '09

Hello all. I have 2 Dovecot IMAP servers with different mailboxes. What serves different email domains. I want to add one Dovecot Proxy server and make him understand based on user domain - were it need to transfer a connection. I use LDAP auth based on "mail" attribute. It is possible? P.S. Proxy documentation at dovecot.org not help at all and seems to not complited. :-( -- Best regards, Proskurin Kirill

3 4

Re: [Dovecot] Unexplainable problem with POP3 quotas
by Anton Dollmaier 30 Apr '09

30 Apr '09

> No, we don't. We use dovecot as POP/IMAP server, and let Postfix do the rest. How does Postfix deliver the mails? mailbox_command should be set to use deliver, not maildrop/procmail. > I see, but it seems like it is *another* solution rather than a > constraint. I just tested the quota-warning, with the dovecot-deliver-example. Exactly the same time as the mail exceeding the quota-percentage is delievered in the account, the quota-warning-message is generated and also delivered. > Anyway, we are neither sending an email nor using deliver. What we are > trying to do is to generate a message file that is injected into the > mailbox. But the script that should do that is never run by dovecot > :-( Try the injection using deliver, and use the "alternative script" from the wiki-page as quota_warning. I just tested it, works great. Also: when using dovecot-deliver, the maildir-indizes are being generated better and faster than with alternative MDAs. Best regards, Anton

1 0

[Dovecot] Unexplainable problem with POP3 quotas
by Marco Marongiu 30 Apr '09

30 Apr '09

Greetings * We are having a problem with POP3 quota warnings, and despite we dig into the documentation, mailing list archives, google... we didn't spot any light We are running a self-compiled dovecot 1.1.7. The user base is in a Postgres database. We'd like a quota warning message to be injected into the maildir at 80% and 95% of occupation reached. >From the logs, it looks like dovecot is correctly reading the quotas from the DB. Nevertheless, the warning message is never delivered. We tried many different configurations (e.g.: from using bytes instead of storage to change the quota configuration alltogether, I think we tried every single sensible, applicable solution that we could spot during our searches in the net). Currently, we have the following non-working one: root@mgo2-popimap-v01:/usr/local/dovecot/etc# ../sbin/dovecot -n # 1.1.7: /usr/local/dovecot_1.1.7/etc/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 16384). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Linux 2.6.24.5-smp i686 Slackware 11.0.0 base_dir: /var/run/dovecot/ protocols: imap pop3 listen(default): mgo2-popimap-v01:143 listen(imap): mgo2-popimap-v01:143 listen(pop3): mgo2-popimap-v01:110 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: POP/IMAP Server! login_max_processes_count: 4096 max_mail_processes: 8192 first_valid_uid: 4000 first_valid_gid: 4000 mail_location: maildir:%h/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle imap_client_workarounds(imap): outlook-idle imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v-%u pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf plugin: quota: maildir:User quota quota_rule: ?:storage=100M quota_warning: storage=95%% /usr/local/dovecot/bin/quota-warning.sh 95 %h %n %d quota_warning2: storage=80%% /usr/local/dovecot/bin/quota-warning.sh 80 %h %n %d root@mgo2-popimap-v01:/usr/local/dovecot/etc# grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = pgsql connect = host=172.30.213.10 dbname=postfix user=postfix password=_HIDDEN_PASSWORD_ default_pass_scheme = SHA1 password_query = SELECT username, password FROM postfix.accounts WHERE (username = '%u' OR username = '%u@_HIDDEN_DOMAIN_') AND ( user_status_id = 0 or user_status_id = 2 ); user_query = SELECT maildir AS home, uid, gid, '*:storage=' || max_quota || 'B' AS quota_rule FROM postfix.accounts WHERE (username = '%u' OR username = '%u@_HIDDEN_DOMAIN_') AND ( user_status_id = 2 OR user_status_id = 0 ) The log says: Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Loading modules from directory: /usr/local/dovecot/lib/dovecot/pop3 Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Module loaded: /usr/local/dovecot/lib/dovecot/pop3/lib10_quota_plugin.so Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Effective uid=10812, gid=5008 Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Quota root: name=User quota backend=maildir args= Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Quota rule: root=User quota mailbox=* bytes=104857600 (0%) messages=0 (0%) Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Quota warning: bytes=99614720 (95%) messages=0 (0%) command=/usr/local/dovecot/bin/quota-warning.sh 95 /mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_ rasrcbldg _HIDDEN_DOMAIN_ Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Quota warning: bytes=83886080 (80%) messages=0 (0%) command=/usr/local/dovecot/bin/quota-warning.sh 80 /mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_ rasrcbldg _HIDDEN_DOMAIN_ Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): maildir: data=/mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_/Maildir Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): maildir++: root=/mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_/Maildir, index=, control=, inbox=/mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_/Maildir Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: pop3-login: Login: user=<rasrcbldg@_HIDDEN_DOMAIN_>, method=PLAIN, rip=_HIDDEN_ADDRESS_, lip=192.168.207.16 Note that having this user's quota the same as the default quota is just an incident, if a user has a quota different from the default, the actual quota it is reported correctly in the logs. What are we doing wrong? Thanks for your help Kind Regards --Marco

1 1

Re: [Dovecot] How to call a script when an E-Mail will moved in a folder?
by Luca Bertoncello 30 Apr '09

30 Apr '09

Steffen Kaiser <skdovecot(a)smail.inf.fh-brs.de> schrieb: > Look at the antispam or pipe plugins of Dovecot. Hello! Thanks for your answer! Could you say me, where I can find this "pipe plugin"? Ich searched in Google, and I found many list messages about it, but no links to download it... Thanks Luca Bertoncello (lucabert(a)lucabert.de)

2 1

[Dovecot] Incorrect listing of shared mailbox names
by Markus Werner 30 Apr '09

30 Apr '09

After the LOGIN do STATUS "User/somemailbox": a0007 STATUS "INBOX/Rechnung" (UIDNEXT UIDVALIDITY UNSEEN RECENT) a0008 STATUS "User/lists(a)example.com/Announce" (UIDNEXT UIDVALIDITY UNSEEN RECENT) a0009 STATUS "User/system(a)example.com/INBOX-root" (UIDNEXT UIDVALIDITY UNSEEN RECENT) a0010 STATUS "User/test(a)example.com/Shared" (UIDNEXT UIDVALIDITY UNSEEN RECENT) a0011 STATUS "User/system(a)example.com/INBOX-mueller" (UIDNEXT UIDVALIDITY UNSEEN RECENT) * STATUS "INBOX/Rechnung" (RECENT 0 UIDNEXT 82 UIDVALIDITY 1225738300 UNSEEN 0) a0007 OK Status completed. * STATUS "User/lists(a)example.com/Announce" (RECENT 0 UIDNEXT 103 UIDVALIDITY 1240061761 UNSEEN 0) a0008 OK Status completed. * STATUS "User/system(a)example.com/INBOX-root" (RECENT 0 UIDNEXT 4 UIDVALIDITY 1240060869 UNSEEN 0) a0009 OK Status completed. * STATUS "User/test(a)example.com/Shared" (RECENT 0 UIDNEXT 3 UIDVALIDITY 1225742113 UNSEEN 0) a0010 OK Status completed. * STATUS "User/system(a)example.com/INBOX-mueller" (RECENT 0 UIDNEXT 80 UIDVALIDITY 1240060873 UNSEEN 0) a0011 OK Status completed. The first listing of "User/%" also lists the first folder of each user, which has been polled by STATUS before. This seems to occur one time (after the login) only. a0012 LIST "" "%" * LIST (\Noselect \HasChildren) "/" "User" * LIST (\HasChildren) "/" "INBOX" a0012 OK List completed. a0013 LIST "" "User" * LIST (\Noselect \HasNoChildren) "/" "User" * LIST (\Noselect \HasChildren) "/" "User" a0013 OK List completed. a0014 LIST "" "User/%" * LIST (\Noselect \HasChildren) "/" "User/Shared" * LIST (\Noselect \HasChildren) "/" "User/Announce" * LIST (\Noselect \HasChildren) "/" "User/INBOX-root" * LIST (\Noselect \HasChildren) "/" "User/test(a)example.com" * LIST (\Noselect \HasChildren) "/" "User/lists(a)example.com" * LIST (\Noselect \HasChildren) "/" "User/system(a)example.com" a0014 OK List completed. Used namespace configuration: namespace private { separator = / prefix = INBOX/ inbox = yes subscriptions = yes } namespace private { separator = / prefix = User/ location = maildir:/var/lib/dovecot/empty:CONTROL=~/Maildir/control/shared subscriptions = yes hidden = yes list = no } namespace shared { separator = / prefix = User/%%u/ location = maildir:%%h/Maildir:INDEX=~/Maildir/index/shared/%%u subscriptions = no list = yes }

2 2

[Dovecot] How do I get my mail from fetchmail into dovecot?
by Michael Steinbeck-Reeves 30 Apr '09

30 Apr '09

I have dovecot (with squirrel mail etc.) running without any problems but cannot understand how to get e-mail from a pop server into dovecot. I have fetchmail configured to pick up the mail from the pop3 server but don't understand how to get it from there into my dovecot mbox structure. New to mail servers! Thanks, Michael.

4 3

[Dovecot] Virtual plugin - [SERVERBUG] BUG: Unknown internal error
by Brandon Lamb 30 Apr '09

30 Apr '09

/etc/dovecot/virtual/Inbox2/dovecot-virtual * -Trash -Trash/* -Deleted* -Junk* inthread x-references2 x-mailbox INBOX Using php to connect o {host}virtual/Inbox2 gives me [SERVERBUG] BUG: Unknown internal error. If I connect to virtual/Allmail which has "all" instead of the inthread line it works.

4 5

[Dovecot] [PATCH] Clarify rawlog example
by Matthijs Kooijman 29 Apr '09

29 Apr '09

# HG changeset patch # User matthijs(a)stdin.nl # Date 1240845142 -7200 # Branch HEAD # Node ID 19f4b6167b426c36b7b3b38db4397f2723dc75c2 # Parent c8de2237478fc01ee46e6ec8cda41e8d3cecb68c Clarify rawlog example. diff -r c8de2237478f -r 19f4b6167b42 dovecot-example.conf --- a/dovecot-example.conf Thu Apr 23 12:01:40 2009 -0400 +++ b/dovecot-example.conf Mon Apr 27 17:12:22 2009 +0200 @@ -543,6 +543,9 @@ # # This would write rawlogs into ~/dovecot.rawlog/ directory: # mail_executable = /usr/libexec/dovecot/rawlog /usr/libexec/dovecot/imap + # Note that this writes into the homedir of the logged in user and will only + # work if the ~/dovecot.rawlog directory already exists. + # <doc/wiki/Debugging/Rawlog> # # This would attach gdb into the imap process and write backtraces into # /tmp/gdbhelper.* files:

3 9

[Dovecot] Quota: ldap dict
by Marcio Merlone 29 Apr '09

29 Apr '09

Hi, I have set a dovecot-1:1.0.10-1ubuntu5.1 server on top of a Ubuntu 8.04 LTS box and everything goes fine. All my users are on a LDAP database integrated via nss_ldap, so from the dovecot point of view they are all local system users. Now I want to set maildir quota for everybody, and was wondering if I could store quota limits per user on LDAP. As I read on http://wiki.dovecot.org/Quota/Dict, there seem to be no way to do that, am I right? It is ok for me to manage the current usage on Maildir++, but would like to retrieve the quota information from the LDAP server. What do you guys recommend? Thanks in advance for any hint or rtfm. Best regards. -- Marcio Merlone

2 3

[Dovecot] Dovecot v2.0 hg tree
by Timo Sirainen 29 Apr '09

29 Apr '09

http://hg.dovecot.org/dovecot-2.0/ I just did the initial commit for master process rewrite, which marks the beginning of Dovecot v2.0. Several things are still missing/broken, but at least I was just able to successfully log in using imap :) I left v1.3 hg tree there for now, but once v2.0 tree is fully usable I'll just delete the v1.3 tree. Note the new dovecot-master-example.conf, which you'll need to !include to get the services running. Some settings have also been removed because they're now more generically set in the dovecot-master.conf. I'm thinking that perhaps the config process could still be run in compatibility mode where it's able to use an existing v1.x dovecot.conf and translate the old settings to new settings.

5 6

[Dovecot] Slow connections with POP3 service
by V S Rao 29 Apr '09

29 Apr '09

Hi All, I am facing a very strange issue with the pop3 server for the past one week. I run my mail service using sendmail & use UW-IMAP for POP3 & IMAP service. We have around 5000 users. Suddenly for the past one week I am facing very slow connections for POP3 alone on that server. Other services such as SMTP, IMAP, telnet, ssh etc work fine. Assuming that UW-IMAP may have an issue, I download the latest dovecot, compiled it and installed it. This also gives the same issue. I do not any firewall issues nor iptables is enabled. I have checked on the network to ensure that I do not have any kind of virus or DoS attacks using an IDS. I am unable to see any 'Strange' messages in /var/log/messages or maillog. What is strange is that it works one day without any issues and the next day the problem persists. Even a telnet to localhost on port 110 is very very slow. Can someone help with any ideas on how to troubleshoot? This is our production box. Thanks V S Rao

2 1

[Dovecot] Virtual plugin, timeout leaks
by Brandon Lamb 29 Apr '09

29 Apr '09

Getting these Warning: imap <brandonl(a)pacwebdev.com>: Timeout leak: 0x461bd0 /etc/dovecot/virtual/Allmail/dovecot-virtual * -Trash -Trash/* all /etc/dovecot/virtual/INBOX/dovecot-virtual virtual/Allmail inthread x-references2 x-mailbox INBOX /etc/dovecot/dovecot.conf namespace private { prefix = "" separator = / list = yes hidden = yes } namespace private { prefix = virtual/ separator = / list = no hidden = yes inbox = yes location = virtual:/etc/dovecot/virtual:INDEX=~/dovecot-index } namespace private { prefix = RealMails/ separator = / list = no hidden = yes }

2 1

[Dovecot] Links on MainConfig wiki page not working
by Matthijs Kooijman 29 Apr '09

29 Apr '09

Hi all, while looking through the wiki page MainConfig, I noticed a lot of wannabe-links, for example: <doc/wiki/SSL> This looks like it should have been converted to a wiki link automatically, but apparently isn't. Would be good to have this fixed? Gr. Matthijs

2 1

[Dovecot] Quota/Dict Postgres Trigger
by Warren Volz 29 Apr '09

29 Apr '09

I posted the trigger for v1.1 versions of Dovecot on the Wiki (http://wiki.dovecot.org/Quota/Dict ) and while I understand the comment posted about two process inserting at the same time, I'm not sure I understand how this is fixed in v1.2 other than via the revised trigger in the Wiki. Does someone have a known working trigger that will handle a double insert correctly? Also, out of curiosity why wasn't the code for dict written to do an update first and then an insert if this failed? That would eliminate the need for this trigger. Thanks. -Warren

3 2

[Dovecot] Mail statistics
by Timo Sirainen 29 Apr '09

29 Apr '09

I just committed a mail statistics gathering patch to v1.2: http://hg.dovecot.org/dovecot-1.2/rev/fdaf0bda70d5 It keeps track of: struct mail_private { .. /* open(), stat(), .. */ unsigned long stats_dentry_lookup_count; /* fstat() mostly */ unsigned long stats_attr_lookup_count; /* number of files we've opened and read */ unsigned long stats_files_read_count; /* number of bytes we've had to read from files */ unsigned long long stats_files_read_bytes; /* number of cache lookup hits */ unsigned long stats_cache_hit_count; So it's possible to write a plugin that does whatever with those values. You can get them per-command or even per-single-mail-access. Any thoughts on if those are good variables? Like would it be useful to split dentry lookups to opens and stats?

1 0

[Dovecot] Virtual mailbox plugin, 4 days of struggling
by Brandon Lamb 28 Apr '09

28 Apr '09

Hello, I finally got an INBOX to work, but is virtual mailbox plugin only meant to create a virtual inbox, or should I be able to have an Allmails virtual folder that is viewable in my imap client? if ~/virtual/ is my location, would I create an Allmails directory in the virtual/ or virtual/INBOX/Allmails. Im fairly confused on how this is suppose to work. I was trying to duplicate the gmail-like setup on the wiki but I cant get it work. Per the wiki, i put in the userdb inbox select, but made swapped pop3 for imap zeus:/etc/dovecot# dovecot -n # 1.2.rc3: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-1-amd64 x86_64 Debian squeeze/sid base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 lda listen: 208.200.251.181 ssl: no disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: Hello there. login_log_format_elements: <%u> <%r> login_log_format: %s login_process_per_connection: no login_process_size: 128 login_processes_count: 4 login_max_processes_count: 20 login_max_connections: 128 mail_max_userip_connections(default): 15 mail_max_userip_connections(imap): 15 mail_max_userip_connections(pop3): 1 verbose_proctitle: yes first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 8 last_valid_gid: 8 mail_access_groups: mail mail_privileged_group: mail mail_uid: 8 mail_gid: 8 mail_location: maildir:~/:INDEX=dovecot-index mailbox_idle_check_interval: 60 mail_debug: yes fsync_disable: yes mailbox_list_index_disable: no mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota virtual autocreate mail_plugins(imap): quota imap_quota virtual autocreate mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_log_prefix: %Ls <%u>: imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_logout_format(default): top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_logout_format(imap): top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_logout_format(pop3): retr=%r/%b, del=%d/%m, size=%s namespace: type: private separator: / hidden: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: virtual/ location: virtual:~/virtual:INDEX=~/dovecot-index list: yes subscriptions: yes namespace: type: private separator: / prefix: RealMails/ hidden: yes list: no subscriptions: yes auth default: mechanisms: plain login default_realm: pacwebdev.com cache_ttl: 60 debug: yes worker_max_count: 60 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 438 user: mail group: mail master: path: /var/run/dovecot/auth-master mode: 438 user: mail group: mail plugin: quota: maildir quota_rule: Trash:ignore quota_rule2: Sent:ignore quota_rule3: Spam:ignore quota_rule4: Archive:ignore quota_rule5: Sent Items:ignore quota_rule6: Deleted Items:ignore quota_warning: storage=95%% /etc/dovecot/quota-warning.sh 95 quota_warning2: storage=80%% /etc/dovecot/quota-warning.sh 80 autocreate: Trash autocreate2: Spam autosubscribe: Trash autosubscribe2: Spam auth_socket_path: /var/run/dovecot/auth-master

2 4

[Dovecot] Error in IMAP command UID: Unknown thread algorithm.
by Ralf Hildebrandt 28 Apr '09

28 Apr '09

Our Squirrelmail offers "Thread based sorting". Now, I have one user, where the activation of thread sorting results in: FEHLER: Falsche oder ungültige Anfrage. Anfrage: THREAD ORDEREDSUBJECT ISO-8859-1 ALL Server antwortete: Error in IMAP command UID: Unknown thread algorithm. Why is that? -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12200 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 Ralf.Hildebrandt(a)charite.de | http://www.charite.de

2 1

[Dovecot] [Fwd: Re: [Pine-info] "incomplete SecBuffer exceeds maximum buffer size" ?]
by Stewart Dean 27 Apr '09

27 Apr '09

Forgive me if I've been asleep at the switch on the SSL problem and it's already been figured out, but....could this be what the prob is? -------- Original Message -------- Subject: Re: [Pine-info] "incomplete SecBuffer exceeds maximum buffer size" ? Date: Mon, 27 Apr 2009 09:47:04 -0700 (PDT) From: Steve Hubert <hubert(a)washington.edu> Organization: Univ of Washington; UW Technology; Seattle To: Pine Forum <pine-info(a)u.washington.edu> References: <Pine.WNT.4.64.0904261823300.-1877079@zuluone> There is a feature called quell-ssl-largeblocks that addresses this. In alpine it is called "Prevent SSL Largeblocks". The help text in alpine says FEATURE: Prevent SSL Largeblocks PC-Alpine only. This feature changes the behavior of fetching messages and attachments so that the message data is fetched in chunks no larger than 12K bytes. This works around a bug in Microsoft's SSL/TLS support. Some versions of Microsoft SSL are not able to read full-sized (16K) SSL/TLS packets. Some servers will send such packets and this will cause PC-Alpine to crash with the error incomplete SecBuffer exceeds maximum buffer size Microsoft is aware of the problem and has developed a hotfix for it, it is discussed in article 300562 in the Microsoft Knowledge Base. _______________________________________________ Pine-info mailing list Pine-info(a)u.washington.edu http://mailman1.u.washington.edu/mailman/listinfo/pine-info -- ==== Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows.... ==== Stewart Dean, Unix System Admin, Bard College, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

1 0

[Dovecot] Log File per Domain
by Darvin Denmian 27 Apr '09

27 Apr '09

Hello list, i need to know if is possible to create a log file per domain, like: /home/vmail/%d/maillog i'm thinking use : log_path = /home/vmail/%d/maillog , this will work? Thanks !!

4 4

[Dovecot] Testing HEAD
by Odhiambo ワシントン 27 Apr '09

27 Apr '09

I have successfully compiled HEAD on FreeBSD-7 and I hope I am not doing anything weird. ./configure \ --cache-file=../cache_file \ --prefix=/opt/dovecot2 \ --with-ioloop=kqueue \ --with-notify=kqueue \ --with-sql=yes \ --with-mysql \ --with-zlib \ --with-bzlib \ --with-ssl=openssl \ --with-sql-drivers FreeBSD-7# pwd /opt/dovecot2 FreeBSD-7# ls -al sbin/dovecot* -rwxr-xr-x 1 root wheel 132924 Apr 27 16:59 sbin/dovecot -rwxr-xr-x 1 root wheel 100452 Apr 27 16:59 sbin/dovecotpw FreeBSD-7# ./sbin/dovecot -n dovecot: illegal option -- n Usage: dovecot [-F] [-c <config file>] [-p] [-n] [-a] [-cb <config binary path>] [--version] [--build-options] FreeBSD-7# ./bin/doveconf doveconf: Fatal: Error in configuration file /opt/dovecot2/etc/dovecot.conf line 1048: Unknown setting: user PS: This is the default config it shipped with. Nothing changed so far. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ "Clothes make the man. Naked people have little or no influence on society." -- Mark Twain

2 1

[Dovecot] Compiling dovecot-sieve-1.1.6 against dovecot-1.1.14
by Bruce Bodger 26 Apr '09

26 Apr '09

When attempting to compile dovecot-sieve-1.1.6 against dovecot-1.1.14 using the following command line to config... G520X2:~/Temp/dovecot-sieve-1.1.6 root# ./configure --with-dovecot=../ dovecot-1.1.14 make fails with the following... G520X2:~/Temp/dovecot-sieve-1.1.6 root# make make all-recursive Making all in src Making all in libsieve /bin/sh ../../libtool --tag=CC --mode=link gcc -std=gnu99 -g -O2 - Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith - Wchar-subscripts -Wformat=2 -Wbad-function-cast -DENABLE_REGEX -o sievec sievec.o map.o imparse.o libsieve.la /Users/BB/Temp/ dovecot-1.1.14/src/lib/liblib.a gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing- declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad- function-cast -DENABLE_REGEX -o sievec sievec.o map.o imparse.o ./.libs/libsieve.a /Users/BB/Temp/dovecot-1.1.14/src/lib/ liblib.a ld: Undefined symbols: _printf$LDBLStub _snprintf$LDBLStub _sprintf$LDBLStub _fprintf$LDBLStub make[3]: *** [sievec] Error 1 make[2]: *** [all-recursive] Error 1 make[1]: *** [all-recursive] Error 1 make: *** [all] Error 2 This is the top of config.log. Please let me know if you'd like to see any additional information. hostname = G520X2.xxxxxx.COM uname -m = Power Macintosh uname -r = 8.11.0 uname -s = Darwin uname -v = Darwin Kernel Version 8.11.0: Wed Oct 10 18:26:00 PDT 2007; root:xnu-792.24.17~1/RELEASE_PPC /usr/bin/uname -p = powerpc /bin/uname -X = unknown /bin/arch = unknown /usr/bin/arch -k = unknown /usr/convex/getsysinfo = unknown /usr/bin/hostinfo = Mach kernel version: Darwin Kernel Version 8.11.0: Wed Oct 10 18:26:00 PDT 2007; root:xnu-792.24.17~1/RELEASE_PPC Kernel configured for up to 2 processors. 2 processors are physically available. Processor type: ppc970 (PowerPC 970) Processors active: 0 1 Primary memory available: 5.00 gigabytes Thank you, B. Bodger

1 0

[Dovecot] Non-atomic Flags in APPEND
by Richard Laager 26 Apr '09

26 Apr '09

I'm using Evolution and Dovecot (on the localhost) and receiving these errors trying to move a message into the IMAP folder: C00095 APPEND INBOX (\Answered \Seen NotJunk "Junk" "NotJunk" "receipt-handled") {1022} C00095 BAD Error in IMAP command APPEND: Flags list contains non-atoms. Is this a Dovecot or Evolution bug? Thanks, Richard $ dovecot -n # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-11-generic i686 Ubuntu 9.04 log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: mbox:~/Private/mail auth default: passdb: driver: pam userdb: driver: passwd

3 2

[Dovecot] Dovecot auth user lookup patch for maildrop
by mr.maX 26 Apr '09

26 Apr '09

Hi, recently I started using maildrop as a MDA doing lightweight filtering in a Postfix/Dovecot mail server combo. Only thing missing was the fact that maildrop couldn't perform user lookups against a user database that was already being served by Dovecot (for smtp auth in Postfix and for imap access obviously) in order to easily determinate proper mailbox location and home directory of my "virtual" users when delivering e-mails. I wanted to avoid having another authentication daemon running (Courier Authlib) that would be serving this data to maildrop, so I've spent some time to write an extension for maildrop that would allow it to do user lookups directly against Dovecot in a similar way how they are done by Dovecot's LDA deliver. For everyone that are using maildrop in a similar setup that may be interested in this extension, a patch against maildrop version 2.0.4 can be downloaded from the following location: http://www.max.rs/ozone/maildrop-2.0.4-dovecotauth.patch.txt When this patch is applied, maildrop will be extended with another command line option "-t", which can be used to specify the location of Dovecot's master auth socket that will be used when performing user lookups. There's a readme file (README.dovecotauth) together with patch with a little bit more information regarding the use of this extension. I hope that some of you may find my modification to maildrop useful. -- Best Regards, Marko Njezic - mr.maX @ MAX Interactive corp. Personal: http://www.markonjezic.com/ MAX's Empire: http://www.maxempire.com/ MAX's HTML Beauty++ 2004: http://www.htmlbeauty.com/

3 3

[Dovecot] Why not just ignore sieve include error and continue read and execute the rest of sieve rules?
by Zhang Huangbin 25 Apr '09

25 Apr '09

Hi, all. I use a global sieve script and include user's personal sieve script in it, but it doesn't run while user's sieve script not exist. Why not just ignore this error and continue read and execute the rest of sieve rules? My global script: ---- require ["include"]; include :personal ".dovecot.sieve"; ---- Sieve log while user's personal sieve script doesn't exist: ---- Info: Loading modules from directory: /usr/lib64/dovecot/lda Info: Module loaded: /usr/lib64/dovecot/lda/lib10_quota_plugin.so Info: Module loaded: /usr/lib64/dovecot/lda/lib90_cmusieve_plugin.so Info: auth input: home=/home/vmail/a.cn/www/ Info: auth input: quota_rule=*:bytes=104857600 Info: auth input: sieve_dir=/home/vmail/sieve/a.cn/www/ Info: Quota root: name= backend=maildir args= Info: Quota rule: root= mailbox=* bytes=104857600 messages=0 Info: maildir: data=//home/vmail/a.cn/www//:INDEX=//home/vmail/a.cn/www// Info: maildir++: root=//home/vmail/a.cn/www/, index=, control=, inbox=//home/vmail/a.cn/www/ Info: cmusieve: /home/vmail/a.cn/www//.dovecot.sieve doesn't exist Info: cmusieve: Using sieve path: /home/vmail/.dovecot.sieve Info: cmusieve: Executing script /home/vmail/.dovecot.sievec Info: cmusieve: Script not found: /home/vmail/sieve/a.cn/www//.dovecot.sieve Info: include: Script not found: '.dovecot.sieve' Info: sieve runtime error: Include can not find script Error: sieve_execute_bytecode(/home/vmail/.dovecot.sievec) failed Info: msgid=<49F117C9.8020505(a)b.cn>: saved mail to INBOX ---- -- Best regards. Zhang Huangbin - Open Source Mail Server Solution for RHEL/CentOS 5.x: http://code.google.com/p/iredmail/

2 1

[Dovecot] uidvalidity file
by Jeff Grossman 24 Apr '09

24 Apr '09

Should I be considered with this log entry? rename(/home/vmail/jeff/dovecot-uidvalidity, /home/vmail/jeff/dovecot-uidvalidity) failed: No such file or directory

2 2

[Dovecot] Virtual mailboxes, howto, examples, help? =)
by Brandon Lamb 24 Apr '09

24 Apr '09

Using 1.2rc3 maildir format maildir /mail/example.com/j/johndoe/{cur,new,tmp} Is there more documentation and examples on how to configure virtual mailboxes, or maybe more info on what it is suppose to do? From what I could understand on the wiki, i could create a fake/virtual folder under /mail/example.com/j/johndoe/virtual/allmail/ and inside that dir create dovecot-virtual with INBOX all And then in my mail client i would see virtual/allmail and when i click that folder it shows me mail from all my normal maildir folders? Is my thinking of how to use virtual mailboxes totally off, or am I trying to use it for what it is suppose to be used for? So far i have been messing with various values = yes/no using the following namespace private { prefix = virtual/ separator = / # location = virtual:~/virtual location = virtual:~/virtual:LAYOUT=maildir++ list = yes inbox = no subscriptions = yes hidden = no } # The default namespace that is visible to IMAP clients namespace private { prefix = separator = / location = maildir:~/ list = yes inbox = yes subscriptions = yes hidden = no } I dont know if I am retarded in my lack of ability to figure this out or what

1 0

[Dovecot] dovecot 1.2 ubuntu horde xi.rename-it.nl
by Robert Schetterer 24 Apr '09

24 Apr '09

Hi, i used to use http://xi.rename-it.nl/debian/ experimental-auto main to update dovecot 1.2 with ubuntu horde didnt done for a time now i get broken deps with apt like -- dovecot-common: Hängt ab: libgssapi-krb5-2 (>= 1.6.dfsg.2) ist aber nicht installierbar Hängt ab: libk5crypto3 (>= 1.6.dfsg.2) ist aber nicht installierbar Hängt ab: libkrb5-3 (>= 1.6.dfsg.2) ist aber nicht installierbar --- ( sorry german *g ) i updated libkrb53 from jaunty but this doesnt fix it any idea what to upgrade to get dovecot 1.2 updated again its a test server so i am free for unstable packs etc no pruduction services running -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

4 8

[Dovecot] Corrupted Index Cache
by Jeff Grossman 23 Apr '09

23 Apr '09

I am starting to use Squirrelmail a little bit more to read my mail during the day and I seem to be getting this error more frequently while using Squirrelmail. Just a coincidence or do you think using Squirrelmail might have something to do with it? Corrupted index cache file /home/vmail/jeff/dovecot.index.cache: record points outside file I am using Squirrelmail, IMAPProxy, and Dovecot 1.2RC3. Here is a copy of my dovecot -n. # 1.2.rc3: /usr/local/etc/dovecot.conf # OS: Linux 2.6.29-1-amd64 x86_64 Debian squeeze/sid ext3 base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /etc/ssl/certs/stikman-godaddy.crt ssl_key_file: /etc/ssl/private/stikman-godaddy.key ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: maildir:/home/vmail/%u mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 auth default: mechanisms: plain login username_format: %Lu passdb: driver: pam userdb: driver: passwd args: uid=vmail gid=vmail home=/home/vmail/%u socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: sieve: sieve

1 0

[Dovecot] possible bug in lib-mail source
by Johann Klasek 23 Apr '09

23 Apr '09

Browsing through the source code to find some properties of deliver I stuck here: --- dovecot-1.2.rc3/src/lib-mail/message-header-parser.c.orig 2009-01-07 19:33:26.000000000 +0100 +++ dovecot-1.2.rc3/src/lib-mail/message-header-parser.c 2009-04-23 09:53:08.000000000 +0200 @@ -284,7 +284,7 @@ Exception to this is if the value consists only of LWSP, then skip only the one LWSP after ':'. */ for (pos = 0; pos < line->value_len; pos++) { - if (!IS_LWSP(line->value[0])) + if (!IS_LWSP(line->value[pos])) break; } I'm not clear if this was really indented but the for-loop does not use the variable pos in the loop body. The expression !IS_LWSP(line->value[0]) is invariant and always false if the first character after ':' is a white space, forcing the loop to go through the whole value. This happens only if flag MESSAGE_HEADER_PARSER_FLAG_SKIP_INITIAL_LWSP is active. I saw this in 1.1.4 too. Johann Klasek -- Johann E. Klasek Zentraler Informatikdienst - Kommunikation Technische Universität Wien Tel: +43 1 58801-42049 A-1040 Wien, Wiedner Hauptstr. 8-10/020C Fax: +43 1 58801-42099 http://pgpkeys.tuwien.ac.at/ PGP Key jklasek

2 1