- dovecot - dovecot.org

[Dovecot] fts-solr plugin issue (Marked invalid)
by Nikolai Derzhak 01 May '09

01 May '09

Hi. We user ftp-solr plugin and have problem with solr-1.3+ with HTMLStripWhitespaceTokenizerFactory (Solr schema in attachments). In some maildir's present messages with wrong "Content-Type: " fields in attachments. For example: " Content-Type: TEXT/mspowerpoint; name="Zapatec_6zap_netvibes_1.ppt" " Indexing for this messages is stop with "fts_solr: Indexing failed: 500 Internal Server Error". In solr log is: " SEVERE: java.io.IOException: Mark invalid at java.io.BufferedReader.reset(BufferedReader.java:485) " (mail list with discussion: http://markmail.org/message/2fnfiwygvehjngyr#query:SEVERE%3A%20java.io.IOEx…) Look's like dovecot try to index attachments like this. Also for some messages we have same error. Dovecot stop indexing of box and each search we have lag and CPU load on server. So we need to make dovecot more "stable" to this error. For first time , will be good, just ignore problematic messages with error from solr. Let's discuss this issue, because this is general problem. We ready to explore code where needed , etc. Regards, Nikolai Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0

[Dovecot] (no subject)
by Nikolai Derzhak 01 May '09

01 May '09

Hi. We user ftp-solr plugin and have problem with solr-1.3+ with HTMLStripWhitespaceTokenizerFactory (Solr schema in attachments). In some maildir's present messages with wrong "Content-Type: " fields in attachments. For example: " Content-Type: TEXT/mspowerpoint; name="Zapatec_6zap_netvibes_1.ppt" " Indexing for this messages is stop with "fts_solr: Indexing failed: 500 Internal Server Error". In solr log is: " SEVERE: java.io.IOException: Mark invalid at java.io.BufferedReader.reset(BufferedReader.java:485) " (mail list with discussion: http://markmail.org/message/2fnfiwygvehjngyr#query:SEVERE%3A%20java.io.IOEx…) Look's like dovecot try to index attachments like this. Also for some messages we have same error. Dovecot stop indexing of box and each search we have lag and CPU load on server. So we need to make dovecot more "stable" to this error. For first time , will be good, just ignore problematic messages with error from solr. Let's discuss this issue, because this is general problem. We ready to explore code where needed , etc. Regards, Nikolai Powered by the 6zap. Sign up at http://www.6zap.com for an account that provides advanced e-mail, calendar and contacts capabilities.

1 0

Re: [Dovecot] How do I get my mail from fetchmail into dovecot?
by Michael Steinbeck-Reeves 01 May '09

01 May '09

> Message: 1 > Date: Thu, 30 Apr 2009 00:27:46 +0200 > From: Andreas Ntaflos <daff(a)dword.org> > Subject: Re: [Dovecot] How do I get my mail from fetchmail into > dovecot? > > I have dovecot (with squirrel mail etc.) running without any problems > > but cannot understand how to get e-mail from a pop server into > > dovecot. I have fetchmail configured to pick up the mail from the > > pop3 server but don't understand how to get it from there into my > > dovecot mbox structure. > > My advice: forget Fetchmail and use Getmail [1] instead. Getmail does > everything Fetchmail does, only better. The documentation is excellent, > the author (and mailinglist) very responsive should you run into > problems you can't seem to solve on your own and I believe there exist > a number of HOWTOs on how to setup Getmail with Dovecot. Not that it's > very difficult, though. Thanks, I have changed over and your diagrams made it much more obvious what is actually going on. > I myself have such a "mail hamster" setup running just fine, which I > mentioned a few weeks ago on this list [2]. You might find that post > helpful. > > The general idea is to use Getmail to poll the remote mail servers (I > poll two POP servers and three IMAP-SSL servers), retrieve messages, > optionally scan them for viruses and spam and then hand them over to > your local Dovecot server using Dovecot's LDA "deliver". See [3] for a > nice picture :) If you skip virus and spam scanning the configuration > for a single remote IMAP server boils down to: > > ~/.getmail/remote_imap_server.rc: > > [options] > verbose = 0 > read_all = false > > [retriever] > type = SimpleIMAPSSLRetriever > server = address_of_remote_imap_server > username = username_on_remote_server > password = password_on_remote_server > > [destination] > type = MDA_external > path = /usr/local/libexec/dovecot/deliver > > The destination part tells getmail to call the "deliver" program > (without any commandline options) with the retrieved message. Dovecot > then does the rest. That seems simple - thanks. Do I just put a list of retrievers, one after the other with a single destination following that and let dovecot sort out the destinations? The only thing I don't understand and can't find/understand in the documentation is how to tell the LDA where to put my e-mails. I have mails to several addresses mixed up in several POP3 boxes and need to sort them out and deliver them based on the target address. e.g. michael@domain1 and michael@domain2 go to my box etc. I can't see where I identify the addresses and allocate the appropriate storage area. Thanks, Michael

3 4

[Dovecot] core dumps disabled?
by Ralf Hildebrandt 01 May '09

01 May '09

Apr 30 18:12:48 postamt dovecot: dovecot v1.1.14 starting up (core dumps disabled) Uh, how do I enable them? -- Ralf Hildebrandt Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.computerbeschimpfung.de #!/bin/sh cat <<EOF | dc -e "[lila/sulila%Plusili0<y]sy?si256salyx" 403736150440747681954588245935305944858835839713675044439128476844672\ 007875165788798502153167817380873133828163530564 EOF

4 4

[Dovecot] Installed include files
by Timo Sirainen 01 May '09

01 May '09

Currently when using configure --enable-header-install and doing make install the include files get installed to their own subdirectories, like: /usr/local/include/dovecot/src/lib/ /usr/local/include/dovecot/src/lib-mail/ ..etc.. But using that is kind of annoying, because you have to give -I paths to all of them with their full directories. The worst thing about that is that it requires having some kind of a --with-dovecot=path configure parameter. It would be nice if you could simply do: CPPFLAGS=-I/usr/local/include/dovecot ./configure Just like for any other include option. But that's not really possible. One possible way to fix it would be to just install all the .h files to a single directory, /usr/local/include/dovecot/ and make sure there aren't any conflicts (there currently are a few). But whis would make it more difficult to find out what files are related. Another possibility would be to put the subdir paths to all #include lines. Such as #include "lib-mail/mail-types.h" instead of just #include "mail-types.h". This seems kind of annoying to use, but would it be clearer? I'm not really sure. Anyone have any thoughts?

1 0

[Dovecot] Case sensitive oddity when mail delivered.
by dovecot＠corwyn.net 01 May '09

01 May '09

Currently running Postfix/Dovecot1.1.8 with mysql storing the user data and delivering to folders as determined by dovecot using dovecot's "deliver" as defined in postfix's master.cf Mail location is determined by mail_location = maildir:/var/spool/mail/%d/%n/Maildir If I have an account user1(a)example.com it works just fine. However, when mail is sent to USER1(a)EXAMPLE.COM it also delivers, but ends up creating a new file structure so I end up with /var/spool/mail/example.com/user1 (with lower case mail in it) and /var/spool/mail/EXAMPLE.COM/USER1 (with uppercase mail in it) which is decidedly not good. Looks to me like wherever %d and %n are pulled from is pulled out of the email, but not lower-cased. Any ideas where I would look to change this value before the email is delivered to the mailbox? Thx. rick Rick Steeves http://www.sinister.net "Life is like a sausage: The more you pack into it, the longer it gets"

3 7

[Dovecot] How to call a script when an E-Mail will moved in a folder?
by Luca Bertoncello 30 Apr '09

30 Apr '09

Hi, list! I use Dovecot 1.1.14 at work. It is configured to manage IMAP and IMAPs. Exim is the MTA of the Network. Of course, I installed SpamAssassin and ClamAV to check all incoming E-Mails. An, of course, some E-Mail marked as Spam are Ham and some E-Mail marked as Ham are Spam... To teach SpamAssassin I create for every user two folder: "DochSpam" (for Spam E-Mails not marked) and "FalscheSpam" (for Ham E-Mails marked as Spam). Every hour a cronjob search for E-Mails in these folders and call sa-learn to teach SpamAssassin. All run perfectly, but I'd like to modify this method and call automatically the script when the user move an E-Mail to DochSpam or FalscheSpam. I searched in Google, but I cannot found any useful link... How can I trigger an action (script calling) based on event (E-Mail will be moved to a folder) in Dovecot? Thanks for your help! Luca Bertoncello (lucabert(a)lucabert.de)

4 3

[Dovecot] 1 Dovecot proxy to 2 real IMAP servers
by Proskurin Kirill 30 Apr '09

30 Apr '09

Hello all. I have 2 Dovecot IMAP servers with different mailboxes. What serves different email domains. I want to add one Dovecot Proxy server and make him understand based on user domain - were it need to transfer a connection. I use LDAP auth based on "mail" attribute. It is possible? P.S. Proxy documentation at dovecot.org not help at all and seems to not complited. :-( -- Best regards, Proskurin Kirill

3 4

Re: [Dovecot] Unexplainable problem with POP3 quotas
by Anton Dollmaier 30 Apr '09

30 Apr '09

> No, we don't. We use dovecot as POP/IMAP server, and let Postfix do the rest. How does Postfix deliver the mails? mailbox_command should be set to use deliver, not maildrop/procmail. > I see, but it seems like it is *another* solution rather than a > constraint. I just tested the quota-warning, with the dovecot-deliver-example. Exactly the same time as the mail exceeding the quota-percentage is delievered in the account, the quota-warning-message is generated and also delivered. > Anyway, we are neither sending an email nor using deliver. What we are > trying to do is to generate a message file that is injected into the > mailbox. But the script that should do that is never run by dovecot > :-( Try the injection using deliver, and use the "alternative script" from the wiki-page as quota_warning. I just tested it, works great. Also: when using dovecot-deliver, the maildir-indizes are being generated better and faster than with alternative MDAs. Best regards, Anton

1 0

[Dovecot] Unexplainable problem with POP3 quotas
by Marco Marongiu 30 Apr '09

30 Apr '09

Greetings * We are having a problem with POP3 quota warnings, and despite we dig into the documentation, mailing list archives, google... we didn't spot any light We are running a self-compiled dovecot 1.1.7. The user base is in a Postgres database. We'd like a quota warning message to be injected into the maildir at 80% and 95% of occupation reached. >From the logs, it looks like dovecot is correctly reading the quotas from the DB. Nevertheless, the warning message is never delivered. We tried many different configurations (e.g.: from using bytes instead of storage to change the quota configuration alltogether, I think we tried every single sensible, applicable solution that we could spot during our searches in the net). Currently, we have the following non-working one: root@mgo2-popimap-v01:/usr/local/dovecot/etc# ../sbin/dovecot -n # 1.1.7: /usr/local/dovecot_1.1.7/etc/dovecot.conf Warning: fd limit 1024 is lower than what Dovecot can use under full load (more than 16384). Either grow the limit or change login_max_processes_count and max_mail_processes settings # OS: Linux 2.6.24.5-smp i686 Slackware 11.0.0 base_dir: /var/run/dovecot/ protocols: imap pop3 listen(default): mgo2-popimap-v01:143 listen(imap): mgo2-popimap-v01:143 listen(pop3): mgo2-popimap-v01:110 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: POP/IMAP Server! login_max_processes_count: 4096 max_mail_processes: 8192 first_valid_uid: 4000 first_valid_gid: 4000 mail_location: maildir:%h/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle imap_client_workarounds(imap): outlook-idle imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v-%u pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf plugin: quota: maildir:User quota quota_rule: ?:storage=100M quota_warning: storage=95%% /usr/local/dovecot/bin/quota-warning.sh 95 %h %n %d quota_warning2: storage=80%% /usr/local/dovecot/bin/quota-warning.sh 80 %h %n %d root@mgo2-popimap-v01:/usr/local/dovecot/etc# grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = pgsql connect = host=172.30.213.10 dbname=postfix user=postfix password=_HIDDEN_PASSWORD_ default_pass_scheme = SHA1 password_query = SELECT username, password FROM postfix.accounts WHERE (username = '%u' OR username = '%u@_HIDDEN_DOMAIN_') AND ( user_status_id = 0 or user_status_id = 2 ); user_query = SELECT maildir AS home, uid, gid, '*:storage=' || max_quota || 'B' AS quota_rule FROM postfix.accounts WHERE (username = '%u' OR username = '%u@_HIDDEN_DOMAIN_') AND ( user_status_id = 2 OR user_status_id = 0 ) The log says: Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Loading modules from directory: /usr/local/dovecot/lib/dovecot/pop3 Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Module loaded: /usr/local/dovecot/lib/dovecot/pop3/lib10_quota_plugin.so Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Effective uid=10812, gid=5008 Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Quota root: name=User quota backend=maildir args= Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Quota rule: root=User quota mailbox=* bytes=104857600 (0%) messages=0 (0%) Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Quota warning: bytes=99614720 (95%) messages=0 (0%) command=/usr/local/dovecot/bin/quota-warning.sh 95 /mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_ rasrcbldg _HIDDEN_DOMAIN_ Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): Quota warning: bytes=83886080 (80%) messages=0 (0%) command=/usr/local/dovecot/bin/quota-warning.sh 80 /mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_ rasrcbldg _HIDDEN_DOMAIN_ Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): maildir: data=/mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_/Maildir Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: POP3(rasrcbldg@_HIDDEN_DOMAIN_): maildir++: root=/mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_/Maildir, index=, control=, inbox=/mnt/maildir/_HIDDEN_DOMAIN_/USER/r/ra/rasrcbldg@_HIDDEN_DOMAIN_/Maildir Apr 28 10:32:13 mgo2-popimap-v01._HIDDEN_DOMAIN_ dovecot: pop3-login: Login: user=<rasrcbldg@_HIDDEN_DOMAIN_>, method=PLAIN, rip=_HIDDEN_ADDRESS_, lip=192.168.207.16 Note that having this user's quota the same as the default quota is just an incident, if a user has a quota different from the default, the actual quota it is reported correctly in the logs. What are we doing wrong? Thanks for your help Kind Regards --Marco

1 1