November 2011 - dovecot

[Dovecot] fts-lucene vs SEARCH header Re: 2.1: problems compiling fts-lucene - CLucene git version necessary?
by Lutz Preßler 05 Nov '11

05 Nov '11

On Tue, 20 Sep 2011, Lutz Preßler wrote: > On Mo, 19 Sep 2011, Timo Sirainen wrote: > > > On Sun, 2011-09-18 at 13:27 +0200, Lutz Preßler wrote: > > > Hello, > > > On So, 11 Sep 2011, Timo Sirainen wrote: > > > dovecot: imap(...): Error: fts_lucene: default_language set, but Dovecot built without stemmer support > > > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/02c84406c661 > Without stemmer support it works nicely now though. Next problem :-) side effect: my test setup (some commits ago) with fts = lucene in plugin section (ftps_lucene plugin without stemmer support): SEARCH header is not working (empty result sets, no logging). Tested in different circumstances (and also happening with virtual folders). Simply disable fts option (while module is still loaded) or use fts=sqat to have header search working correctly again. Lutz

2 1

[Dovecot] dovecot: 2011-11-04 16:58:01 Error: IMAP(<user>): FETCH for mailbox Trash UID 42022 got too little data: 90900 vs 1529791
by Noah 05 Nov '11

05 Nov '11

Hi there I keep getting the following errors scrolling in my dovecot logs. I am wondering how I can nail down what is creating that problem. dovecot: 2011-11-04 16:58:01 Error: IMAP(<usr>): FETCH for mailbox Trash UID 42022 got too little data: 90900 vs 1529791 also I have a trash folder with over 100k messages in mbox format. I am wondering if migrating to Maildir format would make it easier and quicker for dovecot to index my mail. I am getting these types of errors from time to time. dovecot: 2011-10-30 20:32:58 Error: IMAP(<user>): Timeout while waiting for lock for transaction log file /home/<user>/mail/.imap/INBOX/dovecot.index.log Cheers, Noah

2 1

[Dovecot] [PATCH] Use SSL_MODE_RELEASE_BUFFERS if available to keep memory usage low
by Cristian Rodríguez 05 Nov '11

05 Nov '11

# HG changeset patch # User Cristian Rodríguez <crrodriguez(a)opensuse.org> # Date 1318533592 10800 # Node ID c15d6befe20082009cb40926afa208ab4b684818 # Parent 962df5d9413a4a0fcc68aacc1df0dca7a44a0240 Use SSL_MODE_RELEASE_BUFFERS if available to keep memory usage low. diff -r 962df5d9413a -r c15d6befe200 src/login-common/ssl-proxy-openssl.c --- a/src/login-common/ssl-proxy-openssl.c Wed Oct 12 17:16:10 2011 +0300 +++ b/src/login-common/ssl-proxy-openssl.c Thu Oct 13 16:19:52 2011 -0300 @@ -925,6 +925,9 @@ STACK_OF(X509_NAME) *xnames = NULL; SSL_CTX_set_options(ssl_ctx, SSL_OP_ALL | SSL_OP_NO_SSLv2); +#ifdef SSL_MODE_RELEASE_BUFFERS + SSL_CTX_set_mode(ssl_ctx, SSL_MODE_RELEASE_BUFFERS); +#endif if (*set->ssl_ca != '\0') { /* set trusted CA certs */ store = SSL_CTX_get_cert_store(ssl_ctx);

2 1

Re: [Dovecot] lmtp performance
by Juan Carlos Sanchez 04 Nov '11

04 Nov '11

A particular reply (not to the list) has told me to try: " Add to service lmtp: process_min_avail = 20 " And yes, it works (unless for me), so I want to share it with everybody. Have not exactly measured performance but this morning have seen over 1400 messages/minute with lmtp under heavy load. What the "process_min_avail = 20" in service lmtp (or anywhere else) exactly imply? cannot find a reference in wiki2 . I suppose it means than 20 lmtp processes are always open waiting for new connections and so reducing startup latency, isn't it? Thank you. > > On Mon, Oct 17, 2011 at 6:06 AM, Juan Carlos Sanchez > <juancarlos.sanchez(a)upm.es <mailto:juancarlos.sanchez@upm.es>> wrote: > > Hello: > > In the process of migration from version 1.2 to 2.0 have tried to > use lmtp instead of lda as delivery agent. > > But unfortunately througput we get is poor with lmtp compared to lda. > In peak times with lda we are able to deliver over 1800 > messages/minute (high I/O but not affecting service) but if we > switch to lmtp cannot deliver more than 300 mess/minute (very low > I/O). > > This is enough for normal work but low under heavy load > (distribution lists messages sometimes stay queued for 4 hours > before deliver). > > We have arround 50000 boxes and use postfix as MTA > > How to increase lmtp performance? > > > dovecot config for lda and lmtp: > > protocol lda { > auth_socket_path = /usr/local/var/run/dovecot/auth-master > info_log_path = /var/log/mail/dovecot_deliver.log > log_path = /var/log/mail/dovecot_deliver.log > mail_plugins = quota sieve zlib > postmaster_address = postmaster(a)upm.es <mailto:postmaster@upm.es> > sendmail_path = /usr/lib/sendmail > } > > protocol lmtp { > info_log_path = /var/log/mail/dovecot_deliver.log > log_path = /var/log/mail/dovecot_deliver.log > mail_plugins = quota sieve zlib > postmaster_address = postmaster(a)upm.es <mailto:postmaster@upm.es> > sendmail_path = /usr/lib/sendmail > } > > In postfix I have: > > mailbox_transport = lmtp:unix:private/dovecot-lmtp > > > > Thanks in advance. > > -- > > ------------------------------------------------------ > Juan Carlos Sanchez Hernandez > Universidad Politecnica de Madrid > ------------------------------------------------------ > > > -- ------------------------------------------------------ Juan Carlos Sanchez Hernandez Universidad Politecnica de Madrid ------------------------------------------------------

3 2

[Dovecot] imap proxy for Gmail
by Jumping Mouse 04 Nov '11

04 Nov '11

Hello, b I have a situation were I want to be able to give teachers access to their Google apps for education email through Squirrelmail. The network that they are on blocks gmail. I am able to get Squirrelmail to communicate with Gmail via imap. I am looking at getting persistant imap connections to improve the user experience. I have looked at IMAPPROXY but this application is not compatible with the gmail imaps (ssl-encrypted imap over port 993). I recall reading somewhere that Dovecot has a built in imapproxy that could be used for this. Can someone please point me to documentation or other information on how I might achieve the above stated goal? Thanks, Kafriki

3 2

[Dovecot] Proxy and Virtual IMAP Folders
by Pedro Paixao 04 Nov '11

04 Nov '11

Hi all I am a newbie to dovecot and I would like some help clarifying a feature to determine if I can use it in my project. Is is posible to use the virtual plugin, in a IMAP proxy configuration, in a way that the virtual plugin searches messages on the real server? Here's my scenario: [Client]----[Dovecot Proxy]-----[Real Imap Server] Client connects to Dovecot Proxy and gets all the folders that are on the Real Imap Server, plus some virtual ones (generated by Dovecot Proxy) that search for messages on the real server. In my config the Dovecot Proxy has no email messages, real folders, or local delivery. I would like to thank you in advance for ant help and support. All the best Pedro

2 1

[Dovecot] doveadm segfaults on TCP connect - version 2.0.15
by ghandidrivesahumvee＠rocketfish.com 04 Nov '11

04 Nov '11

Hi list, I just recently installed Dovecot 2.0.15. Unfortunately, doveadm segfaults when I attempt to connect to the local dovecot instance. When this occurs, my logs show: 2011-10-19T12:31:23-07:00 mail02 dovecot: doveadm: Error: doveadm client not compatible with this server (mixed old and new binaries?) I am using the settings listed on the wiki page http://wiki2.dovecot.org/Director [root@mail02 ~]# /opt/dovecot/bin/doveadm who -a 10.10.5.220:544 Segmentation fault (core dumped) doveconf and gdb output are below. If there is any more information I can provide please let me know. Thanks! [root@mail02 ~]# /opt/dovecot/bin/doveconf -n # 2.0.15: /opt/dovecot-2.0.15/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.17.4.el5 x86_64 CentOS release 5.5 (Final) auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 60 default_client_limit = 2048 disable_plaintext_auth = no doveadm_proxy_port = 544 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 10.10.5.220, 127.0.0.1 lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_log_prefix = "%r mpid=%p %s(%u): " mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " notify mail_log" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes passdb { args = /opt/dovecot/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete expunge mailbox_delete mail_log_fields = msgid box from mail_log_group_events = yes sieve = ~/MainSieve sieve_before = /storage03/sieve/before/ sieve_dir = ~/sieve sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 2M } quota_full_tempfail = yes service anvil { client_limit = 2000 } service auth { client_limit = 7000 unix_listener /var/spool/postfix/private/auth { mode = 0600 user = postfix } unix_listener auth-userdb { group = mailowner mode = 0600 user = mailowner } } service doveadm { inet_listener { port = 544 } } service imap-login { inet_listener imap { port = 143 } process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service imap {%0

5 6

[Dovecot] Rewrite the ostream output method, to save messages in another directory.
by Alex Baule 04 Nov '11

04 Nov '11

Hi Timo, I Trying to integrate my antispam with dovecot, using the imap folder to do certain actions. I Do almost every thing, but i have some problems saving the message. Explaining this function, i try to use a imap folder like a "collector folder", the user append a message from outside (ie another imap or pop message) to this folder, and i don't want to copy this message, i need to redirect it to another folder outside from user's maildir. Well, i try to base it in zlib plugin, with was the o_stream_create_gz(). Inside the o_stream_create_gz has the Output, it's a copy from the original output. I Try to replace this output, with another one, that i try to create to another location, without sucessfull. struct ostream * o_stream_create_X_list(struct ostream *output, struct istream *input, const char *type) { struct emexis_ostream *X_stream; struct ostream *new_output; int fd; fd = open("/tmp/email",O_WRONLY); new_output = o_stream_create_fd_file(fd, 0, TRUE); o_stream_cork(new_output); emexis_stream = i_new(struct emexis_ostream, 1); emexis_stream->ostream.sendv = o_stream_X_sendv; emexis_stream->ostream.flush = o_stream_X_flush; emexis_stream->ostream.iostream.close = o_stream_X_close; emexis_stream->output = new_output; emexis_stream->input = input; o_stream_ref(new_output); return o_stream_create(&X_stream->ostream); } With this new o_stream, i got this error. Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: o_stream_send_istream(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: o_stream_flush(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: write(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor There is something wrong Timo ? Like missing something or i need to rewrite another funcion ? Tks !!!

2 1

[Dovecot] doveadm delete-user ?
by Jan-Frode Myklebust 04 Nov '11

04 Nov '11

IMHO it would be great if we could both provision and un-provision users without having the provisioning system mess with files in the filesystem. Provisioning new users works fine since dovecot will create all files/directories on first login, but I haven´t found the tools to un-provison them. I see "doveadm mailbox delete" can delete individual mailboxes, but what about indexes, sieve-scripts and home-directories? Are there any tools to clean out these ? -jf

2 3

[Dovecot] Restricting IMAP access
by Thierry de Montaudry 04 Nov '11

04 Nov '11

Hi list, I have a setup with postfix+dovecot+mysql unser CentOS 5, running 50 odd domains with virtual users. Access is allowed for public POP3, and a webmail on apache+PHP solution through local IMAP. I'm not gonna give you the long story about the why, but I'm looking for a way to give public IMAP access only to one domain, knowing that users log in with full email (user(a)domain.tld) Anybody has a trick for that? Running dovecot 2.0.13. I know there should be a way to do it through the database, but quite heavy change on our side for a million odd users. Regards, Thierry

3 2