- dovecot - dovecot.org

Re: [Dovecot] Dot Lock timestmap, users disconnections from roundcube
by Maria Arrea 05 Nov '11

05 Nov '11

Timo, we are not using NFS, we use remote iSCSI volumes with ext4. Regards Maria ----- Original Message ----- From: Timo Sirainen Sent: 11/04/11 09:59 PM To: Maria Arrea Subject: Re: [Dovecot] Dot Lock timestmap, users disconnections from roundcube On Thu, 2011-11-03 at 10:54 +0100, Maria Arrea wrote: > Hello. > > We are running dovecot 2.0.13 with mdbox+zlib on RHEL 5.7 x64, ext4. We use NTP. Indexes are in a iSCSI raid 10, mailboxes in raid5. No NFS. We have detected that sometimes all users get disconnected from roundcube at the same time. In dovecot logs we hundreds of lines like this: > > Nov 3 09:23:07 buzon dovecot: imap(mcrivero@mydomain): Warning: Created dotlock file's timestamp is different than current time (1320308587 vs 1320308542): /buzones/mydomain/03/67/mcrivero/subscriptions I did several fixes related to this, but they were already in v2.0.10. Note the time difference of 45 seconds. > Nov 3 09:23:07 buzon dovecot: imap(mcrivero@mydomain): Connection closed bytes=0/295 The dotlock warning isn't related to this. My guess: NFS was being extremely slow here, some operation took 45 seconds and Roundcube decided to abort before that. The "timestamp is different" check doesn't work 100% correctly if the filesystem operations take more than a second.

2 1

[Dovecot] Bad creation timestamp of migrated mails (maildir format)?
by Lukas Weiß 05 Nov '11

05 Nov '11

Hello everybody, ive just switched to dovecot imap because dbmail i used before is not developed any further and sql storage is difficult to backup. Ive done that, by setting up dovecot with maildir format and copy mails from old dbmail to new dovecot imap server with my mail client (thunderbird). Unfortunately migrating to dovecot brought me some problems with my Android K9 Mail client: Sync with IMAP-Server shows me only the oldest mails. I think the problem is, that K9 only fetches the newest mails (25) from the server (to save memory etc). Which mail is "new" is probably determined by creation timestamp of the email-files in my mailbox, which was copied newest first on migration from dbmail to dovecot. So the older mails have the newer creation timestamp on file system. Do you have any suggestions how to fix that problem? Maybe migrate to dbox mailbox format? BTW: New mails show up correctly, as the creation timestamp is new. Thanks Lukas

3 6

[Dovecot] fts-lucene vs SEARCH header Re: 2.1: problems compiling fts-lucene - CLucene git version necessary?
by Lutz Preßler 05 Nov '11

05 Nov '11

On Tue, 20 Sep 2011, Lutz Preßler wrote: > On Mo, 19 Sep 2011, Timo Sirainen wrote: > > > On Sun, 2011-09-18 at 13:27 +0200, Lutz Preßler wrote: > > > Hello, > > > On So, 11 Sep 2011, Timo Sirainen wrote: > > > dovecot: imap(...): Error: fts_lucene: default_language set, but Dovecot built without stemmer support > > > > Fixed: http://hg.dovecot.org/dovecot-2.1/rev/02c84406c661 > Without stemmer support it works nicely now though. Next problem :-) side effect: my test setup (some commits ago) with fts = lucene in plugin section (ftps_lucene plugin without stemmer support): SEARCH header is not working (empty result sets, no logging). Tested in different circumstances (and also happening with virtual folders). Simply disable fts option (while module is still loaded) or use fts=sqat to have header search working correctly again. Lutz

2 1

[Dovecot] dovecot: 2011-11-04 16:58:01 Error: IMAP(<user>): FETCH for mailbox Trash UID 42022 got too little data: 90900 vs 1529791
by Noah 05 Nov '11

05 Nov '11

Hi there I keep getting the following errors scrolling in my dovecot logs. I am wondering how I can nail down what is creating that problem. dovecot: 2011-11-04 16:58:01 Error: IMAP(<usr>): FETCH for mailbox Trash UID 42022 got too little data: 90900 vs 1529791 also I have a trash folder with over 100k messages in mbox format. I am wondering if migrating to Maildir format would make it easier and quicker for dovecot to index my mail. I am getting these types of errors from time to time. dovecot: 2011-10-30 20:32:58 Error: IMAP(<user>): Timeout while waiting for lock for transaction log file /home/<user>/mail/.imap/INBOX/dovecot.index.log Cheers, Noah

2 1

[Dovecot] [PATCH] Use SSL_MODE_RELEASE_BUFFERS if available to keep memory usage low
by Cristian Rodríguez 04 Nov '11

04 Nov '11

# HG changeset patch # User Cristian Rodríguez <crrodriguez(a)opensuse.org> # Date 1318533592 10800 # Node ID c15d6befe20082009cb40926afa208ab4b684818 # Parent 962df5d9413a4a0fcc68aacc1df0dca7a44a0240 Use SSL_MODE_RELEASE_BUFFERS if available to keep memory usage low. diff -r 962df5d9413a -r c15d6befe200 src/login-common/ssl-proxy-openssl.c --- a/src/login-common/ssl-proxy-openssl.c Wed Oct 12 17:16:10 2011 +0300 +++ b/src/login-common/ssl-proxy-openssl.c Thu Oct 13 16:19:52 2011 -0300 @@ -925,6 +925,9 @@ STACK_OF(X509_NAME) *xnames = NULL; SSL_CTX_set_options(ssl_ctx, SSL_OP_ALL | SSL_OP_NO_SSLv2); +#ifdef SSL_MODE_RELEASE_BUFFERS + SSL_CTX_set_mode(ssl_ctx, SSL_MODE_RELEASE_BUFFERS); +#endif if (*set->ssl_ca != '\0') { /* set trusted CA certs */ store = SSL_CTX_get_cert_store(ssl_ctx);

2 1

Re: [Dovecot] lmtp performance
by Juan Carlos Sanchez 04 Nov '11

04 Nov '11

A particular reply (not to the list) has told me to try: " Add to service lmtp: process_min_avail = 20 " And yes, it works (unless for me), so I want to share it with everybody. Have not exactly measured performance but this morning have seen over 1400 messages/minute with lmtp under heavy load. What the "process_min_avail = 20" in service lmtp (or anywhere else) exactly imply? cannot find a reference in wiki2 . I suppose it means than 20 lmtp processes are always open waiting for new connections and so reducing startup latency, isn't it? Thank you. > > On Mon, Oct 17, 2011 at 6:06 AM, Juan Carlos Sanchez > <juancarlos.sanchez(a)upm.es <mailto:juancarlos.sanchez@upm.es>> wrote: > > Hello: > > In the process of migration from version 1.2 to 2.0 have tried to > use lmtp instead of lda as delivery agent. > > But unfortunately througput we get is poor with lmtp compared to lda. > In peak times with lda we are able to deliver over 1800 > messages/minute (high I/O but not affecting service) but if we > switch to lmtp cannot deliver more than 300 mess/minute (very low > I/O). > > This is enough for normal work but low under heavy load > (distribution lists messages sometimes stay queued for 4 hours > before deliver). > > We have arround 50000 boxes and use postfix as MTA > > How to increase lmtp performance? > > > dovecot config for lda and lmtp: > > protocol lda { > auth_socket_path = /usr/local/var/run/dovecot/auth-master > info_log_path = /var/log/mail/dovecot_deliver.log > log_path = /var/log/mail/dovecot_deliver.log > mail_plugins = quota sieve zlib > postmaster_address = postmaster(a)upm.es <mailto:postmaster@upm.es> > sendmail_path = /usr/lib/sendmail > } > > protocol lmtp { > info_log_path = /var/log/mail/dovecot_deliver.log > log_path = /var/log/mail/dovecot_deliver.log > mail_plugins = quota sieve zlib > postmaster_address = postmaster(a)upm.es <mailto:postmaster@upm.es> > sendmail_path = /usr/lib/sendmail > } > > In postfix I have: > > mailbox_transport = lmtp:unix:private/dovecot-lmtp > > > > Thanks in advance. > > -- > > ------------------------------------------------------ > Juan Carlos Sanchez Hernandez > Universidad Politecnica de Madrid > ------------------------------------------------------ > > > -- ------------------------------------------------------ Juan Carlos Sanchez Hernandez Universidad Politecnica de Madrid ------------------------------------------------------

3 2

[Dovecot] imap proxy for Gmail
by Jumping Mouse 04 Nov '11

04 Nov '11

Hello, b I have a situation were I want to be able to give teachers access to their Google apps for education email through Squirrelmail. The network that they are on blocks gmail. I am able to get Squirrelmail to communicate with Gmail via imap. I am looking at getting persistant imap connections to improve the user experience. I have looked at IMAPPROXY but this application is not compatible with the gmail imaps (ssl-encrypted imap over port 993). I recall reading somewhere that Dovecot has a built in imapproxy that could be used for this. Can someone please point me to documentation or other information on how I might achieve the above stated goal? Thanks, Kafriki

3 2

[Dovecot] Proxy and Virtual IMAP Folders
by Pedro Paixao 04 Nov '11

04 Nov '11

Hi all I am a newbie to dovecot and I would like some help clarifying a feature to determine if I can use it in my project. Is is posible to use the virtual plugin, in a IMAP proxy configuration, in a way that the virtual plugin searches messages on the real server? Here's my scenario: [Client]----[Dovecot Proxy]-----[Real Imap Server] Client connects to Dovecot Proxy and gets all the folders that are on the Real Imap Server, plus some virtual ones (generated by Dovecot Proxy) that search for messages on the real server. In my config the Dovecot Proxy has no email messages, real folders, or local delivery. I would like to thank you in advance for ant help and support. All the best Pedro

2 1

[Dovecot] doveadm segfaults on TCP connect - version 2.0.15
by ghandidrivesahumvee＠rocketfish.com 04 Nov '11

04 Nov '11

Hi list, I just recently installed Dovecot 2.0.15. Unfortunately, doveadm segfaults when I attempt to connect to the local dovecot instance. When this occurs, my logs show: 2011-10-19T12:31:23-07:00 mail02 dovecot: doveadm: Error: doveadm client not compatible with this server (mixed old and new binaries?) I am using the settings listed on the wiki page http://wiki2.dovecot.org/Director [root@mail02 ~]# /opt/dovecot/bin/doveadm who -a 10.10.5.220:544 Segmentation fault (core dumped) doveconf and gdb output are below. If there is any more information I can provide please let me know. Thanks! [root@mail02 ~]# /opt/dovecot/bin/doveconf -n # 2.0.15: /opt/dovecot-2.0.15/etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.17.4.el5 x86_64 CentOS release 5.5 (Final) auth_mechanisms = plain login auth_verbose = yes auth_worker_max_count = 60 default_client_limit = 2048 disable_plaintext_auth = no doveadm_proxy_port = 544 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 10.10.5.220, 127.0.0.1 lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_log_prefix = "%r mpid=%p %s(%u): " mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " notify mail_log" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mmap_disable = yes passdb { args = /opt/dovecot/etc/dovecot/conf.d/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete expunge mailbox_delete mail_log_fields = msgid box from mail_log_group_events = yes sieve = ~/MainSieve sieve_before = /storage03/sieve/before/ sieve_dir = ~/sieve sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 2M } quota_full_tempfail = yes service anvil { client_limit = 2000 } service auth { client_limit = 7000 unix_listener /var/spool/postfix/private/auth { mode = 0600 user = postfix } unix_listener auth-userdb { group = mailowner mode = 0600 user = mailowner } } service doveadm { inet_listener { port = 544 } } service imap-login { inet_listener imap { port = 143 } process_min_avail = 4 service_count = 0 vsz_limit = 128 M } service imap {%0

5 6

[Dovecot] Rewrite the ostream output method, to save messages in another directory.
by Alex Baule 04 Nov '11

04 Nov '11

Hi Timo, I Trying to integrate my antispam with dovecot, using the imap folder to do certain actions. I Do almost every thing, but i have some problems saving the message. Explaining this function, i try to use a imap folder like a "collector folder", the user append a message from outside (ie another imap or pop message) to this folder, and i don't want to copy this message, i need to redirect it to another folder outside from user's maildir. Well, i try to base it in zlib plugin, with was the o_stream_create_gz(). Inside the o_stream_create_gz has the Output, it's a copy from the original output. I Try to replace this output, with another one, that i try to create to another location, without sucessfull. struct ostream * o_stream_create_X_list(struct ostream *output, struct istream *input, const char *type) { struct emexis_ostream *X_stream; struct ostream *new_output; int fd; fd = open("/tmp/email",O_WRONLY); new_output = o_stream_create_fd_file(fd, 0, TRUE); o_stream_cork(new_output); emexis_stream = i_new(struct emexis_ostream, 1); emexis_stream->ostream.sendv = o_stream_X_sendv; emexis_stream->ostream.flush = o_stream_X_flush; emexis_stream->ostream.iostream.close = o_stream_X_close; emexis_stream->output = new_output; emexis_stream->input = input; o_stream_ref(new_output); return o_stream_create(&X_stream->ostream); } With this new o_stream, i got this error. Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: o_stream_send_istream(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: o_stream_flush(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor Oct 27 15:14:24 brc dovecot: imap(alex(a)exemplo.com.br): Error: write(/storage/gss/emexis/messages/ exemplo.com.br/alex/Maildir/.Emexis.Ext-Blacklist/tmp/1319735664.M568409P30815.brc) failed: Bad file descriptor There is something wrong Timo ? Like missing something or i need to rewrite another funcion ? Tks !!!

2 1