- dovecot - dovecot.org

[Dovecot] Reading dovecot-uidlist by external program (locking)
by Andrzej A. Filip 11 Apr '13

11 Apr '13

How to lock dovecot-uidlist file before reading by an external program? [perl script]

1 1

Re: [Dovecot] Configuring dovecot to use tcp wrappers
by Max Pyziur 11 Apr '13

11 Apr '13

On Thu, 11 Apr 2013, lists-dovecot wrote: > > [... snip ...] >> >> I've put in a test ip address in /etc/hosts.deny like so: >> dovecot: 166.84.1.2 >> >> And then I execute the following from 166.84.1.2 to port 110: >> bash-3.2$ telnet SiteWhereImConfiguringDovecot 110 >> Trying SiteWhereImConfiguringDovecot... >> Connected to SiteWhereImConfiguringDovecot. >> Escape character is '^]'. >> +OK Dovecot ready. >> quit >> +OK Logging out >> Connection closed by foreign host. >> >> If dovecot is configured with tcp wrappers (which it is; built on >> a CentOS 6 system, installed and configured per instructions), >> and the firewall has ports 110 and 143 open, >> but I'm blocking a particular host through /etc/hosts.deny >> then I should not be able to telnet to either port 110 or 143; both >> requests should be blocked from the originating IP, no? >> >> Much thanks for your help, >> >> Max Pyziur >> pyz(a)brama.com > > > What are you using as the service name in hosts.deny? I think it > should be "imap-login:", (that's what I have as an > historical/left-over entry) but don't have dovecot configured with > wrappers on my current centos system so can't test this to be > certain. Also make certain that you don't have anything in your > hosts.allow file that would override the hosts.deny entry. I was using dovecot, until you convinced me to do otherwise. Putting pop3 in /etc/hosts.deny with the associated ip seems to work, like so: pop3: 166.84.1.2 or imap imap: 166.84.1.2 (are there any challenges to this?) Given that services such sendmail and sshd respond to sshd: xxx.xxx.xxx.xxx sendmail: xxx.xxx.xxx.xxx I thought that it should be dovecot: xxx.xxx.xxx.xxx As a suggestion, can dovecot binaries for distributions such as CentOS and Fedora be compiled with tcp wrappers by default? > - Richard Much thanks. MP pyz(a)brama.com

1 0

[Dovecot] Questions about the upcoming Object Storage Plugin for 2.2
by Charles Marcus 11 Apr '13

11 Apr '13

Hi Timo, I'm curious and have questions about the new Object Storage Plugin (OSP), and how it can be leveraged by an SMB like us. First, am I reading this right where it could be used as a kind of 'live/realtime backup' solution, where everything is stored *both* locally and in the cloud, with two-way syncing, ie, so local users could access the local server for faster access, and when outside the office, they'd access the cloud based storage and any changes made there are sync'd back to the local server? Or is it intended to be more as an alternative storage for storing older emails in a separate namespace? Or both/either? Second, is SIS fully supported by the OSP? Third - I'm a little confused by the Amazon S3 pricing page, especially on how to try to estimate the costs for usage (bandwidth, etc)... do you have any idea how to go about estimating that? Is there some kind of process we could use on our existing server to measure it over a given period of time that would give us an estimate of what to expect if we decided to switch over? Last - have you established pricing for the OSP? Will it be per user, or per MB/GB, per month (or per year), or just a one-time cost? And/or will you include/bundle it with any/all of your support tiers? Sorry if I'm jumping the gun here... Thanks, really looking forward to the 2.2 release! -- Best regards, Charles

2 3

Re: [Dovecot] Problem with fts lucene, on solaris 10
by Pigi 11 Apr '13

11 Apr '13

Sorry for top posting, but I have no additional info on this. BTW I need to refresh the question as I have tried squat, and I'm biting the dust with the already known problems ( "Corrupted squat uidlist file" or "Panic: file squat-trie.c:" ). Is there some pointer on where/how to find assist on fts-lucene to keep on analisys for this problem on sparc ? T.I.A. Pigi On Monday 08 April 2013, Pigi wrote: > On Monday 08 April 2013, Timo Sirainen wrote: > > On 8.4.2013, at 12.19, Pigi <pigi(a)frumar.it> wrote: > > > > > Program received signal SIGSEGV, Segmentation fault. > > > 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 > > > (gdb) bt full > > > #0 0xfebd65dc in _malloc_unlocked () from /lib/libc.so.1 > > > No symbol table info available. > > > #1 0xfebd66e4 in realloc () from /lib/libc.so.1 > > > No symbol table info available. > > > #2 0xff1d9a70 in pool_system_realloc (pool=0xff21576c, mem=0xff21576c, old_size=0, new_size=8192) at mempool-system.c:115 > > > No locals. > > > #3 0xff1cda28 in i_realloc (mem=0x0, old_size=0, new_size=8192) at imem.c:14 > > > No locals. > > > > Looks to me like memory corruption, which is just about impossible to debug if you don't have valgrind or a similar tool (and I don't think Solaris has any such free tools). > > Yes, you're right. There aren't ( already packaged ) tool for valgrinding or similar. > > > Do you happen to get any other crashes where it doesn't crash in malloc code? You showed previously that it was crashing with SIGBUS somewhere. > > For what I can see, form dovecot.log I have a couple of error: > Apr 08 12:02:18 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 12:02:18 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 12:02:18 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27242 killed with signal 11 (core not dumped) > Apr 08 12:02:19 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out > Apr 08 12:03:46 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 12:03:46 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 12:03:46 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27445 killed with signal 10 (core not dumped) > Apr 08 12:06:57 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 12:06:57 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 12:06:57 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 27761 killed with signal 11 (core not dumped) > Apr 08 12:08:33 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > > Here a couple or more of gdb"ed" process, but tied to SEGV ( I almost suspect that when gdbing I always catch a SEGV ) : > > ============================================================== > First gdb > ============================================================== > No symbol table info available. > #1 0xfebd6884 in realloc () from /lib/libc.so.1 > No symbol table info available. > #2 0xfe83d270 in lucene::util::StringReader::init (this=0x8d328, _value=0x2bb288, _length=3958, copyData=true) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Reader.cpp:48 > tmp = (TCHAR *) 0x2051e0 > length = 3958 > #3 0xfe8837f0 in lucene::index::DocumentsWriter::ThreadState::FieldData::invertField (this=0x92df8, field=0x8d238, analyzer=0x2cb60, maxFieldLength=10000) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriterThreadState.cpp:887 > stringValue = (const TCHAR *) 0x2bb288 > stringValueLength = 3958 > stream = (class lucene::analysis::TokenStream *) 0x0 > streamValue = (class lucene::analysis::TokenStream *) 0x8d328 > #4 0xfe883a58 in lucene::index::DocumentsWriter::ThreadState::FieldData::processField (this=0x92df8, analyzer=0x2cb60) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriterThreadState.cpp:798 > field = (class lucene::document::Field *) 0x8d238 > #5 0xfe883d6c in lucene::index::DocumentsWriter::ThreadState::processDocument (this=0x8c0a8, analyzer=0x2cb60) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Array.h:90 > i = 6 > #6 0xfe87ea00 in lucene::index::DocumentsWriter::updateDocument (this=0x84790, doc=0x8b838, analyzer=0x2cb60, delTerm=0x0) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:946 > state = (class lucene::index::DocumentsWriter::ThreadState *) 0x8c0a8 > #7 0xfe87eb5c in lucene::index::DocumentsWriter::addDocument (this=0x84790, doc=0x8b838, analyzer=0x2cb60) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:930 > No locals. > #8 0xfe8b1ea0 in lucene::index::IndexWriter::addDocument (this=0x8cc18, doc=0x8b838, analyzer=0x2cb60) > at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/index/IndexWriter.cpp:682 > No locals. > #9 0xfea18e04 in lucene_index_build_flush (index=0x37ba8) at lucene-wrapper.cc:484 > ret = 0 > #10 0xfea18f88 in lucene_index_build_more (index=0x37ba8, uid=2995, data=0x185d18 "<xxxxxx(a)xxxxxxxx.xx>", size=23, hdr_name=0x8ba60 "Return-Path") > at lucene-wrapper.cc:507 > id = {4, 0, 0, 0, -4196824, -15011172, 534768, -4196336, 516256, 0, 11560, -20155708, 9, 10, 36, 2727408, 516256, 148, 0, 441, 148864, 534768, 3} > namesize = 9216 > datasize = 9216 > dest = Cannot access memory at address 0xbb3 > (gdb) quit > > ============================================================== > Second gdb > ============================================================== > > gdb) bt full > #0 0xfebd6b24 in realfree () from /lib/libc.so.1 > No symbol table info available. > #1 0xfebd7354 in cleanfree () from /lib/libc.so.1 > No symbol table info available. > #2 0xfebd64ac in _malloc_unlocked () from /lib/libc.so.1 > No symbol table info available. > #3 0xfebd639c in malloc () from /lib/libc.so.1 > No symbol table info available. > #4 0xfe737b38 in operator new () from /usr/sfw/lib/libstdc++.so.6 > No symbol table info available. > #5 0xfe8613f4 in Document (this=0x8b838) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Document.cpp:57 > No locals. > #6 0xfea18fa8 in lucene_index_build_more (index=0x37ba8, uid=2995, data=0x8d7b0 "<xxxxxx(a)xxxxxxxx.xx>", size=23, hdr_name=0x8b9d0 "Return-Path") > at lucene-wrapper.cc:511 > id = {4, 0, 0, 0, -4196824, -15011172, 1605360, -4196336, 516256, 0, 11560, -20155708, 9, 10, 36, 2122656, 516256, 148, 0, 441, 148864, 1605360, 3} > namesize = 9216 > datasize = 9216 > dest = Cannot access memory at address 0xbb3 > (gdb) quit > > =============================================== > third gdb > ===================================================== > (gdb) cont > Continuing. > > Program received signal SIGSEGV, Segmentation fault. > 0xfebd710c in t_splay () from /lib/libc.so.1 > (gdb) bt full > #0 0xfebd710c in t_splay () from /lib/libc.so.1 > No symbol table info available. > #1 0xfebd6eb8 in t_delete () from /lib/libc.so.1 > No symbol table info available. > #2 0xfebd6acc in realfree () from /lib/libc.so.1 > No symbol table info available. > #3 0xfebd72c8 in _free_unlocked () from /lib/libc.so.1 > No symbol table info available. > #4 0xfebd7204 in free () from /lib/libc.so.1 > No symbol table info available. > #5 0xfe862144 in lucene::document::Field::_resetValue (this=0x71e288) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Field.cpp:300 > No locals. > #6 0xfe862248 in ~Field (this=0x71e288) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Field.cpp:103 > No locals. > #7 0xfe90dcc8 in ~CLVector (this=0x23c248) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/util/Equators.h:227 > itr = {_M_current = 0x71eb00} > #8 0xfe860dfc in ~Document (this=0x832e0) at /extpool/PACKAGES/DOVECOT/clucene-core-2.3.3.4/src/core/CLucene/document/Document.cpp:69 > No locals. > #9 0xfea18e30 in lucene_index_build_flush (index=0x8adc0) at lucene-wrapper.cc:493 > ret = 0 > #10 0xfea18f88 in lucene_index_build_more (index=0x8adc0, uid=4128, data=0x6b2b00 "<YYYYYYYYY(a)yyyyyyyyyy.yyy>", size=23, hdr_name=0x1b6508 "Return-Path") > at lucene-wrapper.cc:507 > id = {4, 0, 0, 0, -4196824, -15011172, 3114656, -4196336, 584416, 0, 11560, 0, 0, 0, 36, 7697128, 584416, 845, 0, 2382, 148880, 3114656, 3} > namesize = 9216 > datasize = 9216 > dest = Cannot access memory at address 0x1020 > (gdb) > > > > Here a couple of ( probably ) interesting stuff : > > root # grep "signal 10" /usr/local/dovecot/var/log/dovecot.log |wc > 33 284 2308 > root # grep "signal 11" /usr/local/dovecot/var/log/dovecot.log |wc > 69 549 4457 > root # grep "Lock obtain timed out" /usr/local/dovecot/var/log/dovecot.log |wc > 74 420 3976 > > Thus, 74 times of 102 seems to be tied to "IndexWriter() failed (#1): Lock obtain timed out" ( which I don't really understand, > or at least I have not enough comprehension of code to understand). > The path where lucene try to get a lock is not NFS, but is an automount on the same machine ( no NFS then ). > > It seems that the "Lock obtain timed out" happens every time I read a message with the MUA. > > This error ("Lock obtain") happens every time I read a message from my MUA, I think it's due to the indexing process running on READ > imap command: > > Apr 08 15:18:13 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 15:18:13 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 15:18:13 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 18171 killed with signal 11 (core not dumped) > Apr 08 15:18:15 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out > > > When searching, instead, get the "Lock timeout" followed by another error: > > Apr 08 15:11:37 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 15:11:37 imap(xxxx): Error: indexer failed to index mailbox INBOX > Apr 08 15:11:37 indexer-worker(xxxx): Fatal: master: service(indexer-worker): child 17438 killed with signal 10 (core not dumped) > Apr 08 15:11:38 indexer-worker(xxxx): Error: lucene index /home/xxxx/Maildir/lucene-indexes: IndexWriter() failed (#1): Lock obtain timed out > Apr 08 15:11:51 indexer: Error: Indexer worker disconnected, discarding 1 requests for xxxx > Apr 08 15:11:51 imap(xxxx): Error: indexer failed to index mailbox INBOX > > > > In both case the signal ( 11 or 10, SEGV or SIGBUS ) it's indifferent ( sometimes is 10 sometimes is 11 ). > > Hope I've been able to explain, as my english seems to get worst every time ;) > > Pigi > >

2 1

[Dovecot] Configuring dovecot to use tcp wrappers
by Max Pyziur 11 Apr '13

11 Apr '13

Greetings, I am looking to implement tcp wrappers with dovecot; I am using the following two links as guides to configuration: http://blog.acsystem.sk/linux/brute-force-attack-dovecot-imap-server-blocki… http://wiki2.dovecot.org/LoginProcess (you need to go to the very bottom) I'm concerned in making the configuration correctly. If you set login_access_sockets = tcpwrap in /etc/dovecot/dovecot.conf Then everything accessing ports controlled by dovecot (and open by iptables) is blocked. So my question relates to the second part of the configuration examples in the links above: service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } Where does this code get placed (in dovecot.conf or in one of the files in /etc/dovecot/conf.d)? And regarding $default_login_user, it appears in a comment line in /etc/dovecot/conf.d/10-master.conf Should that line be uncommented? Much thanks. Max Pyziur pyz(a)brama.com Report of dovecot -n: pyz@pangea ~> dovecot -n # 2.1.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-358.2.1.el6.x86_64 x86_64 CentOS release 6.4 (Final) disable_plaintext_auth = no mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } ssl = no ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { driver = passwd }

2 6

[Dovecot] [PATCHES] NetBSD support, authentication buffer size
by Emmanuel Dreyfus 11 Apr '13

11 Apr '13

Hi Here are a few unintegrated patches, just tested against 2.2rc7: 1) NetBSD's getmntinfo uses struct statvfs while other BSD use struct statfs http://ftp.espci.fr/shadow/manu/patch-ak 2) NetBSD 5.x net_getunixcred() support. Build on NetBSD, but not tested (I am testing on NetBSD 6.0): http://ftp.espci.fr/shadow/manu/patch-src_lib_net.c 3) Increase authentication buffer size so that it can cope with unusual authentication scheme. This patch was integrated in dovecot-1.x but did not make its way in dovecot-2.x http://ftp.espci.fr/shadow/manu/patch-src_lib-master_master-auth.h -- Emmanuel Dreyfus manu(a)netbsd.org

3 6

[Dovecot] Easy way to make all mailboxes of a user read-only
by Stephan von Krawczynski 11 Apr '13

11 Apr '13

Hello all, I try to configure dovecot to make all imap accesses read-only for a certain user. I thought this would be possible by creating a global acl file (here "global-acl") like: user=<username> lr and plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 } But that seems to be ignored. What is wrong with this idea, the docs are not really clear about a single acl file with global settings. -- Regards, Stephan

4 11

[Dovecot] v2.2.rc7 released
by Timo Sirainen 11 Apr '13

11 Apr '13

http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc7.tar.gz http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc7.tar.gz.sig OK, still not quite v2.2.0, but now it's definitely very close. :) * checkpasword: AUTH_PASSWORD environment is no longer set. * Running dsync no longer triggers quota warnings. + dsync: Commit large transactions every 100 new messages, so if a large sync crashes it doesn't have to be restarted from the beginning. - replicator: doveadm commands and user list export may have skipped some users. - Various fixes to mailbox_list_index=yes

2 4

[Dovecot] Dovecot distribution configuration files source
by Dave Gattis 11 Apr '13

11 Apr '13

Where can I find unaltered distribution config files (/etc/dovecot/ and /etc/dovecot/config.d/) for Dovecot 2.1.7? I upgraded from version 1 and had to butcher them to get it working. Now that I understand it better, I'd like to do it right. -- Dave

2 1

[Dovecot] My old email is not stored
by HylkeB 11 Apr '13

11 Apr '13

Hi, Im have not much experience with dovecot, postfix or debian, which i am using for my email server. But the thing is, everything worked just fine, until I found out that old emails were missing, only emails of a few months old exist on my server. I have no idea if this is a setting in dovecot, postfix or debian, or that something weird happened. But my question is, is there a setting in either dovecot, postfix or debian that i should check that could cause this behaviour, and if so, how do i check that? (opening and checking a conf file for example, or executing some commands in PuTTy). And if this is somehow default behaviour that cannot be changed, is there some other way to store all emails ever entered my inbox? Sincerely, Hylke Bron -- View this message in context: http://dovecot.2317879.n4.nabble.com/My-old-email-is-not-stored-tp41478.html Sent from the Dovecot mailing list archive at Nabble.com.

6 11