- dovecot - dovecot.org

[Dovecot] solr substring schema.xml
by Daniel Miller 03 Jun '11

03 Jun '11

I'm trying a modified schema.xml with solr - it appears I now have substring searches! I took the schema.xml file shipped with Dovecot, and modified the text field definition to be: <fieldType name="text" class="solr.TextField" positionIncrementGap="100"> <analyzer type="index"> <tokenizer class="solr.WhitespaceTokenizerFactory"/> <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt"/> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="1" catenateNumbers="1" catenateAll="0"/> <filter class="solr.LowerCaseFilterFactory"/> <filter class="solr.SnowballPorterFilterFactory" protected="protwords.txt"/> <filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="15"/> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> </analyzer> <analyzer type="query"> <tokenizer class="solr.WhitespaceTokenizerFactory"/> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/> <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt"/> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="0" catenateNumbers="0" catenateAll="0"/> <filter class="solr.LowerCaseFilterFactory"/> <filter class="solr.SnowballPorterFilterFactory" protected="protwords.txt"/> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> </analyzer> </fieldType> Changing to the new "SnowballPorter" instead of the deprecated "EnglishPorter" filters is probably minor - the magic is the "NGramFilterFactory". 3 & 15 seemed reasonable defaults for the min/max size to search on. -- Daniel

2 2

[Dovecot] unexpected subfolder locaton in Maildir/.INBOX.subfolder
by wulf 03 Jun '11

03 Jun '11

Hallo, I try to migrate existing imap server to dovecot 1.2 in debian squeeze if I connect to imap://user@host/INBOX Inbox works as expected and I get the content of Maildir/{cur,new,tmp} Maildir/.subfolder already exists if I connect to imap://user@host/INBOX.subfolder I get "folder not found" if I do a imap directory listing (raw mutt config, no subscriptions) - I see "../" - If I navigate to "../" I se all my existing subfolders if I create a new folder via imap the folder is created in Maildir/.INBOX.new_subfolder I expect the creation of Maildir/.new_subfolder This doesn't fit to the client configs and if I move the existing folders it doesn't fit to existing delivery agent filters and settings. I enabled mail_debug and the expansion looks ok for me: dovecot: imap-login: Login: user=<wulf>, method=PLAIN, rip=85.178.xx.xxx, lip=80.81.xxx.xxx, TLS dovecot: IMAP(wulf): Effective uid=112, gid=114, home=/var/mail/home/wulf dovecot: IMAP(wulf): maildir: data=~/Maildir dovecot: IMAP(wulf): maildir++: root=/var/mail/home/wulf/Maildir, index=, control=, inbox=/var/mail/home/wulf/Maildir the existing subscription information from courier-imap looks like INBOX.subolder Yes I can sed them to subfolder (of course I have to copy them to Maildir/subscriptions anyhow) But is that the idea? I like to avoid trouble with all the users and their already configured mail-clients. Where is my mistake? Thanks for feedback Best Wulf CONF: protocols = imap imaps log_timestamp = "%Y-%m-%d %H:%M:%S " ssl = required ssl_cert_file = /etc/exim4/xxxxxxxxxxxxxxx.pem ssl_key_file = /etc/exim4/xxxxxx.key mail_location = maildir:~/Maildir mail_uid = 112 mail_gid = 114 mail_access_groups = vmail mail_debug = yes first_valid_uid = 112 protocol imap { } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol managesieve { } auth_verbose = yes auth_debug = yes auth default { mechanisms = plain passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb static { args = uid=112 gid=114 home=/var/mail/home/%u } user = root } dict { } plugin { } dovecot-ldap.conf: hosts = 127.0.0.1:389 auth_bind = yes auth_bind_userdn = uid=%u,ou=users,dc=xxxxxxxx,dc=de base = dc=xxxxxxxx,dc=de

3 4

[Dovecot] Running a dovecot cluster with mixed versions?
by Ian Foutch 03 Jun '11

03 Jun '11

I have been trying to find information and possible issues with running a cluster of dovecot server with different versions without any luck. We have an existing cluster with dovecot v1.1.10 and tried migrating to a new cluster with dovecot v2.0.12. We ran into some issues when we moved traffic to the new cluster and have been unable to reproduce it in our own testing. We may need to put real usage on the new servers but would like to be able to do this by adding newer servers into the existing cluster. What are the potential issues with doing this? Thanks, --Ian This message and any attachments to it are intended only for the addressee(s) identified above and may contain CONFIDENTIAL information. It is not intended for transmission to, or receipt by, any unauthorized persons. If you are not an intended recipient or an agent responsible for delivering it to an intended recipient, you have received this e-mail in error and any dissemination, distribution, or copying of this message or any attachment to it is strictly prohibited. If you have received this email in error, please (i) do not read it, (ii) reply to the sender that you received the message in error, and (iii) erase or destroy the message from your system.

2 1

[Dovecot] Problems in auth when switching from PLAIN-MD5
by Eduardo Casarero 03 Jun '11

03 Jun '11

Hi, i am running dovecot 2.0.11 (with mysql backend) and until now using PLAIN-MD5 as pass default_pass_scheme everything was working fine. However i wanted to change the pass_scheme to something stronger than plain-md5, so i started by reading the wiki. I found this: http://wiki2.dovecot.org/HowTo/ConvertPasswordSchemes But when i comment out "default_pass_scheme" and i create the pass with the {SHA256.hex} prefix i see this in the logs: auth: Error: sql(xxx(a)xxxxxx.com,10.21.1.1): Password in passdb is not in expected scheme SHA256.hex I tried with several algorithms, but it seems to be something in my config that it's only working with plain-md5. the auth_mechanism is plain with ssl/tls. Maybe someone can give me a hint of where to see o which config file review. Thanks in advance. Eduardo.

2 3

[Dovecot] slow squat fts index creation
by Cor Bosman 03 Jun '11

03 Jun '11

Hi all, ive been playing with squat indexes. Up to about 300.000 emails in a single mailbox this was working flawlessly. The search index file is about 500MB at that time. Ive now added some more emails, and at 450.000 or so emails im seeing a serious problem with squat index creation. It takes...f o r e v e r . The .tmp file is being so slowly, it will probably take 2-3 hours to create. Upto this point it took maybe a minute. Im doing this in an openvz container, so theoretically i may be hitting some openvz resource limit. But ive upped all the limits and dont see any improvements. I dont see any resources starvation either. Could there be some dovecot issue when the search index reaches say 1GB? (im estimating that it's now trying to save about 1GB search index). Regards, Cor

2 1

[Dovecot] Dovecot 1.2 with MySQL limit Trash folder
by Damien Robinet 03 Jun '11

03 Jun '11

Hi All, I need your help to limit the size of the Trash folder. I want to exclude the Trash folder in my user quota. But I do not want the Trash folder can not exceed 10M for example. I can manage to exclude the size of the Trash folder. But I can not limit the size of the folder. On my test, I've bytes=512000 for the Trash folder. But the user can move more that 512000B on the Trash folder ... Could you help me please ? Bests Regards, Damien ################################ ## My SQL query (dovecot-sql.conf) ## ################################ user_query = SELECT CONCAT( '/home/vmail/', maildir ) AS home, CONCAT( '/home/vmail/', maildir ) AS sieve_dir, 201 AS uid, 201 AS gid, CONCAT('*:storage=',ROUND((quota*1048.576)),'B') AS quota_rule, 'Trash:storage=50000B' AS quota_rule2, 'Trash:ignore' AS quota_rule3 FROM mail_mailbox WHERE username = '%u' AND actif = '1' ############ ## My Log: ## ############ 2011-05-24 20:08:59 imap-login: Info: Login: user=<postmaster(a)domain.tld>, method=PLAIN, rip=192.168.1.101, lip=192.168.1.10 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_autocreate_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_expire_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Effective uid=201, gid=201, home=/home/vmail/d/o/domain.tld/postmaster/ 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota root: name=user backend=dict args=:proxy::quota 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota rule: root=user mailbox=* bytes=1048576 messages=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota rule: root=user mailbox=Trash bytes=512000 messages=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: expire: No expire or expire_altmove settings - plugin disabled 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: dict quota: user=postmaster(a)domain.tld, uri=proxy::quota, noenforcing=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: maildir: data=/home/vmail/d/o/domain.tld/postmaster/ 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: maildir++: root=/home/vmail/d/o/domain.tld/postmaster, index=, control=, inbox=/home/vmail/d/o/domain.tld/postmaster 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Namespace : Using permissions from /home/vmail/d/o/domain.tld/postmaster: mode=0700 gid=-1 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Connection closed bytes=38/363 ################### ## My dovecot.conf ## ################### dict { quota = mysql:/etc/dovecot/dovecot-quota.conf } plugin { args = /etc/dovecot/dovecot-sql.conf quota = dict:user::proxy::quota autocreate = Junk autocreate2 = NonJunk autocreate3 = Drafts autocreate4 = Sent autocreate5 = Trash autosubscribe = Junk autosubscribe2 = NonJunk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = Trash }

2 1

[Dovecot] New IPC features : any configuration doc ?
by Joan Moreau 03 Jun '11

03 Jun '11

Hi, Dovecot complains at start for the ipc listener not correctly configured. What is the configuration scheme ? Thanks JM

2 5

[Dovecot] passdb: password contains illegal chars question
by Torsten Krah 03 Jun '11

03 Jun '11

Hi, some question about passdb backend: I'll receive this (using dovecot 2.0.13, pgsql passdb backend) for some users: mail dovecot: auth: passdb(account-username,127.0.0.1): Attempted login with password having illegal chars Password schema ist crypt-md5. So what "chars" does dovecot not like (why?) and whats the preferred way to fix this? regards Torsten -- Bitte senden Sie mir keine Word- oder PowerPoint-Anhänge. Siehe http://www.gnu.org/philosophy/no-word-attachments.de.html Really, I'm not out to destroy Microsoft. That will just be a completely unintentional side effect." -- Linus Torvalds

2 1

[Dovecot] doveadm segfault
by Joan Moreau 03 Jun '11

03 Jun '11

Hi, Using HG latest version, I get the following in the dmesg : [38041.387112] doveadm[20515]: segfault at 8 ip 000000000040f51d sp 00007fffb774c010 error 4 in doveadm[400000+2a000] [38041.397966] doveadm[20613]: segfault at 8 ip 000000000040f51d sp 00007fff953c1790 error 4 in doveadm[400000+2a000] [38041.428206] doveadm[20615]: segfault at 8 ip 000000000040f51d sp 00007ffffdce0cf0 error 4 in doveadm[400000+2a000] [38041.444879] doveadm[20619]: segfault at 8 ip 000000000040f51d sp 00007fffbb0668b0 error 4 in doveadm[400000+2a000] [38041.451815] doveadm[20622]: segfault at 8 ip 000000000040f51d sp 00007fff91d9b670 error 4 in doveadm[400000+2a000] [38041.459231] doveadm[20624]: segfault at 8 ip 000000000040f51d sp 00007fffe92b31b0 error 4 in doveadm[400000+2a000] [38041.468292] doveadm[20625]: segfault at 8 ip 000000000040f51d sp 00007fff5a4895c0 error 4 in doveadm[400000+2a000] [38041.481951] doveadm[20626]: segfault at 8 ip 000000000040f51d sp 00007fff8e84d010 error 4 in doveadm[400000+2a000] [38041.489414] doveadm[20629]: segfault at 8 ip 000000000040f51d sp 00007fff79206180 error 4 in doveadm[400000+2a000] [38041.512329] doveadm[20630]: segfault at 8 ip 000000000040f51d sp 00007ffff10582d0 error 4 in doveadm[400000+2a000] hundreds of times... No clue what is the bug.... JM

2 1

[Dovecot] Error: file_dotlock_create failed: Permission denied
by M. Fioretti 03 Jun '11

03 Jun '11

Hi, I have a Fedora 14 x86_64 computer. I run dovecot 2.0.12 on it, only to keep a local imap copy of all my email, in maildir format. A couple days ago the hard disk broke, so I bought a new one, and reinstalled Fedora 14 x86_64 with all the updates. Then I copied all the maildirs from a backup to the new drive. But I can't access email now. No matter how I change sticky bits or ownership and permissions of all the involved files and directories, etc.. Login succeeds, but I get this error whenever I try to create new mailboxes or access existing ones: May 25 13:36:03 polaris dovecot: imap-login: Login: user=<marco>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=8489, secured May 25 13:36:06 polaris dovecot: imap(marco): Error: file_dotlock_open(/home/z/email/marco/dovecot.index.log) failed: Permission denied (euid=500(marco) egid=500(marco) missing +w perm: /home/z/email/marco, euid is not dir owner) May 25 13:36:06 polaris dovecot: imap(marco): Error: file_dotlock_create(/home/z/email/marco/dovecot-uidlist) failed: Permission denied (euid=500(marco) egid=500(marco) missing +w perm: /home/z/email/marco, euid is not dir owner) May 25 13:36:06 polaris dovecot: imap(marco): Error: file_dotlock_create(/home/z/email/marco/dovecot-uidlist) failed: Permission denied (euid=500(marco) egid=500(marco) missing +w perm: /home/z/email/marco, euid is not dir owner) May 25 13:36:06 polaris dovecot: imap(marco): Error: opendir(/home/z/email/marco/new) failed: Permission denied (euid=500(marco) egid=500(marco) missing +r perm: /home/z/email/marco/new, euid is not dir owner) May 25 13:36:06 polaris dovecot: imap(marco): Error: file_dotlock_create(/home/z/email/marco/dovecot-uidlist) failed: Permission denied (euid=500(marco) egid=500(marco) missing +w perm: /home/z/email/marco, euid is not dir owner) Again, this doesn't change changing ownership. Output of dovecot -n is below The only possible difference I can find between this and the previous install of the SAME distro/dovecot package is that this time I use ext4 filesystem. Maybe, I don't remember, I was using ext3 in the original install. What must I change to gain access again to my mailboxes??? thanks! Marco dovecot -n # 2.0.12: /etc/dovecot/dovecot.conf doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:88: ssl_disable has been renamed to ssl doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:979: auth_user has been replaced by service auth { user } doveconf: Warning: SSL is disabled because global ssl=no, ignoring ssl=yes for subsection # OS: Linux 2.6.35.13-91.fc14.x86_64 x86_64 Fedora release 14 (Laughlin) ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login listen = * mail_location = maildir:/home/z/email/%u mail_privileged_group = mail_imap passdb { args = scheme=plain username_format=%n /etc/local_dovecot_passwords driver = passwd-file } protocols = imap service auth { user = root } ssl = no userdb { args = username_format=%n /etc/local_dovecot_passwords driver = passwd-file } protocol lda { postmaster_address = postmaster(a)example.com }

2 2