May 2011 - dovecot - dovecot.org

[Dovecot] Bug: Fixed a duplicate
by Tom Sommer 06 Jun '11

06 Jun '11

I restored a dovecot mailserver today, and when I started the server again, the logs filled up with "Fixed a duplicate" warnings. This in itself it not a problem, the problem is that it appears the fix is not done correct. Consider this: Warning: Fixed a duplicate: [X]/cur/1305907573.V807I37682f3M146183.mail8.xxx.com:2,S -> 1306601066.M382668P27710.mail8.xxx.com The problem appears to be the timestamp of this new file isn't updated correctly. Now I got hundreds of mailboxes filled with mails named 1305907573.* with random (in the past) timestamps, leading to mangled miss-sorted inboxes for customers. 3575 May 25 02:05 1306600913.M982997P26976.mail8.xxx.com:2,S 55313 May 6 01:50 1306600913.M982998P26976.mail8.xxx.com:2,S 9839 May 7 23:59 1306600913.M982999P26976.mail8.xxx.com:2,S 3453 May 10 01:32 1306600913.M983000P26976.mail8.xxx.com:2,S 16616 May 14 00:22 1306600913.M983001P26976.mail8.xxx.com:2,S 68850 May 25 00:46 1306600913.M983002P26976.mail8.xxx.com:2,S etc. Dovecot is v. 2.0.11 I guess I should have deleted all dovecot.* files after the restore, before I started dovecot? // Tom

2 3

[Dovecot] dsync: Invalid mailbox first_recent_uid
by David Jonas 04 Jun '11

04 Jun '11

For the life of me I can't get dsync to work. Please help! Remote server runs dovecot out of /usr/local/dovecot2. Everything makes sense until this line: dsync-local(djonas(a)vitalwerks.com): Error: Invalid mailbox input from worker server: Invalid mailbox first_recent_uid The local uid is 8989 and the remote uid is 89. I added "first_valid_uid = 89" to the local conf but to no avail. Local version is 2.0.12, remote is 2.0.1. # dsync -Dv -u djonas(a)vitalwerks.com mirror \ ssh vmail(a)192.168.15.54 \ /usr/local/dovecot2/bin/dsync -Dv -u djonas(a)vitalwerks.com dsync(vmail): Debug: Effective uid=8989, gid=8989, home=/home/vmail/domains/vitalwerks.com/djonas dsync(vmail): Debug: Quota root: name=user backend=dict args=vitalwerks.com-djonas:proxy::quota dsync(vmail): Debug: dict quota: user=vitalwerks.com-djonas, uri=proxy::quota, noenforcing=0 dsync(vmail): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/Maildir:INBOX=~/Maildir dsync(vmail): Debug: maildir++: root=/home/vmail/domains/vitalwerks.com/djonas/Maildir, index=, control=, inbox=/home/vmail/domains/vitalwerks.com/djonas/Maildir dsync-local(djonas(a)vitalwerks.com): Debug: Namespace : Using permissions from /home/vmail/domains/vitalwerks.com/djonas/Maildir: mode=0770 gid=-1 dsync-local(djonas(a)vitalwerks.com): Error: Invalid mailbox input from worker server: Invalid mailbox first_recent_uid dsync-remote(djonas(a)vitalwerks.com): Error: read() from proxy client failed: EOF

2 2

[Dovecot] Segmentation fault again
by Jim Knuth 03 Jun '11

03 Jun '11

Hi, I have the following report after a cron job again? /root/tools/expunge: Zeile 3: 4869 Speicherzugriffsfehler doveadm expunge -A mailbox Spam savedbefore 5d /root/tools/expunge: Zeile 5: 4915 Speicherzugriffsfehler doveadm expunge -A mailbox Papierkorb savedbefore 4d See the attachment. Any ideas greatly appreciated. Thanks -- Mit freundlichen Grüßen, with kind regards, Jim Knuth --------- Das Leben ist bezaubernd, man muss es nur durch die richtige Brille sehen. (Alexandre Dumas)

3 8

[Dovecot] solr substring schema.xml
by Daniel Miller 03 Jun '11

03 Jun '11

I'm trying a modified schema.xml with solr - it appears I now have substring searches! I took the schema.xml file shipped with Dovecot, and modified the text field definition to be: <fieldType name="text" class="solr.TextField" positionIncrementGap="100"> <analyzer type="index"> <tokenizer class="solr.WhitespaceTokenizerFactory"/> <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt"/> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="1" catenateNumbers="1" catenateAll="0"/> <filter class="solr.LowerCaseFilterFactory"/> <filter class="solr.SnowballPorterFilterFactory" protected="protwords.txt"/> <filter class="solr.NGramFilterFactory" minGramSize="3" maxGramSize="15"/> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> </analyzer> <analyzer type="query"> <tokenizer class="solr.WhitespaceTokenizerFactory"/> <filter class="solr.SynonymFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/> <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt"/> <filter class="solr.WordDelimiterFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="0" catenateNumbers="0" catenateAll="0"/> <filter class="solr.LowerCaseFilterFactory"/> <filter class="solr.SnowballPorterFilterFactory" protected="protwords.txt"/> <filter class="solr.RemoveDuplicatesTokenFilterFactory"/> </analyzer> </fieldType> Changing to the new "SnowballPorter" instead of the deprecated "EnglishPorter" filters is probably minor - the magic is the "NGramFilterFactory". 3 & 15 seemed reasonable defaults for the min/max size to search on. -- Daniel

2 2

[Dovecot] unexpected subfolder locaton in Maildir/.INBOX.subfolder
by wulf 03 Jun '11

03 Jun '11

Hallo, I try to migrate existing imap server to dovecot 1.2 in debian squeeze if I connect to imap://user@host/INBOX Inbox works as expected and I get the content of Maildir/{cur,new,tmp} Maildir/.subfolder already exists if I connect to imap://user@host/INBOX.subfolder I get "folder not found" if I do a imap directory listing (raw mutt config, no subscriptions) - I see "../" - If I navigate to "../" I se all my existing subfolders if I create a new folder via imap the folder is created in Maildir/.INBOX.new_subfolder I expect the creation of Maildir/.new_subfolder This doesn't fit to the client configs and if I move the existing folders it doesn't fit to existing delivery agent filters and settings. I enabled mail_debug and the expansion looks ok for me: dovecot: imap-login: Login: user=<wulf>, method=PLAIN, rip=85.178.xx.xxx, lip=80.81.xxx.xxx, TLS dovecot: IMAP(wulf): Effective uid=112, gid=114, home=/var/mail/home/wulf dovecot: IMAP(wulf): maildir: data=~/Maildir dovecot: IMAP(wulf): maildir++: root=/var/mail/home/wulf/Maildir, index=, control=, inbox=/var/mail/home/wulf/Maildir the existing subscription information from courier-imap looks like INBOX.subolder Yes I can sed them to subfolder (of course I have to copy them to Maildir/subscriptions anyhow) But is that the idea? I like to avoid trouble with all the users and their already configured mail-clients. Where is my mistake? Thanks for feedback Best Wulf CONF: protocols = imap imaps log_timestamp = "%Y-%m-%d %H:%M:%S " ssl = required ssl_cert_file = /etc/exim4/xxxxxxxxxxxxxxx.pem ssl_key_file = /etc/exim4/xxxxxx.key mail_location = maildir:~/Maildir mail_uid = 112 mail_gid = 114 mail_access_groups = vmail mail_debug = yes first_valid_uid = 112 protocol imap { } protocol pop3 { pop3_uidl_format = %08Xu%08Xv } protocol managesieve { } auth_verbose = yes auth_debug = yes auth default { mechanisms = plain passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb static { args = uid=112 gid=114 home=/var/mail/home/%u } user = root } dict { } plugin { } dovecot-ldap.conf: hosts = 127.0.0.1:389 auth_bind = yes auth_bind_userdn = uid=%u,ou=users,dc=xxxxxxxx,dc=de base = dc=xxxxxxxx,dc=de

3 4

[Dovecot] slow squat fts index creation
by Cor Bosman 03 Jun '11

03 Jun '11

Hi all, ive been playing with squat indexes. Up to about 300.000 emails in a single mailbox this was working flawlessly. The search index file is about 500MB at that time. Ive now added some more emails, and at 450.000 or so emails im seeing a serious problem with squat index creation. It takes...f o r e v e r . The .tmp file is being so slowly, it will probably take 2-3 hours to create. Upto this point it took maybe a minute. Im doing this in an openvz container, so theoretically i may be hitting some openvz resource limit. But ive upped all the limits and dont see any improvements. I dont see any resources starvation either. Could there be some dovecot issue when the search index reaches say 1GB? (im estimating that it's now trying to save about 1GB search index). Regards, Cor

2 1

[Dovecot] Dovecot 1.2 with MySQL limit Trash folder
by Damien Robinet 03 Jun '11

03 Jun '11

Hi All, I need your help to limit the size of the Trash folder. I want to exclude the Trash folder in my user quota. But I do not want the Trash folder can not exceed 10M for example. I can manage to exclude the size of the Trash folder. But I can not limit the size of the folder. On my test, I've bytes=512000 for the Trash folder. But the user can move more that 512000B on the Trash folder ... Could you help me please ? Bests Regards, Damien ################################ ## My SQL query (dovecot-sql.conf) ## ################################ user_query = SELECT CONCAT( '/home/vmail/', maildir ) AS home, CONCAT( '/home/vmail/', maildir ) AS sieve_dir, 201 AS uid, 201 AS gid, CONCAT('*:storage=',ROUND((quota*1048.576)),'B') AS quota_rule, 'Trash:storage=50000B' AS quota_rule2, 'Trash:ignore' AS quota_rule3 FROM mail_mailbox WHERE username = '%u' AND actif = '1' ############ ## My Log: ## ############ 2011-05-24 20:08:59 imap-login: Info: Login: user=<postmaster(a)domain.tld>, method=PLAIN, rip=192.168.1.101, lip=192.168.1.10 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_autocreate_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_expire_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Effective uid=201, gid=201, home=/home/vmail/d/o/domain.tld/postmaster/ 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota root: name=user backend=dict args=:proxy::quota 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota rule: root=user mailbox=* bytes=1048576 messages=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota rule: root=user mailbox=Trash bytes=512000 messages=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: expire: No expire or expire_altmove settings - plugin disabled 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: dict quota: user=postmaster(a)domain.tld, uri=proxy::quota, noenforcing=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: maildir: data=/home/vmail/d/o/domain.tld/postmaster/ 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: maildir++: root=/home/vmail/d/o/domain.tld/postmaster, index=, control=, inbox=/home/vmail/d/o/domain.tld/postmaster 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Namespace : Using permissions from /home/vmail/d/o/domain.tld/postmaster: mode=0700 gid=-1 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Connection closed bytes=38/363 ################### ## My dovecot.conf ## ################### dict { quota = mysql:/etc/dovecot/dovecot-quota.conf } plugin { args = /etc/dovecot/dovecot-sql.conf quota = dict:user::proxy::quota autocreate = Junk autocreate2 = NonJunk autocreate3 = Drafts autocreate4 = Sent autocreate5 = Trash autosubscribe = Junk autosubscribe2 = NonJunk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = Trash }

2 1

[Dovecot] New IPC features : any configuration doc ?
by Joan Moreau 03 Jun '11

03 Jun '11

Hi, Dovecot complains at start for the ipc listener not correctly configured. What is the configuration scheme ? Thanks JM

2 5

[Dovecot] passdb: password contains illegal chars question
by Torsten Krah 03 Jun '11

03 Jun '11

Hi, some question about passdb backend: I'll receive this (using dovecot 2.0.13, pgsql passdb backend) for some users: mail dovecot: auth: passdb(account-username,127.0.0.1): Attempted login with password having illegal chars Password schema ist crypt-md5. So what "chars" does dovecot not like (why?) and whats the preferred way to fix this? regards Torsten -- Bitte senden Sie mir keine Word- oder PowerPoint-Anhänge. Siehe http://www.gnu.org/philosophy/no-word-attachments.de.html Really, I'm not out to destroy Microsoft. That will just be a completely unintentional side effect." -- Linus Torvalds

2 1

[Dovecot] doveadm segfault
by Joan Moreau 03 Jun '11

03 Jun '11

Hi, Using HG latest version, I get the following in the dmesg : [38041.387112] doveadm[20515]: segfault at 8 ip 000000000040f51d sp 00007fffb774c010 error 4 in doveadm[400000+2a000] [38041.397966] doveadm[20613]: segfault at 8 ip 000000000040f51d sp 00007fff953c1790 error 4 in doveadm[400000+2a000] [38041.428206] doveadm[20615]: segfault at 8 ip 000000000040f51d sp 00007ffffdce0cf0 error 4 in doveadm[400000+2a000] [38041.444879] doveadm[20619]: segfault at 8 ip 000000000040f51d sp 00007fffbb0668b0 error 4 in doveadm[400000+2a000] [38041.451815] doveadm[20622]: segfault at 8 ip 000000000040f51d sp 00007fff91d9b670 error 4 in doveadm[400000+2a000] [38041.459231] doveadm[20624]: segfault at 8 ip 000000000040f51d sp 00007fffe92b31b0 error 4 in doveadm[400000+2a000] [38041.468292] doveadm[20625]: segfault at 8 ip 000000000040f51d sp 00007fff5a4895c0 error 4 in doveadm[400000+2a000] [38041.481951] doveadm[20626]: segfault at 8 ip 000000000040f51d sp 00007fff8e84d010 error 4 in doveadm[400000+2a000] [38041.489414] doveadm[20629]: segfault at 8 ip 000000000040f51d sp 00007fff79206180 error 4 in doveadm[400000+2a000] [38041.512329] doveadm[20630]: segfault at 8 ip 000000000040f51d sp 00007ffff10582d0 error 4 in doveadm[400000+2a000] hundreds of times... No clue what is the bug.... JM

2 1