- dovecot - dovecot.org

[Dovecot] slow squat fts index creation
by Cor Bosman 03 Jun '11

03 Jun '11

Hi all, ive been playing with squat indexes. Up to about 300.000 emails in a single mailbox this was working flawlessly. The search index file is about 500MB at that time. Ive now added some more emails, and at 450.000 or so emails im seeing a serious problem with squat index creation. It takes...f o r e v e r . The .tmp file is being so slowly, it will probably take 2-3 hours to create. Upto this point it took maybe a minute. Im doing this in an openvz container, so theoretically i may be hitting some openvz resource limit. But ive upped all the limits and dont see any improvements. I dont see any resources starvation either. Could there be some dovecot issue when the search index reaches say 1GB? (im estimating that it's now trying to save about 1GB search index). Regards, Cor

2 1

[Dovecot] Dovecot 1.2 with MySQL limit Trash folder
by Damien Robinet 03 Jun '11

03 Jun '11

Hi All, I need your help to limit the size of the Trash folder. I want to exclude the Trash folder in my user quota. But I do not want the Trash folder can not exceed 10M for example. I can manage to exclude the size of the Trash folder. But I can not limit the size of the folder. On my test, I've bytes=512000 for the Trash folder. But the user can move more that 512000B on the Trash folder ... Could you help me please ? Bests Regards, Damien ################################ ## My SQL query (dovecot-sql.conf) ## ################################ user_query = SELECT CONCAT( '/home/vmail/', maildir ) AS home, CONCAT( '/home/vmail/', maildir ) AS sieve_dir, 201 AS uid, 201 AS gid, CONCAT('*:storage=',ROUND((quota*1048.576)),'B') AS quota_rule, 'Trash:storage=50000B' AS quota_rule2, 'Trash:ignore' AS quota_rule3 FROM mail_mailbox WHERE username = '%u' AND actif = '1' ############ ## My Log: ## ############ 2011-05-24 20:08:59 imap-login: Info: Login: user=<postmaster(a)domain.tld>, method=PLAIN, rip=192.168.1.101, lip=192.168.1.10 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Loading modules from directory: /usr/lib/dovecot/modules/imap 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib10_quota_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib11_imap_quota_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_autocreate_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Module loaded: /usr/lib/dovecot/modules/imap/lib20_expire_plugin.so 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Effective uid=201, gid=201, home=/home/vmail/d/o/domain.tld/postmaster/ 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota root: name=user backend=dict args=:proxy::quota 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota rule: root=user mailbox=* bytes=1048576 messages=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Quota rule: root=user mailbox=Trash bytes=512000 messages=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: expire: No expire or expire_altmove settings - plugin disabled 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: dict quota: user=postmaster(a)domain.tld, uri=proxy::quota, noenforcing=0 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: maildir: data=/home/vmail/d/o/domain.tld/postmaster/ 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: maildir++: root=/home/vmail/d/o/domain.tld/postmaster, index=, control=, inbox=/home/vmail/d/o/domain.tld/postmaster 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Namespace : Using permissions from /home/vmail/d/o/domain.tld/postmaster: mode=0700 gid=-1 2011-05-24 20:08:59 IMAP(postmaster(a)domain.tld): Info: Connection closed bytes=38/363 ################### ## My dovecot.conf ## ################### dict { quota = mysql:/etc/dovecot/dovecot-quota.conf } plugin { args = /etc/dovecot/dovecot-sql.conf quota = dict:user::proxy::quota autocreate = Junk autocreate2 = NonJunk autocreate3 = Drafts autocreate4 = Sent autocreate5 = Trash autosubscribe = Junk autosubscribe2 = NonJunk autosubscribe3 = Drafts autosubscribe4 = Sent autosubscribe5 = Trash }

2 1

[Dovecot] New IPC features : any configuration doc ?
by Joan Moreau 03 Jun '11

03 Jun '11

Hi, Dovecot complains at start for the ipc listener not correctly configured. What is the configuration scheme ? Thanks JM

2 5

[Dovecot] passdb: password contains illegal chars question
by Torsten Krah 03 Jun '11

03 Jun '11

Hi, some question about passdb backend: I'll receive this (using dovecot 2.0.13, pgsql passdb backend) for some users: mail dovecot: auth: passdb(account-username,127.0.0.1): Attempted login with password having illegal chars Password schema ist crypt-md5. So what "chars" does dovecot not like (why?) and whats the preferred way to fix this? regards Torsten -- Bitte senden Sie mir keine Word- oder PowerPoint-Anhänge. Siehe http://www.gnu.org/philosophy/no-word-attachments.de.html Really, I'm not out to destroy Microsoft. That will just be a completely unintentional side effect." -- Linus Torvalds

2 1

[Dovecot] doveadm segfault
by Joan Moreau 03 Jun '11

03 Jun '11

Hi, Using HG latest version, I get the following in the dmesg : [38041.387112] doveadm[20515]: segfault at 8 ip 000000000040f51d sp 00007fffb774c010 error 4 in doveadm[400000+2a000] [38041.397966] doveadm[20613]: segfault at 8 ip 000000000040f51d sp 00007fff953c1790 error 4 in doveadm[400000+2a000] [38041.428206] doveadm[20615]: segfault at 8 ip 000000000040f51d sp 00007ffffdce0cf0 error 4 in doveadm[400000+2a000] [38041.444879] doveadm[20619]: segfault at 8 ip 000000000040f51d sp 00007fffbb0668b0 error 4 in doveadm[400000+2a000] [38041.451815] doveadm[20622]: segfault at 8 ip 000000000040f51d sp 00007fff91d9b670 error 4 in doveadm[400000+2a000] [38041.459231] doveadm[20624]: segfault at 8 ip 000000000040f51d sp 00007fffe92b31b0 error 4 in doveadm[400000+2a000] [38041.468292] doveadm[20625]: segfault at 8 ip 000000000040f51d sp 00007fff5a4895c0 error 4 in doveadm[400000+2a000] [38041.481951] doveadm[20626]: segfault at 8 ip 000000000040f51d sp 00007fff8e84d010 error 4 in doveadm[400000+2a000] [38041.489414] doveadm[20629]: segfault at 8 ip 000000000040f51d sp 00007fff79206180 error 4 in doveadm[400000+2a000] [38041.512329] doveadm[20630]: segfault at 8 ip 000000000040f51d sp 00007ffff10582d0 error 4 in doveadm[400000+2a000] hundreds of times... No clue what is the bug.... JM

2 1

[Dovecot] Error: file_dotlock_create failed: Permission denied
by M. Fioretti 03 Jun '11

03 Jun '11

Hi, I have a Fedora 14 x86_64 computer. I run dovecot 2.0.12 on it, only to keep a local imap copy of all my email, in maildir format. A couple days ago the hard disk broke, so I bought a new one, and reinstalled Fedora 14 x86_64 with all the updates. Then I copied all the maildirs from a backup to the new drive. But I can't access email now. No matter how I change sticky bits or ownership and permissions of all the involved files and directories, etc.. Login succeeds, but I get this error whenever I try to create new mailboxes or access existing ones: May 25 13:36:03 polaris dovecot: imap-login: Login: user=<marco>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=8489, secured May 25 13:36:06 polaris dovecot: imap(marco): Error: file_dotlock_open(/home/z/email/marco/dovecot.index.log) failed: Permission denied (euid=500(marco) egid=500(marco) missing +w perm: /home/z/email/marco, euid is not dir owner) May 25 13:36:06 polaris dovecot: imap(marco): Error: file_dotlock_create(/home/z/email/marco/dovecot-uidlist) failed: Permission denied (euid=500(marco) egid=500(marco) missing +w perm: /home/z/email/marco, euid is not dir owner) May 25 13:36:06 polaris dovecot: imap(marco): Error: file_dotlock_create(/home/z/email/marco/dovecot-uidlist) failed: Permission denied (euid=500(marco) egid=500(marco) missing +w perm: /home/z/email/marco, euid is not dir owner) May 25 13:36:06 polaris dovecot: imap(marco): Error: opendir(/home/z/email/marco/new) failed: Permission denied (euid=500(marco) egid=500(marco) missing +r perm: /home/z/email/marco/new, euid is not dir owner) May 25 13:36:06 polaris dovecot: imap(marco): Error: file_dotlock_create(/home/z/email/marco/dovecot-uidlist) failed: Permission denied (euid=500(marco) egid=500(marco) missing +w perm: /home/z/email/marco, euid is not dir owner) Again, this doesn't change changing ownership. Output of dovecot -n is below The only possible difference I can find between this and the previous install of the SAME distro/dovecot package is that this time I use ext4 filesystem. Maybe, I don't remember, I was using ext3 in the original install. What must I change to gain access again to my mailboxes??? thanks! Marco dovecot -n # 2.0.12: /etc/dovecot/dovecot.conf doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:88: ssl_disable has been renamed to ssl doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:979: auth_user has been replaced by service auth { user } doveconf: Warning: SSL is disabled because global ssl=no, ignoring ssl=yes for subsection # OS: Linux 2.6.35.13-91.fc14.x86_64 x86_64 Fedora release 14 (Laughlin) ext4 auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login listen = * mail_location = maildir:/home/z/email/%u mail_privileged_group = mail_imap passdb { args = scheme=plain username_format=%n /etc/local_dovecot_passwords driver = passwd-file } protocols = imap service auth { user = root } ssl = no userdb { args = username_format=%n /etc/local_dovecot_passwords driver = passwd-file } protocol lda { postmaster_address = postmaster(a)example.com }

2 2

[Dovecot] Squat Question!
by Henrique Fernandes 03 Jun '11

03 Jun '11

Hello folks, I use dovecot squat for indexing. I use to have fts_squat = partial=4 full=4 But i change to fts_squat = partial=4 full=8 My question is, do i need to delete older indexes to have it consistenly, or dovecot is able "update" the indexes or it sees that it is broken and rebuild it all? Other question, is there an comand line to update the indexes ? Thanks a lot! []'sf.rique

3 7

[Dovecot] This is appear a fts bug
by Antonio Perez-Aranda 03 Jun '11

03 Jun '11

I have checked this on dovecot 2.0.9 and 2.0.13 with fts-solr without patching. If you execute the follow IMAP script, then the imap process die by and a "assert" . select "inbox." . search text something After search, the connection is aborted in the client side, and imap process died on the server. When the log in dovecot says: (fts_backend_solr_init): assertion failed: (*box_name != '\0') After debug the code, there isn't in context any possibility to get "box_name". With squat plugin it is running. -- Antonio Pérez-Aranda Alcaide aperezaranda(a)yaco.es Yaco Sistemas S.L. http://www.yaco.es/ C/ Rioja 5, 41001 Sevilla Teléfono +34 954 50 00 57 Fax +34 954 50 09 29

2 1

[Dovecot] v2.0.13 released
by Sean Donelan 03 Jun '11

03 Jun '11

After configure and compiling dovecot-2.0.13, running "make check" fails on a few tests on sparc/solaris net_is_in_network(0) ................................................. : ok net_is_in_network(1) ................................................. : ok net_is_in_network(2) ................................................. : ok net_is_in_network(3) ................................................. : ok net_is_in_network(4) ................................................. : ok net_is_in_network(5) ................................................. : ok net_is_in_network(6) ................................................. : ok net_is_in_network(7) ................................................. : ok net_is_in_network(8) ................................................. : ok net_is_in_network(9) ................................................. : ok net_is_in_network(10) ................................................ : ok net_is_in_network(11) ................................................ : FAILED net_is_in_network(12) ................................................ : FAILED net_is_in_network(13) ................................................ : ok net_is_in_network(14) ................................................ : ok net_is_in_network(15) ................................................ : ok net_is_in_network(16) ................................................ : ok The failing tests are for { "255.255.255.255", "128.0.0.0", 1, TRUE }, { "255.255.255.255", "127.0.0.0", 1, FALSE } src/lib/network.c src/lib/test-network

2 1

[Dovecot] shared folders "invisible" on new setup
by Torsten Harenberg 03 Jun '11

03 Jun '11

Dear list, I hope this is not an old issue, but I couldn't find a solution even after google'ing quite some time. I try to migrate our institute's mail server (~200 users) from an old cyrus-based Mac installation to a new machine (NetBSD, dovecot 2.0.13). Everything went quite smoothly so far, but we are used to have "shared folders" ("public" folders in dovecot) and I simply couldn't make them to appear. I have two separate folders for private (user) mails and for public ones (yes, I set everything to 777 for the moment to avoid file access problems) : mailserver# pwd /var/mail mailserver# ls -al total 8 drwxrwxrwt 4 dovecot wheel 512 May 31 12:26 . drwxr-xr-x 28 root wheel 512 Mar 29 15:05 .. drwxrwxrwx 3 root mail 512 May 31 15:18 public drwxrwxrwx 4 root wheel 512 May 31 12:26 user In the public folder there is a shared folder named "fb8": mailserver# pwd /var/mail/public mailserver# ls -al total 8 drwxrwxrwx 3 root mail 512 May 31 15:18 . drwxrwxrwt 4 dovecot wheel 512 May 31 12:26 .. -rw-rw-rw- 1 10001 mail 0 May 31 15:14 dovecot-acl-list -rwxrwxrwx 1 root mail 0 May 31 11:06 dovecot-shared drwxrwxrwx 5 root mail 512 May 31 12:03 fb8 Now my own username (LDAP-based) is "harenber" and I try to subscribe myself to this list: mailserver# doveadm mailbox subscribe -u harenber public.fb8 mailserver# So a "subscriptions" file appears: mailserver# ls -al total 8 drwxrwxrwx 3 root mail 512 May 31 15:18 . drwxrwxrwt 4 dovecot wheel 512 May 31 12:26 .. -rw-rw-rw- 1 10001 mail 0 May 31 15:14 dovecot-acl-list -rwxrwxrwx 1 root mail 0 May 31 11:06 dovecot-shared drwxrwxrwx 5 root mail 512 May 31 12:03 fb8 -rw-rw-rw- 1 10001 mail 4 May 31 15:18 subscriptions mailserver# cat subscriptions fb8 mailserver# (although I think this is wrong, as I have namespace { list = children location = maildir:/var/mail/public:INDEX=~/public prefix = public. separator = . subscriptions = no type = public } I would assume this file to appear somewhere in /var/mail/user/harenber/public... ) But I cannot access this "fb8" folder with any client. Alpine says that the public folder is empty: ----------------------------------------------------------------------------------------------------------------------------------Folder-Collection <test> ---------------------------------------------------------------------------------------------------------------------------------- [No Folders in Collection] and also Apple Mail sees nothing beneath "public". Tried to speak IMAP directly shows: 01 login harenber XXXXX 01 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS ACL RIGHTS=texk] Logged in 02 namespace * NAMESPACE (("" ".")) NIL (("public." ".")) 02 OK Namespace completed. 03 list "" * * LIST (\HasNoChildren) "." "Trash" * LIST (\HasNoChildren) "." "ALiCEnext" [...] * LIST (\HasNoChildren) "." "sent-mail" * LIST (\HasNoChildren) "." "tier2" * LIST (\HasNoChildren) "." "trash" * LIST (\HasNoChildren) "." "INBOX" * LIST (\Noselect \HasChildren) "." "public" 03 OK List completed Maybe someone of you has a clue what I do wrong here, I'm completely lost at the moment. Thanks for any hint and best regards, Torsten mailserver# doveconf -n # 2.0.13: /usr/pkg/etc/dovecot/dovecot.conf # OS: NetBSD 5.1 amd64 ffs auth_debug = yes auth_verbose = yes base_dir = /var/run/dovecot/ mail_debug = yes mail_gid = 6 mail_location = maildir:/var/mail/user/%u mail_plugins = acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { inbox = yes location = prefix = separator = . type = private } namespace { list = children location = maildir:/var/mail/public:INDEX=%u/public prefix = public. separator = . subscriptions = no type = public } passdb { args = /usr/pkg/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = dovecot user = dovecot } } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } ssl_cert = </etc/certificates/mail.physik.uni-wuppertal.de.crt ssl_key = </etc/certificates/mail.physik.uni-wuppertal.de.key userdb { args = /usr/pkg/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = sieve } protocol lda { mail_plugins = sieve } protocol imap { mail_plugins = acl imap_acl } protocol sieve { managesieve_implementation_string = Dovecot Pigeonhole } mailserver# -- <><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><><> <> <> <> Dr. Torsten Harenberg harenberg(a)physik.uni-wuppertal.de <> <> Bergische Universitaet <> <> FB C - Physik Tel.: +49 (0)202 439-3521 <> <> Gaussstr. 20 Fax : +49 (0)202 439-2811 <> <> 42097 Wuppertal <> <> <> <><><><><><><>< Of course it runs NetBSD http://www.netbsd.org ><>

2 4