- dovecot - dovecot.org

Re: [Dovecot] Indexes.
by Robert Schetterer 03 Dec '10

03 Dec '10

Am 02.12.2010 14:53, schrieb Henrique Fernandes: > I have abou 9000 clients. many clients > > 500 GB of storage used small store anyway you shouldnt run into problems with that > > About the mail option at ocfs2 store creating, i guess the other guy > that format the storage system did not use. what a pitty , mail option help with small files performance like indexes and mail etc as far i remember > > We are looking into ocfs2 1.6 that was out few months ago. But we are > not able to get it running on or Centos5.5 yet. hm centos is more redhat style i speculate Red Hat GFS would have been the better choice is there a list at centos/redhat/ocfs you might can asked about bugs with your ocfs2/distro combination ? > > Are you talking abvout this optimizations? > > Dovecot supports reading a few fields from the <base filename>: > > * > > ,S=<size>: <size> contains the file size. Getting the size > from the filename avoids doing a stat(), which may improve the > performance. This is especially useful with Maildir++ quota > <http://wiki.dovecot.org/Quota/Maildir>. > > * > > ,W=<vsize>: <vsize> contains the file's RFC822.SIZE, ie. the > file size with linefeeds being CR+LF characters. If the > message was stored with CR+LF linefeeds, <size> and <vsize> > are the same. Setting this may give a small speedup because > now Dovecot doesn't need to calculate the size itself. > > A maildir filename with those fields would look something like: > 1035478339.27041_118.foo.org > <http://1035478339.27041_118.foo.org>,S=1000,W=1030:2,S as far i remember keep close to nfs recommands http://wiki2.dovecot.org/NFS FS caching problems NFS caching is a big problem when multiple computers are accessing the same mailbox simultaneously. The best fix for this is to prevent it from happening. Configure your setup so that a user always gets redirected to the same server (unless it's down). This also means that mail deliveries must be done by the same server, or alternatively it shouldn't update index files. Dovecot flushes NFS caches when needed if you set mail_nfs_storage=yes, but unfortunately this doesn't work 100%, so you can get random errors. Disabling NFS attribute cache helps a lot in getting rid of caching related errors, but this makes the performance MUCH worse and increases the load on NFS server. This can usually be done by giving actimeo=0 or noac mount option. Index files As described above, it's better to redirect users to the same server whenever possible. If you do this, it might also be a good idea to keep index files stored locally in that server. If user gets occasionally redirected to another server, the indexes will then be created locally there. This isn't a problem. However you might want to create a cronjob to delete old index directories. If you choose to keep the index files stored in NFS, you'll need to set mmap_disable=yes. Both the mmap_disable and indexing to NFS will result in a notable performance hit. If you're not running lockd you'll have to set lock_method=dotlock, but this degrades performance. Note that many NFS installations have problems with lockd. If you're beginning to get all kinds of locking related errors, try if the problems go away with dotlocking. ------------- but i agree, there should be more info with cluster file systems in the wiki perhaps Timo has time to send recommands by mail, i am not sure that mine are optimal ( whatever i have no problems yet ) > > > I will try send an image on the load of machine. > > > []'sf.rique > > > On Thu, Dec 2, 2010 at 11:25 AM, Robert Schetterer > <robert(a)schetterer.org <mailto:robert@schetterer.org>> wrote: > > Am 02.12.2010 14:10, schrieb Henrique Fernandes: > > With recomendation settings do you have ? > > http://wiki2.dovecot.org/MailLocation/SharedDisk > > and a few more optimizes about maildir > > > > how many clients ? > > i started the server not long ago so they are less yet ( about 100 > maildirs ) > but i have my own account in it which has massive mails ( 10 GB store > with over 1000 mails daily in out , and perhaps 10000 mails in store) > > > > > sorry, i did not say i use dovecot 2.0.6 > > looks fine, update to 2.0.8 if ready > > > did you use the mail option at ocfs2 store creation ? > > what os/distro do you use , i remember bugs with ocfs with some distro > versions > > > > > []'sf.rique > > > > > > On Thu, Dec 2, 2010 at 10:40 AM, Robert Schetterer > > <robert(a)schetterer.org <mailto:robert@schetterer.org> > <mailto:robert@schetterer.org <mailto:robert@schetterer.org>>> wrote: > > > > Am 02.12.2010 13:13, schrieb Henrique Fernandes: > > > Hello people! > > > > > > I have huge problems with IO wait becase dovecot configured > to use > > maildir > > > is under OCFS2 1.4. Now i have an question to OCFS2 each disk > > action is > > > really heavy becaue it has no index. > > > > > > Now i am thinking in what can be done to heltp my system to use > > less disk. > > > > > > Looking for index and etc in dovecot i found this, this > disables > > the index > > > file on disk and leave it on ram or it disable the index files ? > > > > > > If you really want to, you can also disable the index files > > completely by > > > appending :INDEX=MEMORY > > > > > > > > > I am only trying to get dovecot to work faster. Right now we > have > > to waing > > > some seconds to dovecot list all emails or read an email. > > > > > > I am also thinking in right index to an NFS but i don't know if > > this makes > > > any diferences in performance. > > > > > > Thanks to all! > > > > > > I use 3 servres wrinting on OCFS2 one is mailman, and other two > > are to > > > email, I have ipvs to load balance the conections. > > > > > > > > > []'sf.rique > > > > > > > hm , i have no problems with ocfs2 (1.4.3-1: amd64 ) on drbd > ubuntu > > lucid > > using dovecot vers 2 recommended settings for cluster file systems > > i have my index files in the maildir dir > > > > -- > > Best Regards > > > > MfG Robert Schetterer > > > > Germany/Munich/Bavaria > > > > > > > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > > -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

3 2

[Dovecot] Virtual folder root cannot be opened, virtual folders ok
by Tom Talpey 02 Dec '10

02 Dec '10

I am running dovecot 1.2.16 and not able to figure out an error that happens whenever I select the root of a virtual mailbox tree. At the moment I have a simple maildir store, accessed via IMAP, and have successfully added a virtual fs namespace with two subdirectories. I have created dovecot-virtual entries in the subdirs and they are working fine; they show the expected messages, etc. My problem is with the top-level virtual directory. If I happen to select it in Thunderbird (Eudora, actually), I receive a popup "The current command did not succeed. The mail server responded:Mailbox doesn't exist: Mobile." It also fails in the same way during search, which interrupts it and makes other client operations fail. I have tried placing a dovecot-virtual rule in the directory, leaving the directory empty, moving it in or out of the maildir tree, tweaking namespace and INDEX/LAYOUT options all with the same result - the subdirs are fine, the virtual root fails. I must be missing something obvious. Clue, please? Thanks! Relevant configuration: [~] # dovecot -n # 1.2.16: /etc/dovecot/dovecot.conf # OS: Linux 2.6.33.2 i686 ext4 ... mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir mail_executable: /usr/libexec/dovecot/imap mail_plugins: fts fts_squat virtual namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: Mobile/ location: virtual:%h/Mobile:INDEX=MEMORY list: yes subscriptions: yes ... [~] # ls -lsaR /var/MailRoot/domains/<d>/<u>/Maildir/Mobile Mobile: 4 drwx------ 4 xmail xmail 4096 Nov 30 16:06 ./ 20 drwx------ 243 xmail xmail 20480 Nov 30 20:55 ../ 4 -rw------- 1 xmail xmail 19 Nov 26 17:18 .virtual-subscriptions 4 drwx------ 2 xmail xmail 4096 Nov 29 10:54 Mail1/ 4 drwx------ 2 xmail xmail 4096 Nov 29 10:54 Mail2/ 4 -rw------- 1 xmail xmail 14 Nov 30 16:06 dovecot-virtual Mobile/Mail1: 4 drwx------ 2 xmail xmail 4096 Nov 29 10:54 ./ 4 drwx------ 4 xmail xmail 4096 Nov 30 16:06 ../ 4 -rw------- 1 xmail xmail 27 Nov 26 17:16 dovecot-virtual Mobile/Mail2: 4 drwx------ 2 xmail xmail 4096 Nov 29 10:54 ./ 4 drwx------ 4 xmail xmail 4096 Nov 30 16:06 ../ 4 -rw------- 1 xmail xmail 22 Nov 26 17:16 dovecot-virtual [~] #

2 2

[Dovecot] Virtual mailboxes and subfolders
by François-Xavier Payet 02 Dec '10

02 Dec '10

Hello again, I'd like to know if there is a way to have subfolders in virtual mailbox? In my virtual namespaces, I have some virtual maiboxes named like this : Mailbox Mailbox.SubMailbox (the separator is '.') But when I try to access the submailbox, depending on my client, it either : - Tells me the mailbox doesn't exists (Roundcube) - Don't show me any error, but don't display any mail in the mailbox (Apple Mail.app) So I'd like to know if this is because I can't make subfolders of virtual mailboxes, or if I'm doing something wrong. Thanks. François-Xavier Payet dovecot -n : # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-bpo.5-amd64 x86_64 Debian 5.0.7 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps managesieve login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): virtual mail_plugins(imap): virtual mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: . location: virtual:/var/vmail/%d/%n/Maildir/virtual:INDEX=MEMORY inbox: yes list: yes subscriptions: yes namespace: type: private separator: . prefix: RealMail. location: maildir:/var/vmail/%d/%n/Maildir hidden: yes list: no subscriptions: yes lda: log_path: /var/vmail/dovecot-deliver.log auth_socket_path: /var/run/dovecot/auth-master postmaster_address: foux(a)da-foux-server.tfdn.org mail_plugins: sieve virtual auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/var/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: sieve: /var/vmail/%d/%n/sieve sieve_dir: /var/vmail/%d/%n/.sieve

2 2

[Dovecot] Have inbox at the same place
by Spyros Tsiolis 02 Dec '10

02 Dec '10

Hello again, I have an installation with dovecot and I am accessing it through linux mint and thunderbird v3.0.10 As thunderbird "subscribes" to dovecot, it does the following : Inbox Trash MyName(a)Mydomain.gr Local Folders Local Folders MyName(a)Mydomain.gr subfolder A Subfolder B Subfolder C Subfolder D Subfolder E Local Folders Outbox OK, I have to admit a have a couple of folders more than what I need. But this is fine. My problem is that *everything* is in its respective place (say, *all* subfolders have their respective e-mail properly laid in there), but the messages I keep on the inbox is the "Inbox" folder. What I would like to have is my Inbox messages under (or *on*) MyName(a)Mydomain.gr folder. Also, trash mail goes to : Trash MyName(a)Mydomain.gr folder. Could this also be under the more generic MyName(a)Mydomain.gr folder further down the tree ? (Hope you understand this :-) The tree above is represented exactly as it looks like on thunderbird (with the indentations and everthing). The "dovecot -n" output follows : ------------------------------------------------------------------- # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-194.17.1.el5PAE i686 CentOS release 5.5 (Final) ext3 base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-info.log ssl: required ssl_parameters_regenerate: 48 verbose_ssl: yes login_dir: /var/run/dovecot//login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login login_greeting: * Dovecot ready * login_max_processes_count: 32 mail_location: maildir:/var/MailRoot/domains/%d/%n/Maildir mail_plugins: zlib auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: passwd-file args: /etc/dovecot/passwd passdb: driver: pam userdb: driver: static args: uid=vmail gid=vmail home=/home/vmail/%u userdb: driver: passwd ------------------------------------------------------------------- Is this possible ? TIA, Spyros ---- "I merely function as a channel that filters music through the chaos of noise" - Vangelis

1 2

[Dovecot] how do I fix this
by donovan jeffrey j 02 Dec '10

02 Dec '10

Greetings yesterday i was resetting an account from a script. and the user was deleted an re-added. subsequently the user now has two dovecot directories. One is active and working, accepting mail, and the other sits with all previous messages. is there anyway to merge these two buggers ? /Volumes/x/var/spool/imap/dovecot mail:dovecot root# ls -la | grep jsmith drwx------ 16 jsmith mail 544 Dec 2 08:39 330CE746-6F8D-4708-8877-A97FAFB9AADD drwx------ 20 jsmith mail 680 Dec 1 10:17 9EE12CA8-CC7B-4889-ABBA-525E5D522831 thanks for any info -j

2 1

[Dovecot] Permission denied error log messages
by Tim Traver 02 Dec '10

02 Dec '10

Hi Timo, ok, I have a large 2.07 NFS setup, and I have been monitoring error messages to make sure I catch things, and I've come across a lot of messages that come in pairs and look like this : Dec 01 17:48:35 lda(paul(a)xxxxxx.com): Error: write(/home/mailboxes/data/301/paul@xxxxxx.com/Maildir/tmp/1291254514.M620308P83269.mta2.scaledsystems.com) failed: Permission denied Dec 01 17:48:35 lda(paul(a)xxxxxx.com): Error: sieve: msgid=unspecified: failed to store into mailbox 'INBOX': Internal error occurred. Refer to server log for more information. [2010-12-01 17:48:34] I run the dovecot installation as a single user, and that user owns ALL of my virtual accounts directories. I checked, and there aren't any permissions that aren't correct. All the way up the tree has the same owner and group, and there are plenty of messages that make it through without any issue. The NFS servers don't have enough load on them to return errors for file operations, so I don't believe it is that. We use high end NetApp equipment and have never had any problems with them. I'm baffled as to why it gets permission denied message on the tmp directory. There does not seem to be a recognizable pattern for times, or particular accounts. I've just got a heck of a lot of these messages in the deliver log error files... I use qmail control files to feed the lda delivery for messages. When these errors happen, is the message lost? or is it still queued up in qmail's queue when the lda gives a fatal error like that? Thanks, Tim. here is my dovecot -n output : # 2.0.7: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.0-RELEASE-p3 i386 auth_username_format = %Lu auth_username_translation = %@ auth_verbose = yes disable_plaintext_auth = no dotlock_use_excl = yes first_valid_uid = 100 listen = * lock_method = dotlock log_path = /local/logs/dovecot.errors mail_fsync = always mail_gid = 100 mail_location = maildir:%h/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " quota" mail_uid = 100 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify mmap_disable = yes passdb { args = /bin/checkpassword_dovecot_auth driver = checkpassword } plugin { quota = maildir:User quota quota_rule = Trash:storage=+100M sieve = ~/.dovecot.sieve sieve_after = /home/mailboxes/sieve/to_spam_folder.sieve sieve_dir = ~/Maildir/sieve sieve_extensions = +notify +imapflags } protocols = imap pop3 sieve service auth { unix_listener auth-userdb { group = sn mode = 0600 user = sn } } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = prefetch } userdb { args = /bin/checkpassword_dovecot_deliver driver = checkpassword } verbose_proctitle = yes protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } protocol lda { info_log_path = /local/logs/dovecot-deliver.log log_path = /local/logs/dovecot-deliver-errors.log mail_plugins = " quota sieve" } protocol imap { mail_plugins = " quota imap_quota" } protocol sieve { managesieve_sieve_capability = comparator-i;ascii-numeric fileinto reject vacation imap4flags notify include envelope body relational regex subaddress copy }

3 5

[Dovecot] default directory for sent,trash,..
by spamvoll＠googlemail.com 02 Dec '10

02 Dec '10

hi.. is there any way to set default pathes for sent,trash and so on ? Every Client that connects uses different dirs (Outlook, Thunderbird, Android,..) thx

2 1

[Dovecot] All messages in double in a virtual mailbox.
by François-Xavier Payet 02 Dec '10

02 Dec '10

Hello, I've got some virtual maiboxes that are configured as follows : !RealMail.Sent RealMail.Sent all In all those mailboxes, all the messages appears in double. I don't think it's the expected behaviour, but I perhaps missed something. Here's my dovecot -n : # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-bpo.5-amd64 x86_64 Debian 5.0.7 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imaps managesieve login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): virtual mail_plugins(imap): virtual mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: . location: virtual:/var/vmail/%d/%n/Maildir/virtual inbox: yes list: yes subscriptions: yes namespace: type: private separator: . prefix: RealMail. location: maildir:/var/vmail/%d/%n/Maildir hidden: yes list: no subscriptions: yes lda: log_path: /var/vmail/dovecot-deliver.log auth_socket_path: /var/run/dovecot/auth-master postmaster_address: foux(a)da-foux-server.tfdn.org mail_plugins: sieve virtual auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/var/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: sieve: /var/vmail/%d/%n/sieve sieve_dir: /var/vmail/%d/%n/.sieve Thanks for your help François-Xavier Payet

2 2

[Dovecot] dovecot is confused about mail_location
by Eric Raymond 01 Dec '10

01 Dec '10

IMAP logins via fetchmail are failing on my mailserver root@grelber:/home/esr# tail -f /var/log/mail.err Nov 24 16:56:48 grelber dovecot: IMAP(cathy): mail_location not set and autodetection failed: Mail storage autodetection failed with home=/home/cathy Nov 24 16:56:48 grelber dovecot: IMAP(cathy): Fatal: Namespace initialization failed Nov 24 16:57:39 grelber dovecot: IMAP(cathy): mail_location not set and autodetection failed: Mail storage autodetection failed with home=/home/cathy Nov 24 16:57:39 grelber dovecot: IMAP(cathy): Fatal: Namespace initialization failed Nov 24 16:57:52 grelber dovecot: IMAP(cathy): mail_location not set and autodetection failed: Mail storage autodetection failed with home=/home/cathy Nov 24 16:57:52 grelber dovecot: IMAP(cathy): Fatal: Namespace initialization failed Nov 24 17:05:15 grelber dovecot: IMAP(cathy): mail_location not set and autodetection failed: Mail storage autodetection failed with home=/home/cathy Nov 24 17:05:15 grelber dovecot: IMAP(cathy): Fatal: Namespace initialization failed Nov 24 17:09:41 grelber dovecot: IMAP(cathy): mail_location not set and autodetection failed: Mail storage autodetection failed with home=/home/cathy Nov 24 17:09:41 grelber dovecot: IMAP(cathy): Fatal: Namespace initialization failed However: root@grelber:/home/esr# dovecot -n # 1.2.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-24-generic x86_64 Ubuntu 10.04.1 LTS log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail mail_location: mbox:~/mail:/var/mail/%u mbox_write_locks: fcntl dotlock auth default: passdb: driver: pam userdb: driver: passwd And cathy is a real user: root@grelber:/home/esr# grep cathy /etc/passwd cathy:x:1001:1001:Cathy Raymond,,,:/home/cathy:/bin/bash oot@grelber:/home/esr# ls -l /var/mail/cathy -rw------- 1 cathy mail 14296599 2010-11-24 17:30 /var/mail/cathy Dovecot appears confused about whether or not mail_location is set. Just to make matters more perplexing, when *I* fetch from IMAP - using a fetchmail configuration identical except for username - it works. This is driving me nuts. Help? -- <a href="http://www.catb.org/~esr/">Eric S. Raymond</a> "Taking my gun away because I might shoot someone is like cutting my tongue out because I might yell `Fire!' in a crowded theater." -- Peter Venetoklis

6 16

[Dovecot] Differences between Versions 1 and 2?
by Don Buchholz 01 Dec '10

01 Dec '10

What are the major differences between Versions 1.x and 2.0? I am beginning to set up a new mail server for a small group of users (~20 accounts). Options are the "0.99" version pre- packaged with RHEL-4, or building v1.2.16 or v2.0.7. Just wondering what the list recommends for a new installation. Thanks, - Don

3 2