- dovecot - dovecot.org

[Dovecot] Message file prefetching to memory
by Timo Sirainen 31 Mar '11

31 Mar '11

I added a new mail_prefetch_count setting to Dovecot v2.1 (http://hg.dovecot.org/dovecot-2.1/) Its main purpose is to avoid unnecessary latency while waiting for replies from remote server with imapc, i.e. instead of doing (FETCH, wait, FETCH, wait, ...) it can do (FETCH, FETCH, .., wait). For the same reason it's also going to be very useful once I add support for key-value databases / other high latency cloud filesystems. It also works with Maildir, single-dbox and cydir backends by calling posix_fadvise(POSIX_FADV_WILLNEED) for the files. This syscall is apparently only implemented by Linux. It should tell the kernel to start reading the files from disk to page cache. By calling this for multiple files, it should help the kernel optimize disk I/O. For example if 10 files are prefetched, the kernel might figure out that it should read them in a different order to avoid extra disk seeks. Perhaps it also does something useful with NFS, I don't know. I'm not sure if it would be a good idea to use this for mbox or multi-dbox files, since they already have multiple messages in same file so kernel probably already did some prefetching. With mdbox I guess it could be useful if the message file changes.. This optimization currently works only for FETCH command (and POP3 RETR and TOP). SEARCH/THREAD/SORT commands will hopefully implement it soon also. I'd be interested in knowing what the effects of this setting are if anyone tests this some day.

1 0

[Dovecot] Increase /proc/sys/fs/inotify/max_user_instances
by Adrian Stoica 31 Mar '11

31 Mar '11

Hi I allready have set 256 on max_user_instances , and in the log i keep seeing Mar 28 10:08:44 mail dovecot: imap(some.username): Warning: Inotify instance limit for user 98 (UID vmail) exceeded, disabling. Increase /proc/sys/fs/inotify/max_user_instances All users use thunderbird 3.1.9 , and from time to time this show in log , with a random user. What can i do to resolve this issue ? my doveconf-n : # 2.0.11: /usr/dovecot2/etc/dovecot/dovecot.conf # OS: Linux 2.6.35.4 i686 auth_cache_negative_ttl = 10 secs auth_cache_size = 10 M auth_cache_ttl = 1 mins auth_mechanisms = plain login cram-md5 auth_socket_path = /var/run/dovecot/auth-userdb auth_verbose_passwords = plain base_dir = /var/run/dovecot/ default_client_limit = 5000 default_internal_user = vmail default_login_user = nobody default_process_limit = 200 deliver_log_format = mail from=%f subject=%s msgid=%m: %$ dict { acl = mysql:/usr/dovecot2/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 1 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * mail_location = maildir:~/Maildir mail_plugins = " quota acl trash notify mail_log" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { inbox = yes location = prefix = separator = / subscriptions = yes type = private } namespace { hidden = no list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } passdb { args = /usr/dovecot2/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile acl_shared_dict = proxy::acl autocreate = Trash autocreate2 = Drafts autocreate3 = Sent autosubscribe = Trash autosubscribe2 = Drafts autosubscribe3 = INBOX autosubscribe4 = Sent mail_log_events = delete mailbox_delete mailbox_rename mail_log_group_events = yes quota = maildir:User quota quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=95%% quota-warning 90 %u quota_warning3 = storage=85%% quota-warning 85 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve trash = /usr/dovecot2/etc/dovecot/dovecot-trash.conf.ext } postmaster_address = postmaster(a)mydomain.com protocols = imap rejection_subject = Rejected: %s: %r service auth { unix_listener auth-userdb { mode = 0660 user = vmail } } service dict { unix_listener dict { user = vmail } } service imap-login { process_min_avail = 16 service_count = 1 } service imap { process_limit = 2048 vsz_limit = 512 M } service quota-warning { executable = script /bin/quota_warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /usr/dovecot2/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lda { mail_plugins = " quota acl trash notify mail_log sieve autocreate" } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 16 mail_plugins = " quota acl trash notify mail_log imap_quota imap_acl" }

2 2

[Dovecot] log
by Walt Shekrota 30 Mar '11

30 Mar '11

does the following indicate TLS is configured? 2011-03-30 10:37:07 auth(default): Info: client out: OK 1 user=wshek 2011-03-30 10:37:07 auth(default): Info: master in: REQUEST 2 13371 1 2011-03-30 10:37:07 auth(default): Info: passwd(wshek,127.0.0.1): lookup 2011-03-30 10:37:07 auth(default): Info: master out: USER 2 wshek system_groups_user=wshek uid=1000 gid=1000 home=/home/wshek 2011-03-30 10:37:07 imap-login: Info: Login: user=<wshek>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, TLS If it is I do not intend it. How can I turn it off? Thanks. -Walt

2 2

[Dovecot] v1.2.12 and debug
by Walt Shekrota 30 Mar '11

30 Mar '11

Is there some kind of extended debug that might show why my maildir is not foundat login? It has worked off and on, once briefly today then no more. I'm going around twiddling knobs guessing at this point which is foolish. I need some real bread crumbs to indicate what is going wrong. I've tried all kinds of .conf file ... example file etc. I figured using the least number of settings should get me somewhere but I still have no luck. I'd love to just give up and load that PPA for 2.x but I have no idea what package to install in debian. (I have the PPA update) Thanks. -Walt

2 1

[Dovecot] dovecot.conf
by Walt Shekrota 30 Mar '11

30 Mar '11

In 1.2.12 or there abouts how do changes in the dovecot.conf happen? After doing the sig HUP I have noted there is generally a delay in the recognition of items in my .conf. An example I had logging set off, turned it on and it was several restarts before I again saw logging? This delay is driving me nuts in trying to figure out what needs to change. Thanks. -Walt

2 2

[Dovecot] dovecot-lda can not find home dir
by Pete 30 Mar '11

30 Mar '11

Hello, Running dovecot 2.0.11 and pigeonhole on Fedora 14 x86_64. The lda can not seem to find the user's home directory, yet other parts of dovecot (pop3, imap, managesieve) can. Grepping "Effective uid" from /var/log/maillog: Mar 29 11:21:34 new-eagle dovecot: pop3(pete): Debug: Effective uid=726, gid=726, home=/home/pete Mar 29 11:23:18 new-eagle dovecot: imap(pete): Debug: Effective uid=726, gid=726, home=/home/pete Mar 29 11:23:52 new-eagle dovecot: managesieve(pete): Debug: Effective uid=726, gid=726, home=/home/pete Mar 29 11:24:53 new-eagle dovecot: managesieve(pete): Debug: Effective uid=726, gid=726, home=/home/pete Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: Effective uid=726, gid=726, home= Although mail does get delivered, the .dovecot.lda-dupes file can not be created because of this: Mar 29 11:26:15 new-eagle dovecot: lda: Debug: Loading modules from directory: /usr/lib64/dovecot Mar 29 11:26:15 new-eagle dovecot: lda: Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: Effective uid=726, gid=726, home= Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: fs: root=/home/pete/mail, index=, control=, inbox=/var/spool/mail/pete Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: userdb lookup skipped, username taken from passwd lookup for process euid Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: none: root=, index=, control=, inbox= Mar 29 11:26:15 new-eagle dovecot: lda(pete): Error: User pete doesn't have home dir set, disabling duplicate database Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: sieve: using sieve path for user's script: /home/pete/.dovecot.sieve Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: sieve: opening script /home/pete/.dovecot.sieve Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: sieve: script /home/pete/.dovecot.sieve successfully compiled Mar 29 11:26:15 new-eagle dovecot: lda(pete): Debug: sieve: executing script from /home/pete/.dovecot.sieve Mar 29 11:26:15 new-eagle dovecot: lda(pete): sieve: msgid=<FF641E3CEA3748B5B7D678ABE85F1A7B@pete1>: stored mail into mailbox 'INBOX' Dovecot seems to be able to determine the user's home directory, but I do not know how to tell dovecot-lda where it is. Running "doveadm user pete" produces: userdb: pete system_groups_user: pete uid : 726 gid : 726 home : /home/pete In /home/pete, the .forward file is: | "/usr/libexec/dovecot/dovecot-lda" Entry from /etc/passwd: pete:x:726:726:Peter:/home/pete:/bin/false Output of dovecot -n: # 2.0.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.35.11-83.fc14.x86_64 x86_64 Fedora release 14 (Laughlin) ext4 auth_cache_size = 10 M auth_debug = yes auth_mechanisms = login plain auth_verbose = yes disable_plaintext_auth = no listen = * mail_debug = yes mail_location = mbox:/home/%u/mail:INBOX=/var/spool/mail/%u:INDEX=MEMORY managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mbox_write_locks = fcntl passdb { driver = pam } plugin/sieve = /home/%u/.dovecot.sieve plugin/sieve_dir = /home/%u/sieve protocols = pop3 imap sieve rejection_reason = Sorry, your message was automatically rejected:%n%r rejection_subject = failure notice re: %s service managesieve-login { inet_listener sieve { port = 4190 } } ssl = no userdb { driver = passwd } protocol lda { mail_plugins = sieve I did update from dovecot-2.0.9 (which the lda could find the home directory) but I also had to change the mail_location from: mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=MEMORY to: mail_location = mbox:/home/%u/mail:INBOX=/var/spool/mail/%u:INDEX=MEMORY Also had to change: plugin/sieve = ~/.dovecot.sieve plugin/sieve_dir = ~/sieve To: plugin/sieve = /home/%u/.dovecot.sieve plugin/sieve_dir = /home/%u/sieve ... in order for 2.0.11 to function. Any thoughts on how to get the home dir passed correctly to lda ? Thanks, Pete

2 3

[Dovecot] service auth { client_limit=4096 } is lower than required under max. load (5720
by Frank Bonnet 30 Mar '11

30 Mar '11

Hello Since I started up dovecot2 this morning I get this kind of warning message when I start Dovecot Help appreciated thanks doveconf: Warning: service auth { client_limit=4096 } is lower than required under max. load (5720) Stopping dovecot. Waiting for PIDS: 79978, 79978. doveconf: Warning: service auth { client_limit=4096 } is lower than required under max. load (5720) Starting dovecot. doveconf: Warning: service auth { client_limit=4096 } is lower than required under max. load (5720) Warning: service auth { client_limit=4096 } is lower than required under max. load (5720)

2 1

[Dovecot] migrating to dovecot
by Alexandre Chapellon 30 Mar '11

30 Mar '11

Hello, I am trying to setup a migration scenario from an proprietary solution to dovecot IMAP/POP3. Whereas am only at the strating point, things appear quite complicated because of the following reasons: - The proprietary solution uses special/own/proprietary mailbox format (wich is more like maildir but is not maildir) - I don't have direct access to the filesystem where the mails are stored. The best I could do would be a snapshots of the filesystem - I have about 1,5TB of mail data. - Having users to be forced to empty their mailbox before migration or re-download their whole mailbox after migration would be something hard for me to present as a correct option. Am looking for advices that would avoid me loosing time searching in bad directions. Or even point me to a miraculous tool thatdoes all magic while i have a beer :) Best regards. -- horoa: la voie est libre

4 6

[Dovecot] dovecot.conf settings vs 'dovecot-n' output
by Walt Shekrota 30 Mar '11

30 Mar '11

I am curious why these do not seem to match? It especially bothers me that the modes set are different. Am I missing something? Thanks. -Walt

2 1

[Dovecot] 1.2 problem 'dovecot -n' vs dovecot.conf
by Walt Shekrota 30 Mar '11

30 Mar '11

To elaborate, if there is a database associated with this setup it is really fubar. note: tail of dovecot -n lda: postmaster_address: postmaster mail_plugins: sieve quota_full_tempfail: yes deliver_log_format: msgid=%m: %$ rejection_reason: Your message to <%t> was automatically rejected:%n%r auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 504 socket: type: listen client: path: /var/spool/postfix/private/dovecot-auth mode: 432 user: postfix group: postfix plugin: sieve: ~/.dovecot.sieve sieve_dir: ~/sieve This in no way represents the settings in my dovecot.conf. It seems to have rembered old .conf settings and mixed them. At no time was mode 504 set or even 432. What am I doing wrong? Thanks. -Walt I'm also toying with the idea of loading 2.x if I can figure out the PPA stuff.

2 1