- dovecot - dovecot.org

[Dovecot] Questions about converting maildir to mdbox.
by Henrique Fernandes 12 Apr '11

12 Apr '11

First of all i would like to thanks Timo for the excellent job done in dovecot. We are using it in you prodution server with about 5 millions of emails and it is pretty good, only a performance problens but i guess it is realated to ocfs2 that we are using. So lets begin: We are using dovecot 2.0.6 with maildir in an ocfs2 partiton. It is pretty slow access in peak time, but it is related to ocfs2 as i said before, i am trying to mimimize the ocfs2 latancy by using mdbox. Another problem that we have are Full backup that takes about 24h and incremental takes about 13h I am thinking in converting some email for testing propose, but i am wondoring how would dovecot convert this, like if i convert all mail from maildir to mdbox it would make many mailbox based on this seetings ? Or in the first convert it would make a big mdbox file and after it it will rotate by day or it would make many boxes just based on size? mdbox_rotate_size = 5m mdbox_rotate_interval = 1d Well, another thing can i make rotate interval happens in a certain time of day? end from where it takes this time ? it rotates at midnight ? Another one!, if i lose the index files what really happens ? Sometimes in my server the index get corrupet and as i am reading mdbox index files held information that is not in other place. So what should i do to prevent any possible lose of data even if i lose the indexes? I was reading about backup restore also, but i did not get it pretty well. With maildir we simple restore the files and the index gets rebuilt! What should i do with mdbox ? Restore the files and the index ? But how about the other emails that the account got after the backup, how i should merge the multiple files and more importanet how do i merge the index files ? Well, sorry about my english! And Thanks alot guys! []'sf.rique

3 4

[Dovecot] Vpopmail and lastauth
by mailing＠securitylabs.it 12 Apr '11

12 Apr '11

Hello, I'm migrating many accounts to a new server with vpopmail 5.4.33 and dovecot 2.0.11. I've already vpopmail 5.4.32 and dovecot 1.2.16 on others servers running without problems. With dovecot 2.0.11 my lastauth file is not updated. This file usually is update on any access (smtp, pop3, imap) with the client's IP, for every mailbox. Now it's updated only when a client authenticate itself via SMTP (smtp-auth with qmail + vpopmail), and not with imap/pop3 access. My conf: # 2.0.11: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.1 auth_cache_negative_ttl = 2 mins auth_cache_size = 1000 M auth_cache_ttl = 2 mins auth_mechanisms = plain cram-md5 apop auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@& disable_plaintext_auth = no first_valid_uid = 89 last_valid_uid = 95 lock_method = dotlock log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = Server ready. mail_fsync = never mail_gid = vchkpw mail_location = maildir:~/Maildir mail_privileged_group = vchkpw mail_uid = vpopmail namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = webmail=127.0.0.1 driver = vpopmail } plugin/mail_log_events = delete expunge plugin/mail_log_group_events = plugin/quota = maildir plugin/quota_rule = ?:storage=0 pop3_uidl_format = %f protocols = imap pop3 service auth { unix_listener auth-userdb { group = vchkpw mode = 0600 user = vpopmail } } service imap-login { client_limit = 256 process_limit = 128 process_min_avail = 3 service_count = 1 } service imap { drop_priv_before_exec = yes process_limit = 256 vsz_limit = 256 M } service pop3-login { client_limit = 256 process_limit = 128 process_min_avail = 3 service_count = 1 } service pop3 { drop_priv_before_exec = yes process_limit = 256 vsz_limit = 256 M } ssl_cert = </usr/local/etc/dovecot/dovecot.crt ssl_key = </usr/local/etc/dovecot/dovecot.key userdb { args = quota_template=quota_rule=*:backend=%q driver = vpopmail } protocol imap { mail_max_userip_connections = 10 mail_plugins = " notify quota imap_quota mail_log" }

3 4

[Dovecot] SUMMARY: LDA vs LMTP, Cyrus SASL, verbose_proctitle
by Joseph Tam 12 Apr '11

12 Apr '11

A summary of answers I got to the questiosn I posed. > Is there a reason I should prefer LMTP over LDA for local delivery? Thanks for the responses I received. The benefits reported were more/better information logging, and service isolation. Also, one significant advantage not mentioned for LMTP was that one delivery failure to multiple recipients can be disambiguated; LDA can only return an exit code to be tested by the MTA, but the MTA cannot know which recipient(s) generated the error. This problem present can itself, for example, when one user has a full mailbox. An LDA will return EX_TEMPFAIL, and the message will be requeued, and delivery will be retried for all recipients (even those that were successfully delivered to). > The Wiki doesn't differentiates LMTP vs LDA with respect to sendmail > configuration, so am I correct that I just need to replace mail.local > with dovecot-lda, which will choose LDA/LMTP based on dovecot.conf? Not that simple, but I finally did find my answer in the Dovecot archives. It's too bad I had to spend hours tearing apart the sendmail docs before finding it http://www.dovecot.org/list/dovecot/2010-September/052936.html The .mc version of the configuration: # Use LMTP for local delivery over IPC channel FEATURE(`local_lmtp',`[IPC]') # Location of LMTP socket define(`LOCAL_MAILER_ARGS', `FILE /path/to/dovecot/lmtp') # Replace default sendmail LMTP options: the same options # with the 'P' flag removed so that the Return-Path is not # added (again?) define(`LOCAL_MAILER_FLAGS', `SXmnz9') MAILER(`local') I haven't tried this yet, but this is pretty close. > Also, can I consolidate authentication by configuring dovecot to use > what sendmail uses (Cyrus SASL) or vice versa? The Wiki hints this is > in the works. No response, so I guess the answer is no. > Lastly, toggling verbose_proctitle seems to have no effect on the output > of ps. Is verbose_proctitle broken for Solaris? The answer to is verbose_proctitle is broken for Solaris. There is no setproctitle(), and ps does not report changes to a process's argv[]: echo "main(int c,char**v){**v='x';sleep(9);}" | \ gcc -xc -o y -; ./y; rm y & ps -f You'll have to use "lsof", "pfiles" or "doveadm who" to get the information. Joseph Tam <jtam.home(a)gmail.com>

3 2

[Dovecot] Intermitent ldap auth problems benchmarking dovecot
by Maria Arrea 12 Apr '11

12 Apr '11

Hello We are using SLAMD (Distributed Load Generation Engine, www.slamd.com) to benchmark our dovecot server (ldap auth). We are simulating 2.000 simultaneous logins and 20% of them fail. We saw the following errors in the log: Apr 12 09:40:07 buzon dovecot: auth: Error: ldap(correo,192.168.4.153): Request queue is full (oldest added 1 secs ago) Apr 12 09:40:07 buzon dovecot: auth: Error: ldap(correo,192.168.4.153): Request queue is full (oldest added 1 secs ago) Apr 12 09:40:07 buzon dovecot: auth: Error: ldap(correo,192.168.4.153): Request queue is full (oldest added 1 secs ago) We increased auth_worker_max_count from 350 to 3500 (10x increase). Now we see the following errors (still 20% of logins fail): Apr 12 10:14:45 buzon dovecot: imap-login: Internal login failure (pid=29016 id=24783) (auth failed, 1 attempts): user=<correo>, method=PLAIN, rip=192.168.4.153, lip=192.168.4.80, mpid=21284 Apr 12 10:14:45 buzon dovecot: imap-login: Internal login failure (pid=29016 id=24784) (auth failed, 1 attempts): user=<correo>, method=PLAIN, rip=192.168.4.153, lip=192.168.4.80, mpid=21286 What are we doing wrong? We expect 1000 simultaneous imap sessions, we have 65.000 mailboxes. This is our doveconf -n output # 2.0.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-238.5.1.el5 x86_64 Red Hat Enterprise Linux Server release 5.6 (Tikanga) ext4 auth_debug = yes auth_master_user_separator = * auth_mechanisms = plain login auth_worker_max_count = 3500 base_dir = /var/run/dovecot/ default_client_limit = 5000 default_process_limit = 6500 disable_plaintext_auth = no imap_client_workarounds = tb-extra-mailbox-sep delay-newmail lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_fsync = never mail_gid = entrega mail_home = /buzones/%2.26Hn/%2.200Hn/%n/ mail_location = mdbox:/buzones/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n mail_max_userip_connections = 15000 mail_plugins = " zlib acl" mail_uid = entrega managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date mdbox_rotate_interval = 1 days mdbox_rotate_size = 60 M passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } passdb { args = /etc/usuario_maestro.txt driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin/acl = vfile plugin/quota = dict:Cuota de usuario::file:/buzones/cuotas/%n plugin/quota_rule2 = Trash:storage=+10%% plugin/quota_warning = storage=95%% /usr/local/bin/quota-warning.sh 95 plugin/quota_warning2 = storage=80%% /usr/local/bin/quota-warning.sh 80 plugin/sieve = /buzones/%2.26Hn/%2.200Hn/%n/dovecot.sieve plugin/sieve_dir = /buzones//%2.26Hn/%2.200Hn/%n/sieve/ plugin/zlib_save = gz plugin/zlib_save_level = 9 protocols = pop3 imap sieve service anvil { client_limit = 25000 } service auth { client_limit = 28000 unix_listener auth-master { user = entrega } unix_listener auth-userdb { user = entrega } user = root } service imap-login { executable = /usr/libexec/dovecot/imap-login group = dovenull service_count = 0 } service imap { executable = /usr/libexec/dovecot/imap process_limit = 6000 } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 2000 } process_limit = 2000 } service managesieve { executable = /usr/libexec/dovecot/managesieve process_limit = 5000 } service pop3-login { executable = /usr/libexec/dovecot/pop3-login process_limit = 4000 service_count = 0 } service pop3 { executable = /usr/libexec/dovecot/pop3 process_limit = 4000 } ssl_ca = </etc/pki/generico/cacert.crt.pem ssl_cert = </etc/pki/generico/wildcard.crt ssl_key = </etc/pki/generico/wildcard-key.pem userdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } verbose_proctitle = yes protocol sieve { managesieve_implementation_string = dovecot managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 } protocol lda { hostname = us.es info_log_path = log_path = mail_fsync = optimized mail_plugins = sieve zlib postmaster_address = evcorreo(a)domain.es syslog_facility = mail } protocol imap { mail_plugins = zlib } protocol pop3 { mail_plugins = zlib pop3_enable_last = yes pop3_uidl_format = %g }

3 3

[Dovecot] Fwd: .dovecot.sieve as Mailbox
by Francisco Wagner C. Freire 12 Apr '11

12 Apr '11

---------- Forwarded message ---------- From: Francisco Wagner C. Freire <wgrcunha(a)gmail.com> Date: Tue, Apr 12, 2011 at 9:20 AM Subject: Re: [Dovecot] .dovecot.sieve as Mailbox To: Jan Phillip Greimann <jg(a)softjury.de> Yeah, i can do that, or change the user homedir, but i need some time to change scripts. But, is normal to dovecot show a file as a mailbox? And have any kind of option to hide this one? On Tue, Apr 12, 2011 at 9:15 AM, Jan Phillip Greimann <jg(a)softjury.de>wrote: > > > Am 12.04.2011 14:08, schrieb Francisco Wagner C. Freire: > > Hello, > Hi there, > > > > > I current using maildir and mail location is: > > *mail_location = maildir:%h:INDEX=%h/cache* > > > > Any tip to hide this to users? > > what's about > sieve_dir = ~/sieve > in 90-sieve.conf? > > must the sieve-files be in ~/ ? > > > > > Sorry for my bad english :) > Sorry for my bad english too ^^ > > Greetings Jan P. Greimann > Administrator (in training) > >

3 4

[Dovecot] .dovecot.sieve as Mailbox
by Francisco Wagner C. Freire 12 Apr '11

12 Apr '11

Hello, I current using dovecot 2.0.11 and with all other 2x versions occurring the same problem. When i create the file .dovecot.sieve and compiled one .dovecot.svbin on user homedir, the imap show it like a folder, example: doveadm mailbox list -u user(a)domain.com .. .. *dovecot.sieve* *dovecot.svbin* .. .. I current using maildir and mail location is: *mail_location = maildir:%h:INDEX=%h/cache* Any tip to hide this to users? Sorry for my bad english :) Att. Francisco Freire System Administrator

3 2

[Dovecot] trying to combine static userdb with LDAP passdb with per-user userdb_mail and userdb_home
by Igor Zinovik 12 Apr '11

12 Apr '11

Hello, dovecot users. I'm trying to cope with following problem I have single computer which will be going to be final destination for several virtual domains. Domains are stored in LDAP catalog. Dovecot will be working together with Postfix MTA running on same computer. I'm a bit confused how to achieve following thing: I want Postfix to use Dovecot LMTP server for mail delivery. All my mail is located under /var/vmail partition. I designed my own ldap schema and according to dovecot documentation that user should always has home and mail directory i added separate attributes for user home and mail. My typical user that is stored in LDAP has homeDirectory (which stores value like /var/vmail/domain.com/j/joe) and mailMessageStore (which stores value like /var/vmail/domain.com/j/joe/Maildir). All data under /var/vmail is owned by Postfix MTA user (which is called `postfix', uid=89). After reading dovecot documentation I understand that my setup needs to combine static userdb with LDAP passdb. But i also want dovecot to be able to deliver mail for local system users (that are stored in /etc/passwd). For system users i want to store their mail in $HOME/Mail. So i set mail_location = ~/Mail (which turns into /home/user/Mail), but for virtual (which are stored in LDAP) users i want to set mail (or maybe i should write here userdb_mail) to LDAP value mailMessageStore. Seems to me that LMTP server needs separate userdb query to fetch mail_location from LDAP. Setting mail_location = /var/vmail/%d/%n1/%u solves my problem, but I want dovecot to dynamically fetch maildir location from LDAP. Maybe in near future I would also store mail somewhere else not only under /var/vmail. And dovecot will fetch this information from LDAP. Here is excerpt from dovecot log when user tries to login: Apr 11 13:32:29 auth: Debug: Loading modules from directory: /usr/lib64/dovecot/auth Apr 11 13:32:29 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libauthdb_ldap.so Apr 11 13:32:29 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_mysql.so Apr 11 13:32:29 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_pgsql.so Apr 11 13:32:29 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libdriver_sqlite.so Apr 11 13:32:29 auth: Debug: Module loaded: /usr/lib64/dovecot/auth/libmech_gssapi.so Apr 11 13:32:29 auth: Debug: auth client connected (pid=14748) Apr 11 13:32:29 auth: Debug: client in: AUTH 1 PLAIN service=imap lip=172.20.21.26 rip=172.20.20.216 lport=143 rport=1227 resp=<hidden> Apr 11 13:32:29 auth: Debug: ldap(joe(a)domain.com,172.20.20.216): pass search: base=pdomain=domain.com,ou=mail,dc=org,dc=ru scope=onelevel filter=(&(objectClass=mailAccount)(uid=joe)(accountStatus=TRUE)) fields=mail,userPassword,mailQuota,homeDirectory,mailMessageStore Apr 11 13:32:29 auth: Debug: ldap(joe(a)domain.com,172.20.20.216): result: mail(user)=joe(a)domain.com mailQuota(userdb_quota_rule=*:bytes=%$)=1073741824 mailMessageStore(userdb_mail)=/var/vmail/domain.com/p/joe/Maildir homeDirectory(userdb_home)=/var/vmail/domain.com/p/joe userPassword(password)=<hidden> Apr 11 13:32:29 auth: Debug: client out: OK 1 user=joe(a)domain.com Apr 11 13:32:29 auth: Debug: master in: REQUEST 2814377985 14748 1 5e00190b4fbfd1a4b8a50e13fa6562b1 Apr 11 13:32:29 auth: Debug: master out: USER 2814377985 joe(a)domain.com uid=89 gid=89 Apr 11 13:32:29 imap-login: Info: Login: user=<joe(a)domain.com>, method=PLAIN, rip=172.20.20.216, lip=172.20.21.26, mpid=14750 Apr 11 13:32:29 imap: Debug: Loading modules from directory: /usr/lib64/dovecot Apr 11 13:32:29 imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Apr 11 13:32:29 imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so Apr 11 13:32:29 imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_trash_plugin.so Apr 11 13:32:29 imap: Debug: Module loaded: /usr/lib64/dovecot/lib20_autocreate_plugin.so Apr 11 13:32:29 imap: Debug: Module loaded: /usr/lib64/dovecot/lib20_expire_plugin.so Apr 11 13:32:29 imap(joe(a)domain.com): Debug: Effective uid=89, gid=89, home= Apr 11 13:32:29 imap(joe(a)domain.com): Debug: Quota root: name=User quota backend=maildir args= Apr 11 13:32:29 imap(joe(a)domain.com): Debug: Quota rule: root=User quota mailbox=* bytes=1073741824 messages=0 Apr 11 13:32:29 imap(joe(a)domain.com): Debug: Quota warning: bytes=1020054732 (95%) messages=0 reverse=no command=/usr/libexec/dovecot/quota-warning.sh 95 joe(a)domain.com domain.com Apr 11 13:32:29 imap(joe(a)domain.com): Debug: Quota warning: bytes=966367641 (90%) messages=0 reverse=no command=/usr/libexec/dovecot/quota-warning.sh 90 joe(a)domain.com domain.com Apr 11 13:32:29 imap(joe(a)domain.com): Debug: Quota warning: bytes=858993459 (80%) messages=0 reverse=no command=/usr/libexec/dovecot/quota-warning.sh 80 joe(a)domain.com domain.com Apr 11 13:32:29 imap(joe(a)domain.com): Error: user joe(a)domain.com: Initialization failed: Initializing mail storage from mail_location setting failed: Home directory not set for user. Can't expand ~/ for mail root dir in: ~/Mail Apr 11 13:32:29 imap(joe(a)domain.com): Error: Invalid user settings. Refer to server log for more information. Here is my ldap query: pass_filter = (&(objectClass=mailAccount)(uid=%n)(accountStatus=TRUE)) # ldap_attr = dovecot_variable pass_attrs = mail=user, userPassword=password, mailQuota=userdb_quota_rule=*:bytes=%$,\ homeDirectory=userdb_home, mailMessageStore=userdb_mail What is the best way to do in my situation? Should i just add two attributes to each LDAP user like mailuid and mailgid and set both these variables to `postfix'. Or maybe i should just forget about mail for local system users and just user `prefetch' userdb. I'm just mazed about dovecot userdb and passdb queries. It so powerful but also so hard to understand. I would appreciate any help, since I peck dovecot authentication and userdb-passdb queries like woodpecker starting from last week. Do I understand right that dovecot during userdb fetches Unix UID which will be used to access data on disk? I just want postfix (uid=89) to allow to do this. Here is `dovecot -n' output: # 2.0.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.18-238.1.1.1.el5 x86_64 CentOS release 5.5 (Final) auth_debug = yes auth_failure_delay = 3 secs auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 last_valid_gid = 89 last_valid_uid = 89 listen = * log_path = /var/log/dovecot login_greeting = Dovecot ready to serve. mail_debug = yes mail_fsync = always mail_location = maildir:~/Mail mail_nfs_index = yes mail_nfs_storage = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags mmap_disable = yes passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin/autocreate = &BBoEPgRABDcEOAQ9BDA- plugin/autocreate2 = &BCEEPwQwBDw- plugin/autosubscribe = &BBoEPgRABDcEOAQ9BDA- plugin/autosubscribe2 = &BCEEPwQwBDw- plugin/expire = &BBoEPgRABDcEOAQ9BDA- 7 &BCEEPwQwBDw- 30 plugin/login_executable = /usr/libexec/dovecot/managesieve-login plugin/mail_executable = /usr/libexec/dovecot/managesieve plugin/quota = maildir:User quota plugin/quota_rule = *:storage=1GB plugin/quota_warning = storage=95%% /usr/libexec/dovecot/quota-warning.sh 95 %u %d plugin/quota_warning2 = storage=90%% /usr/libexec/dovecot/quota-warning.sh 90 %u %d plugin/quota_warning3 = storage=80%% /usr/libexec/dovecot/quota-warning.sh 80 %u %d plugin/sieve_dir = /var/vmail/%d/%1n/%n/.dovecot.sieve plugin/sieve_extensions = +imapflags plugin/sieve_storage = /var/vmail/%d/%1n/%n/sieve protocols = pop3 imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service imap-login { executable = /usr/libexec/dovecot/imap-login inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } service_count = 1 } service imap { executable = /usr/libexec/dovecot/imap } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { executable = /usr/libexec/dovecot/managesieve-login inet_listener sieve { port = 4190 } service_count = 1 } service managesieve { executable = /usr/libexec/dovecot/managesieve } service pop3-login { executable = /usr/libexec/dovecot/pop3-login inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } service_count = 1 } service pop3 { executable = /usr/libexec/dovecot/pop3 } service quota-warning { executable = script /usr/libexec/dovecot/quota-warning.sh user = dovecot } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = uid=postfix gid=postfix driver = static } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugin_dir = /usr/lib64/dovecot mail_plugins = autocreate expire quota imap_quota trash } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_lock_session = yes pop3_uidl_format = %08Xu%08Xv } protocol lmtp { info_log_path = /var/log/dovecot-lmtp-info.log log_path = /var/log/dovecot-lmtp.log mail_plugins = quota sieve } Here is my typical LDAP user: dn: uid=joe,pdomain=domain.com,ou=mail,dc=org,dc=ru objectClass: top objectClass: uidObject objectClass: mailAccount accountStatus: TRUE mail: joe(a)domain.com mailQuota: 1073741824 mailMessageStore: /var/vmail/domain.com/j/joe/Maildir mailOwnerFirstName: Joe mailOwnerLastName: User registerPersonFirstName: Joe registerPersonLastName: User registerDate: 1301665769 homeDirectory: /var/vmail/domain.com/j/joe uid: joe userPassword: {SSHA}FvxQwgDycssHhfoMTtkzogZ0Nh43PpHL

1 1

Re: [Dovecot] IO rate quotas?
by Alan Brown 12 Apr '11

12 Apr '11

From: Timo Sirainen <tss(a)iki.fi> Subject: Re: [Dovecot] IO rate quotas? > So a single process that is reading files fast enough from disk can > cause disk IO to spike in a way that makes all other processes wait for > available disk IO? It's not a single process. Thunderbird's newest defaults are to syncronize every folder and it will open one connectrion per folder in order to do that. Appropriate disk/swappiness/readahead/cache tuning is required - along with enough ram to cope with several users trying this at once. The underlaying filesystem is also important. as a for-instance, this kind of load with maildir format will effectively _kill_ a GFS box. Our fix was to install systemwide defaults on managed systems to not synchronize (not needed, the home directories are on network storage anyway) and to ask people to check/unset this on laptops/etc

5 4

[Dovecot] hardlinks deliver not work
by Arnaud Yonnet 11 Apr '11

11 Apr '11

hello, I try to use the deliver dovecot with hardlinks. in command line, it's work with this command /usr/lib/dovecot/deliver -p themail -d user when i send mail with postfix. I received the mail for all users but it doesn't create hardlinks. i check with command line md5sum themail it same for all mail . but it don't create hardlinks. in my master.cf dovecot unix - n n - - pipe user=utilisateurmail:utilisateurmail argv=/usr/lib/dovecot/deliver -d ${user} have you got a solution ? thinks you Arnaud Yonnet ps, im sorry. my English is really poor....

3 4

[Dovecot] Over quota and send Mails
by Jim Knuth 11 Apr '11

11 Apr '11

Hello, if a user over quota is, he can do no mails more receive. So far, so good. But why he can do, nevertheless, mails do send? Has that to do something with dict option? -- Mit freundlichen Grüßen, Jim Knuth P.S.: Bitte HTML-Mails! Zufallszitat: Richtig verheiratet ist erst der Mann, der jedes Wort versteht, das seine Frau nicht gesagt hat. (Alfred Hitchcock)

3 4

[Dovecot] domain variable still empty
by Andre Rodier 11 Apr '11

11 Apr '11

Hello all, First, thanks for your help with my previous NFS problem. I am trying to mount a mail server, with debian and dovecot 1.2. Until now, I have both shared and public folders working, on a NFS share. indexes are stored locally, as well as per user flags. Sive is also working :-) Now, I'd like to restrict sharing by domain, and for this, to use the "%d" variable When I authenticate, for instance using arodier@red2team, the authentication works. However, the "%d" variable is still empty, when I'd like it to contains "red2team" Here my config: -------------------------------------------------------------- # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-amd64 x86_64 Debian 6.0.1 nfs4 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve ssl: required disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login login_greeting: Titan Ready mail_access_groups: mails mail_privileged_group: mails mail_uid: vmails mail_gid: mails mail_location: maildir:/home/emails/%d/%n/Maildir:INDEX=/var/mail/indexes/%n:CONTROL=/var/mail/indexes/%n mail_debug: yes mmap_disable: yes fsync_disable: yes mail_nfs_storage: yes lock_method: flock mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugins(default): quota imap_quota acl imap_acl fts fts_squat mail_plugins(imap): quota imap_quota acl imap_acl fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve namespace: type: private separator: / location: maildir:/home/emails/%d/%n/Maildir:INDEX=/var/mail/indexes/private/%n:CONTROL=/var/mail/indexes/private/%n inbox: yes list: yes subscriptions: yes namespace: type: shared separator: / prefix: Shared/%%u/ location: maildir:/home/emails/%d/%%n/Maildir:INDEX=/var/mail/indexes/users/%n/%%n:CONTROL=/var/mail/indexes/users/%n/%%n list: children namespace: type: public separator: / prefix: Team/ location: maildir:/home/emails/%d/Public/Maildir/:INDEX=/var/mail/indexes/public/%n list: yes lda: postmaster_address: postmaster(a)red2group.com hostname: smtp1.red2group.com mail_plugins: quota acl sieve auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login default_realm: red2team username_format: %u verbose: yes debug: yes passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 438 plugin: quota: maildir acl: vfile:/etc/dovecot/acls/:cache_secs=300 acl: vfile acl_shared_dict: proxy::acl sieve: /home/emails/%d/%n/Filters/Active.sieve sieve_dir: /home/emails/%d/%n/Filters fts: squat dict: quota: ldap:/etc/dovecot/dovecot-ldap.conf acl: mysql:/etc/dovecot/dovecot-mysql.conf -------------------------------------------------------------- This is now the content of the dovecot-ldap config -------------------------------------------------------------- auth_bind = yes base = dc=red2,dc=srv default_pass_scheme = PLAIN-MD5 hosts = callisto.red2.srv thebe.red2.srv ldap_version = 3 pass_filter = (&(objectClass=posixAccount)(uid=%n)) scope = subtree user_attrs = homeDirectory=home,gosaMailQuota=quota_rule=*:storage=%$M, mail_plugins user_filter = (&(objectClass=posixAccount)(uid=%n)) -------------------------------------------------------------- What surprise me is this line during the authentication: ===> auth(arodier(a)red2team,10.10.2.19): username changed arodier@red2team -> arodier Any idea, please ? I am stuck on that since two days ! Kind regards, André.

2 4

[Dovecot] INBOX empty after dsync
by Gary Chodos 11 Apr '11

11 Apr '11

After hearing so many good things about mdbox, I am testing it. I moved my Maildir to a test box, and did the conversion with dsync which reported no errors and appeared to go fine after I set: namespace { separator = / inbox = yes } and changed mail_location=mdbox:~/mdbox But the problem is that the Inbox now is empty in my imap client. What did I do wrong? I can see the emails are there if I grep for subject lines I know exist in my inbox within ~/mdbox, but in the imap client it is as if inbox is totally empty. All the other folders appear fine in imap client.

1 1

[Dovecot] Memory access mistake
by Jim Knuth 10 Apr '11

10 Apr '11

Hi, I have the following report after a cron job? Unfortunately, I do not know the English word. Memory access mistake/error? /tools/expunge: 2980 Speicherzugriffsfehler doveadm expunge -A mailbox Spam savedbefore 8d What can this lie with? What must I show in addition? dovecot-n or what? Thank you. # 2.0.11 (a0c1c6f7cf6e): /etc/dovecot/dovecot.conf # OS: Linux 2.6.29.4 i686 Debian wheezy/sid -- Mit freundlichen Grüßen, Jim Knuth P.S.: Bitte HTML-Mails! Zufallszitat: Die Menschheit ist zu weit vorwärts gegangen, um sich zurückzuwenden, und bewegt sich zu rasch, um anzuhalten. [Churchill]

4 8

[Dovecot] Dovecot 2.0 config bug with SSL certificate per protocol?
by Andy Smith 09 Apr '11

09 Apr '11

Hi, yesterday I upgraded Dovecot from 1.2 to 2.0.11. I'd seen that there was a config file converter to make the upgrade smooth so was expecting it to be pretty quick and easy. In the end I spent a long time trying to get it working as it just wouldn't listen on the ssl ports, imaps and pop3s. I am using per portocol SSL certificates, as I was in version 1.2. The part of my config is as follows (as generated by doveconf): protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_plugins = fts fts_squat ssl = yes ssl_cert = </usr/local/etc/ssl.crt/imap.crt ssl_key = </usr/local/etc/ssl.key/imap.key } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv ssl = yes ssl_cert = </usr/local/etc/ssl.crt/pop3.crt ssl_key = </usr/local/etc/ssl.key/pop3.key } But when I started dovecot it was only listening on the non SSL ports for IMAP and POP3. I went through many things, adding in a service imap-login section with the SSL port set via inet_listener and spent ages googling for how to get it to work. In the end it turns out it was that the global ssl setting was set to "no", but I hadn't enabled this previously as this requires that there are global SSL certificates, which I don't have; I have specific certs for IMAP and for POP3. Also this isn't how dovecot 1.2 worked, there I specificed the protocols (pop3, pop3s, imap, imaps) and specificed the protocol certs and it worked. Anyway, I ended up just specifiing my pop3 certs as the global certs, this is then redefined in the pop3 protcol section etc. The config seems to work, but to me all this doesn't seem logical and doesn't work like in dovecot 1.2. Maybe this is something that can be cleaned up in the next version? thanks Andy.

3 5

[Dovecot] transferring imap folders
by Voytek Eymont 09 Apr '11

09 Apr '11

I have some old mail on courier-imap that I'd like to bring over some of the readme says I need to make Dovecot's inbox as "INBOX" not "Inbox" for courier-imap compatibility.. that seems to be already default, no ? also, my INBOX is mainly like 'sent/year/month' and some other 'work/this' subfolders is there a tool I need to use, or should just copy over dir tree from old server and suck'n'see ? dovecot --version 1.2.9 -- Voytek

2 1

[Dovecot] IO rate quotas?
by Kádár Tamás (KTamas) 09 Apr '11

09 Apr '11

Hi Okay so we've been having this issue since forever and I figured why the heck not ask it here since it's mostly related to dovecot. The thing is, we have a huge amount of public folders (at the moment, around 1100). Now, with dovecot indexing and caching we're mostly okay, also being careful with things like Thunderbird 3's default 'Download everything' option ("Keep messages for this account on this computer") and such. However once in a while, someone goes rogue, we install a new version of thunderbird, someone accidentally sets up an email account in thunderbird mistakingly leaving the download everything option on. This causes high IO on our server, and a single user can quickly more or less kill the whole server in mere minutes, load average quickly spiking to 30-40-50 and everything becomes sloooooow (obviously). Is there any way I can limit the amount of IO a certain user can use? Thanks and best regards, KT P.S. my dovecot -n is: # 2.0.9: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-xen-amd64 x86_64 Debian 5.0.8 auth_mechanisms = plain login disable_plaintext_auth = no listen = * mail_location = maildir:~/Maildir mail_plugins = acl maildir_very_dirty_syncs = yes namespace { inbox = yes location = prefix = separator = . type = private } namespace { location = maildir:/home/_shared/projects:INDEX=~/Maildir/_shared prefix = shared. separator = . subscriptions = no type = public } namespace { location = maildir:/home/_shared/sys:INDEX=~/Maildir/sys prefix = sys. separator = . subscriptions = no type = public } passdb { driver = pam } plugin { acl = vfile mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid from subject size vsize flags mail_log_group_events = no } protocols = imap pop3 service imap { executable = imap } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { driver = passwd } verbose_proctitle = yes protocol imap { mail_max_userip_connections = 40 mail_plugins = acl imap_acl }

7 12

[Dovecot] coredump in dovecot 2.0.11
by k b 09 Apr '11

09 Apr '11

Hi. I use dovecot-2.0.11-1.fc14.i686 on linux,redhat fedora 14. Using alpine 2.02 and Kmail 1.13.5 i have one IMAP connection to the dovecot server and one IMAP connection to a MS exchange server. After i moved a few messages from the exchange server i cannot open the folders where i placed the moved mails. instead dovecot crashes, all other directories and emails work fine. here is what i see in /var/log/messages: Apr 9 08:23:10 server00 abrt[28509]: saved core dump of pid 28508 (/usr/libexec/dovecot/imap) to /var/spool/abrt/ccpp-1302330190-28508.new/coredump (626688 bytes) Apr 9 08:23:10 server00 abrtd: Directory 'ccpp-1302330190-28508' creation detected Apr 9 08:23:10 server00 abrtd: Crash is in database already (dup of /var/spool/abrt/ccpp-1302111878-7921) Apr 9 08:23:10 server00 abrtd: Deleting crash ccpp-1302330190-28508 (dup of ccpp-1302111878-7921), sending dbus signal I can post the coredump but i will have to clean it first as i can see it contains a few emails. would it help to post the coredump or shuould i skip that?

2 1

[Dovecot] mysql lookup on another host performance q?
by Voytek Eymont 09 Apr '11

09 Apr '11

Hi, new to dovecot I'm setting a small postfix/dovecot server for virtual domain/users in mysql dovecot is on one host, mysql on another seems to be working, but I'm concerned over performance overhead of this setup; dumb Q, is there any 'proxy mysql' or cacheing option I can use ? any suggestions appreciated also, my mail users as set as 5000/5000 virtual_gid_maps = static:5000 virtual_uid_maps = static:5000 so, I should use uid/gid 5000/5000 in query below, yes ? thanks -- Voytek --------------------------------------------------------- # dovecot --version 1.2.9 Linux 2.6.32-21-generic-pae #32-Ubuntu SMP Fri Apr 16 09:39:35 UTC 2010 i686 GNU/Linux # grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = mysql connect = host=host.tld dbname=ddd user=ccc password=xxx user_query = SELECT concat('/var/mail/vhosts/', maildir) as home, concat('maildir:/var/mail/vhosts/', maildir) as mail, 5000 AS uid, 5000 AS gid, concat('maildir:storage=', quota) AS quota FROM mailbox WHERE username = '%u' AND active = '1' default_pass_scheme = MD5 user_query = SELECT '/var/mail/vhosts/%d/%n@%d' as home, 'maildir:/var/mail/vhosts/%d/%n@%d' as mail, 5000 AS uid, 5000 AS gid, concat('dirsize:storage=', quota) AS quota FROM mailbox WHERE username = '%u' AND active = '1' password_query = SELECT username as user, password, '/var/mail/vhosts/%d/%n@%d' as userdb_home, 'maildir:/var/mail/vhosts/%d/%n@%d' as userdb_mail, 5000 as userdb_uid, 5000 as userdb_gid FROM mailbox WHERE username = '%u' AND active = '1'

3 3

[Dovecot] 143 STARTTLS/ 993 SSL/TLS query
by Voytek Eymont 09 Apr '11

09 Apr '11

I'm testing my new dovecot server with Thundirbird I can have it working on port 143 with STARTTLS, or on port 993 with SSL/TLS my uderstanding is that on 993 I get encrypted 'password and mail transfer' (yes ?) so what happens if I use 143 with STARTTLS, is that equivalent to port 993 if STARTTLS is used ? thanks for any insights.. -- Voytek

2 3

Re: [Dovecot] Permission Denied - cannot create inbox
by Joseph Tam 09 Apr '11

09 Apr '11

Timo Sirainen <tss(a)iki.fi> writes: > This is anyway mbox-specific problem, so I added it now to mbox page: > > http://wiki2.dovecot.org/MailLocation/mbox ... >> imap(tss): Error: >> fchown(/home/tss/mail/.imap/INBOX/dovecot.index.log.newlock, >> group=8(mail)) failed: Operation not permitted (egid=1000(tss), group >> based on /var/mail/tss - see http://wiki2.dovecot.org/Errors/NoPerm) >> > Changed the wiki link: http://wiki2.dovecot.org/Errors/ChgrpNoPerm Thanks, Timo. This will be opaque to the user, but I don't think it will happen often so it's no bother to find the problem in the logs. Joseph Tam <jtam.home(a)gmail.com>

1 0

[Dovecot] Imap segfault on login with version 2.0.8 & 2.0.11
by Nicholas VonHollen 09 Apr '11

09 Apr '11

Hi everyone, I'm trying to upgrade/test our configuration files from Dovecot 1.2 to 2.0.11. I used the Dovecot config convert command, created a RHEL 5 x86_64 rpm, and tested it. I can connect, but once I login, the IMAP service segfaults. I've also reproduced this on version 2.0.8. I installed the debug RPM (for the stripped symbols), took a look at the core dump in gdb, and just got the _start method in ld_preload and a broken pointer in the backtrace. I tried to strace everything but the segfault doesn't happen then :-). I'm not sure what to do to get better information. I attached my client session, dovecot -n output, gdb trace, maillog, and the core dump. I published the RPMs I made at: http://c3205012.r12.cf0.rackcdn.com/dovecot-2.0.11-1_125.x86_64.rpm http://c3205012.r12.cf0.rackcdn.com/dovecot-debuginfo-2.0.11-1_125.x86_64.r… My platform is RHEL 5 with kernel 2.6.18 on x86_64. Is there anything else I can provide for more info? Thanks, Nick Nick VonHollen Rackspace Software Developer Desk: 540-443-2003 (internal 505-2003) Personal Cell: 757-710-7038

4 7

[Dovecot] restarting director
by Cor Bosman 08 Apr '11

08 Apr '11

Hi all, anyone having any problems with restarting the director? Every time I bring down 1 of the director servers, reboot it, or just restart it for whatever reason, im seeing all kinds of problems. Dovecot generally always gives me this error: Jan 20 22:49:55 imapdirector3 dovecot: director: Error: Director 194.109.26.173:444/right disconnected before handshake finished It seems the directors cant agree on forming a ring anymore, and this may be leading to problems with clients. I mostly have to resort to bringing down all directors, and restarting them all at once. Not really a workable solution. As an example, last night for a few hours we were getting complaints from customers about being disconnected, and the only obvious error in the log was the one above, after one of my colleagues had to restart a director because of some changes in the syslog daemon. After I restarted all directors withing a few seconds of each other, all complaints disappeared. Timo, i know ive asked similar questions before, but the answer just eludes me. If I have 3 director servers, and need to take one down and restart it, what is the proper method to reconnect the ring? In practice, I cant seem to work it out and I mostly end up with the above error until I just restart them all. Not fun with 20.000 clients connected. Cor

3 4

[Dovecot] Thunderbird 3.1 unable to delete subfolder of Trash under mdbox
by William Blunn 08 Apr '11

08 Apr '11

Thunderbird 3.1.9 over Windows 7. Dovecot 2.0.11 (2:2.0.11-0~auto+41 from http://xi.rename-it.nl/debian/ source on 8 Apr 2011) over Ubuntu 10.04 LTS. Trying to set up a Dovecot system with mdbox. But I also wanted to keep some Maildir. So I ended up with both mdbox and Maildir side-by-side and noticed an issue. On this system, Dovecot's global mail location is configured with maildir:~/Maildir I have a two users configured in a password-file passdb/userdb: One using the Dovecot global mail location (maildir:~/Maildir) the other with an override mail location (userdb_mail) of mdbox:~/mdbox (The only other configurations different to the default were to turn off the default system password passdb and userdb, and enable my local password-file-format passdb and userdb.) I have configured two IMAP accounts in Thunderbird 3.1.9, one to access each of the two users above. The test procedure is: In Thunderbird, create a folder at the top level (i.e. alongside Inbox), say "foo". In Thunderbird, delete the folder just created. This results in Thunderbird "moving" the folder to "Trash", resulting in a folder "Trash/foo". Up to this point, both the Maildir and mdbox users behave OK. Then in Thunderbird, delete the trashed folder "Trash/foo". At this point, things start to happen differently. With the Maildir user, the folder "Trash/foo" deletes successfully. But with the mdbox user, Thunderbird pops up an error: The current command did not succeed. The mail server for account <accountname> responded: Invalid mailbox name: Trash/foo/. The folder does disappear from the Thunderbird folder pane, but if Thunderbird is "prodded" to refresh what folders it thinks are there, then the folder reappears. If we check the user's mdbox directory, we can see that indeed the mailbox has not been deleted. Whatever I then do, I am unable to delete this folder in the mdbox user through Thunderbird. The only way I have found to safely delete the folder is to use "doveadm mailbox delete", but this requires root privilege on the server, which is not really a practical solution. It maybe a Thunderbird problem, but the question then arises: Why does it work under Maildir but doesn't work under mdbox? Any ideas? Bill

2 4

[Dovecot] fstat no such file or directory error
by Mark Dieterich 08 Apr '11

08 Apr '11

Periodically, we will have users IMAP sessions get hung. Their client sees a message like: The server responded: 'SERVERBUG] Internal error occurred. Refer to server log for more information On the server, we see the following in the logs: IMAP(<username>): Transaction log dovecot.index.log: duplicate transaction log sequence (37) IMAP(<username>): fscking index file dovecot.index IMAP(<username>): fstat() failed with index file dovecot.index: No such file or directory After the fstat message shows up, there doesn't appear to be anything on the user side that can be done to fix the problem. We've seen multiple instances where the file dovecot is complaining about not existing is visible, readable, and writable by the user in question, but dovecot is convinced it's not. The only way we've found to fix this issue is to kill off all user connections. When the user reconnects, then all appears to work fine. We have not found a way to recreate this problem. Some details: # 1.2.15: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.8 Mail files are stored on NFS. All imap connections for a given user are are mapped to a particular server at any given time. We have a script in place that watches our logs for this order of events, so the problem self corrects relatively quickly. But it would certainly be nice not have this happen at all. Thanks, Mark -- ---------- I'd rather be burning carbohydrates than hydrocarbons

2 4

[Dovecot] a strange doveadm behavior
by fakessh ＠ 08 Apr '11

08 Apr '11

hi timo very very good job you realize for the community here I have a very strange problem with doveadm I actually use a configuration file parameters in which the parameters are placed carefully My problem appears when I run this command doveadm expunge -A mailbox Trash savedbefore 30d i post command and result to the terminal [fakessh@r13151 ~]$ doveadm expunge -A mailbox Trash savedbefore 30d doveadm(fakessh): Error: userdb lookup: connect(/var/run/dovecot//auth-userdb) failed: Permission denied (euid=514(fakessh) egid=100(users) missing +r perm: /var/run/dovecot//auth-userdb, euid is not dir owner) doveadm: Error: Failed to iterate through some users [root@r13151 ~]$ chmod +r /var/run/dovecot/auth-userdb [fakessh@r13151 ~]$ doveadm expunge -A mailbox Trash savedbefore 30d doveadm(fakessh): Error: userdb lookup: connect(/var/run/dovecot//auth-userdb) failed: Permission denied (euid=514(fakessh) egid=100(users) missing +w perm: /var/run/dovecot//auth-userdb, euid is not dir owner) doveadm: Error: Failed to iterate through some users [root@r13151 ~]# chmod og+w /var/run/dovecot/auth-userdb [fakessh@r13151 ~]$ doveadm expunge -A mailbox Trash savedbefore 30d doveadm(dkimproxy): Fatal: seteuid(0) failed: Operation not permitted [fakessh@r13151 ~]$ any kind of discussion would be welcome -- gpg --keyserver pgp.mit.edu --recv-key 092164A7 http://pgp.mit.edu:11371/pks/lookup?op=get&search=0x092164A7

2 5