- dovecot - dovecot.org

[Dovecot] 1.1 namespaces and message corruption
by Kyle Wheeler 02 Jul '08

02 Jul '08

Hello, I've been trying out the new dovecot's namespace support, and I'm having some issues moving messages between namespaces. Specifically, when I move some messages from a Maildir-based namespace to an mbox-based namespace, the message gets corrupted: its contents are removed, and an entirely empty message is added to the destination mailbox. This is 100% repeatable (some messages just *cannot* be copied intact). I have two namespaces, set up like so: namespace private { # Default separator = . hidden = no inbox = yes prefix = location = maildir:%h/Maildir } namespace private { separator = . hidden = no prefix = "INBOX.ArchiveTest." location = mbox:%h/Maildir/Archive } All I do is tell my client (mutt) to copy a message from a folder in the maildir namespace into a folder in the mbox namespace. Does anyone know what might be going wrong or how I can even debug this? No error messages of any kind are showing up in the dovecot log file, and the mail_debug setting doesn't seem to give me any useful information. Message corruption of this sort worries me... ~Kyle -- To sin by silence when they should protest makes cowards of men. -- Abraham Lincoln

2 2

Re: [Dovecot] Poor pop3 over nfs performance
by Mark Zealey 02 Jul '08

02 Jul '08

In case anyone else is experiencing this issue, using the following in a postlogin script is a reasonable workaround: if [[ ! -e "$HOME/.lastlogin_imap" && "$HOME/Maildir/dovecot.index.cache" -ot "$HOME/Maildir/new" && "$HOME/Maildir/dovecot-uidlist" -ot "$HOME/Maildir/new" ]]; then rm -f "$HOME/Maildir/dovecot.index.cache" fi (whenever a user logs in via imap we touch .lastlogin_imap, so we only kill the cache file if the user is pop3-only and both the cache and uidlist are older than the new directory). Mark -- Mark Zealey -- Shared Hosting Team Leader Product Development * Webfusion 123-reg.co.uk, webfusion.co.uk, donhost.co.uk, supanames.co.uk This mail is subject to http://www.gxn.net/disclaimer > -----Original Message----- > From: dovecot-bounces+mark.zealey=webfusion.com(a)dovecot.org > [mailto:dovecot-bounces+mark.zealey=webfusion.com@dovecot.org] > On Behalf Of Mark Zealey > Sent: 02 July 2008 11:01 > To: Dovecot Mailing List > Subject: Re: [Dovecot] Poor pop3 over nfs performance > > > rc11 had this fix which may be relevant: > > > > - dovecot-uidlist is now recreated if it results in > > file shrinking > > over 25%. > > Not sure this fix is relevent; but I have upgraded to 1.1.1 > > > With v1.1 INDEX=MEMORY shouldn't matter that much anymore, since it > > should cache the virtual message size to dovecot-uidlist. > > > > 1) Do you have ,W=<size> in maildir filenames? Apparently not? > > No; yesterday though I did switch exim to delivering through lda - > surprisingly though there was not much effect on the graphs. > > > 2) Do you have W=<size> added to dovecot-uidlist? > > I have found something here which I believe is a bug; will > detail below > > > 3) Are your POP3 users download + delete or do they leave > mail on the > > server? > > A mixture; I believe at least 80% will download+delete; > probably closer > to 95% but we do have some very large mail stores - most of > these would > be accessed by a combination of pop and imap. > > > You should be able to use dotlock_use_excl=yes. > ... > > dotlock is the slowest locking method. Did you try how well > > fcntl would > > have worked? > > Not tried fcntl; I don't really trust nfs locking. I have enabled the > excl in the config; again not much change. > > Now what I discovered in testing a particularly problematic > user with an > 800mb cur directory (under v1.1.1; I have never used v1.0 on this mbox > but it was converted with your courier convert script); initially they > had the following: > > drwx------ 2 exim exim 2048 Apr 11 2007 courierimapkeywords > -rw-r--r-- 1 exim exim 47 Apr 22 15:56 courierimapsubscribed > -rw-r--r-- 1 exim exim 142493 Jun 23 19:57 courierimapuiddb > -rw-r--r-- 1 exim exim 195309 Jun 24 18:52 courierpop3dsizelist > drwx------ 2 exim exim 499712 Jul 2 10:35 cur > -rw------- 1 exim exim 20912 Jul 2 10:51 dovecot.index > -rw------- 1 exim exim 33056 Jun 17 17:34 dovecot.index.cache > -rw------- 1 exim exim 31336 Jul 2 10:37 dovecot.index.log > -rw------- 1 exim exim 158465 Jul 2 10:13 dovecot-uidlist > drwx------ 2 exim exim 4096 Jul 2 10:29 new > -rw------- 1 exim exim 23 Jun 24 22:49 subscriptions > drwx------ 2 exim exim 2048 Jul 2 10:42 tmp > > As you can see, the cache file is very old, and the uidlist file is > behind the last time that the logged in (which was 10:35). > When I log in > over pop and do a stat/list, it re-reads everything in cur/new but > didn't update the dovecot-uidlist file or the index.cache > file (the log > file is updated though). Dovecot-uidlist file does not have > the extra W= > tags in it. I removed the dovecot.index.cache file and performed the > same login/stat/list operation and logged out, and suddenly the > dovecot-uidlist file was updated to the new v1.1 format, and the > directory listing looks like: > > total 1068 > drwx------ 2 exim exim 2048 Apr 11 2007 courierimapkeywords > -rw-r--r-- 1 exim exim 47 Apr 22 15:56 courierimapsubscribed > -rw-r--r-- 1 exim exim 142493 Jun 23 19:57 courierimapuiddb > -rw-r--r-- 1 exim exim 195309 Jun 24 18:52 courierpop3dsizelist > drwx------ 2 exim exim 499712 Jul 2 10:35 cur > -rw------- 1 exim exim 20912 Jul 2 10:53 dovecot.index > -rw------- 1 exim exim 31428 Jul 2 10:53 dovecot.index.log > -rw------- 1 exim exim 175508 Jul 2 10:53 dovecot-uidlist > drwx------ 2 exim exim 4096 Jul 2 10:29 new > -rw------- 1 exim exim 23 Jun 24 22:49 subscriptions > drwx------ 2 exim exim 2048 Jul 2 10:42 tmp > > This looks like a bug to me; I will have a look in the source > and see if > I can find anything, but I thought I'd send this email as > you'll be able > to find the bug faster than I can. > > Thanks, > > Mark >

5 5

[Dovecot] 'Book of IMAP' ?
by Bob Gustafson 02 Jul '08

02 Jul '08

Hi I am needing a bit more detail on IMAP protocol and setup possibilities (for an application in mind). I note that 'The Book of IMAP' has recently been published in English (May 08). It seems to be focused on Cyrus IMAP rather than Dovecot. Does anyone on the list have the book? Is the book's treatment of Cyrus IMAP much different from Dovecot? Thanks for any comments. Bob G

1 0

[Dovecot] Dovecot Config Problem
by Kaushal Gandhi 02 Jul '08

02 Jul '08

Hello, I am getting below error & dovecot is not working.. ------------------------------------------------------------------------------ [root@] # dovecot -n | head -1 Error: Error in configuration file /usr/local/etc/dovecot.conf line 1: Expecting '=' Fatal: Invalid configuration in /usr/local/etc/dovecot.conf /usr/local/etc/dovecot.conf is as under: ------------------------------------------------------------------- # Basic Configuration base_dir = /var/run/dovecot/ protocols = imap pop3 listen = * disable_plaintext_auth = no # Logging log_path = /var/log/dovecot.log info_log_path = /var/log/dovecot-info.log # SSL ssl_disable = yes ssl_listen = # Login Processes login_dir = /var/run/dovecot/login login_chroot = yes login_process_size = 64 login_process_per_connection = yes login_processes_count = 3 login_max_processes_count = 128 login_max_connections = 256 login_greeting = Dovecot ready # Mailbox locations mail_location = mbox:~/mail:INBOX=/var/mail/%u # mail_location = maildir:~/Maildir # mbox (Traditional) mbox_read_locks = fcntl mbox_write_locks = fcntl # maildir (Latest) # Mail Processes max_mail_processes = 1024 mail_process_size = 256 mail_max_keyword_length = 50 # IMAP Specific Settings protocol imap { login_executable = /usr/libexec/dovecot/imap-login mail_executable = /usr/libexec/dovecot/imap mail_plugins = mail_plugin_dir = /usr/lib/dovecot/imap } # POP3 specific settings protocol pop3 { login_executable = /usr/libexec/dovecot/pop3-login mail_executable = /usr/libexec/dovecot/pop3 mail_executable = /usr/libexec/dovecot/pop3 } # Authentication processes auth_executable = /usr/libexec/dovecot/dovecot-auth auth_process_size = 256 auth_realms = auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth default { mechanisms = plain login passdb pam { } userdb passwd { } socket listen { client { # Assuming the default Postfix $queue_directory setting path = /var/spool/postfix/private/auth mode = 0660 # Assuming the default Postfix user and group user = postfix group = postfix } } }

3 2

[Dovecot] Errors running imaptest with dovecot-1.1.1
by Joseba Torre 02 Jul '08

02 Jul '08

Hi, I've been trying some benchmarks to compare 1.0 vs 1.1 -this is the easiest way to explain the move to my boss-, so I've compiled dovecot 1.1 and imaptest-20080627 in my secondary machine running RHEL4, with homes in NFS, indeces in local files and control files also in NFS. Then I've created 100 new users imaptest001-imaptest100, and set the password paquitoelchocolatero to all of them. Then I run: imaptest user="imaptest%03d" pass=paquitoelchocolatero mbox=dovecot.mbox clients=50 secs=10 logout=0 seed=123 2> errores The output is normal (still haven't began with the benchmark), but the "errores" file -attached- is filled with lines like this: Error: UIVALIDITY changed: 1214910049 -> 1214910037 Error: imaptest071[19]: UID=8 INTERNALDATE changed 1214910065+120 -> 1214910042+120: * 1 FETCH (INTERNALDATE ... Error: imaptest085[15]: uid=59 <Pine.LNX.4.58.0312160021060.6698(a)diku.intranet.braincell.com>: BODY[] size ... Dovecot -n output: # dovecot -n # 1.1.1: /usr/local/etc/dovecot.conf syslog_facility: local1 protocols: imap imaps pop3 pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_cert_file: /usr/share/ssl/certs/dovecot-beta.pem ssl_key_file: /usr/share/ssl/certs/dovecot-beta.pem disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mail_location: maildir:~/Maildir:INDEX=/var/dovecot/%u:CONTROL=/var/dovecot-nas/%u/control mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u auth default: master_user_separator: * passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf passdb: driver: pam passdb: driver: passwd-file args: /usr/local/etc/dovecot-master.conf master: yes userdb: driver: prefetch userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs -- Joseba Torre. CIDIR Bizkaia.

2 5

[Dovecot] User changing password
by Mauricio Tavares 02 Jul '08

02 Jul '08

If users are checking their email using imap or pop, is there a way they can change their own passwords (so I can create a temporary one and let them change them to whatever they want) through, say, Thunderbird or whatever?

3 2

Re: [Dovecot] sieve doesn't work with 1.1.1
by Stephan Bosch 02 Jul '08

02 Jul '08

Benjamin Andreas schreef: > Mail debug is now Enable but and don't see any errors > > the .dovecot.sieve file in my home will be ignored > > > Dovecot v1.1.1 starting up > deliver(andreas): Jul 02 10:53:49 Info: maildir: data=/var/spool/imap/andreas > deliver(andreas): Jul 02 10:53:49 Info: maildir++: > root=/var/spool/imap/andreas, index=, control=, > inbox=/var/spool/imap/andreas > deliver(andreas): Jul 02 10:53:50 Info: > msgid=<b186cc8f0807020156l42d4ea75v150ba75bf69f16cb(a)mail.gmail.com>: > saved mail to INBOX > > Strange, it looks as though mail_debug is not doing anything or that the cmusieve plugin is not loaded. Did you add it to mail_plugins under protocol lda {} ? This is what my test server logs: Jul 2 11:48:10 xi deliver(stephan): Loading modules from directory: /usr/lib/dovecot/modules/lda Jul 2 11:48:10 xi deliver(stephan): Module loaded: /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so Jul 2 11:48:10 xi deliver(stephan): maildir: root exists (/home/stephan/Maildir) Jul 2 11:48:10 xi deliver(stephan): maildir++: root=/home/stephan/Maildir, index=, control=, inbox=/home/stephan/Maildir Jul 2 11:48:10 xi deliver(stephan): cmusieve: Using sieve path: /home/stephan/.dovecot.sieve Jul 2 11:48:10 xi deliver(stephan): cmusieve: Executing script /home/stephan/.dovecot.sievec Jul 2 11:48:11 xi deliver(stephan): msgid=<486B4ECD.6050707(a)utwente.nl>: saved mail to INBOX Regards, Stephan

2 1

[Dovecot] Can't create subfolders when activating namespaces, e.g. private/public
by Torsten Krah 02 Jul '08

02 Jul '08

Hi, i am using hardy dovecot, 1.0.10. If i enable namespaces (the private and a public one) i am unable to create new subfolders in my private namespace, only top level folders works. There is nothing in the log about that error even if i set mail_debug = yes. If i comment out everything (no namespaces at all, implicit private one), it works again. Any hints whats going wrong, why is my client getting the message about not being able to create this subfolder? kinds regards Torsten

2 1

[Dovecot] problem with expire plugin (dovecot 1.1.1)
by peceka 02 Jul '08

02 Jul '08

Hi, i want to set up expire plugin with my dovecot configuration. host# dovecot -n # 1.1.1: /usr/local/etc/dovecot.conf protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login verbose_proctitle: yes first_valid_gid: 0 mail_privileged_group: mail mail_location: maildir:~/Maildir mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins: expire mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: pam userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: expire: Trash 7 Trash/* 7 Spam 30 expire_dict: proxy::expire dict: expire: db:/var/lib/dovecot/expire.db host# dovecot --build-options Build options: ioloop=kqueue notify=kqueue openssl Mail storages: maildir mbox dbox cydir raw SQL drivers: Passdb: checkpassword pam passwd passwd-file Userdb: checkpassword passwd prefetch passwd-file static ok, now i do: host# dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool Error: read(/var/run/dovecot/dict-server) failed: Illegal seek What's wrong with this? Best regards, p.

1 0

[Dovecot] Cant't get quota / dict work
by Nicola Tiling 02 Jul '08

02 Jul '08

Hi I have a mixed configuration for MAILDIR und MBOX accounts LDA is exim. For maildir exim writes a maildirsize file and I can see the IMAP contingent in my mailclient. But I can't find a solution for mbox. I tried dict with mysql, db, and pgsql - but notihing works for me. - db: a file is written but it seems to be empty: 1013 [mail] =db_dump-4.6 -p quota.db VERSION=3 format=print type=btree db_pagesize=4096 HEADER=END priv/quota/messages 0 priv/quota/storage 0 DATA=END - mysql: the dict-server connects, but nothing is written to the table dovecot: Jul 02 11:24:13 Info: dict: mysql: Connected to mail the mysql log shows no entries for an update or insert to the table "quota" - pgsql: same: the dict-server connects, but nothing is written to the table dovecot: Jul 02 10:56:45 Info: dict: pgsql: Connected to mail the pgsql log shows no activities System: FreeBSD 6.2-STABLE-200709 dict-quota.conf: connect = host= ... table = quota select_field = current where_field = path username_field = username Dovecot: 1027 [mail] =dovecot --version 1.1.1 1046 [mail] =dovecot --build-options Build options: ioloop=kqueue notify=kqueue openssl Mail storages: maildir mbox dbox cydir raw SQL drivers: mysql postgresql Passdb: checkpassword passwd passwd-file sql Userdb: checkpassword passwd prefetch passwd-file sql static 1047 [mail] =dovecot -n # 1.1.1: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot log_path: /var/log/dovecot/dovecot info_log_path: /var/log/dovecot/dovecot protocols: imap imaps pop3 pop3s ... disable_plaintext_auth: no shutdown_clients: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: W4W Dovecot ready. login_process_per_connection: no verbose_proctitle: yes first_valid_uid: 99 last_valid_uid: 99 first_valid_gid: 99 last_valid_gid: 99 mail_privileged_group: pop3 mail_location: mbox:/var/mbox/%u/mail:INBOX=/var/pop3/%u:INDEX=/var/ mbox/%u/indexes (for maildir values comes from database) mbox_write_locks: fcntl dotlock mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota expire autocreate mail_plugins(imap): quota imap_quota expire autocreate mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape- eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_lock_session(default): no pop3_lock_session(imap): no pop3_lock_session(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh dict_db_config: /usr/local/etc/dovecot/dovecot-db.conf auth default: mechanisms: plain login user: dovecot_auth verbose: yes passdb: driver: sql args: /usr/local/etc/dovecot/pgsql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/etc/dovecot/pgsql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 384 plugin: autocreate: Sent autocreate2: Trash autocreate3: Drafts autocreate4: Junk autosubscribe: Sent autosubscribe2: Trash autosubscribe3: Drafts autosubscribe4: Junk expire: Trash 1 Trash/* 1 Junk 1 expire_dict: proxy:/var/run/dovecot/dict-server:expire quota: maildir quota2: dict:::proxy:/var/run/dovecot/dict-server:quota quota_rule: *:storage=20M quota_rule2: Trash:storage=10M quota_rule3: Spam:storage=20M quota_rule4: Junk:storage=20M quota2_rule: *:storage=20M quota2_rule2: Trash:storage=10M quota2_rule3: Spam:storage=20M quota2_rule4: Junk:storage=20M dict: expire: db:/usr/local/lib/dovecot/db/expire.db quota: mysql:/usr/local/etc/dovecot/dict-quota.conf or: quota: pgsql:/usr/local/etc/dovecot/dict-quota.conf or: quota = db:/usr/local/lib/dovecot/db/quota.db

1 0