- dovecot - dovecot.org

[Dovecot] Slow IMAP Auth
by Jeff Duncan 24 Nov '09

24 Nov '09

Hello, I am experiencing IMAP authentication delays when a client first authenticates, or after the last auth timeout. There are only a handful of clients - less than 5 - using the server. I am using a mysql database and I have verified the PAM auth is commented out. Other than that I can't figure out what might be causing the slow authentication. The first time a client authenticates with SSL/CRAMD5 it takes almost 20 seconds. Does anyone have any suggestions? My config and version is below: mail:~# dovecot --version 1.1.11 mail:/usr/share/gallery2# dovecot -n # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.3 ext3 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 first_valid_uid: 6060 mail_privileged_group: mail mail_location: maildir:/var/vmail/%d/%n mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): autocreate quota imap_quota mail_plugins(imap): autocreate quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf passdb: driver: sql

2 2

[Dovecot] Error: read(/var/run/dovecot/dict-server) failed: Remote disconnected
by Lauryca Puyulik 24 Nov '09

24 Nov '09

Hello all, I have a problem with my mail configuration and I don`t know how to resolve this error (listed bellow): deliver(mymail(a)testtest.ro): Nov 11 09:07:54 Error: Internal quota calculation error dovecot: Nov 11 09:07:54 Error: dict: /etc/dovecot/dovecot-dict-quota.conf: 'username_field' missing dovecot: Nov 11 09:07:54 Error: dict: Failed to initialize dictionary 'quota1' deliver(mymail(a)testtest.ro): Nov 11 09:07:54 Error: read(/var/run/dovecot/dict-server) failed: Remote disconnected deliver(mymail(a)testtest.ro): Nov 11 09:07:54 Error: Internal quota calculation error dovecot: Nov 11 09:07:56 Error: dict: /etc/dovecot/dovecot-dict-quota.conf: 'username_field' missing dovecot: Nov 11 09:07:56 Error: dict: Failed to initialize dictionary 'quota1' My dovecot configuration is: dovecot -n # 1.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.27.7-9-pae i686 openSUSE 11.1 (i586) ext3 log_path: /var/log/dovecot.err info_log_path: /var/log/dovecot.info ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login first_valid_uid: 5000 last_valid_uid: 5000 mail_location: maildir:/home/vmail/%d/%n mail_debug: yes mail_plugins: quota imap_quota auth default: mechanisms: plain login user: vmail verbose: yes passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: prefetch socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail plugin: quota: dict:::proxy::quota1 quota_rule: *:storage=50M:messages=10000 acl: vfile:/etc/dovecot/acls quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 quota_warning2: storage=80%% /usr/local/bin/quota-warning.sh 80 dict: quota1: mysql:/etc/dovecot/dovecot-dict-quota.conf Another question that raise from these logs is what are the permissions for all files from /var/run/dovecot? In the master.cf file I have somthing like this: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -d ${recipient} Regarding this log : "dovecot: Nov 11 09:07:54 Error: dict: /etc/dovecot/dovecot-dict-quota.conf: 'username_field' missing", my dovecot-dict-quota.conf is correctly and that field exists. So...any idea? Thanks!

2 1

[Dovecot] Migrating existing local Maildir structure to dovecot server Maildir
by Halim Issa 23 Nov '09

23 Nov '09

Hello, I'm about to migrate a number of existing users who have been using POP3 with emails stored locally in KMail's Maildir format into an IMAP solution based on Dovecot. Will it be possible to simply move all the KDE Maildir folders from the local PCs to the Maildir folder on the IMAP server running Dovecot and then have the emails accessible on the server, or will this most likely mess up the Dovecot index files? If this causes index file trouble, is there any way to force a re-indexing of all these files, or is there another recommended way of migrating up to 7 years of email communication from local hosts to the IMAP server, for later putting them in folders? Thanks in advance! (PS. I noticed a few of the howto's on how to migrate to dovecot, but they only focus on moving from mbox to dovecot or similar, and not migrating existing Maildir emails to a new dovecot server... Any such pointers would be greatly appreciated :-)) -y1

4 10

[Dovecot] dovecot ignoring folder permissions on directory creation
by Peter 23 Nov '09

23 Nov '09

Ubuntu 8.04lts Dovecot 1.2.6 So, further to the 'deliver' problem posted yesterday I've also discovered another issue regarding permissions: files and directories are being created 0600/0700 by the IMAP and deliver process (depending on who gets there first!) preventing use of shared mailboxes. According to documentation: "When creating a new mailbox, Dovecot v1.2+ copies the permissions from the mailbox root directory." and "When creating new files inside a mailbox, Dovecot v1.2+ copies the read/write permissions from the mailbox's directory." (http://wiki.dovecot.org/SharedMailboxes/Permissions) So, with an empty directory of: drwxr-xr-x 3 root root 21 2009-11-16 13:36 /home drwxrwx--x 3 nobody maildir 21 2009-11-16 13:36 /home/mail I would expect a user logging in to have their mail directory created automatically with the same permissions (but not necessarily the same group). What I see post-login is: drwxrwx--x 3 nobody maildir 21 2009-11-16 13:42 /home/mail drwx------ 3 auser adomain 18 2009-11-16 13:42 /home/mail/adomain drwx------ 3 auser adomain 20 2009-11-16 13:42 /home/mail/adomain/auser drwx------ 5 auser adomain 4096 2009-11-16 13:42 /home/mail/adomain/auser/Maildir drwx------ 2 auser adomain 6 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/cur -rw------- 1 auser adomain 0 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot-acl-list -rw------- 1 auser adomain 156 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot.index.log -rw------- 1 auser adomain 17 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot-uidlist -rw------- 1 auser adomain 8 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot-uidvalidity -rw------- 1 auser adomain 0 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/dovecot-uidvalidity.4b0156e2 drwx------ 2 auser adomain 6 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/new drwx------ 2 auser adomain 6 2009-11-16 13:42 /home/mail/adomain/auser/Maildir/tmp I've tried pre-creation of /home/mail/adomain, /home/mail/adomain/auser and /home/mail/adomain/auser/Maildir in each case with permissions 0770 but in each case subsequent subdirectories and files are 0700/0600. I've also tried use of a "dovecot-shared" file, but this also has no effect under any permutation I can create. Anyone else seen this?

2 1

[Dovecot] Dovecot on Qnap ts-439
by BeKi 23 Nov '09

23 Nov '09

Hello, I use Xdove 1.2 on my ts-409 together with IMAP/dovecot. I like to see the same folder structure on my different workstation (private/work ...). I move the mails into the folder structure I created. That works fine. But since I use Xdove with IMAP I have the problem that my mailclient loads all mails I already stored in different folders again into the INBOX (some mails also multiple with subfolders). These mails are duplicates (or multiples) because I delete them all. The mails in my folders are still there. Up to now I tried different mail clients. Thunderbird 2.x/3.x, Pegasus 4.5, Outlook Express. All behave the same way, so I think it must have something to do with the server. The times when the clients loads the mails into INBOX are not regular intervals. It can be a day when this happens again or one week. Maybe one of you heard about this and can give me hints where to look for. Which configuration files shall I post to help debug? Thanks, Bernd

1 0

[Dovecot] lda deliver + vpopmail
by Stéphane Cottin 23 Nov '09

23 Nov '09

Hi all, I'm enjoying using dovecot deliver with qmail+vpopmail+dspam. It works mostly fine, I like the indexing and sieve features with dovecot deliver. I would like to get more details on trouble, the log entry is just : " 2009-11-18_20:38:55.64778 delivery 50833: deferral: " As you see, there no reason for the deferral. How can I make deliver more verbose ? I also have a vpopmail alias issue. Because some domains (sadly) needs a catchall, and to keep using the useful vpopmail alias features, I'm using the following ugly script : " #!/bin/sh email=`/usr/sbin/valias -- $1 2>/dev/null | cut -d" " -f3` if [ -z "$email" ];then email=$1 t=`/usr/sbin/vuserinfo -n -- $1 2>&1>/dev/null` t=$? if [ "$t" == "255" ];then domain=`echo "${1}" | cut -d'@' -f 2` dir=`/usr/sbin/vdominfo -d $domain 2> /dev/null| head -1` email=`cat ${dir}/.qmail-default | head -1 | awk -F# '{ print $2 }'` if [ "$email" == "bounce-no-mailbox" ];then email=$1 fi fi fi echo $email " my .qmail-default file contains : " #bounce-no-mailbox | /usr/bin/dspam --client --deliver=innocent,spam --user `/usr/sbin/vrealemails $EXT@$USER` --stdout | /usr/bin/preline -f /usr/lib/dovecot/deliver -d `/usr/sbin/vrealemails $EXT@$USER` " or if using a catchall : " #catchall(a)domain.com | /usr/bin/dspam --client --deliver=innocent,spam --user `/usr/sbin/vrealemails $EXT@$USER` --stdout | /usr/bin/preline -f /usr/lib/dovecot/deliver -d `/usr/sbin/vrealemails $EXT@$USER` " I don't like this way for design and security reasons and would prefer a more consistent approach. The vpopmail alias lookup should be made internally by deliver, and unlike my script, handle one to many aliasing. The catchall feature is (sadly) also needed, my implementation is ugly, in practice it works, but is limited as the catchall address must be on the same host. I'm thinking about adding a specific option to the deliver command line, but I'm not sure that's the better way to do it. Help needed please Stéphane

2 1

[Dovecot] Anonymous SSL Ciphers
by Jeffrey Nikoletich 23 Nov '09

23 Nov '09

Everyone, I am having an issue with getting anonymous ssl ciphers disabled in dovecot. I have googled like crazy to find the solution with no help. Here is my doveconf -n # 1.2.5: /etc/dovecot.conf # OS: Linux 2.6.18-92.el5 x86_64 CentOS release 5.2 (Final) nfs log_path: /var/log/dovecot ssl_cert_file: /etc/ssl/islandemail.com.wild.cert ssl_key_file: /etc/ssl/islandemail.com.wild.key ssl_cipher_list: HIGH:MEDIUM:+TLSv1:!SSLv2:+SSLv3 login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_greeting: Island Email - Ready. login_process_per_connection: no login_process_size: 512 login_processes_count: 100 login_max_processes_count: 500 login_max_connections: 1000 max_mail_processes: 5000 mail_max_userip_connections: 2000 verbose_proctitle: yes first_valid_uid: 5000 first_valid_gid: 5000 mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mbox_read_locks: dotlock mbox_write_locks: dotlock mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_process_size: 512 mail_plugins(default): mail_log mail_plugins(imap): mail_log mail_plugins(pop3): mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 pop3_save_uidl(default): no pop3_save_uidl(imap): no pop3_save_uidl(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %v.%u lda: postmaster_address: xxxx(a)xxxxx.xxxx mail_plugins: sieve log_path: /var/log/dovecot-deliver.log info_log_path: /var/log/dovecot-deliver.log auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login digest-md5 cram-md5 failure_delay: 1 verbose: yes debug: yes debug_passwords: yes worker_max_count: 100 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: mailowner group: mailowner plugin: mail_log_events: delete undelete expunge copy mailbox_delete mailbox_rename thanks in advance. Jeff N.

2 1

[Dovecot] FW: Panic: Message unexpectedly expunged from index
by Cliff Hayes 23 Nov '09

23 Nov '09

Nevermind. I figured it out. I left off the INDEX command. Sorry to spam the mail list :( Here is my mail_location for future reference / searches: mail_location = mbox:/var/spool/mail:INBOX=/var/spool/mail/%u:INDEX=/var/indexes/%u -----Original Message----- From: dovecot-bounces+chayes=afo.net(a)dovecot.org [mailto:dovecot-bounces+chayes=afo.net@dovecot.org]On Behalf Of Cliff Hayes Sent: Sunday, November 15, 2009 4:02 PM To: dovecot(a)dovecot.org Subject: [Dovecot] Panic: Message unexpectedly expunged from index Hello, I just installed Fedora 11 with Dovecot 1.2.6 and am now seeing a steady stream of these in maillog: Nov 15 15:52:03 sendmail dovecot: POP3(<username>): Panic: Message unexpectedly expunged from index Nov 15 15:52:03 sendmail dovecot: POP3(<username>): Raw backtrace: pop3 [0x4930ab] -> pop3 [0x493123] -> pop3 [0x4927b6] -> pop3 [0x43ddd4] -> pop3 [0x43de84] -> pop3(index_mail_set_seq+0x146) [0x449c16] -> pop3 [0x43e129] -> pop3(index_storage_search_next_nonblock+0x141) [0x44d5c1] -> pop3(mailbox_search_next_nonblock+0x20) [0x45b580] -> pop3(mailbox_search_next+0x26) [0x45b5d6] -> pop3 [0x419ef9] -> pop3(client_command_execute+0x666) [0x41abd6] -> pop3(client_handle_input+0x80) [0x418f80] -> pop3(io_loop_handler_run+0xbd) [0x49b02d] -> pop3(io_loop_run+0x18) [0x49a498] -> pop3(main+0x526) [0x41b286] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x3a9b61ea2d] -> pop3 [0x418809] Nov 15 15:52:03 sendmail dovecot: dovecot: child 26792 (pop3) killed with signal 6 (core dumps disabled) I see nothing about this in the mail archives or on the internet! What could be happening and how do I fix? I'm also seeing lots of these: Nov 15 11:26:24 sendmail dovecot: POP3(<username>): Log synchronization error at seq=12646,offset=172 for /var/spool/mail/.imap/INBOX/dovecot.index: Extension introduction for unknown id 1 Nov 15 11:26:24 sendmail dovecot: POP3(<username>): fscking index file /var/spool/mail/.imap/INBOX/dovecot.index Here are the only things I messed with in dovecot.conf: protocols = pop3 mail_location = mbox:/var/spool/mail:INBOX=/var/spool/mail/%u mbox_very_dirty_syncs = yes Thanks in advance, Cliff

4 9

[Dovecot] .temp file, public folders
by Mayer 23 Nov '09

23 Nov '09

We recently migrated from UW-Imap to dovecot. Our setup: dovecot 1.2.6 postfix 2.3.3 (from rhel) systemusers without shell access to the mailstore location = maildir:/maildir/%1n/%u:LAYOUT=fs All mails on local disks. Performance is great compared with mbox. But I still have some unresolved problems, mainly concerning deliver. Deliver sometimes wants to write a .temp.<hostname>.some-number file in the user's home directory. If the user is over quota (in his home!) he can't receive mails though no mails are stored in his home. The user homes are on a distributed filesystem (AFS). The mails are stored locally on the mailserver as I mentioned before. How can I tell deliver in the configuration to write the temp file at another location ? We would like to offer public folders for work groups. Reading with imap works fine. But I didn't find a way to tell deliver to drop mails directly in a public folder. Should I use Sieve instead ? Maybe this is rather a postfix question. Postfix is calling deliver. Userdb in the dovecot config is passwd. Postfix looks for local users in: local_recipient_maps = $alias_maps $recipient_canonical_maps unix:passwd.byname Any help is appreciated. Helga Mayer

2 1

[Dovecot] mbox sync: UID inserted in the middle of mailbox
by Ivan S 23 Nov '09

23 Nov '09

Hi All, Our webmail having an issue with the harddrive so I build new webmail on other machine (using Squirrelmail+dovecot+postfix). After copy all data/home folder from the backup, when this user want to access his Sent item, nothing's in it. I've checked the log and found the message as below. mailserver dovecot: IMAP(xxxxx): mbox sync: UID inserted in the middle of mailbox /home/xxxx/mail/Sent (691 > 657, seq=473, idx_msgs=10950) mailserver dovecot: IMAP(xxxxx): mbox sync: UID inserted in the middle of mailbox /home/xxxx/mail/Sent (691 > 657, seq=473, idx_msgs=10950) This is only happen with the Sent items, since I also found other similar log and this user advised that everything is fine with that folder mailserver dovecot: IMAP(xxxxx): mbox sync: UID inserted in the middle of mailbox /home/xxxxx/mail/Accountant Info (327 > 326, seq=306, idx_msgs=353) mailserver dovecot: IMAP(xxxxx): mbox sync: UID inserted in the middle of mailbox /home/xxxxx/mail/Accountant Info (327 > 326, seq=306, idx_msgs=353) I've rebuild the index file by delete the Sent item folder in .imap directory, no such luck. Any help would be really appreciated Thank you

2 1