- dovecot - dovecot.org

[Dovecot] Dovecot strange logs
by Guillaume de Lafond 02 Dec '07

02 Dec '07

Hello, I have some strange logs entries in my dovecot_info.log (auth_debug=yes & auth_verbose=ye) : dovecot: Nov 27 00:28:09 Info: auth(default): vpopmail(CLIENT_EMAIL,CLIENT_IP): lookup user= domain=??п????? dovecot: Nov 27 00:28:09 Info: auth(default): vpopmail(CLIENT_EMAIL,CLIENT_IP): lookup user=CLIENT_USER domain=CLIENT_DOMAIN dovecot: Nov 27 00:28:09 Info: auth(default): vpopmail(CLIENT_EMAIL,CLIENT_IP): lookup user=CLIENT_USER domain= CLIENT_DOMAIN (replace CLIENT_EMAIL,CLIENT_IP,CLIENT_USER,CLIENT_DOMAIN with real value of course) For each authentication I have the in first line : "lookup user= domain=??п?????" It's working.. but I think that it's not normal :) My dovecot -n : # 1.0.7: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: log/dovecot.log info_log_path: log/dovecot_info.log protocols: imap pop3 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: Mail server login_process_per_connection: no login_process_size: 96 login_processes_count: 10 login_max_processes_count: 196 verbose_proctitle: yes first_valid_uid: 89 mail_location: maildir:~/Maildir:INDEX=/Volumes/LD1/dovecot_indexes/ %1d/%d/%n mmap_disable: yes dotlock_use_excl: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: . prefix: INBOX. inbox: yes namespace: type: private separator: / prefix: INBOX/ inbox: yes hidden: yes auth default: mechanisms: plain login apop cram-md5 cache_size: 1024 verbose: yes debug: yes count: 10 passdb: driver: vpopmail args: cache_key=%u dovecot userdb: driver: vpopmail plugin: quota: maildir Regards, -- Guillaume de Lafond Aqua Ray

2 1

[Dovecot] Quick fix for nfs-workarounds.c
by Dean Brooks 02 Dec '07

02 Dec '07

Hi, Under Solaris 8, the rmdir() command returns EEXIST instead of ENOTEMPTY if an rmdir() is attempted on a directory with files still in it. Dovecot 1.1beta9 currently gives tons of errors in the logfile as a result of the code not checking for the right error value. The function nfs_flush_file_handle_cache_dir() in nfs-worksarounds.c probably needs to reflect EEXIST as well as ENOTEMPTY. -- Dean Brooks dean(a)iglou.com

2 1

[Dovecot] imap login messages not logged
by Nikolay Shopik 02 Dec '07

02 Dec '07

One of my server stop logging such messages when user trying to login. imap-login: Login: user=<username(a)example.com>. I check configuration from another server and it very same. I'm running on debian testing with config below. # 1.0.5: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot.info protocols: imap ssl_cert_file: /etc/postfix/new_chained.crt ssl_key_file: /etc/postfix/mail.pem login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login login_greeting_capability: yes mail_location: maildir:/var/mail/store/%u dotlock_use_excl: yes maildir_copy_with_hardlinks: yes auth default: mechanisms: PLAIN CRAM-MD5 passdb: driver: passwd-file args: /etc/dovecot/passwd userdb: driver: static args: uid=vmail gid=vmail home=/var/mail/store/%u socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 438 user: root group: root plugin: sieve: /var/mail/store/%u/sieve

2 2

[Dovecot] locking strategies?
by Joe Allesi -X (joallesi - Coyote Creek Consulting at Cisco) 01 Dec '07

01 Dec '07

Any known issues with these locking strategies? (RHEL 4.x default) Dovecot: mbox_locks = fcntl Procmail Locking strategies: dotlocking, fcntl() We're considering moving to all dotlocking after a recommendation from RedHat, even though we're not using NFS at all. Thanks!

3 4

[Dovecot] Received Date vs Date Header
by Jeff Grossman 01 Dec '07

01 Dec '07

I am trying to figure out why my mail clients are not correctly showing me the received date versus the date header date. I am using Dovecot 1.1B9. Here is a copy of the rawlog from Dovecot when I started up the client. Is Dovecot supposed to be sending the received date and the date header during this conversation? * OK [RAWLOG TIMESTAMP] 2007-11-30 16:48:31 * NAMESPACE (("" ".")) NIL NIL 3 OK Namespace completed. * LSUB () "." "Junk E-mail" * LSUB () "." "Deleted Items" * LSUB () "." "Drafts" * LSUB () "." "Ham" * LSUB () "." "INBOX" * LSUB () "." "Keep Messages" * LSUB () "." "Mailing Lists" * LSUB () "." "Sent Items" * LSUB () "." "Spam" * LSUB () "." "Other" * LSUB () "." "Inbox2" * LSUB () "." "Dovecot" * LSUB () "." "MIMEDefang" * LSUB () "." "Beta" * LSUB () "." "Debian" * LSUB () "." "Leafnode" * LSUB () "." "Sendmail" 4 OK Lsub completed. * LIST (\HasNoChildren) "." "INBOX" 5 OK List completed. * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded $MDNSent Junk NonJu: nk) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded $MDNSent Junk NonJunk \*)] Flags permitted. * 19 EXISTS * 2 RECENT * OK [UNSEEN 17] First unseen. * OK [UIDVALIDITY 1191346544] UIDs valid * OK [UIDNEXT 7608] Predicted next UID 6 OK [READ-WRITE] Select completed. * 1 FETCH (FLAGS (\Seen) UID 5) * 2 FETCH (FLAGS (\Seen) UID 5707) * 3 FETCH (FLAGS (\Seen) UID 7042) * 4 FETCH (FLAGS (\Seen) UID 7103) * 5 FETCH (FLAGS (\Seen) UID 7110) * 6 FETCH (FLAGS (\Seen) UID 7183) * 7 FETCH (FLAGS (\Seen) UID 7237) * 8 FETCH (FLAGS (\Seen) UID 7334) * 9 FETCH (FLAGS (\Seen) UID 7353) * 10 FETCH (FLAGS (\Answered \Seen) UID 7355) * 11 FETCH (FLAGS (\Seen) UID 7364) * 12 FETCH (FLAGS (\Seen) UID 7482) * 13 FETCH (FLAGS (\Seen) UID 7485) * 14 FETCH (FLAGS (\Seen) UID 7496) * 15 FETCH (FLAGS (\Seen) UID 7546) : * 16 FETCH (FLAGS (\Seen) UID 7555) * 17 FETCH (FLAGS () UID 7605) * 18 FETCH (FLAGS (\Recent) UID 7606) * 19 FETCH (FLAGS (\Recent) UID 7607) 7 OK Fetch completed. * 18 FETCH (UID 7606 RFC822.SIZE 4589 FLAGS (\Recent) BODY[HEADER.FIELDS (FROM TO CC SUBJECT DATE MESSAGE-ID PRIORITY X-PRIORITY REFERENCES NEWSGROUPS IN-REPLY-(END) TO CONTENT-TYPE)] {352} Date: Fri, 30 Nov 2007 15:24:32 -0800 Subject: x From: x To: x Message-ID: <C375DBB0.416E%x> Content-type: text/plain; charset="US-ASCII" ) * 19 FETCH (UID 7607 RFC822.SIZE 4590 FLAGS (\Recent) BODY[HEADER.FIELDS (FROM TO CC SUBJECT DATE MESSAGE-ID PRIORITY X-PRIORITY REFERENCES NEWSGROUPS IN-REPLY-TO CONTENT-TYPE)] {353} Date: Fri, 30 Nov 2007 15:25:23 -0800 Subject: x From: x To: x Message-ID: <C375DBE2.416F%x> Content-type: text/plain; charset="US-ASCII" ) 8 OK Fetch completed. + idling I am using Maildir and the date and time of those files from "ls -l" are "2007-11-30 16:48" and "2007-11-30 16:49". The mail client (Thunderbird) showed the received date/time and date date/time as "2007-11-30 3:24" and "2007-11-30 3:25" Thanks for any help you can offer me. Jeff

2 2

[Dovecot] 1.1.Beta9 deliver problem: Unknown mail storage driver raw
by Velko Ivanov 01 Dec '07

01 Dec '07

Hello, I'm new to dovecot, trying to configure a Postfix/Dovecot system. Got everything in place - smtp with dovecot SASL and imap working fine, maildir is created, thunderbird logs in successfuly .. but the Dovecot LDA gives me this error on delivery: "Couldn't create internal raw storage: Unknown mail storage driver raw". I tried searching the configuration manual, reference, google and this list's archives, but found no clue. Checked the source, but it will take me some time to figure out what is a storage driver and where is the "raw" one hiding, so if somebody could help, please .. I did it with userdb static initially - uid=dovecot_mail, gid=dovecot_mail, home=/usr/local/storage/mail/%d/%n but after reading, that some passdbs don't work with deliver&static, I moved everything to the db (found out that prefetch isn't working with deliver btw - moans about userdb_ entries not present, while the imap finds them and works happily). It didn't help. # 1.1.beta9: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot listen: mail.srv.ivanov-nest.com ssl_cert_file: /usr/local/etc/dovecot.crt ssl_key_file: /usr/local/etc/dovecot.key login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login mail_location: dbox:~/Maildir dotlock_use_excl: yes maildir_copy_preserve_filename: yes namespace: type: private inbox: yes hidden: yes list: yes subscriptions: yes auth default: mechanisms: plain login user: dovecot_db passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: dovecot_mail group: wheel

1 0

[Dovecot] last logon time
by Nikolay Shopik 30 Nov '07

30 Nov '07

Hi list, How can I detect when user last time logon into their mailbox? For what file I should look and compare change time?

2 1

[Dovecot] deliver+quota assertion
by Andrew Garner 30 Nov '07

30 Nov '07

When stressing dovecot's delivery agent, I sporadically encountered the following assertion failures and the associated errors. I was trickling in ~50 messages per minute to this mailbox via postal. Nov 30 09:38:41 mail deliver(example(a)example.com): close(/home/vmail/domains//+/example.com/k/example//Maildir/maildirsize) failed: Bad file descriptor Nov 30 09:38:41 mail deliver(example(a)example.com): rename(/home/vmail/domains//+/example.com/k/example//Maildir/maildirsize.lo…, /home/vmail/domains//+/example.com/k/example//Maildir/maildirsize) failed : No such file or directory Nov 30 09:38:41 mail deliver(example(a)example.com): file_dotlock_replace(/home/vmail/domains//+/example.com/k/example//Maildir/… failed: No such file or directory Nov 30 09:38:41 mail deliver(example(a)example.com): Internal quota calculation error Nov 30 09:38:41 mail deliver(example(a)example.com): file index-transaction.c: line 54 (index_transaction_finish_rollback): assertion failed: (t->mail_ref_count == 0) Nov 30 09:38:41 mail deliver(example(a)example.com): Raw backtrace: /usr/lib/dovecot/deliver(i_syslog_fatal_handler+0x2b) [0x80bf0ab] -> /usr/lib/dovecot/deliver [0x80beeba] -> /usr/lib/dovecot/deliver [0x 808f243] -> /usr/lib/dovecot/deliver(index_transaction_rollback+0x1a) [0x808f06a] -> /usr/lib/dovecot/modules/lda/lib10_quota_plugin.so [0xb7ea2f13] -> /usr/lib/dovecot/deliver(deliver_save+0x212) [0x8059412] -> /usr/lib/dovecot/deliver(main+0x12cb) [0x805a79b] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7ebcea8] -> /usr/lib/dovecot/deliver [0x8058611] # dovecot -n # 1.1.beta9: /etc/dovecot/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting: Nationwide Internet Mail Server ready. verbose_proctitle: yes first_valid_uid: 89 last_valid_uid: 89 first_valid_gid: 89 last_valid_gid: 89 mail_uid: 89 mail_gid: 89 mail_location: maildir:/home/vmail/domains/%h/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes lock_method: dotlock mail_executable(default): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 imap_client_workarounds(default): delay-newmail imap_client_workarounds(imap): delay-newmail imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: login plain cram-md5 digest-md5 username_format: %Lu verbose: yes debug: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir quota_rule: *:storage=102400 This is the latest hg sources, somewhat after beta9: $ hg tip changeset: 6877:a5a7d38b6df7 branch: HEAD tag: tip user: Timo Sirainen <tss(a)iki.fi> date: Thu Nov 29 19:38:06 2007 +0200

1 0

[Dovecot] Zimbra benchmarking
by Timo Sirainen 30 Nov '07

30 Nov '07

Now that I have a working kvm setup, I thought I'd finally try how Zimbra works. This is mainly some microbenchmarking, so it may not have much to do with actual performance in real life. Setup: - 1GB memory given to kvm (from host's 2GB) - Intel Core 2 6600 (kvm uses only one CPU) - CentOS 5 - 15GB qcow2 image on XFS filesystem - Zimbra 5.0 RC2 RHEL5 x86_64 - Dovecot latest hg, dbox format Both Zimbra and Dovecot were tested running on the same kvm image. All data could be cached in memory, so this didn't really test disk I/O. Dovecot was run with fsync_disable=no. Running with =yes would have made its performance even better. Zimbra features/bugs -------------------- Zimbra's SEARCH command doesn't support substring searching as IMAP requires: 1 search text performance * SEARCH 136 183 227 231 232 233 245 1 OK SEARCH completed 2 search text erformance * SEARCH 2 OK SEARCH completed 3 search text performanc * SEARCH 3 OK SEARCH completed It's possible to search "performanc" in a non-standard way though: 4 search text "performanc*" * SEARCH 136 183 227 231 232 233 245 4 OK SEARCH completed This means that the upcoming Dovecot v1.1 is probably the only IMAP server that supports IMAP-compatible full text search indexes with incremental updates. (Cyrus Squat requires rebuilding the whole index from scratch just for adding one mail, which makes it kind of impractical.) Zimbra doesn't support SORT or THREAD extensions. I had trouble benchmarking more than 5 simultaneous connections in one mailbox. I'm not sure if this is a configurable setting somewhere, or if there's just some bug. The error messages that my imaptest gave looked like Zimbra was buggy, but I didn't look at them too closely. STORE command also seemed to be buggy, giving lots of "STORE failed" errors, even with just one connection. Zimbra uses 500MB of memory just to start up, so it's not exactly for hosting small installations. Login+Logout ------------ Dovecot: ./imaptest - select=0 secs=10 seed=0 clients=1 Logi Logo 100% 100% 3439 6878 ./imaptest - select=0 secs=10 seed=0 clients=10 Logi Logo 100% 100% 4415 8830 Zimbra: ./imaptest - select=0 secs=10 seed=0 clients=1 Logi Logo 100% 100% 18032 36064 ./imaptest - select=0 secs=10 seed=0 clients=10 Logi Logo 100% 100% 25519 51056 Looks like Dovecot's imap process creation hurts it a lot compared to Zimbra's thread creation. Luckily IMAP connections are usually long-living, so this shouldn't matter much, except for webmails for which you can use imapproxy in the middle. LIST "" * --------- Dovecot: ./imaptest - select=0 logout=0 list=100 secs=10 seed=0 clients=1 Logi List 100% 100% 1 181411 ./imaptest - select=0 logout=0 list=100 secs=10 seed=0 clients=10 Logi List 100% 100% 10 133451 Zimbra: ./imaptest - select=0 logout=0 list=100 secs=10 seed=0 clients=1 Logi List 100% 100% 1 1021 ./imaptest - select=0 logout=0 list=100 secs=10 seed=0 clients=10 Logi List 100% 100% 10 972 Yes, Dovecot's LIST is over 100 times faster. STATUS INBOX (MESSAGES UNSEEN RECENT) ------------------------------------- 100 messages in INBOX dovecot: ./imaptest - logout=0 select=0 status=100 secs=10 seed=0 clients=1 Logi Stat 100% 100% 1 191003 ./imaptest - logout=0 select=0 status=100 secs=10 seed=0 clients=10 Logi Stat 100% 100% 10 171171 Zimbra: ./imaptest - logout=0 select=0 status=100 secs=10 seed=0 clients=1 Logi Stat 100% 100% 1 3697 ./imaptest - logout=0 select=0 status=100 secs=10 seed=0 clients=10 Logi Stat 100% 100% 10 7009 FETCH 1:* (UID FLAGS ENVELOPE INTERNALDATE BODYSTRUCTURE) --------------------------------------------------------- 100 messages in INBOX. dovecot: ./imaptest - logout=0 select=100 fetch=100 secs=10 seed=0 clients=1 Logi Sele Fetc 100% 100% 100% 1 1 2769 ./imaptest - logout=0 select=100 fetch=100 secs=10 seed=0 clients=5 Logi Sele Fetc 100% 100% 100% 5 5 2902 Zimbra: ./imaptest - logout=0 select=100 fetch=100 secs=10 seed=0 clients=1 Logi Sele Fetc 100% 100% 100% 1 1 203 ./imaptest - logout=0 select=100 fetch=100 secs=10 seed=0 clients=5 Logi Sele Fetc 100% 100% 100% 5 5 258 FETCH ? (BODY[]) ---------------- Randomly fetch message body from 100 messages Dovecot: ./imaptest - logout=0 select=100 fetch2=100 secs=10 seed=0 clients=1 Logi Sele Fet2 100% 100% 100% 30% 1 1 51958 ./imaptest - logout=0 select=100 fetch2=100 secs=10 seed=0 clients=5 Logi Sele Fet2 100% 100% 100% 30% 5 5 141397 Zimbra: ./imaptest - logout=0 select=100 fetch2=100 secs=10 seed=0 clients=1 Logi Sele Fet2 100% 100% 100% 30% 1 1 410 ./imaptest - logout=0 select=100 fetch2=100 secs=10 seed=0 clients=5 Logi Sele Fet2 100% 100% 100% 30% 5 5 2291 STORE ? FLAGS.SILENT (random flags and keywords) ------------------------------------------------ Dovecot: ./imaptest - logout=0 select=100 store=100 secs=10 seed=0 clients=1 Logi Sele Stor 100% 100% 100% 1 1 15236 ./imaptest - logout=0 select=100 store=100 secs=10 seed=0 clients=5 Logi Sele Stor 100% 100% 100% 5 5 5533 Zimbra: ./imaptest - logout=0 select=100 store=100 secs=10 seed=0 clients=1 Logi Sele Stor 100% 100% 100% 1 1 308 ./imaptest - logout=0 select=100 store=100 secs=10 seed=0 clients=5 Logi Sele Stor 100% 100% 100% 5 5 319 Zimbra gave lots of errors: Error: STORE failed: STORE failed APPEND ------ Appends to empty mailbox: Dovecot: 1 client, 5 seconds: 3959 mails 1 client, 5 seconds, fsync_disable=yes: 21889 mails Zimbra: 1 clients, 5 seconds: 222 mails 5 clients, 5 seconds: 322 mails Zimbra is apparently building full text search indexes while appending, so this test doesn't mean much until I can test Dovecot's performance with Squat indexing.

5 6

[Dovecot] squat plugin
by Joe Wong 29 Nov '07

29 Nov '07

Hello Timo, I have installed 1.1 beta 8 with fts-squat enabled. I have added the plugin section in dovecot.conf. How can I actually make use of the full text index? Regards, - Joe

2 2