September 2009 - dovecot

[Dovecot] ntpd / Time just moved backwards
by Frank Elsner 11 Sep '09

11 Sep '09

Hello *, strange happening yesterday. See this logfile lines: Sep 10 20:45:52 seymour ntpd[9104]: synchronized to 192.53.103.108, stratum 1 Sep 10 20:58:07 seymour ntpd[9104]: synchronized to 134.34.3.18, stratum 1 Sep 10 21:21:02 seymour dovecot: dovecot: Fatal: Time just moved backwards by 434 seconds. [ ... ] Sep 10 21:26:36 seymour ntpd[9104]: no servers reachable Sep 10 21:42:56 seymour ntpd[9104]: synchronized to 192.53.103.104, stratum 1 Sep 10 21:50:55 seymour ntpd[9104]: time reset +434.824810 s Sep 10 21:54:09 seymour ntpd[9104]: synchronized to 130.149.7.71, stratum 2 Sep 10 21:55:07 seymour ntpd[9104]: synchronized to 129.69.1.153, stratum 1 What might happened? And where to ask also? --Frank Elsner

2 1

[Dovecot] high imap load on large folders
by Ingo Thierack 10 Sep '09

10 Sep '09

Hello, i sync with imapsync from an archiopteryx-server to an dovecot-server, for testing until now. The dovecot is inside an VM. storage for mail is on an nfs-share, indexes are local. What i now see, is, on large folder( 58000 messages and more) the load on the imap-process is very high, and slowdown the transferprocess. Is there something, I can do. Whats cause the high load ind the imap-process. Here are the configuration, and below, a partial strace # 1.2.4: /opt/dovecot/etc/dovecot.conf # OS: Linux 2.6.18-128.1.14.el5 i686 CentOS release 5.3 (Final) nfs base_dir: /var/run/dovecot/ ssl_cert_file: /opt/dovecot/etc/ssl/certs/dovecot.pem ssl_key_file: /opt/dovecot/etc/ssl/private/dovecot.pem login_dir: /var/run/dovecot/login login_executable: /opt/dovecot/libexec/dovecot/imap-login mail_max_userip_connections: 50 mail_location: maildir:/mnt/mail/%u/Maildir:INDEX=/var/spool/indexes/%u mailbox_idle_check_interval: 5 fsync_disable: yes mail_nfs_storage: yes lda: postmaster_address: postmaster(a)ghostdive.org hostname: mail.ghostdive.org mail_plugins: sieve mail_plugin_dir: /opt/dovecot/lib/dovecot/lda sendmail_path: /opt/postfix26/sbin/sendmail auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /opt/dovecot/etc/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /opt/dovecot/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: mailaccess group: mailaccess ------------------------------ strace output close(7) = 0 munmap(0xb7255000, 2101248) = 0 munmap(0xb7c73000, 1052672) = 0 munmap(0xb7d74000, 528384) = 0 brk(0x84c1000) = 0x84c1000 time(NULL) = 1252311837 stat64("/mnt/mail/mail/ingoiwt/.wx-dev/cur", {st_mode=S_IFDIR|0700, st_size=3526656, ...}) = 0 pwrite64(8, "\0\0\0\0@\0\0\20\0\0\0\0\0\0\0\0$\0\0\0\0\0\0\0\1\0\0\0\200\200\200\214"..., 92, 32720) = 92 pwrite64(8, "\200\200\200\207", 4, 32720) = 4 fstat64(8, {st_mode=S_IFREG|0600, st_size=32812, ...}) = 0 pread64(8, "\200\200\200\207@\0\0\20\0\0\0\0\0\0\0\0$\0\0\0\0\0\0\0\1\0\0\0\200\200\200\214"..., 1024, 32720) = 92 pread64(8, "", 1024, 32812) = 0 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index", {st_mode=S_IFREG|0600, st_size=451180, ...}) = 0 fcntl64(9, F_SETLK64, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb084c8) = 0 pread64(9, "\7\2x\0\320\0\0\0\f\0\0\0\1\0\0\0\22o\240J\0\0\0\0k\201\237J\316\222\0\0"..., 120, 0) = 120 pwrite64(9, "$\0\0\0\0\0\0\0\0\0\0\0\0\0\7\0maildir\0\35\303\244J\22o\240J"..., 88, 120) = 88 pwrite64(9, "\316\222\0\0\10\0\0\0H\2064\0\317\222\0\0\10\0\0\0\234\2064\0\320\222\0\0\10\0\0\0"..., 1032, 451180) = 1032 pwrite64(9, "\7\2x\0\320\0\0\0\f\0\0\0\1\0\0\0\22o\240J\0\0\0\0k\201\237J$\223\0\0"..., 120, 0) = 120 fcntl64(9, F_SETLK64, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb08518) = 0 fstat64(8, {st_mode=S_IFREG|0600, st_size=32812, ...}) = 0 umask(066) = 077 time(NULL) = 1252311837 lstat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log.newlock", 0xbfb081c0) = -1 ENOENT (No such file or directory) open("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log.newlock", O_RDWR|O_CREAT|O_EXCL|O_LARGEFILE, 0666) = 7 fstat64(7, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 umask(077) = 066 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=32812, ...}) = 0 write(7, "\1\2(\0\22o\240J\226\1\0\0\225\1\0\0,\200\0\0\26\303\244J\0\0\0\0\0\0\0\0"..., 40) = 40 fstat64(7, {st_mode=S_IFREG|0600, st_size=40, ...}) = 0 alarm(180) = 0 fcntl64(7, F_SETLKW64, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb08388) = 0 alarm(0) = 180 unlink("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log.2") = 0 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=32812, ...}) = 0 link("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log", "/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log.2") = 0 rename("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log.newlock", "/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log") = 0 fcntl64(8, F_SETLK64, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb08498) = 0 fcntl64(7, F_SETLK64, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb08658) = 0 alarm(180) = 0 fcntl64(7, F_SETLKW64, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb085b8) = 0 alarm(0) = 180 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=40, ...}) = 0 fstat64(7, {st_mode=S_IFREG|0600, st_size=40, ...}) = 0 pread64(7, "", 1024, 40) = 0 fstat64(8, {st_mode=S_IFREG|0600, st_size=32812, ...}) = 0 time(NULL) = 1252311837 stat64("/mnt/mail/mail/ingoiwt/.wx-dev/cur", {st_mode=S_IFDIR|0700, st_size=3526656, ...}) = 0 rename("/mnt/mail/mail/ingoiwt/.wx-dev/tmp/1252311830.M363574P30566.devel5.ghostdive.org", "/mnt/mail/mail/ingoiwt/.wx-dev/cur/12523 11830.M363574P30566.devel5.ghostdive.org,W=5448:2,S") = 0 brk(0x8501000) = 0x8501000 _llseek(12, 0, [2365285], SEEK_END) = 0 _llseek(12, 0, [2365285], SEEK_CUR) = 0 fstat64(12, {st_mode=S_IFREG|0600, st_size=2365285, ...}) = 0 write(12, "37668 :1252311830.M363574P30566."..., 64) = 64 fstat64(12, {st_mode=S_IFREG|0600, st_size=2365349, ...}) = 0 pwrite64(7, "\0\0\0\0@\0\0\20\0\0\0\0\0\0\0\0$\0\0\0\0\0\0\0\1\0\0\0\200\200\200\214"..., 92, 40) = 92 pwrite64(7, "\200\200\200\207", 4, 40) = 4 fstat64(7, {st_mode=S_IFREG|0600, st_size=132, ...}) = 0 pread64(7, "\200\200\200\207@\0\0\20\0\0\0\0\0\0\0\0$\0\0\0\0\0\0\0\1\0\0\0\200\200\200\214"..., 1024, 40) = 92 pread64(7, "", 1024, 132) = 0 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index", {st_mode=S_IFREG|0600, st_size=452212, ...}) = 0 umask(0) = 077 open("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.tmp", O_RDWR|O_CREAT|O_TRUNC|O_LARGEFILE, 0600) = 10 umask(077) = 0 fstat64(10, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 write(10, "\7\2x\0\320\0\0\0\f\0\0\0\1\0\0\0\22o\240J\0\0\0\0k\201\237J$\223\0\0"..., 208) = 208 write(10, "\1\0\0\0\10\0\0\0,\366\7\0\2\0\0\0\10\0\0\0<\366\7\0\3\0\0\0\10\0\0\0"..., 452004) = 452004 close(10) = 0 rename("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.tmp", "/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index") = 0 fcntl64(7, F_SETLK64, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb08728) = 0 alarm(10) = 0 fcntl64(6, F_SETLKW64, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb08668) = 0 alarm(0) = 10 fstat64(6, {st_mode=S_IFREG|0600, st_size=3794944, ...}) = 0 pwrite64(6, "\0\0\0\0\\\0\0\0\f\0\0\0D\0\0\0,\0\0\0\0\0\0\0Message-"..., 92, 3449984) = 92 pwrite64(6, "\1\10\0\0\22o\240J{\266\240J\252\30\0\0\0\0\0\0\334\2444\0\0\0\0\0\200\200\200\210", 32, 0) = 32 fcntl64(6, F_SETLK64, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb086e8) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=2309, ...}) = 0 alarm(180) = 0 fcntl64(7, F_SETLKW64, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb085f8) = 0 alarm(0) = 180 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=132, ...}) = 0 fstat64(7, {st_mode=S_IFREG|0600, st_size=132, ...}) = 0 pwrite64(7, "\0\0\0\0@\0\0\20\1\0\0\0{\266\240J\0\0\0\0\4\0\4\0\1\0\0\0\200\200\200\204"..., 104, 132) = 104 pwrite64(7, "\200\200\200\207", 4, 132) = 4 fcntl64(7, F_SETLK64, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb08668) = 0 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=236, ...}) = 0 fstat64(7, {st_mode=S_IFREG|0600, st_size=236, ...}) = 0 pread64(7, "\200\200\200\207@\0\0\20\1\0\0\0{\266\240J\0\0\0\0\4\0\4\0\1\0\0\0\200\200\200\204"..., 1024, 132) = 104 pread64(7, "", 1024, 236) = 0 lstat64("/mnt/mail/mail/ingoiwt/.wx-dev/dovecot-uidlist.lock", {st_mode=S_IFREG|0600, st_size=26, ...}) = 0 unlink("/mnt/mail/mail/ingoiwt/.wx-dev/dovecot-uidlist.lock") = 0 epoll_ctl(5, EPOLL_CTL_DEL, 0, {0, {u32=136644264, u64=136644264}}) = 0 epoll_ctl(5, EPOLL_CTL_ADD, 0, {EPOLLIN|EPOLLPRI|EPOLLERR|EPOLLHUP, {u32=136644264, u64=136644264}}) = 0 stat64("/mnt/mail/mail/ingoiwt/.wx-dev/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 stat64("/mnt/mail/mail/ingoiwt/.wx-dev/cur", {st_mode=S_IFDIR|0700, st_size=3526656, ...}) = 0 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=236, ...}) = 0 fstat64(7, {st_mode=S_IFREG|0600, st_size=236, ...}) = 0 time(NULL) = 1252311837 umask(0177) = 077 time(NULL) = 1252311837 lstat64("/mnt/mail/mail/ingoiwt/.wx-dev/dovecot-uidlist.lock", 0xbfb08530) = -1 ENOENT (No such file or directory) open("/mnt/mail/mail/ingoiwt/.wx-dev/dovecot-uidlist.lock", O_RDWR|O_CREAT|O_EXCL|O_LARGEFILE, 0666) = 10 write(10, "30566:devel5.ghostdive.org", 26) = 26 fstat64(10, {st_mode=S_IFREG|0600, st_size=26, ...}) = 0 close(10) = 0 lstat64("/mnt/mail/mail/ingoiwt/.wx-dev/dovecot-uidlist.lock", {st_mode=S_IFREG|0600, st_size=26, ...}) = 0 umask(077) = 0177 stat64("/mnt/mail/mail/ingoiwt/.wx-dev", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 chown32("/mnt/mail/mail/ingoiwt/.wx-dev", 20000, -1) = 0 open("/mnt/mail/mail/ingoiwt/.wx-dev/dovecot-uidlist", O_RDONLY|O_LARGEFILE) = 10 close(10) = 0 stat64("/mnt/mail/mail/ingoiwt/.wx-dev/dovecot-uidlist", {st_mode=S_IFREG|0600, st_size=2365349, ...}) = 0 fstat64(12, {st_mode=S_IFREG|0600, st_size=2365349, ...}) = 0 alarm(180) = 0 fcntl64(7, F_SETLKW64, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}, 0xbfb085d8) = 0 alarm(0) = 180 stat64("/var/spool/indexes/ingoiwt/.wx-dev/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=236, ...}) = 0 fstat64(7, {st_mode=S_IFREG|0600, st_size=236, ...}) = 0 open("/mnt/mail/mail/ingoiwt/.wx-dev/new", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 10 fstat64(10, {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 fcntl64(10, F_SETFD, FD_CLOEXEC) = 0 fstat64(10, {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 time(NULL) = 1252311837 getdents64(10, /* 2 entries */, 4096) = 48 getdents64(10, /* 0 entries */, 4096) = 0 close(10) = 0 open("/mnt/mail/mail/ingoiwt/.wx-dev/cur", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 10 fstat64(10, {st_mode=S_IFDIR|0700, st_size=3526656, ...}) = 0 fcntl64(10, F_SETFD, FD_CLOEXEC) = 0 fstat64(10, {st_mode=S_IFDIR|0700, st_size=3526656, ...}) = 0 time(NULL) = 1252311837 getdents64(10, /* 52 entries */, 4096) = 4048 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 brk(0x8541000) = 0x8541000 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4072 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 mmap2(NULL, 528384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7d74000 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4072 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4072 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 time(NULL) = 1252311840 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4072 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4080 getdents64(10, /* 51 entries */, 4096) = 4072 getdents64(10, /* 51 entries */, 4096) = 4080

2 6

[Dovecot] New need to delete dovecot-acl-list in dovecot 1.2?
by Adam McDougall 09 Sep '09

09 Sep '09

I just started testing 1.2.3 then 1.2.4 this week, I was too busy earlier in the year to look at 1.2 at all. So far so good except I noticed newly granted permissions via ACL on some newly created public mailboxes were not visible by the client. It seemed to be a version thing because the same files work fine concurrently on a server running 1.1.x. I came across this in the ACLwiki which seems to fix it: List cache dovecot-acl-list file lists all mailboxes that have "l" rights assigned. If you manually add/edit dovecot-acl files, you may need to delete the dovecot-acl-list to get the mailboxes visible. I don't ever recall needing to do this before, and it sounds similar to this which I have had set to 10 for a long time: # cache_secs parameter # specifies how many seconds to wait between stat()ing dovecot-acl file # to see if it changed. All of my dovecot-acl files are symlinks so hopefully it runs stat() on the target, but just in case I tried recreating the symlink afterwards but it didn't help and its over NFS so who knows if the running dovecot 'saw' it. Do I need to debug this behavior further or will I just have to live with remembering to delete the dovecot-acl-list file when I manually change dovecot-acl contents? Thanks.

2 3

[Dovecot] Odd/Incorrect Quota Reporting on Dovecot 1.2.4 & FreeBSD4
by Siraj 'Sid' Rakhada 09 Sep '09

09 Sep '09

Hi, Am seeing an odd problem on an old FreeBSD 4.11 box that I'm trying to get courier off, and dovecot on. At the same time, I'm trying to put some fairly simple quota support on, but getting very odd results. I think it might be better described with the log below, but, the gist of it is this: I have set a 1GB quota, and I was getting intermittent reports on the quota usage - sometimes at the correct usage (300MB or so), and then at some crazy amount over the quota usage. I can get it to be consistently incorrect though, as displayed with the below log. The maildirsize is correct, and matches closely to 'du' output, it's simply coming through incorrect on IMAP. It also only seems to happen if the maildirsize is not created before the first 'getquota[root]' command occurs. I think it's something to do with dovecot + FreeBSD (at least, this version)! I've done a quick test on a Debian box, and I don't have the same problem. Anyone else have any ideas what could be going wrong on this FreeBSD box? Is it worth me giving the dovecot -n output at this stage? It happens on different mailboxes too, this is just a sample. Thanks! ----- information & log follow # /usr/local/dovecot/sbin/dovecot --version 1.2.4 # uname -a FreeBSD server1.domain 4.11-RELEASE-p13 FreeBSD 4.11-RELEASE-p13 #5: Wed Oct 12 18:02:46 BST 2005 root@server1.domain:/usr/obj/build/src/sys/FBSD410RELENG i386 # cat maildirsize 1073741824S 304806180 16002 Attempt 1: . OK Capability completed. a login sid@domain test a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH QUOTA] Logged in a getquotaroot inbox * QUOTAROOT "inbox" "User Quota" * QUOTA "User Quota" (STORAGE 117738174 1048576) a OK Getquotaroot completed. a logout * BYE Logging out a OK Logout completed. closed Attempt 2: (on server do 'rm maildirsize') . OK Capability completed. a login sid@domain test a OK [snip] Logged in a getquotaroot inbox * QUOTAROOT "inbox" "User Quota" * QUOTA "User Quota" (STORAGE 117738174 1048576) a OK Getquotaroot completed. (on server, do 'rm maildirsize' again, while still connected, the first 'getquotaroot' is incorrect, as it seems dovecot regenerates the maildirsize file on login, hence the 'rm') a getquotaroot inbox * QUOTAROOT "inbox" "User Quota" * QUOTA "User Quota" (STORAGE 297662 1048576) a OK Getquotaroot completed. a getquotaroot inbox * QUOTAROOT "inbox" "User Quota"

2 2

[Dovecot] Password & Authentication schemes to comply with postfixadmin
by bsd 09 Sep '09

09 Sep '09

Hello, I am using the latest version of Dovecot on a FreeBSD box. I am trying to figure out which password scheme to use to comply with my database backend which is administered by "postfix admin". Here is an example of the password that can be generated in the database using the various encryption schemes available in postfix admin: $1$a733fb07$/g1h6opQxemdWUtzD2/kQ. --> md5crypt 25f9e794323b453885f5181f1b624d0b --> md5 acFhkap78XB2I --> system I am not certain I have understood very well how things all feet together… I have tried to modify the various options in dovecot-mysql.conf in order to comply with these settings: I have updated "default_pass_scheme" to "PLAIN-MD5, DIGEST-MD5, and CRYPT" but none of this seems to work. Do I have to modify something in dovecot.conf? For the moment I have these settings: auth default { mechanisms = plain login passdb sql { args = /usr/local/etc/dovecot-mysql.conf } userdb sql { args = /usr/local/etc/dovecot-mysql.conf } socket listen { client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } } The main idea is simply not to have cleatext passwd in the DB. Thanks for your support. ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ Gregober ---> PGP ID --> 0x1BA3C2FD bsd @at@ todoo.biz ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ P "Please consider your environmental responsibility before printing this e-mail"

2 1

[Dovecot] LDA does not read quota from userdb's extra fields
by Tim Chen 09 Sep '09

09 Sep '09

The version I use is dovecot 1.2.4 My config in dovecot.conf protocol imap { mail_plugins = quota imap_quota mail_log } protocol lda { mail_plugins = quota } userdb passwd-file { args = /etc/dovecot.userdb } quota = maildir quota_rule = *:storage=100MB /etc/dovecot.userdb user1:*:2001:2001::/ms/user1::userdb_quota_rule=*:storage=300M And in postfix/main.cf mailbox_command = /usr/local/libexec/dovecot/deliver I wish to have a global quota 100MB for all the users and using /etc/dovecot.userdb to specify larger quota(300MB) for some vip users. IMAP works normally as expected, using the following command will report correct quota. a login user1 pass1 user1 getquotaroot INBOX However, it seems LDA treat all users the same quota (100MB), and when trying to send mails to those vip users(300MB), it will reject the email and report "552 Requested mailbox exceeds quota. (in reply to RCPT TO command))" My speculation is LDA forget the read 'extra fields' from userdb, would you please help to verify it? Thanks very much for your help. Sincerely, Tim Chen

2 1

[Dovecot] changing location of index files
by suzuki 09 Sep '09

09 Sep '09

Hello, I think changing index files location of mail_location setting to reduce disk I/O. by adding "INDEX=/var/index/%d/%1n/%n" to mail_location like below, mail_location = maildir:~/Maildir:INDEX=/var/index/%d/%1n/%n Will this change cause any problems or data loss to existing pop3 users? There are only pop3 users on this server. % dovecot --version 1.1.18 % dovecot -n # 1.1.18: /usr/local/dovecot/etc/dovecot.conf # OS: FreeBSD 7.2-STABLE i386 syslog_facility: local4 protocols: pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: ready mail_max_userip_connections: 1 verbose_proctitle: yes first_valid_uid: 10026 last_valid_uid: 10026 first_valid_gid: 10026 last_valid_gid: 10026 mail_privileged_group: vmail mail_uid: 10026 mail_gid: 10026 mail_location: maildir:~/Maildir mail_debug: yes maildir_copy_preserve_filename: yes mail_executable: /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins: quota mail_plugin_dir: /usr/local/dovecot/lib/dovecot/pop3 mail_log_max_lines_per_sec: 30 pop3_enable_last: yes pop3_reuse_xuidl: yes pop3_lock_session: yes pop3_client_workarounds: outlook-no-nuls,oe-ns-eoh lda: postmaster_address: postmaster mail_plugins: quota sendmail_path: /usr/local/sbin/sendmail auth_socket_path: /var/run/dovecot/auth-master auth default: verbose: yes passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir

2 1

Re: [Dovecot] FTS Plugin design
by rui.carneiro＠portugalmail.net 09 Sep '09

09 Sep '09

Hi again! After sometime using my changes on this plugin I found one major problem. When a message have two attachments with same name or one with content-type equal to "message/*", my solr schema design does not work because as attachment unique identifier I used attachment's name what is not correct. Now I am trying to find a way to know the mime part id of the parts used on fts_build_mail. Is that already possible or I need to do that by my own? Thank you in advance, Rui Carneiro

2 1

[Dovecot] The usage of dovecot-uidvalidity* files?
by Tim Chen 09 Sep '09

09 Sep '09

After installing a new server with dovecot 1.2.4, I found there is some new dovecot-uidvalidity* files in user's Maildir directory. However, I did not see such files in other servers with dovecot 1.1.2 (around 2008/07). What is function of those files? What will happen if I delete that files? I am curious why need to keep 2 files: dovecot-uidvalidity dovecot-uidvalidity.4aa4fa4c since the content of dovecot-uidvalidity is '4aa4fa4c' why do we need extra files? Thanks Timo for providing the wonderful dovecot software! Hope you don't mind my stupid questions. Sincerely, Tim Chen

2 1

[Dovecot] compression script for use with zlib module
by Leonardo Rodrigues 09 Sep '09

09 Sep '09

Hi, I'm wondering if someone already implemented a compression script (and would like to share it) based on the step-by-step provided on wiki page of Zlib module. I can already do some find|xargs gzip .... but couldnt implement it completly as described on the wiki page. I know the suggested step-by-step is very detailed and probably a must simplier will be enough for almost anyone .... anyway, if someone have the full script and would like to share it, i would be glad to get it :) http://wiki.dovecot.org/Plugins/Zlib 1) Find the mails you want to compress in a single maildir. 2) Compress the mails to tmp/ * Update the compressed files' mtimes to be the same as they were in the original files (e.g. touch command) 3) Run maildirlock <path> <timeout>. It writes PID to stdout, save it. * <path> is path to the Maildir's dovecot-uidlist (the control directory, if it's separate) * <timeout> specifies how long to wait for the lock before failing. 4) If maildirlock grabbed the lock successfully (exit code 0) you can continue. 5) For each mail you compressed: 1. Verify that it still exists where you last saw it. 2. If it doesn't exist, delete the compressed file. Its flags may have been changed or it may have been expunged. This happens rarely, so just let the next run handle it. 3. If the file does exist, rename() (mv) the compressed file over the original file. * Dovecot can now read the file, but to avoid compressing it again on the next run, you'll probably want to rename it again to include e.g. a "Z" flag in the file name to mark that it was compressed (e.g. 1223212411.M907959P17184.host,S=3271:2,SZ). Remember that the Maildir specifications require that the flags are sorted by their ASCII value, although Dovecot itself doesn't care about that. 6) Unlock the maildir by sending a TERM signal to the maildirlock process (killing the PID it wrote to stdout). -- Atenciosamente / Sincerily, Leonardo Rodrigues Solutti Tecnologia http://www.solutti.com.br Minha armadilha de SPAM, NÃO mandem email gertrudes(a)solutti.com.br My SPAMTRAP, do not email it

2 1