- dovecot - dovecot.org

[Dovecot] Performance problem with STATUS after upgrade (1.0.15 -> 1.2.2)
by Stefan Förster 03 Aug '09

03 Aug '09

Hello list, after upgrading dovecot from 1.0.15 to 1.2.2 (and carefully reading through the upgrading notes in the wiki), I got sieve, quota and fts up and running, but I'm now suffering some kind of performance problem with the STATUS command. Symptoms: Reading mail on the IMAP server itself with "mutt", no TLS/SSL, connected through loopback interface. Whenever I idle a bit and then hit any key thereafter, for example to change into another mailbox, mutt will send a number of "STATUS" commands: # T 127.0.0.1:53604 -> 127.0.0.1:143 [AP] DONE..a0070 STATUS "postfix-buch" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0071 STATUS "postfix-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0072 STATUS "Trash" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0073 STATUS "Sent" (UIDNEXT UIDVALID ITY UNSEEN RECENT)..a0074 STATUS "mailman-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0075 STATUS "mailman-developers" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0076 STATUS "de-postfix-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0077 STATUS "amavis-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0078 STATUS "spam" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0079 STATUS "localreports" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0080 STATUS "Drafts" (UIDNEXT UIDVALIDITY UNSEEN R ECENT)..a0081 STATUS "exim-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT).. # (The whole conversation is available as: http://www.incertum.net/~cite/dovecot-snoop.log) Those commands take almost one(!) second to complete. I've used strace to capture what happens and made the results available at http://www.incertum.net/~cite/imap.log. With 1.0.15, I never noticed this kind of delay, and reading mail feels really sluggish at the moment. Is there any way to improve performance? Configuration data: Filesystem mounted to /export/vmailboxes is an ext3: # tune2fs -l /dev/rootvg/mailhome_lv | grep "^Filesystem features" Filesystem features: has_journal resize_inode dir_index filetype needs_recovery sparse_super large_file (needs_recovery is set because the filesystem is mounted, I umounted it, did fsck -Dfy and it didn't display that "feature" when unmounted). dovecot -n (also available as: http://www.incertum.net/~cite/dovecot-n.log) # 1.2.2: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-amd64 x86_64 Debian 5.0.2 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve listen(default): *:143 listen(imap): *:143 listen(managesieve): * ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(managesieve): ssl_cert_file: /etc/ssl/owncerts/mail_incertum_net.crt ssl_key_file: /etc/ssl/private/mail_incertum_net.key login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login verbose_proctitle: yes mail_privileged_group: vmail mail_location: maildir:~/Maildir mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_process_size: 1024 mail_plugins(default): quota imap_quota fts fts_squat mail_plugins(imap): quota imap_quota fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve lda: postmaster_address: postmaster(a)incertum.net hostname: mail.incertum.net mail_plugins: quota sieve auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: sasl master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir:User quota quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 sieve: ~/.dovecot.sieve sieve_storage: ~/sieve sieve_extensions: +imapflags fts: squat fts_squat: partial=4 full=10 SQL-Configuration: # grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = pgsql connect = hostaddr=333.33.33.3 port=5432 dbname=secret user=secret password=secret sslmode=require default_pass_scheme = PLAIN password_query = SELECT login AS user, password FROM virtual_user_maps WHERE login IN ('%u', '%n') user_query = SELECT vum.uid, vum.gid, ('*:storage=' || vum.quota_kbytes || 'k') AS quota_rule, ('/export/vmailboxes/' || SUBSTR(vum.login, 1, 1) || '/' || vum.login) AS home FROM virtual_mailbox_domains AS vmd LEFT JOIN virtual_mailbox_maps AS vmm ON (vmd.id = vmm.domain) LEFT JOIN virtual_user_maps AS vum ON (vmm.login = vum.id) WHERE ((vmm.localpart = '%n' AND vmd.name='%d') OR (vum.login = '%u')) AND vum.active Memory: # free -m total used free shared buffers cached Mem: 3952 3003 949 0 226 1036 -/+ buffers/cache: 1740 2211 Swap: 7812 5 7807 The version is Debian/unstable's 1.2.2, available at http://packages.debian.org/sid/dovecot-common, I've made a backport to Debian/stable. Any help/insights are really appreciated. Cheers Stefan

2 3

[Dovecot] Spaces in user or group-names
by Sven Strickroth 03 Aug '09

03 Aug '09

Hi, how it is possible to use group names with spaces (like "Domain Admins") in dovecot-acl files? -- Best regards, Sven mailto:sven@clamav.net ClamAV, a GPL anti-virus toolkit http://www.clamav.net

2 4

[Dovecot] Panic: file mbox-sync-rewrite.c: line 590
by Kostik 03 Aug '09

03 Aug '09

Hello! We start migrate to dovecot (v1.2.2). # 1.2.2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30 i686 Slackware 11.0.0 We have FS user quota and NFS mailboxs(mbox only). While user not overquota, all works fine. But if is, we get error at log: --- Aug 3 16:45:17 chest004 dovecot: pop3-login: Login: user=<boggart(a)xxxx.xx>, method=PLAIN Aug 3 16:45:17 chest004 dovecot: POP3(boggart(a)xxxx.xx): close(/var/virtual/mail/boggart.lock) failed: Disk quota exceeded Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): close(/var/virtual/mail/boggart.lock) failed: Disk quota exceeded Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): Panic: file mbox-sync-rewrite.c: line 590 (mbox_sync_rewrite): assertion failed: (mails[idx].from_offset == start_offset) Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): Raw backtrace: pop3 [0x80c949c] -> pop3 [0x80c9c3e] -> pop3 [0x80c9638] -> pop3(mbox_sync_rewrite+0x6ff) [0x807c9af] -> pop3 [0x8078038] -> pop3 [0x807a30a] -> pop3(mbox_sync+0x399) [0x807b279] -> pop3(mbox_storage_sync_init+0x53) [0x807b773] -> pop3(mailbox_sync+0x2d) [0x809331d] -> pop3(client_command_execute+0x2e6) [0x805d066] -> pop3(client_handle_input+0x75) [0x805be35] -> pop3(io_loop_handler_run+0x101) [0x80d2221] -> pop3(io_loop_run+0x29) [0x80d15a9] -> pop3(main+0x779) [0x805dd49] -> /lib/tls/libc.so.6(__libc_start_main+0xd4) [0xb7e46e14] -> pop3 [0x805b161] --- What does that mean? /usr/local/sbin/dovecot -n --- # 1.2.2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30 i686 Slackware 11.0.0 base_dir: /var/run/dovecot/ protocols: imap pop3 listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: dotlock_try fcntl mbox_lock_timeout: 150 mbox_dotlock_change_timeout: 60 mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_log mail_plugins(imap): quota imap_quota mail_log mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql userdb: driver: prefetch plugin: quota: fs:Quota:user =koc

1 0

[Dovecot] Subfolders not listed in Dovecot-1.2.2 with listescape
by Petter Urkedal 03 Aug '09

03 Aug '09

After upgrading to Dovecot-1.2.2 from 1.1* subfolders disappeared, though it was possible to access them directly, e.g. with "mutt -f =lists/dovecot". The problem only occurs if the listescape plugin is enabled. Some relevant bits from the configuration: namespace private { # The only namespace. separator = / prefix = inbox = yes } protocol imap { mail_plugins = fts fts_squat listescape }

2 2

[Dovecot] Best way to get login protocol (pop3/imap) in post-login script
by Zhang Huangbin 03 Aug '09

03 Aug '09

Hi, all. I found doc here: http://wiki.dovecot.org/PostLoginScripting and use ${USER}, ${IP} to track last-login username and remote ip address, but how can i track the mail protocol it used? like pop3, pop3s, imap, imaps? Currently, i wrote shell script as post-login script, and use below command to get protocol: ---- $(basename ${MAIL_PLUGIN_DIR}) ---- But is it the best way to get it? Thanks very much. :) -- Best Regards. Zhang Huangbin - Open Source Mail Server Solution for Red Hat(R) Enterprise Linux, CentOS, Debian, Ubuntu: + http://code.google.com/p/iredmail/ + http://www.iredmail.org/forum/

2 2

Re: [Dovecot] expire plugin no delete 1.2.1 / 1.2.2
by Robert Schetterer 03 Aug '09

03 Aug '09

Robert Schetterer schrieb: > Timo Sirainen schrieb: >> On Fri, 2009-07-31 at 17:21 +0200, Robert Schetterer wrote: >>> Hi Timo, >>> so now its clear, the mail >>> did not got deleted if i now do >>> >>> Info: robert(a)schetterer.com/Trash: no messages left >> So, it worked? "no messages left" means if you didn't give --test it >> would have deleted all messages from the mailbox. >> > Hi Timo, no it didnt work > i repeated the test since then twice > the mail was not deleted > Hi Timo, no it didnt work i repeated the test since then twice the mail was not deleted -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

1 0

[Dovecot] How to delete retrieved mail
by Don Muller 03 Aug '09

03 Aug '09

Hi All, I use Dovecot and XMail on a QNAP TS-509 NAS. QNAP has combined the two into a package they call XDove. Everything seems to be working great except for one thing. When Dovecot retrieves the mail from XMail it is not removing it from XMail. It is leaving a copy on XMail. Is there an option I can set in Dovecot so it will delete the mail message from XMail when it retrieves it. Thanks Don

2 1

[Dovecot] Client Cert Auth Problem
by Christian Felsing 03 Aug '09

03 Aug '09

Hello, is there a config possible which supports both of following authentication schemes ? 1st: If user presents a client certificate, he can log in w/o username/password, where user id comes from CN. Accepting any password is not the right solution. 2nd: If user does not present a client certificate, he have to authenticate by username/password. In both cases user data is read from userdb LDAP, which is already working. I was not able to get both auth schemes working at same time. With Postfix such a config is fully operable. regards Christian

2 1

[Dovecot] Public folders, individual SEEN flags
by Keith Edmunds 03 Aug '09

03 Aug '09

Hi list I'm trying to set up shared public folders with individual SEEN flags. I've set up three test users, but as soon as one of them marks a mail in the public folder as seen or unseen, that change is propagated to all three users. If I watch the dovecot.index.log file in each user's directory for the public folder, I see all three change their last access time as soon as one user changes the SEEN status of a mail. Any hints as to what I'm doing wrong gratefully received, thanks. -------------------------------------------------------------------------------- # dovecot --version 1.2.1 -------------------------------------------------------------------------------- # dovecot -n # 1.2.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.2 log_timestamp: %Y-%m-%d %H:%M:%S disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_privileged_group: mail namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: shared/ location: maildir:/home/publicfolders:INDEX=~/Maildir/public list: yes auth default: passdb: driver: pam userdb: driver: passwd -------------------------------------------------------------------------------- # ls -l /home/publicfolders/dovecot-shared -rw-rw-r-- 1 publicfolders publicfolders 0 2009-07-27 15:01 /home/publicfolders/dovecot-shared --------------------------------------------------------------------------------

2 3

[Dovecot] parameter "mail_location" and variables
by maximatt 03 Aug '09

03 Aug '09

hi.... i have virtual users stored in ldap server and i must to do some modifications that requiere to chage mail_location value... the solution comes to use the "uid" value stored in ldap server for users on mail_location parameter... i can see in http://wiki.dovecot.org/Variables that i can't do them (i uses sasl authentication) so.. ¿exist any way to get a value from ldap server and use them in mail_location parameter? thanks in advance!!! -- Salu2 ;)

2 3