August 2009 - dovecot

[Dovecot] Sending log messages too fast
by Luigi Rosa 04 Aug '09

04 Aug '09

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 What does this error message means? IMAP(xxxxx(a)yyyyy.com): Sending log messages too fast, throttling.. It appeared twiche on the same user during a period when the server was very high on CPU load I don't know if it is related, but the user later told me that Thunderbird forced a reload of all the messages. Ciao, luigi - -- / +--[Luigi Rosa]-- \ It is not the strongest of the species that survives, nor the most intelligent, but the one most responsive to change. --Charles Darwin -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkp4HOwACgkQ3kWu7Tfl6ZSIeACgrzXidrLIh783fr7DVFblfwc5 s/kAnAy5rztbmeqFt11uPGF0LVp6UBga =ZgWV -----END PGP SIGNATURE-----

3 2

[Dovecot] sieve not working with Postfix and maildir
by Florin Andrei 03 Aug '09

03 Aug '09

I am moving away from Cyrus, I'm trying to migrate to Dovecot. I am trying to get Sieve working with Dovecot and Postfix and it just won't work. Postfix is able to delived new messages to the "new" subfolder of the inbox structure. After I run Thunderbird, the new message gets moved to "cur" and it shows up in my inbox. So far so good. But now I'm trying to add Sieve. I turned on managesieve, installed Avelsieve in Squirrelmail, and did some tests. No matter what, the message stays in the inbox, it does not move to the designated folder: Postfix throws it in "new", it gets moved to "cur" after accessing my email with Thunderbird, and that's it. Detailed report: ########################### $ dovecot -n # 1.1.11: /etc/dovecot/dovecot.conf # OS: Linux 2.6.28-11-server x86_64 Ubuntu 9.04 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login mail_privileged_group: mail mail_location: maildir:~/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve sieve_storage(default): sieve_storage(imap): sieve_storage(managesieve): ~/sieve sieve(default): sieve(imap): sieve(managesieve): ~/.dovecot.sieve auth default: passdb: driver: pam userdb: driver: passwd ########################### Postfix is configured to deliver to Maildir: home_mailbox = Maildir/ I am testing the delivery: ######################## $ telnet localhost 25 Trying ::1... Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. 220 andrei.myip.org ESMTP Postfix (Ubuntu) helo joblo 250 andrei.myip.org mail from: joe(a)blow.com 250 2.1.0 Ok rcpt to: florin(a)andrei.myip.org 250 2.1.5 Ok data 354 End data with <CR><LF>.<CR><LF> testing . 250 2.0.0 Ok: queued as 512FE480C8 ######################## And the message is delivered: $ ls ~/Maildir/new/ 1249331187.V801Ia16012M874274.weiqi I fire up Thunderbird, look in the inbox, and the message is there - and it gets moved from "new" to "cur" after Thunderbird connects to the server: $ ls ~/Maildir/cur/1249331187.V801Ia16012M874274.weiqi* /home/XXXX/Maildir/cur/1249331187.V801Ia16012M874274.weiqi:2,S Okay, now I go to Squirrelmail / Avelsieve and make a rule for this >From address: ################################# $ ls -l sieve/ total 8 -rw------- 1 XXXX XXXX 1050 2009-08-03 13:30 phpscript.sieve drwx------ 2 XXXX XXXX 4096 2009-08-03 13:30 tmp florin@weiqi:~$ ls -l .dovecot.sieve lrwxrwxrwx 1 XXXX XXXX 21 2009-08-03 13:30 .dovecot.sieve -> sieve/phpscript.sieve $ cat .dovecot.sieve # I removed some commented out lines, they were too many require ["fileinto","envelope","reject","vacation","imapflags","relational","comparator-i;ascii-numeric","regex","notify","body"]; if address :contains "From" "joe(a)blow.com" { fileinto "personal.joeblow"; stop; } ################################# I do the telnet thing again, fire up Thunderbird, but this new message is still in the Inbox (it's in the "new" subfolder before running Thunderbird, then it gets moved to "cur") instead of the designated folder. Am I missing something? What is the magic I need to do to get it to move? I googled, but nothing came up. With Cyrus and Postfix, the filters worked like a charm, no problems at all, but it had its own issues (too complicated to manage for a small site). Dovecot seems more reasonable, but I can't get Sieve to work. :-( -- Florin Andrei http://florin.myip.org/

2 1

[Dovecot] Linefeeds in mailbox names
by Timo Sirainen 03 Aug '09

03 Aug '09

Wonder if I should just disallow creating mailboxes whose name contains CR or LF characters? Wonder how many peoples' scripts/tools already would break if a user created such mailbox names.. :)

2 1

[Dovecot] Dovecot with SSL Client Certification
by Evaggelos Balaskas 03 Aug '09

03 Aug '09

Hi, i am trying to setup dovecot over ssl in the last couple days unsuccessfully My notes are from here: http://wiki.dovecot.org/SSL My OpenSSL commands are: mkdir -pv /opt/certificates/dovecot/ cd !$ (just to prevent questions about Common Name) [ebal@myhome:~]€ hostname myhome openssl req -new -x509 -nodes -out dovecot.crt -keyout dovecot.key -days 1825 # Country Name (2 letter code) [AU]:GR # State or Province Name (full name) [Some-State]:Athens # Locality Name (eg, city) []:Aigaleo # Organization Name (eg, company) [Internet Widgits Pty Ltd]:Ebalaskas.Gr # Organizational Unit Name (eg, section) []:Mail Apps # Common Name (eg, YOUR name) []:myhome # Email Address []:ebalaskas@ebalaskas.gr openssl pkcs12 -export -in dovecot.crt -inkey dovecot.key \ -name "dovecot Certificate Client" -out dovecot.p12 openssl ca -gencrl -keyfile dovecot.key -cert dovecot.crt -out dovecot.crl -selfsign I've imported the dovecot.p12 to thunderbird certificates and dovecot.crt to thunderbird authorities (i've tried claws mail too - same errors) My dovecot.conf is this: [root@myhome dovecot]# dovecot -n # 1.2.2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30-ARCH i686 ext4 info_log_path: /var/log/dovecot.log protocols: imaps ssl: required ssl_ca_file: /opt/certificates/dovecot/dovecot.crl ssl_cert_file: /opt/certificates/dovecot/dovecot.crt ssl_key_file: /opt/certificates/dovecot/dovecot.key ssl_cipher_list: ALL:!LOW:!SSLv2 ssl_verify_client_cert: yes verbose_ssl: yes login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login first_valid_uid: 300 mail_location: maildir:/var/spool/mail/%u:INBOX=/var/spool/mail/%u/.INBOX mail_debug: yes lda: postmaster_address: ebalaskas(a)ebalaskas.gr auth default: verbose: yes debug: yes debug_passwords: yes ssl_require_client_cert: yes passdb: driver: pam userdb: driver: passwd My /var/log/dovecot.log: Jul 30 20:14:52 Info: Dovecot v1.2.2 starting up (core dumps disabled) Jul 30 20:14:52 Info: Generating Diffie-Hellman parameters for the first time. This may take a while.. Jul 30 20:14:53 auth(default): Info: new auth connection: pid=5872 Jul 30 20:14:53 auth(default): Info: new auth connection: pid=5873 Jul 30 20:14:53 auth(default): Info: new auth connection: pid=5874 Jul 30 20:15:16 ssl-build-param: Info: SSL parameters regeneration completed Jul 30 20:15:17 auth(default): Info: new auth connection: pid=5898 Jul 30 20:15:18 imap-login: Info: Disconnected (client didn't send a cert): rip=127.0.0.1, lip=127.0.0.1, TLS handshaking: SSL_accept() failed: error:14094419:SSL routines:SSL3_READ_BYTES:tlsv1 alert access denied Any ideas? Evaggelos Balaskas Unix System Engineer - http://ebalaskas.gr/wiki Informatics Engineer Technological Education

2 2

Re: [Dovecot] Stuck with dovecot-sieve and horde-ingo ...
by Robert Schetterer 03 Aug '09

03 Aug '09

Stefan G. Weichinger schrieb: > Robert Schetterer schrieb: >> Stefan G. Weichinger schrieb: >>> Robert Schetterer schrieb: >>> >>>> if you get problems with sieve dovecot >>>> try http://www.woozle.org/~neale/src/pysieved/ >>> exactly the same behavior: ingo complains "driver not in transaction >>> state" ... >>> >>> Seems as if ingo fails to even contact port 2000 ... any idea on how to >>> debug ingo itself? >>> >>> Stefan >> there is somewhere in the horde doku >> how to setup verbose php debug logging >> sorry i couldnt remember where , but i used it allready >> during testing >> > > done already, see my last mail to horde-ml ... > > danke ;-) i will retest tonight horde ingo sieve with latest dovecot perhaps i will see equal problems so i will report to you -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

2 1

[Dovecot] v1.2.3 release candidate
by Timo Sirainen 03 Aug '09

03 Aug '09

http://dovecot.org/tmp/dovecot-1.2.3.rc.tar.gz I thought about doing v1.2.3 release immediately, but I think I'll wait about 10-24h first. So until then, testing this RC is appreciated and hopefully we'll have a good release this time. :) + Allow namespace prefix to be opened as mailbox, if a mailbox already exists in the root dir. - Maildir: dovecot-uidlist was being recreated every time a mailbox was accessed, even if nothing changed. - listescape plugin was somewhat broken - Compiling fixes for non-Linux/BSDs

2 1

[Dovecot] Performance problem with STATUS after upgrade (1.0.15 -> 1.2.2)
by Stefan Förster 03 Aug '09

03 Aug '09

Hello list, after upgrading dovecot from 1.0.15 to 1.2.2 (and carefully reading through the upgrading notes in the wiki), I got sieve, quota and fts up and running, but I'm now suffering some kind of performance problem with the STATUS command. Symptoms: Reading mail on the IMAP server itself with "mutt", no TLS/SSL, connected through loopback interface. Whenever I idle a bit and then hit any key thereafter, for example to change into another mailbox, mutt will send a number of "STATUS" commands: # T 127.0.0.1:53604 -> 127.0.0.1:143 [AP] DONE..a0070 STATUS "postfix-buch" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0071 STATUS "postfix-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0072 STATUS "Trash" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0073 STATUS "Sent" (UIDNEXT UIDVALID ITY UNSEEN RECENT)..a0074 STATUS "mailman-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0075 STATUS "mailman-developers" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0076 STATUS "de-postfix-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0077 STATUS "amavis-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0078 STATUS "spam" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0079 STATUS "localreports" (UIDNEXT UIDVALIDITY UNSEEN RECENT)..a0080 STATUS "Drafts" (UIDNEXT UIDVALIDITY UNSEEN R ECENT)..a0081 STATUS "exim-users" (UIDNEXT UIDVALIDITY UNSEEN RECENT).. # (The whole conversation is available as: http://www.incertum.net/~cite/dovecot-snoop.log) Those commands take almost one(!) second to complete. I've used strace to capture what happens and made the results available at http://www.incertum.net/~cite/imap.log. With 1.0.15, I never noticed this kind of delay, and reading mail feels really sluggish at the moment. Is there any way to improve performance? Configuration data: Filesystem mounted to /export/vmailboxes is an ext3: # tune2fs -l /dev/rootvg/mailhome_lv | grep "^Filesystem features" Filesystem features: has_journal resize_inode dir_index filetype needs_recovery sparse_super large_file (needs_recovery is set because the filesystem is mounted, I umounted it, did fsck -Dfy and it didn't display that "feature" when unmounted). dovecot -n (also available as: http://www.incertum.net/~cite/dovecot-n.log) # 1.2.2: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-amd64 x86_64 Debian 5.0.2 log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps managesieve listen(default): *:143 listen(imap): *:143 listen(managesieve): * ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(managesieve): ssl_cert_file: /etc/ssl/owncerts/mail_incertum_net.crt ssl_key_file: /etc/ssl/private/mail_incertum_net.key login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(managesieve): /usr/lib/dovecot/managesieve-login verbose_proctitle: yes mail_privileged_group: vmail mail_location: maildir:~/Maildir mbox_write_locks: fcntl dotlock mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(managesieve): /usr/lib/dovecot/managesieve mail_process_size: 1024 mail_plugins(default): quota imap_quota fts fts_squat mail_plugins(imap): quota imap_quota fts fts_squat mail_plugins(managesieve): mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(managesieve): /usr/lib/dovecot/modules/managesieve lda: postmaster_address: postmaster(a)incertum.net hostname: mail.incertum.net mail_plugins: quota sieve auth_socket_path: /var/run/dovecot/auth-master auth default: mechanisms: plain login cram-md5 passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: sasl master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: maildir:User quota quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 quota_warning: storage=95%% /usr/local/bin/quota-warning.sh 95 sieve: ~/.dovecot.sieve sieve_storage: ~/sieve sieve_extensions: +imapflags fts: squat fts_squat: partial=4 full=10 SQL-Configuration: # grep -v '^ *$#.*$\?$' dovecot-sql.conf driver = pgsql connect = hostaddr=333.33.33.3 port=5432 dbname=secret user=secret password=secret sslmode=require default_pass_scheme = PLAIN password_query = SELECT login AS user, password FROM virtual_user_maps WHERE login IN ('%u', '%n') user_query = SELECT vum.uid, vum.gid, ('*:storage=' || vum.quota_kbytes || 'k') AS quota_rule, ('/export/vmailboxes/' || SUBSTR(vum.login, 1, 1) || '/' || vum.login) AS home FROM virtual_mailbox_domains AS vmd LEFT JOIN virtual_mailbox_maps AS vmm ON (vmd.id = vmm.domain) LEFT JOIN virtual_user_maps AS vum ON (vmm.login = vum.id) WHERE ((vmm.localpart = '%n' AND vmd.name='%d') OR (vum.login = '%u')) AND vum.active Memory: # free -m total used free shared buffers cached Mem: 3952 3003 949 0 226 1036 -/+ buffers/cache: 1740 2211 Swap: 7812 5 7807 The version is Debian/unstable's 1.2.2, available at http://packages.debian.org/sid/dovecot-common, I've made a backport to Debian/stable. Any help/insights are really appreciated. Cheers Stefan

2 3

[Dovecot] Spaces in user or group-names
by Sven Strickroth 03 Aug '09

03 Aug '09

Hi, how it is possible to use group names with spaces (like "Domain Admins") in dovecot-acl files? -- Best regards, Sven mailto:sven@clamav.net ClamAV, a GPL anti-virus toolkit http://www.clamav.net

2 4

[Dovecot] Panic: file mbox-sync-rewrite.c: line 590
by Kostik 03 Aug '09

03 Aug '09

Hello! We start migrate to dovecot (v1.2.2). # 1.2.2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30 i686 Slackware 11.0.0 We have FS user quota and NFS mailboxs(mbox only). While user not overquota, all works fine. But if is, we get error at log: --- Aug 3 16:45:17 chest004 dovecot: pop3-login: Login: user=<boggart(a)xxxx.xx>, method=PLAIN Aug 3 16:45:17 chest004 dovecot: POP3(boggart(a)xxxx.xx): close(/var/virtual/mail/boggart.lock) failed: Disk quota exceeded Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): close(/var/virtual/mail/boggart.lock) failed: Disk quota exceeded Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): Panic: file mbox-sync-rewrite.c: line 590 (mbox_sync_rewrite): assertion failed: (mails[idx].from_offset == start_offset) Aug 3 16:46:28 chest004 dovecot: POP3(boggart(a)xxxx.xx): Raw backtrace: pop3 [0x80c949c] -> pop3 [0x80c9c3e] -> pop3 [0x80c9638] -> pop3(mbox_sync_rewrite+0x6ff) [0x807c9af] -> pop3 [0x8078038] -> pop3 [0x807a30a] -> pop3(mbox_sync+0x399) [0x807b279] -> pop3(mbox_storage_sync_init+0x53) [0x807b773] -> pop3(mailbox_sync+0x2d) [0x809331d] -> pop3(client_command_execute+0x2e6) [0x805d066] -> pop3(client_handle_input+0x75) [0x805be35] -> pop3(io_loop_handler_run+0x101) [0x80d2221] -> pop3(io_loop_run+0x29) [0x80d15a9] -> pop3(main+0x779) [0x805dd49] -> /lib/tls/libc.so.6(__libc_start_main+0xd4) [0xb7e46e14] -> pop3 [0x805b161] --- What does that mean? /usr/local/sbin/dovecot -n --- # 1.2.2: /usr/local/etc/dovecot.conf # OS: Linux 2.6.30 i686 Slackware 11.0.0 base_dir: /var/run/dovecot/ protocols: imap pop3 listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: dotlock_try fcntl mbox_lock_timeout: 150 mbox_dotlock_change_timeout: 60 mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_log mail_plugins(imap): quota imap_quota mail_log mail_plugins(pop3): mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql userdb: driver: prefetch plugin: quota: fs:Quota:user =koc

1 0

[Dovecot] Subfolders not listed in Dovecot-1.2.2 with listescape
by Petter Urkedal 03 Aug '09

03 Aug '09

After upgrading to Dovecot-1.2.2 from 1.1* subfolders disappeared, though it was possible to access them directly, e.g. with "mutt -f =lists/dovecot". The problem only occurs if the listescape plugin is enabled. Some relevant bits from the configuration: namespace private { # The only namespace. separator = / prefix = inbox = yes } protocol imap { mail_plugins = fts fts_squat listescape }

2 2