- dovecot - dovecot.org

[Dovecot] Wrong message information reported shortly after delivery
by Ron Avriel 06 Mar '08

06 Mar '08

Hi, If an IMAP fetch is issued some "short" time after a message was delivered with dovecot deliver then dovecot reports wrong (zero) values for that new message. Afterward, it reports the information OK. This causes problems to our IMAP client. The problem is easily reproduced with a large message on a slow machine. I'm using dovecot 1.0.10 Here's a sample trace: 1 uid fetch 1:* fast * 1 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:20:50 +0200" RFC822.SIZE 3378380 UID 1) * 2 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:21:40 +0200" RFC822.SIZE 3378380 UID 2) * 3 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:23:38 +0200" RFC822.SIZE 3378380 UID 3) * 4 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:40:06 +0200" RFC822.SIZE 3378380 UID 4) 1 OK Fetch completed. ######## Here dovecot reports a new message (5) arrived ######## 1 uid fetch 1:* fast * 1 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:20:50 +0200" RFC822.SIZE 3378380 UID 1) * 2 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:21:40 +0200" RFC822.SIZE 3378380 UID 2) * 3 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:23:38 +0200" RFC822.SIZE 3378380 UID 3) * 4 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:40:06 +0200" RFC822.SIZE 3378380 UID 4) * 5 EXISTS * 5 RECENT 1 OK Fetch completed. ######## This is where dovecot reports wrong information about message 5 ######## 1 uid fetch 1:* fast * 1 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:20:50 +0200" RFC822.SIZE 3378380 UID 1) * 2 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:21:40 +0200" RFC822.SIZE 3378380 UID 2) * 3 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:23:38 +0200" RFC822.SIZE 3378380 UID 3) * 4 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:40:06 +0200" RFC822.SIZE 3378380 UID 4) * 5 FETCH (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 5) 1 OK Fetch completed. ######## The same wrong information is repeated ######## 1 uid fetch 1:* fast * 1 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:20:50 +0200" RFC822.SIZE 3378380 UID 1) * 2 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:21:40 +0200" RFC822.SIZE 3378380 UID 2) * 3 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:23:38 +0200" RFC822.SIZE 3378380 UID 3) * 4 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:40:06 +0200" RFC822.SIZE 3378380 UID 4) * 5 FETCH (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 5) 1 OK Fetch completed. ######## The same wrong information is repeated several times ######## 1 uid fetch 1:* fast * 1 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:20:50 +0200" RFC822.SIZE 3378380 UID 1) * 2 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:21:40 +0200" RFC822.SIZE 3378380 UID 2) * 3 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:23:38 +0200" RFC822.SIZE 3378380 UID 3) * 4 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:40:06 +0200" RFC822.SIZE 3378380 UID 4) * 5 FETCH (FLAGS (\Recent) INTERNALDATE "01-Jan-1970 00:00:00 +0000" RFC822.SIZE 0 UID 5) 1 OK Fetch completed. ######## Trace truncated here ######## ######## Finally, correct information is reported ######## 1 uid fetch 1:* fast * 1 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:20:50 +0200" RFC822.SIZE 3378380 UID 1) * 2 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:21:40 +0200" RFC822.SIZE 3378380 UID 2) * 3 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:23:38 +0200" RFC822.SIZE 3378380 UID 3) * 4 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:40:06 +0200" RFC822.SIZE 3378380 UID 4) * 5 FETCH (FLAGS (\Recent) INTERNALDATE "06-Mar-2008 17:41:07 +0200" RFC822.SIZE 3378380 UID 5) dovecot -n: # 1.0.10: /etc/dovecot.conf log_timestamp: “%Y-%m-%d %H:%M:%S ” protocols: imap listen: *:143 ssl_disable: yes login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login login_process_per_connection: no first_valid_uid: 150 last_valid_uid: 150 dotlock_use_excl: yes fsync_disable: yes maildir_copy_with_hardlinks: yes maildir_copy_preserve_filename: yes mail_plugins: quota imap_quota auth default: mechanisms: plain login user: nobody master_user_separator: * passdb: driver: sql args: /etc/dovecot-sql.conf passdb: driver: passwd-file args: /etc/dovecot.masterusers master: yes userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: mail plugin: quota: maildir:storage=1024 Thanks, Ron ____________________________________________________________________________________ Never miss a thing. Make Yahoo your home page. http://www.yahoo.com/r/hs

2 1

[Dovecot] Quota exceeded - ignore setting
by Fabian Lazarski 06 Mar '08

06 Mar '08

Hello, I have a problem if I use the 'ignore' setting in my dovecot.conf A delete operation in the client means that the mail is copied to Trash mailbox. If the user is already over quota the delete operation will fail. Therefore I use the ignore setting, which doesn`t count the quota at all for the given mailbox. But it doesn`t work. I got still a quoted exceeded failure in my client. Here is the plugin part of my dovecot.conf (The trash folder was renamed in Papierkorb on the mailserver): plugin { quota = maildir:storage=0:ignore=Papierkorb acl = vfile:/etc/dovecot/acls } and the appropriate View definition: SELECT u.userid, 999 AS uid, 8 AS gid, rel_homedir(v.volume::text, u.userid::text) AS home, ('maildir:storage='::text || u.quota::text) || ':ignore=Papierkorb'::text AS quota FROM mailuser u, user_volume v WHERE u.userid::text = v.userid::text;iate view definition: here is a section of imap-info.log: dovecot: 2008-03-06 18:30:55 Info: auth(default): master in: REQUEST 184 3289 173 dovecot: 2008-03-06 18:30:55 Info: auth(default): sql(dg-SW3,172.27.60.237): SELECT * FROM dovecotuser WHERE userid = 'dg-SW3'; dovecot: 2008-03-06 18:30:55 Info: auth(default): master out: USER 184 dg-SW3 userid=dg-SW3 uid=999 gid=8 home=mail02/dg/SW3 quota=maildir:storage=2097152:ignore=Papierkorb master_user=master dovecot: 2008-03-06 18:30:55 Info: imap-login: Login: user=<dg-SW3>, method=PLAIN, rip=172.27.x.y, lip=172.27.x.x dovecot: 2008-03-06 18:30:55 Info: auth(default): client in: AUTH 174 PLAIN service=IMAP lip=172.27.x.x rip=172.27.x.y resp=<hidden> dovecot: 2008-03-06 18:30:55 Info: auth(default): passwd-file(master,172.27.x.y,master): lookup: user=master file=/etc/dovecot/dovecot-master.pwd dovecot: 2008-03-06 18:30:55 Info: auth(default): passdb(master,172.27.x.y,master): Master user logging in as dg-SW3 dovecot: 2008-03-06 18:30:55 Info: auth(default): client out: OK 174 user=dg-SW3 Used dovecot Version is 1.0.2 Can someone help? Is there another possiblity to except the quota for my papierkorb folder? Bye Fabian ----------------------------------------------------------------- Sicherheit - Verfügbarkeit - Kontinuität ----------------------------------------------------------------- IT-Service-Management von ScanPlus GmbH Lise-Meitner-Strasse 5 Tel. +49 731 92013 152 D-89081 Ulm, Germany Fax. +49 731 92013 290 Web: http://www.scan-plus.de/ Mail: lazarski(a)scan-plus.de Amtsgericht Ulm HRB 3220 Geschäftsführung: Jürgen Hörmann, Andreas Werther -----------------------------------------------------------------

1 0

[Dovecot] two problems with dovecot and antispam-plugin and qmail/vpopmail
by Mario Cardia 06 Mar '08

06 Mar '08

Hi! I'm trying do use antispam plug-in to split spams in different folders. My problem is with backends... I tried dspam backend and now I'm tring mail training backend. With dspam backend the problem is: When I receive a mail then dspam creates a data directory to store his data as it should do it. But when a try to move the message to Spam folder I get an error (could not execute dspam). If I remove de data directory, it works... I can move the message and by doing this de data directory is re-created. So I decided to try mail training backend. My configuration is: antispam_mail_tmpdir = /tmp antispam_mail_spam = spam@%d antispam_mail_notspam = nospam@%d antispam_mail_sendmail = /opt/qmail/bin/sendmail # antispam_mail_sendmail_args = -f;%u But an error occurs. (Failed to send mail) I tried to use qmail-inject instead but the same error occurs. Then i tried to use de args commented (-f;%u) but didn't work yet. I also tried to use a complete e-mail address to spam and notspam parameters... but nothing seems to works. So I created a shell script to use instead a sendmail program to be able to debug de error. The script has these contents: #!/bin/sh /opt/qmail/bin/sendmail 2> /tmp/error.txt The result of this test is: qmail-inject: fatal: unable to parse this line: Return-Path: <mario(a)cardia.com.br>Delivered-To: isharedev.travelnet.com.br-mario(a)isharedev.travelnet.com.br Note that there is not a "\n" between return-path and delivered-to Can someone help me? (Sorry by my english, I'm brazilian) Tks Mário Cardia

1 0

[Dovecot] Can't connect to auth server at /var/run/dovecot//auth-master
by maxxfire 06 Mar '08

06 Mar '08

Hi, I'm using dovecot1.1 with postfix2.2.5; I configure dovecot.conf following the dovecot-wiki. But i doesn't work. The maillog said 'Can't connect to auth server at /var/run/dovecot//auth-master: No such file or directory' when I send a mail. my Postfix Master.cf configure: dovecot unix - n n - - pipe flags=DRhu user=vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${recipient} I just confused that why it needed to be authed again when postfix pipe the mail to dovecot. Best regards! Thanks and forgive my poor english writing.

2 1

[Dovecot] assert() using plugins zlib and antispam together
by Steffen Kaiser 06 Mar '08

06 Mar '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, I'm running Dovecot v1.0.10 and downloaded the "HEAD snapshot" today. If both plugins are enabled, I get: : file zlib-plugin.c: line 64 (zlib_maildir_get_stream): assertion failed: (fname != NULL) : Raw backtrace: imap [0x80ad741] -> imap [0x80ad65c] -> /usr/local/dovecot-1.0.10patch4mgtsv92/lib/dovecot/imap/lib20_zlib_plugin.so [0xb7e517ac] -> /usr/local/dovecot-1.0.10patch4mgtsv92/lib/dovecot/imap/lib90_antispam_plugin.so(backend_handle_mail+0x98) [0xb7e4e783] -> /usr/local/dovecot-1.0.10patch4mgtsv92/lib/dovecot/imap/lib90_antispam_plugin.so [0xb7e4d8bf] -> imap(mail_storage_copy+0xdd) [0x809ea1d] -> imap(maildir_copy+0x52) [0x806b802] -> /usr/local/dovecot-1.0.10patch4mgtsv92/lib/dovecot/imap/lib10_quota_plugin.so [0xb7e5a8b6] -> /usr/local/dovecot-1.0.10patch4mgtsv92/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7f97050] -> /usr/local/dovecot-1.0.10patch4mgtsv92/lib/dovecot/imap/lib90_antispam_plugin.so [0xb7e4d5f5] -> imap(cmd_copy+0x1aa) [0x8056c7a] -> imap [0x805ac38] -> imap [0x805acc7] -> imap(_client_input+0x6c) [0x805b3bc] -> imap(io_loop_handler_run+0x162) [0x80b3562] -> imap(io_loop_run+0x28) [0x80b29a8] -> imap(main+0x5a0) [0x8063590] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc : 8) [0xb7e73ea8] -> Error: child 18612 (imap) killed with signal 6 Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHzoT8VJMDrex4hCIRAjtnAJ9OqdFWUVC2fr1ahVkpMSie7vQeRQCeKVjA VG9n+AzEM/hIHd66Bg2Xat4= =GEEc -----END PGP SIGNATURE-----

3 4

[Dovecot] Effects of migration
by Andy Dills 05 Mar '08

05 Mar '08

So, to follow up to my previous thread, we just successfully migrated our NFS-based mail cluster from qmail pop, courier imap, and bincimap to dovecot 1.1rc1. Overall the transition was very smooth, the only unexpected adjustment was having to implement ntpd on each box, rather than doing an hourly ntpdate against our local ntpd server, to prevent dovecot from crashing itself from too much drift. The impact has been severe! Even with NFS-stored indexes, our netapp is seeing 1/6th of the NFS ops per second, and its CPU utilization is now at 1/3rd previous levels. The only user comment thus far was thanking us for bringing IMAP folders out from under INBOX. Dovecot is truly excellent. In my book, Timo joins Wietse Venema and Marc Martinec to form the backbone of the premiere open source mail solution. For now, praise will have to suffice. I do, however, maintain a little IOU list that I intend to fulfill at some point in the future, and Timo is now high on the list. Thanks again! Andy --- Andy Dills Xecunet, Inc. www.xecu.net 301-682-9972 ---

3 4

[Dovecot] Checkpassword question
by Bob Wonder 05 Mar '08

05 Mar '08

Hi all, I would like to write my own checkpassword script for dovecot. I have very little experience with C programming. My questions are: 1. Can I use php for this purpose? 2. How dovecot call checkpassword program (passes <username> NUL <password> to checkpassword)? Thank you in advance for answers. Bob

2 1

[Dovecot] Quota override problem
by Oliver 05 Mar '08

05 Mar '08

Hi all, i am using debian etch with backports for dovecot (1.0.10) with Postfix (Version: 2.3.8-2+b1) At the moment the quota for all maildir mailboxes is 265MB, some should be 512MB an others 10 MB for example. See my Mysql: mysql> show fields from users from mail; +----------+-------------+------+-----+----------+-------+ | Field | Type | Null | Key | Default | Extra | +----------+-------------+------+-----+----------+-------+ | email | varchar(80) | NO | PRI | | | | password | varchar(20) | NO | | | | | quota | int(15) | NO | | 10485760 | | | active | tinyint(1) | NO | | 1 | | +----------+-------------+------+-----+----------+-------+ http://wiki.dovecot.org/Quota -> I looked here but i dont see my failure, merde. My configuration is: dovecot.conf: base_dir = /var/run/dovecot/ protocols = imaps log_timestamp = �^�^�%Y-%m-%d %H:%M:%S �^�^ syslog_facility = mail ssl_cert_file = /etc/ssl/dovecot/server.pem ssl_key_file = /etc/ssl/dovecot/server.key #ssl_ca_file = /etc/ssl/mycompany/ca/mycompany.pem #ssl_verify_client_cert = yes ssl_parameters_regenerate = 168 verbose_ssl = no mail_location = maildir:/home/vmail/%d/%n mail_extra_groups = mail mail_debug = no first_valid_uid = 5000 last_valid_uid = 5000 maildir_copy_with_hardlinks = yes protocol imap { login_executable = /usr/lib/dovecot/imap-login mail_executable = /usr/lib/dovecot/imap imap_max_line_length = 65536 mail_plugins = quota imap_quota ssl_listen = *:993 } protocol lda { postmaster_address = postmaster(a)osthome.de sendmail_path = /usr/lib/sendmail auth_socket_path = /var/run/dovecot/auth-master mail_plugins = cmusieve quota #sieve = /home/vmail/%d/%n/.dovecot.sieve } auth_verbose = no auth_debug = no auth_debug_passwords = no auth default { mechanisms = plain passdb sql { args = /etc/dovecot/dovecot-sql.conf } userdb static { args = uid=5000 gid=5000 sieve=/home/vmail/%d/%n/.dovecot.sieve } userdb sql { args = /etc/dovecot/dovecot-sql.conf } user = nobody socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = vmail } client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = postfix } } # # If you want client certificates, use these lines # ssl_require_client_cert = yes # ssl_username_from_cert = yes } namespace private { separator = . prefix = INBOX. inbox = yes } plugin { #quota = maildir # 10 MB + 1000 messages quota limit quota = maildir:storage=265000:messages=50000:ignore=Trash } ______________________ My dovecot-sql.conf is: driver = mysql connect = host=localhost dbname=mail user=admin password=secret default_pass_scheme = CRYPT password_query = SELECT password FROM users WHERE email = '%u' AND active ='1' user_query = SELECT email, 5000 AS uid, 5000 AS gid, CONCAT('maildir:storage=', quota) AS quota, mail_plugins FROM users WHERE email = '%u' AND active = '1' ______

3 4

[Dovecot] Problem with Thunderbird hang, multiple retry to .Sent/.Draft
by tlum 05 Mar '08

05 Mar '08

I have begun havening a problem when sending or when Thunderbird tries to write copy to .Draft. Usually only happens when the message is longer. While in the Thunderbird editor will say "Copying message to Draft folder". It will try indefinitely. The copy is successful but it looks like it is believed to have failed so its retried. Same then happens when sending. Send happens but then hangs on copy to .Sent. Copy works, but apparently is not seen and just keeps getting retried. If you let it go hundreds of copies of message end up in .Sent and .Draft. Have logs from Thunderbird and rawlog but they are huge and don't want to post them to the list until after determining there is no quick answer for this behavior. dovecot --version = 1.0.rc15 dovecot -n # /etc/dovecot.conf base_dir: /var/run/dovecot/ log_timestamp: ¦%Y-%m-%d %H:%M:%S ¦ protocols: imap imaps listen: 127.0.0.1:143 ssl_listen: *:993 ssl_ca_file: /etc/pki/mydomain/mailserver/certs/class3.crt ssl_cert_file: /etc/pki/mydomain/mailserver/certs/ms1srvp01.mydomain.net.crt ssl_key_file: /etc/pki/mydomain/mailserver/private/ms1srvp01.mydomain.net.key disable_plaintext_auth: yes verbose_ssl: yes login_dir: /var/run/dovecot//login login_executable: /usr/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 5000 last_valid_uid: 5000 mail_extra_groups: vmail mail_location: maildir:/home/vmail/%d/%u:INDEX=/var/indexes/%d/%n mail_debug: yes maildir_copy_with_hardlinks: yes mbox_read_locks: dotlock mbox_write_locks: dotlock mail_executable: /usr/libexec/dovecot/rawlog /usr/libexec/dovecot/imap imap_client_workarounds: outlook-idle, tb-extra-mailbox-sep auth default: user: nobody passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: vmail group: vmail mail_location: gets an override from userdb SQL lookup. /home/vmail is nfs mounted, /var/indexes is is local ext3. No error messages are logged any place. I think Thunderbird asks for the copy and then verifies it. It seems dovecot never confirms they copy happened. -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

3 2

[Dovecot] antispam plugin / mailtrain backend: t_pop() leak & killed with signal 6
by Steffen Kaiser 05 Mar '08

05 Mar '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, antispam plugin version downloaded HEAD snapshot today. Leaked a t_pop() call in I/O handler 0x805b350 Raw backtrace: imap [0x80ad741] -> imap [0x80ad65c] -> imap(io_loop_handler _run+0x1ce) [0x80b35ce] -> imap(io_loop_run+0x28) [0x80b29a8] -> imap(main+0x5a0) [0x8063590] -> /lib/tls/i686/cmov/libc.so.6(__lib c_start_main+0xc8) [0xb7e37ea8] -> imap [0x8055e31] child 18478 (imap) killed with signal 6 Cause is, if sendmail fails with an exit code != 0, the function returns with -1 immediately skipping the t_pop() before the end of the function. See attached diff. Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHzpkeVJMDrex4hCIRAhhzAJ9uwU9pYEOZoSZiYJiERcKJJOzI/ACfXG10 BmSVMKMh2FUFve9Qu8atY9k= =wE4j -----END PGP SIGNATURE-----

2 1