- dovecot - dovecot.org

[Dovecot] version 1.1.3 assertion on index-sort-string
by Nuno Lopes 13 Sep '08

13 Sep '08

Hi, I am seeing the following log lines on some accounts on my setup: Sep 11 01:42:36 xxxx dovecot: Panic: IMAP(xxxxxxxxxxxxxxxx): file index-sort-string.c: line 610 (index_sort_add_ids_range): assertion failed: (skip > 0) Sep 11 01:42:36 xxxx dovecot: IMAP(xxxxxxxxxxxxxx): Raw backtrace: imap [0x5555555d3690] -> imap [0x5555555d36f7] -> imap [0x5555555d2d58] -> imap(index_sort_list_finish_string+0xf13) [0x5555555a04b3] -> imap(index_storage_search_next_nonblock+0x432) [0x55555559cd22] -> imap(mailbox_search_next+0x21) [0x5555555a42b1] -> imap(imap_sort+0xdc) [0x555555577ddc] -> imap(cmd_sort+0x33d) [0x555555570ead] -> imap(cmd_uid+0x54) [0x555555571934] -> imap [0x55555557234c] -> imap [0x555555572402] -> imap [0x555555572c1f] -> imap(client_input+0x62) [0x555555572e42] -> imap(io_loop_handler_run+0xf8) [0x5555555da6d8] -> imap(io_loop_run+0x1d) [0x5555555d972d] -> imap(main+0x462) [0x55555557a5f2] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b7c871d8154] -> imap [0x55555556c8c9] these assertions happen when ordering by from and go away by deleting index files. As usual if you wish I can send you the index files as they were when this error happened. Thanks, -- Nuno Lopes

2 2

[Dovecot] Dovecot 1.1.3 Kerberos5 GSSAPI bug (with patch)
by Matthew Wesley 12 Sep '08

12 Sep '08

The functionality added in changeset 818a638fa9a3 has a bug for x86_64 on line 103. The src/auth/mech-gssapi.c file must now include stdlib.h to have the declaration for getenv(). Otherwise, the compiler uses the implicit return type (int), which truncates the 8-byte pointer getenv() returns to a 4-byte value. This causes a segfault on subsequent reads. Here is debugger output illustrating the problem: (gdb) list 106 101 const char *path; 102 103 path = getenv("KRB5_KTNAME"); 104 if (path != NULL) { 105 #ifdef HAVE_GSSKRB5_REGISTER_ACCEPTOR_IDENTITY 106 gsskrb5_register_acceptor_identity(path); 107 #elif defined (HAVE_KRB5_GSS_REGISTER_ACCEPTOR_IDENTITY) 108 krb5_gss_register_acceptor_identity(path); 109 #endif 110 } (gdb) p/x getenv("KRB5_KTNAME") $32 = 0xb0d7aef7 (gdb) x/s 0xb0d7aef7 0xb0d7aef7: <Address 0xb0d7aef7 out of bounds> (gdb) x/s 0x7fffb0d7aef7 0x7fffb0d7aef7: "/etc/dovecot/dovecot.keytab" A Mercurial bundle with a fix is attached, and here is the trivial patch to put in the needed #include: diff -r 43e55b9af85b src/auth/mech-gssapi.c --- a/src/auth/mech-gssapi.c Mon Sep 01 15:02:49 2008 +0300 +++ b/src/auth/mech-gssapi.c Wed Sep 03 11:37:33 2008 -0400 @@ -22,6 +22,8 @@ #include "safe-memset.h" #ifdef HAVE_GSSAPI + +#include <stdlib.h> #ifndef HAVE___GSS_USEROK # define USE_KRB5_USEROK -- UNIX was not designed to stop you from doing stupid things, because that would also stop you from doing clever things. -- Doug Gwyn

2 2

[Dovecot] error in 1.1.2
by Cor Bosman 12 Sep '08

12 Sep '08

Ive been getting a LOT of these errors since 1.1.2: So far ive seen this with 1800 customers, and we're getting active complaints about errors in imap clients. When I check the users log I always see this error.. This always happens with COPY commands in Squirrelmail. Sep 2 20:09:35 userimap4.xs4all.nl dovecot: IMAP(xxxxxxx): rename(/var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache.lock, /var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache) failed: No such file or directory Sep 2 20:09:35 userimap4.xs4all.nl dovecot: IMAP(xxxxxxx): rename(/var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache.lock, /var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache) failed: No such file or directory Sep 2 20:09:35 userimap4.xs4all.nl dovecot: IMAP(xxxxxxx): file_dotlock_replace() failed with index cache file /var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache: No such file or directory Sep 2 20:09:35 userimap4.xs4all.nl dovecot: IMAP(xxxxxxx): file_dotlock_replace() failed with index cache file /var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache: No such file or directory Sep 1 20:14:06 userimap4.xs4all.nl dovecot: IMAP(xxxxxxx): rename(/var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache.lock, /var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache) failed: No such file or directory Sep 1 20:14:06 userimap4.xs4all.nl dovecot: IMAP(xxxxxxx): rename(/var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache.lock, /var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache) failed: No such file or directory Sep 1 20:14:06 userimap4.xs4all.nl dovecot: IMAP(xxxxxxx): file_dotlock_replace() failed with index cache file /var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache: No such file or directory Sep 1 20:14:06 userimap4.xs4all.nl dovecot: IMAP(xxxxxxx): file_dotlock_replace() failed with index cache file /var/spool/mail/dovecot-control/indexes/j/jd/xxxxxxx/.Inveztor/dovecot.index.cache: No such file or directory FreeBSD 6.2, NFS storage for everything. Any idea? Cor

6 41

[Dovecot] Dovecot 1.1.12 ignores auth_krb5_keytab settings
by christop 12 Sep '08

12 Sep '08

Hello, i am using here a FreeBSD 7.0 amd64 with latest dovecot from ports. It ignores the krb5_keytab settings, which looks like this in the logs: dovecot: Aug 02 18:56:54 Error: auth(default): gssapi(?,130.149.58.145): While processing incoming data: Miscellaneous failure (see text) dovecot: Aug 02 18:56:54 Error: auth(default): gssapi(?,130.149.58.145): While processing incoming data: /etc/krb5.keytab: No such file or directory dovecot: Aug 02 18:56:59 Info: imap-login: Aborted login (auth failed, 1 attempts): method=GSSAPI, rip=130.149.58.145, lip=130.149.58.162, TLS It is the same errror i got with dovecot 1.0.13. MfG Christoph Below my config: # 1.1.2: /usr/local/etc/dovecot.conf log_path: /var/log/dovecot.log protocols: imaps managesieve listen: mail2.physik-pool.tu-berlin.de ssl_cert_file: /etc/CERT ssl_key_file: /etc/KEY login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login verbose_proctitle: yes first_valid_uid: 200 mail_privileged_group: mail mail_location: maildir:~/maildir:INDEX=/var/dovecot/%1n/%n mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(managesieve): sieve_storage(default): sieve_storage(imap): sieve_storage(managesieve): ~/sieve sieve(default): sieve(imap): sieve(managesieve): ~/.dovecot.sieve namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ location: mbox:~/mail list: yes subscriptions: yes auth default: mechanisms: gssapi plain login krb5_keytab: /etc/mail2.krb5.keytab worker_max_count: 120 passdb: driver: pam userdb: driver: passwd args: [blocking=yes]

2 4

[Dovecot] Public (Shared Folders) ACL Questions
by Mailing List 11 Sep '08

11 Sep '08

I'm trying to set up a public namespace so that a set of IMAP folders are available to all staff - similar to MS Exchange Public Folders. I've managed to set up the namespace correctly but I'm having trouble with the ACLs. The global ACL file is the only method I can get to work. All I want to do is to allow 1 user admin privileges to create & delete anything but all other users should only be able to create not delete. Reading through the mailing list I thought a /etc/dovecot-acls/.DEFAULT file would be suitable but what should be put in here to achieve what I want? Are you able to use wildcards somehow within this file, i.e.: ---------------------------------------- owner lrwstiekxa user=admin(a)domain.com lrwstiekxa user=*(a)domain.com lrw ---------------------------------------- Does this .DEFAULT file only apply to the public (shared) namespace or will it effect private mailboxes also? If I was to create a specific global acl file for a specific folder which would take precedence, the .DEFAULT acls or the specific folder acls? Also an "INBOX" is shown within the public folders namespace but no folder exists in the public folders maildir hierarchy - any ideas how I can stop this? Any help would be greatly appreciated. Gavin

2 1

[Dovecot] Stumped on adding X-Header...
by Brian Hayden 11 Sep '08

11 Sep '08

Recently I posted about wanting to add an x-header recording a timestamp for changing the \Deleted flag, for purposes of doing expiry on mbox mailboxes. Timo replied: > Be sure to add it to mbox_hide_headers[] and mbox_save_drop_headers[] > arrays in mbox-storage.c and hope that it doesn't exist in any of your > existing mails. :) Other than that there shouldn't be problems. I looked at the two places where X-Status was being written--mbox-save.c and mbox-sync-update.c--and tried adding this header. It didn't work. To test my sanity, I changed the string 'X-Status' in each of these to something else. The mbox file still ended up with 'X-Status' written in it, and I can't for the life of me find any other code that might write that string. Timo? Anyone? -- Brian Hayden UMN OIT Internet Services

2 1

[Dovecot] 1.1.3 panics
by Dean Brooks 11 Sep '08

11 Sep '08

Hi, Installed Dovecot 1.1.3 today and started receiving panic errors on a few of our users: dovecot: [ID 107833 mail.crit] Panic: IMAP(xx): file mail-index-transaction-view.c: line 204: unreached When I upgraded, I deleted all of our users index files so it started with a clean slate. We are running mbox format over NFS with fsquota plugin on Solaris 8. Here is output of dovecot -n: base_dir: /var/run/dovecot/ protocols: imap ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login login_user: daemon login_log_format_elements: user=%u ip=%r mail_max_userip_connections: 5 first_valid_uid: 100 last_valid_uid: 128000 mail_privileged_group: mail mail_location: mbox:~/Mail:INBOX=/var/mail/%u:INDEX=/var/indexes/local/%u mail_nfs_storage: yes mbox_write_locks: fcntl mbox_lock_timeout: 180 mbox_lazy_writes: no mail_plugins: quota imap_quota namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: Mail/ hidden: yes subscriptions: yes auth default: mechanisms: plain login failure_delay: 5 debug: yes debug_passwords: yes passdb: driver: shadow userdb: driver: passwd plugin: quota: fs -- Dean Brooks dean(a)iglou.com

3 8

[Dovecot] SSL fields as variables for SQL statements ...
by XhE 11 Sep '08

11 Sep '08

Hi, I was wondering if there is any possibility to access the status if a user has provided a certificate, that has been accepted or not via variables. And further if there is any way to get the value of SSL certificate fields by use variables. I'd like to use those variables in sql statements. I then could assign a single certificate to a user, and make up passdb sql statements, that allow him to access multiple (but not all) mailboxes without the need to issue any further certificates. --- Michael

2 2

[Dovecot] How to propelry restore a Maildir
by Thomas Hummel 11 Sep '08

11 Sep '08

Hello, I would like to know what is the proper way to restore a Maildir : Assuming someone has got a foobar/[cur|new|tmp] maildir, loses for some reason its content and that some new mail (seen and/or unseen) comes into that mailbox inbetween (that is before the restore procedure takes place, thus creating the need to merge restored messages and new ones). I'd like to check the following (I don't use deliver but procmail) : 1. the messages filenames are unique in time (meaning that a new message cannot be assigned a name already existing in the backup (the name of an old message), at least for the same mailbox instance : if that's not the case : how can we merge safely ? 2. what naming scheme is used (the left part of the name, before the :2,) ? I've got something like : 1215166123.52887_0.host.dom.ain:2,[...] what are the 1215166123, the 52887 and 0 ? 3. what can we deduce from the last modified date of the file as seen in ls -l ? . when in new/, is it the same as the one in the Received: header or is it when in tmp/ ? . when in cur/, is it the date the client "saw" the message ? What would "saw" mean in that case ? 4. should the dovecot-uidlist and dovecot-keywords be updated after the restore or is it better to let dovecot rearrange them itself ? 5. same question for the index and cache files ? Thanks -- Thomas Hummel | Institut Pasteur <hummel(a)pasteur.fr> | Pôle informatique - systèmes et réseau

3 8

[Dovecot] Panic in Dovecot 1.1.3: index-mail.c: line 1091: assertion failed: (!mail->data.destroying_stream)
by Peter Eriksson 11 Sep '08

11 Sep '08

Dovecot 1.1.3 Solaris 10 SPARC (Sun Fire T1000) Compiled with Sun Studio 12 compilers. Maildir on NFS Indexes on local disk (UFS). 'dovecot -n' output attached. IMAP process crashes for certain (many, but not all) users when accessing certain folders (in the example below, in crashes when accessing my INBOX, about 1700 mails). I could access other mailboxes without problems. And a simple telnet to the imap port followed by a login works fine. Erased the coredumps (was filling up the system too quickly) so I can't really produce a backtrace right now (had to back down to 1.0.13 again even though that one has another core-dump-generating problem - but that is atleast limited to only one specific user so far). Going to set up a separate test server to test things more without disturbing our normal operations... I started with an empty INDEX directory to make sure there weren't problems with old corrupted indexes. Output from syslog: Sep 9 12:34:44 ifm.liu.se dovecot: [ID 107833 mail.info] imap-login: Login: user=<peter>, method=GSSAPI, rip=130.236.160.102, lip=130.236.160.6, secured Sep 9 12:34:44 ifm.liu.se dovecot: [ID 107833 mail.crit] Panic: IMAP(peter): file index-mail.c: line 1091: assertion failed: (!mail->data.destroying_stream) Sep 9 12:34:44 ifm.liu.se dovecot: [ID 107833 mail.error] IMAP(peter): Raw backtrace: 0x1000b5188 -> 0x1000605ac -> 0x1000605e4 -> 0x100060734 -> 0x1000657b8 -> 0x100070470 -> 0x1000204e0 -> 0x100020868 -> 0x100016e78 -> 0x10001dab8 -> 0x10001debc -> 0x10001e0a4 -> 0x1000bf4b4 -> 0x1000bea68 -> 0x10002933c -> 0x100014c9c Sep 9 12:34:48 ifm.liu.se dovecot: [ID 107833 mail.info] auth(default): client out: OK 1 user=peter Sep 9 12:34:48 ifm.liu.se dovecot: [ID 107833 mail.info] auth(default): passwd(peter,130.236.160.102): lookup Sep 9 12:34:48 ifm.liu.se dovecot: [ID 107833 mail.info] auth(default): master out: USER 241 peter system_user=peter uid=103 gid=10 home=/home/peter Sep 9 12:34:48 ifm.liu.se dovecot: [ID 107833 mail.info] imap-login: Login: user=<peter>, method=GSSAPI, rip=130.236.160.102, lip=130.236.160.6, secured Sep 9 12:34:48 ifm.liu.se dovecot: [ID 107833 mail.crit] Panic: IMAP(peter): file index-mail.c: line 1091: assertion failed: (!mail->data.destroying_stream) Sep 9 12:34:48 ifm.liu.se dovecot: [ID 107833 mail.error] IMAP(peter): Raw backtrace: 0x1000b5188 -> 0x1000605ac -> 0x1000605e4 -> 0x100060734 -> 0x1000657b8 -> 0x100070470 -> 0x1000204e0 -> 0x100020868 -> 0x100016e78 -> 0x10001dab8 -> 0x10001debc -> 0x10001e0a4 -> 0x1000bf4b4 -> 0x1000bea68 -> 0x10002933c -> 0x100014c9c - Peter # 1.1.3: /etc/dovecot.conf.new base_dir: /var/run/dovecot/ protocols: imap pop3 imaps pop3s ssl_ca_file: /ifm/etc/certs/dovecot-CA.cert.pem ssl_cert_file: /ifm/etc/certs/dovecot-ifm.cert.pem ssl_key_file: /ifm/etc/certs/dovecot-ifm.key.pem login_dir: /var/run/dovecot/login login_executable(default): /ifm/libexec/dovecot/imap-login login_executable(imap): /ifm/libexec/dovecot/imap-login login_executable(pop3): /ifm/libexec/dovecot/pop3-login login_greeting: Welcome to the IFM Dovecot Server. first_valid_uid: 100 mail_location: maildir:Maildir:INDEX=/var/indexes/%u mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mbox_write_locks: fcntl mail_executable(default): /ifm/libexec/dovecot/imap mail_executable(imap): /ifm/libexec/dovecot/imap mail_executable(pop3): /ifm/libexec/dovecot/pop3 mail_plugin_dir(default): /ifm/lib/dovecot/imap mail_plugin_dir(imap): /ifm/lib/dovecot/imap mail_plugin_dir(pop3): /ifm/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: Mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: ~/mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: ~/Mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: ~%u/mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: ~%u/Mail/ hidden: yes subscriptions: yes auth default: mechanisms: plain login gssapi executable: /ifm/libexec/dovecot/dovecot-auth verbose: yes debug: yes passdb: driver: pam userdb: driver: passwd

3 11