July 2015 - dovecot - dovecot.org

[Dovecot] dsync replication errors
by Oli Schacher 09 Sep '15

09 Sep '15

Hi I'm trying to build a cluster of two servers with dsync replication (based on http://wiki2.dovecot.org/Replication) My test setup works fine for very simple tests, I can log in to both servers, copy a message to one of the servers and it successfully apperars in the other account. But, if I try to copy a large amount of messages at once to one of the accounts, my maillogs get flodded with errors(see below) and the mailboxes seem to get out of sync and messages are duplicated over and over again (I originally copied 100 messages and ended up with thousands in both mailboxes until I killed dovecot) I'd appreciate if someone could have a look at my config and tell me what I did wrong. dovecot.conf of both servers, they are identical except for the target ip in mail_replica: dovecot -n # 2.2.beta1 (070ca24e5846+): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-279.19.1.el6.x86_64 x86_64 CentOS release 6.3 (Final) disable_plaintext_auth = no mail_plugins = " notify replication" namespace { inbox = yes location = prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { mail_replica = remote:vmail@192.168.23.62 } protocols = pop3 imap service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service auth { unix_listener auth-master { group = vmail mode = 0660 user = vmail } user = root } service replicator { process_min_avail = 1 } ssl = no userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } Log on server1 after I copied 100 messages to an account on that server: Jan 31 10:41:04 doco1 dovecot: imap-login: Login: user=<user1>, method=PLAIN, rip=192.168.23.130, lip=192.168.23.61, mpid=1432, session=<OdjlbJLUmwDAqBeC> Jan 31 10:42:12 doco1 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=72, file=1359625327.M621257P1432.doco1,S=2472,W=2547:2,) Jan 31 10:42:12 doco1 dovecot: dsync-local(user1): Error: Recent flags state corrupted for mailbox INBOX Jan 31 10:42:12 doco1 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=73, file=1359625327.M740847P1432.doco1,S=2417,W=2492:2,) Jan 31 10:42:12 doco1 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=74, file=1359625328.M206735P1432.doco1,S=2400,W=2474:2,) Jan 31 10:42:12 doco1 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=75, file=1359625328.M668118P1432.doco1,S=2421,W=2496:2,) Jan 31 10:42:12 doco1 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=76, file=1359625329.M167578P1432.doco1,S=2480,W=2559:2,) Jan 31 10:42:13 doco1 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=77, file=1359625329.M520528P1432.doco1,S=2525,W=2604:2,) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 132: 1359625329.M520528P1432.doco1,S=2525,W=2604 (uid 77 -> 133) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 133: 1359625327.M621257P1432.doco1,S=2472,W=2547 (uid 72 -> 134) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 134: 1359625327.M740847P1432.doco1,S=2417,W=2492 (uid 73 -> 135) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 135: 1359625328.M206735P1432.doco1,S=2400,W=2474 (uid 74 -> 136) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 136: 1359625328.M668118P1432.doco1,S=2421,W=2496 (uid 75 -> 137) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 137: 1359625329.M167578P1432.doco1,S=2480,W=2559 (uid 76 -> 138) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 139: 1359625329.M782065P1432.doco1,S=2461,W=2539 (uid 78 -> 140) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 140: 1359625329.M973834P1432.doco1,S=2523,W=2602 (uid 79 -> 141) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 141: 1359625330.M114922P1432.doco1,S=2546,W=2626 (uid 80 -> 142) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 142: 1359625330.M255922P1432.doco1,S=2467,W=2546 (uid 81 -> 143) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 143: 1359625330.M403257P1432.doco1,S=2534,W=2611 (uid 82 -> 144) Jan 31 10:42:14 doco1 dovecot: doveadm(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 144: 1359625330.M486295P1432.doco1,S=2451,W=2529 (uid 83 -> 145) Jan 31 10:42:14 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Unexpected GUID mismatch for UID=85: 1359625327.M740847P1432.doco1,S=2417,W=2492 != 2e1b1ee97994566870c02910ea929091 Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625329.M167578P1432.doco1,S=2480,W=2559 (UID=175) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625329.M167578P1432.doco1,S=2480,W=2559 (UID=150) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625329.M520528P1432.doco1,S=2525,W=2604 (UID=176) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625329.M520528P1432.doco1,S=2525,W=2604 (UID=179) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625327.M740847P1432.doco1,S=2417,W=2492 (UID=123) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625327.M740847P1432.doco1,S=2417,W=2492 (UID=147) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625328.M668118P1432.doco1,S=2421,W=2496 (UID=174) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625328.M668118P1432.doco1,S=2421,W=2496 (UID=149) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625328.M206735P1432.doco1,S=2400,W=2474 (UID=173) Jan 31 10:42:15 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625328.M206735P1432.doco1,S=2400,W=2474 (UID=148) Jan 31 10:42:16 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Importing mailbox INBOX failed Jan 31 10:42:16 doco1 dovecot: dsync-local(user1): Error: read(vmail(a)192.168.23.62) failed: EOF Jan 31 10:42:16 doco1 dovecot: dsync-local(user1): Error: Remote command returned error 75 Jan 31 10:42:20 doco1 dovecot: doveadm: Error: dsync-remote(user1): Error: Mailbox INBOX: Remote didn't send mail GUID=1359625329.M167578P1432.doco1,S=2480,W=2559 (UID=230) [...] Log on server2: Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 132: 1359625329.M520528P1432.doco1,S=2525,W=2604 (uid 77 -> 133) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 133: 1359625327.M621257P1432.doco1,S=2472,W=2547 (uid 72 -> 134) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 134: 1359625327.M740847P1432.doco1,S=2417,W=2492 (uid 73 -> 135) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 135: 1359625328.M206735P1432.doco1,S=2400,W=2474 (uid 74 -> 136) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 136: 1359625328.M668118P1432.doco1,S=2421,W=2496 (uid 75 -> 137) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 137: 1359625329.M167578P1432.doco1,S=2480,W=2559 (uid 76 -> 138) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 139: 1359625329.M782065P1432.doco1,S=2461,W=2539 (uid 78 -> 140) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 140: 1359625329.M973834P1432.doco1,S=2523,W=2602 (uid 79 -> 141) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 141: 1359625330.M114922P1432.doco1,S=2546,W=2626 (uid 80 -> 142) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 142: 1359625330.M255922P1432.doco1,S=2467,W=2546 (uid 81 -> 143) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 143: 1359625330.M403257P1432.doco1,S=2534,W=2611 (uid 82 -> 144) Jan 31 10:42:14 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: /mailstore/user1/maildir/dovecot-uidlist: Duplicate file entry at line 144: 1359625330.M486295P1432.doco1,S=2451,W=2529 (uid 83 -> 145) Jan 31 10:42:15 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=84, file=1359625330.M608391P1432.doco1,S=2480,W=2559:2,) Jan 31 10:42:15 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=85, file=1359625330.M813949P1432.doco1,S=2427,W=2502:2,) Jan 31 10:42:15 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=86, file=1359625331.M217320P1432.doco1,S=2547,W=2625:2,) Jan 31 10:42:15 doco2 dovecot: doveadm: Error: dsync-remote(user1): Warning: Maildir /mailstore/user1/maildir: Expunged message reappeared, giving a new UID (old uid=87, file=1359625331.M688431P1432.doco1,S=2529,W=2609:2,) [...] Thanks Oli -- message transmitted on 100% recycled electrons

7 45

Dovecot 2.2.18 Panic: file index-mail-binary.c
by Michael Borgelt 09 Sep '15

09 Sep '15

Hi, I got the following in my dovecot log's on an particular email message with dovecot-imap. ---snip--- Jul 28 08:42:11 hermes dovecot: imap(mborgelt): Panic: file index-mail-binary.c: line 354 (blocks_count_lines): assertion failed: (ret == -1) Jul 28 08:42:11 hermes dovecot: imap(mborgelt): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x740f2) [0xb75780f2] -> /usr/lib/dovecot/libdovecot.so.0(+0x74212) [0xb7578212] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb7520484] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x99bbb) [0xb76abbbb] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x92) [0xb76ac122] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x72) [0xb7639172] -> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x183) [0xb76ed323] -> dovecot/imap(+0x1a2b4) [0x800c32b4] -> dovecot/imap(+0x18907) [0x800c1907] -> dovecot/imap(imap_fetch_more+0x3d) [0x800c2aad] -> dovecot/imap(cmd_fetch+0x359) [0x800b5299] -> dovecot/imap(command_exec+0x4f) [0x800bff1f] -> dovecot/imap(+0x15c3b) [0x800bec3b] -> dovecot/imap(+0x15cc9) [0x800becc9] -> dovecot/imap(client_handle_input+0x13d) [0x800bf03d] -> dovecot/imap(client_input+0x95) [0x800bf445] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5e) [0xb758c2fe] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe2) [0xb758d522] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x1a) [0xb758c38a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x49) [0xb758c419] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x25) [0xb75261a5] -> dovecot/imap(main+0x384) [0x800b1f54] -> /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xf3) [0xb735ea63] -> dovecot/imap(+0x913a) [0x800b213a] Jul 28 08:42:11 hermes dovecot: imap(mborgelt): Fatal: master: service(imap): child 30866 killed with signal 6 (core dumped) ---snip--- The dovecot -n output. ---snip--- # 2.2.18: /etc/dovecot/dovecot.conf # OS: Linux 4.1.3 i686 Debian stretch/sid lda_mailbox_autocreate = yes login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k mail_location = maildir:~/Maildir mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { antispam_allow_append_to_spam = no antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/sa-learn.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_spam = Junk antispam_trash = Trash antispam_verbose_debug = 1 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_vacation_send_from_recipient = yes } protocols = " imap sieve" ssl_cert = </etc/dovecot/dovecot.pem ssl_cipher_list = ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_dh_parameters_length = 2048 ssl_key = </etc/dovecot/private/dovecot.pem ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv3 !SSLv2 userdb { driver = passwd } protocol lda { log_path = /var/log/dovecot_deliver.log mail_plugins = sieve } protocol imap { mail_plugins = antispam } ---snip--- gdb output: GNU gdb (Debian 7.7.1+dfsg-5) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i586-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/lib/dovecot/imap...(no debugging symbols found)...done. [New LWP 30866] Core was generated by `dovecot/imap'. Program terminated with signal SIGABRT, Aborted. #0 0xb7764b60 in __kernel_vsyscall () ---snip--- And this is the offending email: ---snip--- Return-Path: <linux-media-owner(a)vger.kernel.org> X-Original-To: mborgelt@localhost Delivered-To: mborgelt@localhost Received: from localhost (localhost [127.0.0.1]) by hermes.dg4yfa.org (Postfix) with ESMTP id 9B7E6520BAD for <mborgelt@localhost>; Tue, 28 Jul 2015 04:38:45 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at hermes.dg4yfa.org Received: from hermes.dg4yfa.org ([127.0.0.1]) by localhost (hermes.dg4yfa.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PUqAdlewtXE3 for <mborgelt@localhost>; Tue, 28 Jul 2015 04:38:43 +0200 (CEST) Received: from pop3.1blu.de (localhost [127.0.0.1]) by hermes.dg4yfa.org (Postfix) with ESMTP id 4EC74520A86 for <mborgelt@localhost>; Tue, 28 Jul 2015 04:38:43 +0200 (CEST) Delivered-To: <xxxxx(a)xxxxxx.xxx.de> Received: from ms-10.1blu.de ([178.254.4.101]) by mb-17.1blu.de (Dovecot) with LMTP id KpihOJzptlWyFgAAZwzaeA for <xxxxx(a)xxxxxx.xxx.de>; Tue, 28 Jul 2015 04:31:56 +0200 Received: from [209.132.180.67] (helo=vger.kernel.org) by ms-10.1blu.de with esmtp (Exim 4.76) (envelope-from <linux-media-owner(a)vger.kernel.org>) id 1ZJugO-0003Zs-BC for michael(a)borgelt.org; Tue, 28 Jul 2015 04:31:56 +0200 Received: (majordomo(a)vger.kernel.org) by vger.kernel.org via listexpand id S1754900AbbG1Cbl (ORCPT <rfc822;michael(a)borgelt.org>); Mon, 27 Jul 2015 22:31:41 -0400 Received: from smtp74.iad3a.emailsrvr.com ([173.203.187.74]:59595 "EHLO smtp74.iad3a.emailsrvr.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754333AbbG1Cbk (ORCPT <rfc822;linux-media(a)vger.kernel.org>); Mon, 27 Jul 2015 22:31:40 -0400 X-Greylist: delayed 541 seconds by postgrey-1.27 at vger.kernel.org; Mon, 27 Jul 2015 22:31:40 EDT Received: from smtp26.relay.iad3a.emailsrvr.com (localhost.localdomain [127.0.0.1]) by smtp26.relay.iad3a.emailsrvr.com (SMTP Server) with ESMTP id 54B4C801BA; Mon, 27 Jul 2015 22:22:38 -0400 (EDT) Received: from smtp192.mex08.mlsrvr.com (unknown [74.205.9.160]) by smtp26.relay.iad3a.emailsrvr.com (SMTP Server) with ESMTPS id 1D84C8018F; Mon, 27 Jul 2015 22:22:38 -0400 (EDT) X-Sender-Id: xiaoquan.li(a)vivantecorp.com Received: from smtp192.mex08.mlsrvr.com ([UNAVAILABLE]. [74.205.9.160]) (using TLSv1 with cipher AES256-SHA) by 0.0.0.0:25 (trex/5.4.2); Tue, 28 Jul 2015 02:22:38 GMT Received: from MBX05B-IAD3.mex08.mlsrvr.com (172.29.17.24) by MBX05A-IAD3.mex08.mlsrvr.com (172.29.17.23) with Microsoft SMTP Server (TLS) id 15.0.1044.25; Mon, 27 Jul 2015 22:22:37 -0400 Received: from MBX05B-IAD3.mex08.mlsrvr.com ([fe80::7d8e:af8c:8538:7e20]) by MBX05B-IAD3.mex08.mlsrvr.com ([fe80::7d8e:af8c:8538:7e20%21]) with mapi id 15.00.1044.021; Mon, 27 Jul 2015 22:22:37 -0400 From: Xiaoquan Li <xiaoquan.li(a)vivantecorp.com> To: Benjamin Gaignard <benjamin.gaignard(a)linaro.org>, "linux-media(a)vger.kernel.org" <linux-media(a)vger.kernel.org>, "Linux Kernel Mailing List" <linux-kernel(a)vger.kernel.org>, "dri-devel(a)lists.freedesktop.org" <dri-devel(a)lists.freedesktop.org>, "Hans Verkuil" <hverkuil(a)xs4all.nl>, Laurent Pinchart <laurent.pinchart(a)ideasonboard.com>, Daniel Vetter <daniel.vetter(a)ffwll.ch>, Rob Clark <robdclark(a)gmail.com>, Thierry Reding <treding(a)nvidia.com>, "Sumit Semwal" <sumit.semwal(a)linaro.org>, Tom Cooksey <tom.cooksey(a)arm.com>, "Daniel Stone" <daniel.stone(a)collabora.com> CC: Linaro MM SIG Mailman List <linaro-mm-sig(a)lists.linaro.org> Subject: RE: [Linaro-mm-sig] [PATCH v3 0/2] RFC: Secure Memory Allocation Framework Thread-Topic: [Linaro-mm-sig] [PATCH v3 0/2] RFC: Secure Memory Allocation Framework Thread-Index: AQHQuwv8BuA+2hTILk+/oDnwCSiUlp3vdmmAgADK2CA= Date: Tue, 28 Jul 2015 02:22:37 +0000 Message-ID: <da0dde9a302342e5a13ce7ac3069419e(a)MBX05B-IAD3.mex08.mlsrvr.com> References: <1436531290-23191-1-git-send-email-benjamin.gaignard(a)linaro.org> <CA+M3ks7X++to23mXjRaB_wUJUo0TDLFh2hMbziEGeMDkVBx-7w(a)mail.gmail.com> In-Reply-To: <CA+M3ks7X++to23mXjRaB_wUJUo0TDLFh2hMbziEGeMDkVBx-7w(a)mail.gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [172.29.9.17] Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 Sender: linux-media-owner(a)vger.kernel.org Precedence: bulk List-ID: <linux-media.vger.kernel.org> X-Mailing-List: linux-media(a)vger.kernel.org X-Envelope-To: michael(a)borgelt.org SGkgQmVuamFtaW4sDQoNCkl0IGxvb2tzIGxpa2UgdGhpcyBmcmFtZXdvcmsgb25seSBhbGxvd3Mg dXNlciBzcGFjZSBjbGllbnQgdG8gdGFsayB3aXRoIHRydXN0IGFwcGxpY2F0aW9uLCBpdCB0aGVy ZSBhIHBsYW4gdG8gcHJvdmlkZSBrZXJuZWwgc2lkZSBBUElzIGZvciBrZXJuZWwgc3BhY2UgY2xp ZW50Pw0KDQpQbGVhc2UgY29ycmVjdCBtZSBpZiBteSB1bmRlcnN0YW5kaW5nIGlzIHdyb25nLg0K DQpUaGFua3MNCg0KWGlhb3F1YW4NCg0KLS0tLS1PcmlnaW5hbCBNZXNzYWdlLS0tLS0NCkZyb206 IExpbmFyby1tbS1zaWcgW21haWx0bzpsaW5hcm8tbW0tc2lnLWJvdW5jZXNAbGlzdHMubGluYXJv Lm9yZ10gT24gQmVoYWxmIE9mIEJlbmphbWluIEdhaWduYXJkDQpTZW50OiBNb25kYXksIEp1bHkg MjcsIDIwMTUgNjoxMiBQTQ0KVG86IGxpbnV4LW1lZGlhQHZnZXIua2VybmVsLm9yZzsgTGludXgg S2VybmVsIE1haWxpbmcgTGlzdDsgZHJpLWRldmVsQGxpc3RzLmZyZWVkZXNrdG9wLm9yZzsgSGFu cyBWZXJrdWlsOyBMYXVyZW50IFBpbmNoYXJ0OyBEYW5pZWwgVmV0dGVyOyBSb2IgQ2xhcms7IFRo aWVycnkgUmVkaW5nOyBTdW1pdCBTZW13YWw7IFRvbSBDb29rc2V5OyBEYW5pZWwgU3RvbmUNCkNj OiBMaW5hcm8gTU0gU0lHIE1haWxtYW4gTGlzdA0KU3ViamVjdDogUmU6IFtMaW5hcm8tbW0tc2ln XSBbUEFUQ0ggdjMgMC8yXSBSRkM6IFNlY3VyZSBNZW1vcnkgQWxsb2NhdGlvbiBGcmFtZXdvcmsN Cg0KSGkgYWxsLA0KDQpUaGlzIHRocmVhZCBkb2Vzbid0IGdldCBhbnkgZmVlZGJhY2suLi4NCg0K V2hhdCB3b3VsZCBiZSBncmVhdCBpcyB0byBrbm93IGlmIHRoaXMgZnJhbWV3b3JrIHByb3Bvc2Fs IGZpciB3aXRoDQp5b3VyIHBsYXRmb3JtIG5lZWRzLg0KDQpNYXliZSBJIGhhdmVuJ3QgY29weSB0 aGUgZ29vZCBtYWlsaW5nIGxpc3RzIHNvIGlmIHlvdSB0aGluayB0aGVyZSBpcw0KYmV0dGVyIG9u ZXMgZG8gbm90IGhlc2l0YXRlIHRvIGZvcndhcmQuDQoNClJlZ2FyZHMsDQpCZW5qYW1pbg0KDQoN CjIwMTUtMDctMTAgMTQ6MjggR01UKzAyOjAwIEJlbmphbWluIEdhaWduYXJkIDxiZW5qYW1pbi5n YWlnbmFyZEBsaW5hcm8ub3JnPjoNCj4gdmVyc2lvbiAzIGNoYW5nZXM6DQo+ICAtIFJlbW92ZSBp b2N0bCBmb3IgYWxsb2NhdG9yIHNlbGVjdGlvbiBpbnN0ZWFkIHByb3ZpZGUgdGhlIG5hbWUgb2YN Cj4gICAgdGhlIHRhcmdldGVkIGFsbG9jYXRvciB3aXRoIGFsbG9jYXRpb24gcmVxdWVzdC4NCj4g ICAgU2VsZWN0aW5nIGFsbG9jYXRvciBmcm9tIHVzZXJsYW5kIGlzbid0IHRoZSBwcmVmZXJlZCB3 YXkgb2Ygd29ya2luZw0KPiAgICBidXQgaXMgbmVlZGVkIHdoZW4gdGhlIGZpcnN0IHVzZXIgb2Yg dGhlIGJ1ZmZlciBpcyBhIHNvZnR3YXJlIGNvbXBvbmVudC4NCj4gIC0gRml4IGlzc3VlcyBpbiBj YXNlIG9mIGVycm9yIHdoaWxlIGNyZWF0aW5nIHNtYWYgaGFuZGxlLg0KPiAgLSBGaXggbW9kdWxl IGxpY2Vuc2UuDQo+ICAtIFVwZGF0ZSBsaWJzbWFmIGFuZCB0ZXN0cyB0byBjYXJlIG9mIHRoZSBT TUFGIEFQSSBldm9sdXRpb24NCj4gICAgaHR0cHM6Ly9naXQubGluYXJvLm9yZy9wZW9wbGUvYmVu amFtaW4uZ2FpZ25hcmQvbGlic21hZi5naXQNCj4NCj4gdmVyc2lvbiAyIGNoYW5nZXM6DQo+ICAt IEFkZCBvbmUgaW9jdGwgdG8gYWxsb3cgYWxsb2NhdG9yIHNlbGVjdGlvbiBmcm9tIHVzZXJzcGFj ZS4NCj4gICAgVGhpcyBpcyByZXF1aXJlZCBmb3IgdGhlIHVzZXMgY2FzZSB3aGVyZSB0aGUgZmly c3QgdXNlciBvZg0KPiAgICB0aGUgYnVmZmVyIGlzIGEgc29mdHdhcmUgSVAgd2hpY2ggY2FuJ3Qg cGVyZm9ybSBkbWFfYnVmIGF0dGFjaGVtZW50Lg0KPiAgLSBBZGQgbmFtZSBhbmQgcmFua2luZyB0 byBhbGxvY2F0b3Igc3RydWN0dXJlIHRvIGJlIGFibGUgdG8gc29ydCB0aGVtLg0KPiAgLSBDcmVh dGUgYSB0aW55IGxpYnJhcnkgdG8gdGVzdCBTTUFGOg0KPiAgICBodHRwczovL2dpdC5saW5hcm8u b3JnL3Blb3BsZS9iZW5qYW1pbi5nYWlnbmFyZC9saWJzbWFmLmdpdA0KPiAgLSBGaXggb25lIGlz c3VlIHdoZW4gdHJ5IHRvIHNlY3VyZSBidWZmZXIgd2l0aG91dCBzZWN1cmUgbW9kdWxlIHJlZ2lz dGVyZWQNCj4NCj4gVGhlIG91dGNvbWUgb2YgdGhlIHByZXZpb3VzIFJGQyBhYm91dCBob3cgZG8g c2VjdXJlIGRhdGEgcGF0aCB3YXMgdGhlIG5lZWQNCj4gb2YgYSBzZWN1cmUgbWVtb3J5IGFsbG9j YXRvciAoaHR0cHM6Ly9sa21sLm9yZy9sa21sLzIwMTUvNS81LzU1MSkNCj4NCj4gU01BRiBnb2Fs IGlzIHRvIHByb3ZpZGUgYSBmcmFtZXdvcmsgdGhhdCBhbGxvdyBhbGxvY2F0aW5nIGFuZCBzZWN1 cmluZw0KPiBtZW1vcnkgYnkgdXNpbmcgZG1hX2J1Zi4gRWFjaCBwbGF0Zm9ybSBoYXZlIGl0IG93 biB3YXkgdG8gcGVyZm9ybSB0aG9zZSB0d28NCj4gZmVhdHVyZXMgc28gU01BRiBkZXNpZ24gYWxs b3cgdG8gcmVnaXN0ZXIgaGVscGVyIG1vZHVsZXMgdG8gcGVyZm9ybSB0aGVtLg0KPg0KPiBUbyBi ZSBzdXJlIHRvIHNlbGVjdCB0aGUgYmVzdCBhbGxvY2F0aW9uIG1ldGhvZCBmb3IgZGV2aWNlcyBT TUFGIGltcGxlbWVudA0KPiBkZWZlcnJlZCBhbGxvY2F0aW9uIG1lY2hhbmlzbTogbWVtb3J5IGFs bG9jYXRpb24gaXMgb25seSBkb25lIHdoZW4gdGhlIGZpcnN0DQo+IGRldmljZSBlZmZlY3RpdmVs eSByZXF1aXJlZCBpdC4NCj4gQWxsb2NhdG9yIG1vZHVsZXMgaGF2ZSB0byBpbXBsZW1lbnQgYSBt YXRjaCgpIHRvIGxldCBTTUFGIGtub3cgaWYgdGhleSBhcmUNCj4gY29tcGF0aWJsZXMgd2l0aCBk ZXZpY2VzIG5lZWRzLg0KPiBUaGlzIHBhdGNoIHNldCBwcm92aWRlIGFuIGV4YW1wbGUgb2YgYWxs b2NhdG9yIG1vZHVsZSB3aGljaCB1c2UNCj4gZG1hX3thbGxvYy9mcmVlL21tYXB9X2F0dHJzKCkg YW5kIGNoZWNrIGlmIGF0IGxlYXN0IG9uZSBkZXZpY2UgaGF2ZQ0KPiBjb2hlcmVudF9kbWFfbWFz ayBzZXQgdG8gRE1BX0JJVF9NQVNLKDMyKSBpbiBtYXRjaCBmdW5jdGlvbi4NCj4gSSBoYXZlIG5h bWVkIHNtYWYtY21hLmMgbGlrZSBpdCBpcyBkb25lIGZvciBkcm1fZ2VtX2NtYV9oZWxwZXIuYyBl dmVuIGlmDQo+IGEgYmV0dGVyIG5hbWUgY291bGQgYmUgZm91bmQgZm9yIHRoaXMgZmlsZS4NCj4N Cj4gU2VjdXJlIG1vZHVsZXMgYXJlIHJlc3BvbnNpYmxlcyBvZiBncmFudGluZyBhbmQgcmV2b2tp bmcgZGV2aWNlcyBhY2Nlc3MgcmlnaHRzDQo+IG9uIHRoZSBtZW1vcnkuIFNlY3VyZSBtb2R1bGUg aXMgYWxzbyBjYWxsZWQgdG8gY2hlY2sgaWYgQ1BVIG1hcCBtZW1vcnkgaW50bw0KPiBrZXJuZWwg YW5kIHVzZXIgYWRkcmVzcyBzcGFjZXMuDQo+IEFuIGV4YW1wbGUgb2Ygc2VjdXJlIG1vZHVsZSBp bXBsZW1lbnRhdGlvbiBjYW4gYmUgZm91bmQgaGVyZToNCj4gaHR0cDovL2dpdC5saW5hcm8ub3Jn L3Blb3BsZS9iZW5qYW1pbi5nYWlnbmFyZC9vcHRlZS1zZHAuZ2l0DQo+IFRoaXMgY29kZSBpc24n dCB5ZXQgcGFydCBvZiB0aGUgcGF0Y2ggc2V0IGJlY2F1c2UgaXQgZGVwZW5kcyBvbiBnZW5lcmlj IFRFRQ0KPiB3aGljaCBpcyBzdGlsbCB1bmRlciBkaXNjdXNzaW9uIChodHRwczovL2x3bi5uZXQv QXJ0aWNsZXMvNjQ0NjQ2LykNCj4NCj4gRm9yIGFsbG9jYXRpb24gcGFydCBvZiBTTUFGIGNvZGUg SSBnZXQgaW5zcGlyYXRlZCBieSBTdW1pdCBTZW13YWwgd29yayBhYm91dA0KPiBjb25zdHJhaW50 IGF3YXJlIGFsbG9jYXRvci4NCj4NCj4gQmVuamFtaW4gR2FpZ25hcmQgKDIpOg0KPiAgIGNyZWF0 ZSBTTUFGIG1vZHVsZQ0KPiAgIFNNQUY6IGFkZCBDTUEgYWxsb2NhdG9yDQo+DQo+ICBkcml2ZXJz L0tjb25maWcgICAgICAgICAgICAgICAgfCAgIDIgKw0KPiAgZHJpdmVycy9NYWtlZmlsZSAgICAg ICAgICAgICAgIHwgICAxICsNCj4gIGRyaXZlcnMvc21hZi9LY29uZmlnICAgICAgICAgICB8ICAx MSArDQo+ICBkcml2ZXJzL3NtYWYvTWFrZWZpbGUgICAgICAgICAgfCAgIDIgKw0KPiAgZHJpdmVy cy9zbWFmL3NtYWYtY21hLmMgICAgICAgIHwgMjAwICsrKysrKysrKysrDQo+ICBkcml2ZXJzL3Nt YWYvc21hZi1jb3JlLmMgICAgICAgfCA3MzUgKysrKysrKysrKysrKysrKysrKysrKysrKysrKysr KysrKysrKysrKysNCj4gIGluY2x1ZGUvbGludXgvc21hZi1hbGxvY2F0b3IuaCB8ICA1NCArKysN Cj4gIGluY2x1ZGUvbGludXgvc21hZi1zZWN1cmUuaCAgICB8ICA2MiArKysrDQo+ICBpbmNsdWRl L3VhcGkvbGludXgvc21hZi5oICAgICAgfCAgNTIgKysrDQo+ICA5IGZpbGVzIGNoYW5nZWQsIDEx MTkgaW5zZXJ0aW9ucygrKQ0KPiAgY3JlYXRlIG1vZGUgMTAwNjQ0IGRyaXZlcnMvc21hZi9LY29u ZmlnDQo+ICBjcmVhdGUgbW9kZSAxMDA2NDQgZHJpdmVycy9zbWFmL01ha2VmaWxlDQo+ICBjcmVh dGUgbW9kZSAxMDA2NDQgZHJpdmVycy9zbWFmL3NtYWYtY21hLmMNCj4gIGNyZWF0ZSBtb2RlIDEw MDY0NCBkcml2ZXJzL3NtYWYvc21hZi1jb3JlLmMNCj4gIGNyZWF0ZSBtb2RlIDEwMDY0NCBpbmNs dWRlL2xpbnV4L3NtYWYtYWxsb2NhdG9yLmgNCj4gIGNyZWF0ZSBtb2RlIDEwMDY0NCBpbmNsdWRl L2xpbnV4L3NtYWYtc2VjdXJlLmgNCj4gIGNyZWF0ZSBtb2RlIDEwMDY0NCBpbmNsdWRlL3VhcGkv bGludXgvc21hZi5oDQo+DQo+IC0tDQo+IDEuOS4xDQo+DQoNCg0KDQotLSANCkJlbmphbWluIEdh aWduYXJkDQoNCkdyYXBoaWMgV29ya2luZyBHcm91cA0KDQpMaW5hcm8ub3JnIOKUgiBPcGVuIHNv dXJjZSBzb2Z0d2FyZSBmb3IgQVJNIFNvQ3MNCg0KRm9sbG93IExpbmFybzogRmFjZWJvb2sgfCBU d2l0dGVyIHwgQmxvZw0KX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX18NCkxpbmFyby1tbS1zaWcgbWFpbGluZyBsaXN0DQpMaW5hcm8tbW0tc2lnQGxpc3RzLmxp bmFyby5vcmcNCmh0dHBzOi8vbGlzdHMubGluYXJvLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2xpbmFy by1tbS1zaWcNCg== -- To unsubscribe from this list: send the line "unsubscribe linux-media" in the body of a message to majordomo(a)vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ---snip--- Ask if you need the complete core dump. Regards, Michael. -- Michael Borgelt e-mail: mborgelt(a)borgelt.org

4 4

Different behavior of ACLs in MUA and doveadm
by Thomas Leuxner 08 Sep '15

08 Sep '15

I have noticed a difference in the behavior of ACLs. When used in a MUA the following global ACL works fine and has the desired effect - new mailboxes can be created by a user being part of the 'PublicMailboxAdmins' group: [ global-acl: ] INBOX owner lrwstiekxap Public/* group=PublicMailboxAdmins lrwsipk Public/* anyone lr Public/* authenticated lrws Creating the same mailbox via doveadm however fails with a permission problem: doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:/var/vmail/public:INDEXPVT=~/mdbox/public doveadm(tlx(a)leuxner.net): Debug: fs: root=/var/vmail/public, index=, indexpvt=/var/vmail/domains/leuxner.net/tlx/mdbox/public, control=, inbox=, alt= doveadm(tlx(a)leuxner.net): Debug: acl: initializing backend with data: vfile:/var/vmail/conf.d/leuxner.net/global-acl:cache_secs=300 doveadm(tlx(a)leuxner.net): Debug: acl: acl username = tlx(a)leuxner.net doveadm(tlx(a)leuxner.net): Debug: acl: owner = 0 doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: Namespace : type=private, prefix=Virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:~/mdbox/virtual doveadm(tlx(a)leuxner.net): Debug: fs: root=/var/vmail/domains/leuxner.net/tlx/mdbox/virtual, index=, indexpvt=, control=, inbox=, alt= doveadm(tlx(a)leuxner.net): Debug: acl: initializing backend with data: vfile:/var/vmail/conf.d/leuxner.net/global-acl:cache_secs=300 doveadm(tlx(a)leuxner.net): Debug: acl: acl username = tlx(a)leuxner.net doveadm(tlx(a)leuxner.net): Debug: acl: owner = 1 doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/dovecot-acl not found doveadm(tlx(a)leuxner.net): Error: Can't create mailbox Public/Archive/Newsletters/heise-security/2014: Permission denied Interestingly, doveadm succeeds when dovecot-acl is present in the namespace root - which of course is not desirable in the light of the global ACL: [ dovecot-acl: ] group=PublicMailboxAdmins lrwsipk doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:/var/vmail/public:INDEXPVT=~/mdbox/public doveadm(tlx(a)leuxner.net): Debug: fs: root=/var/vmail/public, index=, indexpvt=/var/vmail/domains/leuxner.net/tlx/mdbox/public, control=, inbox=, alt= doveadm(tlx(a)leuxner.net): Debug: acl: initializing backend with data: vfile:/var/vmail/conf.d/leuxner.net/global-acl:cache_secs=300 doveadm(tlx(a)leuxner.net): Debug: acl: acl username = tlx(a)leuxner.net doveadm(tlx(a)leuxner.net): Debug: acl: owner = 0 doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: Namespace : type=private, prefix=Virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:~/mdbox/virtual doveadm(tlx(a)leuxner.net): Debug: fs: root=/var/vmail/domains/leuxner.net/tlx/mdbox/virtual, index=, indexpvt=, control=, inbox=, alt= doveadm(tlx(a)leuxner.net): Debug: acl: initializing backend with data: vfile:/var/vmail/conf.d/leuxner.net/global-acl:cache_secs=300 doveadm(tlx(a)leuxner.net): Debug: acl: acl username = tlx(a)leuxner.net doveadm(tlx(a)leuxner.net): Debug: acl: owner = 1 doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: acl vfile: reading file /var/vmail/public/mailboxes/dovecot-acl doveadm(tlx(a)leuxner.net): Debug: Namespace Public/: /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/2014 doesn't exist yet, using default permissions doveadm(tlx(a)leuxner.net): Debug: Namespace Public/: Using permissions from /var/vmail/public: mode=0700 gid=default doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/dbox-Mails/dovecot-acl not found doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/2014/dbox-Mails/dovecot-acl not found doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/2014/dbox-Mails/dovecot-acl not found doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/2014/dbox-Mails/dovecot-acl not found # 2.2.15 (6078354e6238): /etc/dovecot/dovecot.conf I know there have been some changes in Mercurial as to how global ACLs are interpreted. Is doveadm probably behind on them? Regards Thomas

2 5

charset-iconv.c panic
by mihaiush 08 Sep '15

08 Sep '15

Hi, I have a mailbox where indexing fails with the following error: # /opt/dovecot2/bin/doveadm -c /tmp/dovecot.conf -o mail_location=/tmp/skesselring index '*' doveadm(root): Panic: file charset-iconv.c: line 132 (charset_to_utf8): assertion failed: (*src_size - pos <= CHARSET_MAX_PENDING_BUF_SIZE) doveadm(root): Error: Raw backtrace: /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7f1b7376f13f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f1b7376f21a] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f1b7371d555] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x754a7) [0x7f1b737684a7] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(message_decoder_decode_next_block+0x528) [0x7f1b7375d8d8] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x19e) [0x7f1b726fbe3e] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(+0xfa20) [0x7f1b72701a20] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x19) [0x7f1b73a1fad9] -> /opt/dovecot2/bin/doveadm() [0x4246b1] -> /opt/dovecot2/bin/doveadm() [0x4201d0] -> /opt/dovecot2/bin/doveadm(doveadm_mail_try_run+0x261) [0x421131] -> /opt/dovecot2/bin/doveadm(main+0x34f) [0x41413f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f1b73386ead] -> /opt/dovecot2/bin/doveadm() [0x414235] Aborted (core dumped) Dovecot 2.2.18 build from sources ./configure --prefix=/opt/dovecot2 --with-mysql --with-sqlite --with-solr --with-ssl --disable-rpath --disable-static. Filesystem is ext4 # /opt/dovecot2/bin/doveadm -c /tmp/dovecot.conf config -n # 2.2.18: /tmp/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.8 auth_master_user_separator = * auth_mechanisms = plain login base_dir = /services/dovecot1/var/run default_client_limit = 10240 default_login_user = dovecot dict { quotadict = mysql:/services/dovecot1/etc/quota.conf } disable_plaintext_auth = no log_path = login_log_format_elements = user=%u session=%{session} mpid=%e rip=%r rrip=%{real_rip} mail_location = mdbox:~/mails mail_log_prefix = "store107: %s(%u): %{session}: " mail_max_userip_connections = 0 mail_plugins = quota virtual fts fts_solr notify mail_log mailbox_list_index = yes mdbox_rotate_size = 256 k mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } namespace virtual { hidden = yes list = no location = virtual:/services/dovecot1/etc/virtual:INDEX=~/mails/virtual mailbox all { auto = create special_use = \All } mailbox unseen { auto = create } prefix = virtual/ separator = / } passdb { args = /services/dovecot1/etc/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { args = /services/dovecot1/etc/mysql.conf driver = sql } plugin { fts = solr fts_solr = break-imap-search url=http://10.78.18.127:8080/solr/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid flags quota = dict:user::proxy::quotadict quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+152M quota_rule3 = Trash:messages=+5 } protocols = imap service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { group = nogroup mode = 0660 } } service dict { process_limit = 400 unix_listener dict { mode = 0600 user = nobody } } service imap-login { chroot = login client_limit = 2048 inet_listener imap { address = 10.78.18.127 port = 143 } process_limit = 1024 service_count = 0 } service imap { process_limit = 10240 vsz_limit = 320 M } service indexer-worker { process_limit = 4 process_min_avail = 2 service_count = 1 vsz_limit = 1 G } shutdown_clients = no ssl = no syslog_facility = local3 userdb { args = /services/dovecot1/etc/mysql.conf driver = sql } protocol imap { mail_plugins = quota virtual fts fts_solr notify mail_log imap_quota } protocol lda { auth_socket_path = /services/dovecot1/var/run/auth-master mail_plugins = quota virtual fts fts_solr notify mail_log sieve event_broker submission_host = osmtp:8090 } # gdb /opt/dovecot2/bin/doveadm core GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /opt/dovecot2_clean/bin/doveadm...done. [New LWP 4172] warning: Can't read pathname for load map: Input/output error. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/opt/dovecot2/bin/doveadm -c /tmp/dovecot.conf -o mail_location=/tmp/skesselrin'. Program terminated with signal 6, Aborted. #0 0x00007f1b7339a165 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) (gdb) (gdb) bt full #0 0x00007f1b7339a165 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f1b7339d3e0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f1b7376f135 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:202 backtrace = 0x2304560 "/opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7f1b7376f13f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f1b7376f21a] -> /opt/dovecot2/lib/dovecot/libdovecot.s"... #3 0x00007f1b7376f21a in default_fatal_handler (ctx=0x7fff678c4510, format=<optimized out>, args=<optimized out>) at failures.c:216 status = 0 #4 0x00007f1b7371d555 in i_panic (format=format@entry=0x7f1b73799298 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:276 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff678c4600, reg_save_area = 0x7fff678c4540}} #5 0x00007f1b737684a7 in charset_to_utf8 (t=0x2371a50, src=src@entry=0x23845e0 "\213h\201\347/\364\322*\303\307YpG\a\207\002\222\276\364z\301\350\201\227\335\360<\016(20~\365\254A\373?\326\070ir\364S\270-\006\245\360\237\250\242}iz]ph`<\026T9H\325F\033\301\354\333K\270|\353\345rF3-\277\211\003XOT\375\347\241\273\256\360<\330cy0\327", src_size=src_size@entry=0x7fff678c4668, dest=0x2369320) at charset-iconv.c:132 result = CHARSET_RET_INVALID_INPUT pos = 8226 size = 2183 prev_invalid_pos = 9595 ret = <optimized out> __FUNCTION__ = "charset_to_utf8" #6 0x00007f1b7375d8d8 in message_decode_body (output=0x7fff678c4780, ctx=0x2370b60, input=<optimized out>) at message-decoder.c:342 data = 0x23845e0 "\213h\201\347/\364\322*\303\307YpG\a\207\002\222\276\364z\301\350\201\227\335\360<\016(20~\365\254A\373?\326\070ir\364S\270-\006\245\360\237\250\242}iz]ph`<\026T9H\325F\033\301\354\333K\270|\353\345rF3-\277\211\003XOT\375\347\241\273\256\360<\330cy0\327" ret = <optimized out> pos = 6042 size = 6042 error = 0x7fff678c4760 "\020B0\002" #7 message_decoder_decode_next_block (ctx=0x2370b60, input=input@entry=0x7fff678c4760, output=output@entry=0x7fff678c4780) at message-decoder.c:375 No locals. #8 0x00007f1b726fbe3e in fts_build_mail_real (mail=0x23639b0, update_ctx=0x2355980) at fts-build-mail.c:543 ctx = {mail = 0x23639b0, update_ctx = 0x2355980, content_type = 0x2371540 "text/*", content_disposition = 0x2371fa0 "attachment; filename=\"PTT-20141109-WA0001.amr\"", body_parser = 0x23832a0, word_buf = 0x0, pending_input = 0x0, cur_user_lang = 0x0} parser = 0x2371130 decoder = 0x0 raw_block = {part = 0x2304210, hdr = 0x0, data = 0x236eb50 "\ni2iB5y/00irDx1lwRweHApK+9HrB6IGX3fA8DigyMH71rEH7P9Y4aXL0U7gtBqXwn6iifWl6XXBo\nYDwWVDlI1UYbwezbS7h86+VyRjMtv4kDWE9U/eehu67wPNhjeTDXABPB8tdUnMju+InvVF0WrHjV\ns4DPnnWsU/A8QHFtQIZOQyH2OXXwA/i5uBFaqadFhd/L4"..., size = 8162} prev_part = 0x2304210 skip_body = false block = {part = 0x2304210, hdr = 0x0, data = 0x2391a60 "", size = 0} binary_body = <optimized out> ret = <optimized out> input = 0x2370fa0 parts = 0x7f1b73ab63c1 body_part = true body_added = true #9 fts_build_mail (update_ctx=0x2355980, mail=mail@entry=0x23639b0) at fts-build-mail.c:592 _data_stack_cur_id = 5 ret = 1 #10 0x00007f1b72701a20 in fts_mail_index (_mail=0x23639b0) at fts-storage.c:484 ft = 0x235bdf0 flist = 0x2326868 #11 fts_mail_precache (_mail=0x23639b0) at fts-storage.c:501 _data_stack_cur_id = 4 mail = 0x23639b0 fmail = <optimized out> ft = <optimized out> #12 0x00007f1b73a1fad9 in mail_precache (mail=0x23639b0) at mail.c:401 _data_stack_cur_id = 3 p = 0x23639b0 #13 0x00000000004246b1 in cmd_index_box_precache (box=0x233a360) at doveadm-mail-index.c:75 ctx = 0x235ca40 metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, cache_fields = 0x0, precache_fields = 2359788, backend_ns_prefix = 0x0, backend_ns_type = 0} counter = 0 max = 1574 status = {messages = 13892, recent = 0, unseen = 0, uidvalidity = 1426760059, uidnext = 20447, first_unseen_seq = 0, first_recent_uid = 1, last_cached_seq = 12318, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 1, have_only_guid128 = 0} mail = 0x23639b0 ret = 0 trans = 0x23536d0 search_args = 0x0 seq = <optimized out> #14 cmd_index_box (ctx=0x2318910, info=<optimized out>) at doveadm-mail-index.c:130 box = 0x233a360 status = {messages = 36801008, recent = 0, unseen = 36838224, uidvalidity = 0, uidnext = 1, first_unseen_seq = 0, first_recent_uid = 36805392, last_cached_seq = 0, highest_modseq = 36801016, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 1939790736, permanent_keywords = 1, allow_new_keywords = 1, nonpermanent_modseqs = 0, no_modseq_tracking = 1, have_guids = 1, have_save_guids = 0, have_only_guid128 = 0} ret = 0 ---Type <return> to continue, or q <return> to quit--- #15 cmd_index_run (user=0x2321b50, _ctx=0x2318910) at doveadm-mail-index.c:201 _data_stack_cur_id = 2 iter = 0x2332360 info = <optimized out> ret = 0 #16 cmd_index_run (_ctx=0x2318910, user=0x2321b50) at doveadm-mail-index.c:173 ctx = 0x2318910 i = <optimized out> #17 0x00000000004201d0 in doveadm_mail_next_user (error_r=0x7fff678c4aa8, input=<optimized out>, ctx=0x2318910) at doveadm-mail.c:380 error = <optimized out> ret = 0 #18 doveadm_mail_next_user (ctx=0x2318910, input=<optimized out>, error_r=0x7fff678c4aa8) at doveadm-mail.c:333 ip = <optimized out> ret = <optimized out> #19 0x0000000000421131 in doveadm_mail_cmd (argv=0x23093c0, argc=2, cmd=0x2317b90) at doveadm-mail.c:608 input = {module = 0x0, service = 0x44f7aa "doveadm", username = 0x2309600 "root", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} ctx = 0x2318910 getopt_args = 0x2301688 "qn:AF:S:u:" ret = <optimized out> c = <optimized out> wildcard_user = 0x0 error = <optimized out> #20 doveadm_mail_try_run (cmd_name=cmd_name@entry=0x2309421 "index", argc=2, argv=0x23093b8) at doveadm-mail.c:704 cmd = 0x2317b90 #21 0x000000000041413f in main (argc=2, argv=0x23093b8) at doveadm.c:346 cmd_name = 0x2309421 "index" quick_init = false c = <optimized out> (gdb)

2 2

bug in acl_defaults_from_inbox option
by Marco Giunta 08 Sep '15

08 Sep '15

Hi at all, there is a bug in in acl_defaults_from_inbox option: if you define it with ANY value ('yes', 'no', 'whatyouwant', 'xxx') it acts like the value is ALWAYS 'yes', and Dovecot enable it; the only way to disable it, is comment it or delete from configuration file. With 'acl_defaults_from_inbox = no', or 'acl_defaults_from_inbox = whatyouwant', all my folders get ACLs from INBOX; in my case I want to only share INBOX, but also all other folders were shared. When you comment 'acl_defaults_from_inbox', Dovecot works like expected. Marco # 2.2.15: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.6 (3e924b1b6c5c+) # OS: Linux 2.6.18-400.1.1.el5 x86_64 Red Hat Enterprise Linux Server auth_master_user_separator = * auth_mechanisms = plain login disable_plaintext_auth = no doveadm_password = XXXXXXXXXXXXXXXXXXXXXXXX doveadm_port = 12345 first_valid_uid = 200 hostname = xxxxxxx.sissa.it imap_client_workarounds = delay-newmail lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To listen = * login_log_format_elements = user=<%u> PID=%p method=%m rip=%r lip=%l %c login_trusted_networks = XXX.XXX.1.172/30 XXX.XXX.24.0/23 mail_gid = mail mail_home = /var/spool/mail/%1n/%n mail_location = maildir:/var/spool/mail/%1n/%n:INDEX=/var/shared/indexes/%1n/%n mail_plugins = acl fts fts_solr mailbox_alias quota mail_shared_explicit_inbox = yes mail_uid = vmail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace archives { hidden = no inbox = no list = children location = maildir:/var/spool/archives/%1n/%n:INDEX=/var/shared/indexes/%1n/%n/archives mailbox 2015 { auto = subscribe special_use = \Archive } prefix = Archives. separator = . subscriptions = no type = private } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox INBOX_spam { auto = subscribe special_use = \Junk } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } namespace others { list = children location = maildir:/var/spool/mail/%%1n/%%n:INDEXPVT=/var/shared/indexes/%1n/%n/shared/%%n prefix = Other Users.%%n. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_defaults_from_inbox = no acl_shared_dict = file:/var/shared/dovecot/shared-mailboxes.dict fts = solr fts_autoindex = yes fts_autoindex_max_recent_msgs = 20 fts_solr = url=http://solr.localdomain:8080/solr/ mailbox_alias_new = INBOX_spam mailbox_alias_old = Junk quota = maildir:User quota:ns= quota2 = maildir:Archive quota:ns=Archives. quota2_rule = *:storage=20GB quota2_warning = storage=95%% quota2-warning 95 %u quota2_warning2 = storage=90%% quota2-warning 90 %u quota2_warning3 = storage=80%% quota2-warning 80 %u quota_rule = *:storage=5GB quota_rule2 = Trash:storage=+20%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Quota exceeded (mailbox for user is full) quota_status_success = DUNNO quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=80%% quota-warning 80 %u sieve = file:~/sieve;active=~/sieve/.dovecot.sieve sieve_default = /etc/dovecot/sieve/dovecot.sieve sieve_extensions = +notify +imapflags sieve_max_redirects = 16 } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster(a)sissa.it protocols = imap pop3 lmtp sieve rejection_reason = Your message to <%t> was automatically rejected for the following reason: %n%n%r service auth { inet_listener { port = 49494 } unix_listener auth-userdb { user = vmail } } service dict { unix_listener dict { user = vmail } } service doveadm { inet_listener { port = 26001 } } service imap-login { process_min_avail = 16 service_count = 0 } service imap { process_limit = 2048 } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } process_min_avail = 16 service_count = 0 vsz_limit = 256 M } service quota-status { client_limit = 1 executable = /usr/libexec/dovecot/quota-status -p postfix inet_listener { port = 25001 } } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } service quota2-warning { executable = script /usr/local/bin/dovecot-quota2-warning.sh unix_listener quota2-warning { user = vmail } user = vmail } ssl_cert = </etc/pki/dovecot/certs/xxxxx-crt.pem ssl_key = </etc/pki/dovecot/private/Xxxxx-key.pem ssl_protocols = !SSLv2 !SSLv3 submission_host = xxxxxx.sissa.it:25 syslog_facility = local2 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl fts fts_solr mailbox_alias quota sieve postmaster_address = xxxxxxx(a)sissa.it } protocol lda { info_log_path = log_path = mail_plugins = acl fts fts_solr mailbox_alias quota sieve syslog_facility = local2 } protocol imap { mail_max_userip_connections = 50 mail_plugins = acl fts fts_solr mailbox_alias quota imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 50 } protocol pop3 { mail_max_userip_connections = 50 } -- ----------------------------------- |Marco Giunta - SISSA Computer Staff| |Via Bonomea, 265 | |34136 - Trieste, Italy | |Tel: +39-40-3787-503 | |Fax: +39-040-3787-244 | |e-mail: giunta(a)sissa.it | -----------------------------------

2 2

[Patch] Fix hang in safe_sendfile on SmartOS
by Sebastian Wiedenroth 08 Sep '15

08 Sep '15

# HG changeset patch # User Sebastian Wiedenroth <sebastian.wiedenroth(a)skylime.net> # Date 1437050484 -7200 # Thu Jul 16 14:41:24 2015 +0200 # Node ID 7ef3a533b097e8e6590e754dc56ad308ab29233b # Parent e3640ccaa76d77a9658126d1f8f306480dad8af7 Fix hang in safe_sendfile on SmartOS The call to sendfile on SmartOS can fail with EOPNOTSUPP. This is a valid error code and documented in the man page. This error code needs to be handled or else dovecot will retry the sendfile call endlessly and hang. diff -r e3640ccaa76d -r 7ef3a533b097 src/lib/sendfile-util.c --- a/src/lib/sendfile-util.c Sat Jan 10 04:32:42 2015 +0200 +++ b/src/lib/sendfile-util.c Thu Jul 16 14:41:24 2015 +0200 @@ -116,7 +116,7 @@ if (errno == EINVAL) { /* most likely trying to read past EOF */ ret = 0; - } else if (errno == EAFNOSUPPORT) { + } else if (errno == EAFNOSUPPORT || errno == EOPNOTSUPP) { /* not supported, return Linux-like EINVAL so caller sees only consistent errnos. */ errno = EINVAL;

2 4

Patch for "doveadm -f table" nit (was Re: Dovecot current number of connections being used.)
by Joseph Tam 08 Sep '15

08 Sep '15

> doveadm who -1 2>/dev/null | wc -l You have to redirect stderr to /dev/null because that's where the first header line is written to. The default format style (table) is inconsistent with the other formats (flow,pager,tab) that write headers and data to stdout. The following patch will pick this nit. This patch will require modifications to scripts that rely on doveadm writing headers to stderr. For example, the above doveadm command could be modified to doveadm who -1 | grep -vc '^username' -------------------------------------------------------------------------------- --- a/dovecot-2.2.16.rc1/src/doveadm/doveadm-print-table.c Wed Mar 18 15:40:40 2015 +++ b/dovecot-2.2.16.rc1/src/doveadm/doveadm-print-table.c Wed Mar 18 15:41:18 2015 @@ -151,3 +151,3 @@ for (i = 0; i < count; i++) { - if (i > 0) fprintf(stderr, " "); + if (i > 0) printf(" "); @@ -155,3 +155,3 @@ DOVEADM_PRINT_HEADER_FLAG_RIGHT_JUSTIFY) == 0) { - fprintf(stderr, "%-*s", (int)headers[i].length, + printf("%-*s", (int)headers[i].length, headers[i].title); @@ -158,3 +158,3 @@ } else { - fprintf(stderr, "%*s", (int)headers[i].length, + printf("%*s", (int)headers[i].length, headers[i].title); @@ -162,3 +162,3 @@ } - fprintf(stderr, "\n"); + printf("\n"); } -------------------------------------------------------------------------------- Joseph Tam <jtam.home(a)gmail.com>

5 9

Re: Null deference pointer in dovecot-2.2.18
by 吴迪 08 Sep '15

08 Sep '15

Dear, use our static analysis tools, I find some bugs (Null deference pointer) for dovecot-2.2.18. Null deference pointer bugs often make program crashes, Please confim them, Thanks! 1. dovecot-2.2.18/src/config/config-request.c 332 'setting_export_section_name(ctx->prefix, def, children[i], i);', pointer 'children' in line 202 assigned NULL and if branch 'case SET_DEFLIST_UNIQUE' not execute, so pointer 'children' is always NULL. It load to a bug of null deference pointer In line 332. The same bugs also appeared in : 1. dovecot-2.2.18/src/lib-index/mail-index-fsck.c line 170 or 174, pointer 'kw_rec ' mybe NULL. 2.dovecot-2.2.18/src/lib-storage/mail-search-args-simplify line 349, pointer 'prev_arg' mybe NULL. best wishes~ Amy

3 2

RFC 5465 (NOTIFY) violation: missing HIGHESTMODSEQ in initial STATUS responses
by Guilhem Moulin 08 Sep '15

08 Sep '15

Quoting RFC 5465 (NOTIFY): “If the NOTIFY command enables MessageNew, MessageExpunge, AnnotationChange, or FlagChange notifications for a mailbox other than the currently selected mailbox, and the client has specified the STATUS indicator parameter, then the server MUST send a STATUS response for that mailbox before NOTIFY's tagged OK. […] If either AnnotationChange or FlagChange are included and the server also supports the CONDSTORE [RFC4551] and/or QRESYNC [RFC5162] extensions, the STATUS response MUST contain UIDVALIDITY and HIGHESTMODSEQ.” — https://tools.ietf.org/html/rfc5465#section-3.1 While unsolicited STATUS responses include HIGHESTMODSEQ indeed, the initial STATUS responses (caused by the presence of the STATUS indicator) do not: ~$ /usr/lib/dovecot/imap * PREAUTH [CAPABILITY IMAP4rev1 … CONDSTORE QRESYNC … NOTIFY SPECIAL-USE] Logged in as guilhem a ENABLE QRESYNC * ENABLED QRESYNC a OK Enabled (0.000 secs). b NOTIFY SET STATUS (SUBSCRIBED (MessageNew MessageExpunge FlagChange)) * STATUS INBOX (MESSAGES 9069 UIDNEXT 109398 UIDVALIDITY 1312585007 UNSEEN 0) […] b OK NOTIFY completed (0.008 secs). [time passes… a new message is delivered to INBOX] * STATUS INBOX (MESSAGES 9070 UIDNEXT 109399 UNSEEN 1 HIGHESTMODSEQ 22216) This defeats the purpose of the STATUS indicator for disconnected clients since they have to issue separate STATUS commands (or a LIST command if LIST-{EXTENDED,STATUS} have been advertized) to find out which mailboxes have got a new HIGHESTMODSEQ. Cheers, -- Guilhem.

2 1

NOTIFY regression: 2.18 no longer notifies of events in INBOX
by Guilhem Moulin 08 Sep '15

08 Sep '15

Here is an example with APPEND $ /usr/lib/dovecot/imap S1: * PREAUTH [CAPABILITY IMAP4rev1 … MOVE NOTIFY SPECIAL-USE] Logged in as guilhem C1: a1 NOTIFY SET (INBOXES (MessageNew MessageExpunge FlagChange)) S1: a1 OK NOTIFY completed (0.000 secs) $ /usr/lib/dovecot/imap S2: * PREAUTH [CAPABILITY IMAP4rev1 … MOVE NOTIFY SPECIAL-USE] Logged in as guilhem C2: a2 APPEND INBOX {1+} C2: x S2: a2 OK [APPENDUID 1384472528 26085] Append completed (0.229 secs). With 2.13 from Debian Jessie, S1 sends a notification for the new message in INBOX, as expected: S1: * STATUS INBOX (MESSAGES 4333 UIDNEXT 26086 UNSEEN 1) However it doesn't with 2.18 from Debian Sid, as if ‘INBOX’ was excluded from the mailbox filter ‘INBOXES’. It does send a notification for ‘virtual/unseen’ instead (as expected), but nothing for ‘INBOX’. S1: * STATUS virtual/unseen (MESSAGES 3 UIDNEXT 15186 UNSEEN 3) This is INBOX-specific because APPENDING the message to another mailbox triggers the notification on both 2.13 and 2.18 as expected: S1: * STATUS test (MESSAGES 2 UIDNEXT 3 UNSEEN 2) S1: * STATUS virtual/unseen (MESSAGES 2 UIDNEXT 15195 UNSEEN 2) I attach the ‘dovecot -n’ output for both 2.13 and 2.18. -- Guilhem.

2 1