September 2015 - dovecot

Different behavior of ACLs in MUA and doveadm
by Thomas Leuxner 08 Sep '15

08 Sep '15

I have noticed a difference in the behavior of ACLs. When used in a MUA the following global ACL works fine and has the desired effect - new mailboxes can be created by a user being part of the 'PublicMailboxAdmins' group: [ global-acl: ] INBOX owner lrwstiekxap Public/* group=PublicMailboxAdmins lrwsipk Public/* anyone lr Public/* authenticated lrws Creating the same mailbox via doveadm however fails with a permission problem: doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:/var/vmail/public:INDEXPVT=~/mdbox/public doveadm(tlx(a)leuxner.net): Debug: fs: root=/var/vmail/public, index=, indexpvt=/var/vmail/domains/leuxner.net/tlx/mdbox/public, control=, inbox=, alt= doveadm(tlx(a)leuxner.net): Debug: acl: initializing backend with data: vfile:/var/vmail/conf.d/leuxner.net/global-acl:cache_secs=300 doveadm(tlx(a)leuxner.net): Debug: acl: acl username = tlx(a)leuxner.net doveadm(tlx(a)leuxner.net): Debug: acl: owner = 0 doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: Namespace : type=private, prefix=Virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:~/mdbox/virtual doveadm(tlx(a)leuxner.net): Debug: fs: root=/var/vmail/domains/leuxner.net/tlx/mdbox/virtual, index=, indexpvt=, control=, inbox=, alt= doveadm(tlx(a)leuxner.net): Debug: acl: initializing backend with data: vfile:/var/vmail/conf.d/leuxner.net/global-acl:cache_secs=300 doveadm(tlx(a)leuxner.net): Debug: acl: acl username = tlx(a)leuxner.net doveadm(tlx(a)leuxner.net): Debug: acl: owner = 1 doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/dovecot-acl not found doveadm(tlx(a)leuxner.net): Error: Can't create mailbox Public/Archive/Newsletters/heise-security/2014: Permission denied Interestingly, doveadm succeeds when dovecot-acl is present in the namespace root - which of course is not desirable in the light of the global ACL: [ dovecot-acl: ] group=PublicMailboxAdmins lrwsipk doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: Namespace : type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=no location=mdbox:/var/vmail/public:INDEXPVT=~/mdbox/public doveadm(tlx(a)leuxner.net): Debug: fs: root=/var/vmail/public, index=, indexpvt=/var/vmail/domains/leuxner.net/tlx/mdbox/public, control=, inbox=, alt= doveadm(tlx(a)leuxner.net): Debug: acl: initializing backend with data: vfile:/var/vmail/conf.d/leuxner.net/global-acl:cache_secs=300 doveadm(tlx(a)leuxner.net): Debug: acl: acl username = tlx(a)leuxner.net doveadm(tlx(a)leuxner.net): Debug: acl: owner = 0 doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: Namespace : type=private, prefix=Virtual/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes location=virtual:~/mdbox/virtual doveadm(tlx(a)leuxner.net): Debug: fs: root=/var/vmail/domains/leuxner.net/tlx/mdbox/virtual, index=, indexpvt=, control=, inbox=, alt= doveadm(tlx(a)leuxner.net): Debug: acl: initializing backend with data: vfile:/var/vmail/conf.d/leuxner.net/global-acl:cache_secs=300 doveadm(tlx(a)leuxner.net): Debug: acl: acl username = tlx(a)leuxner.net doveadm(tlx(a)leuxner.net): Debug: acl: owner = 1 doveadm(tlx(a)leuxner.net): Debug: acl vfile: Global ACL file: /var/vmail/conf.d/leuxner.net/global-acl doveadm(tlx(a)leuxner.net): Debug: acl vfile: reading file /var/vmail/public/mailboxes/dovecot-acl doveadm(tlx(a)leuxner.net): Debug: Namespace Public/: /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/2014 doesn't exist yet, using default permissions doveadm(tlx(a)leuxner.net): Debug: Namespace Public/: Using permissions from /var/vmail/public: mode=0700 gid=default doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/dbox-Mails/dovecot-acl not found doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/2014/dbox-Mails/dovecot-acl not found doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/2014/dbox-Mails/dovecot-acl not found doveadm(tlx(a)leuxner.net): Debug: acl vfile: file /var/vmail/public/mailboxes/Archive/Newsletters/heise-security/2014/dbox-Mails/dovecot-acl not found # 2.2.15 (6078354e6238): /etc/dovecot/dovecot.conf I know there have been some changes in Mercurial as to how global ACLs are interpreted. Is doveadm probably behind on them? Regards Thomas

2 5

Fetch command response questions
by Vlad Pop 08 Sep '15

08 Sep '15

Hello, I have the following issue: When using command FETCH 2 (BODY.PEEK[HEADER] UID INTERNALDATE FLAGS BODYSTRUCTURE) on 2 different emails, we get 2 different response structure. First response structure contains the BODYSTRUCTURE in a single line, while in the second response, the BODYSTRUCTURE is divided into multiple lines with "{61}" character at the end of each line. The difference between those 2 emails is the name of some attachments. The attachment is an .eml file named "Re: [SR-Users] Keep-Alive in dialog "freeing a free fragment"" Is this a sort of bug or is it correct to receive the BODYSTRUCTURE on multiple lines? Vlad Pop

2 1

segfault when using zlib module with glibc 2.22
by Florian Pritz 08 Sep '15

08 Sep '15

Hi, I'm seeing the following segfault when I run `doveadm search mailbox inbox` with the zlib module enabled with dovecot 2.18 and glibc 2.22 on Arch Linux. It does not happen with glibc 2.21. I've noticed that when I remove "zlib" from the mail_plugins line at the beginning of the config file the segfault goes away. I've also tested hg tip and the problem does not appear to be fixed yet. The segfault also happens with other commands like `doveadm purge`. Do you need any more information to reproduce and fix this? Florian backtrace: > 0x00007ffff5eaf1e0 in pthread_mutex_unlock () from /usr/lib/libpthread.so.0 > #0 0x00007ffff5eaf1e0 in pthread_mutex_unlock () from /usr/lib/libpthread.so.0 > #1 0x00007ffff7def753 in _dl_close_worker () from /lib64/ld-linux-x86-64.so.2 > #2 0x00007ffff7defede in _dl_close () from /lib64/ld-linux-x86-64.so.2 > #3 0x00007ffff7dea124 in _dl_catch_error () from /lib64/ld-linux-x86-64.so.2 > #4 0x00007ffff6d235e1 in ?? () from /usr/lib/libdl.so.2 > #5 0x00007ffff6d230bf in dlclose () from /usr/lib/libdl.so.2 > #6 0x00007ffff739326a in module_free (module=0x69da20) at module-dir.c:67 > #7 0x00007ffff7394882 in module_dir_unload (modules=0x68b680 <mail_storage_service_modules>) at module-dir.c:593 > #8 0x00007ffff765376b in mail_storage_service_deinit (_ctx=0x6a05d0) at mail-storage-service.c:1475 > #9 0x0000000000425ac2 in doveadm_mail_cmd (cmd=0x69f780, argc=3, argv=0x6943a0) at doveadm-mail.c:631 > #10 0x0000000000425dcb in doveadm_mail_try_run (cmd_name=0x6943c9 "search", argc=3, argv=0x694398) at doveadm-mail.c:711 > #11 0x0000000000433e1f in main (argc=3, argv=0x694398) at doveadm.c:346 dovecot.conf: > # 2.0.0: dovecot.conf.orig > # OS: Linux 2.6.35-ARCH x86_64 Arch Linux > auth_mechanisms = plain login > disable_plaintext_auth = yes > mail_location = mdbox:~/.mdbox > mdbox_rotate_size = 10m > mail_plugins = $mail_plugins zlib notify mail_log > > # enable imap notify > mailbox_list_index=yes > > # remove domain part from username and lowercase it > # needed for lmtp delivery to system users > auth_username_format = %Ln > > namespace inbox { > hidden = no > inbox = yes > list = yes > location = > prefix = > separator = . > type = private > mailbox Trash { > auto = subscribe > special_use = \Trash > } > mailbox Drafts { > auto = subscribe > special_use = \Drafts > } > mailbox Sent { > auto = subscribe # autocreate, autosubscribe > special_use = \Sent > } > mailbox Junk { > auto = subscribe > special_use = \Junk > } > } > > passdb { > driver = pam > } > plugin { > sieve = ~/.dovecot.sieve > sieve_dir = ~/.sieve > sieve_global_dir = /etc/dovecot/sieve/global/ > sieve_global_path = /etc/dovecot/sieve/default.sieve > > mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename > mail_log_fields = uid box msgid size > } > protocols = imap pop3 sieve lmtp > service auth { > unix_listener auth-client { > group = postfix > mode = 0660 > user = postfix > } > user = root > } > service imap-login { > process_limit = 400 > process_min_avail = 5 > #executable = imap-login -D > #chroot = > } > > service managesieve-login { > inet_listener sieve { > #port = 4190 > } > inet_listener sieve-obsolete { > port = 2000 > } > } > service managesieve { > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0660 > user = postfix > } > } > > #service imap { > # executable = imap postlogin > #} > # > #service postlogin { > # executable = script-login -d rawlog > # unix_listener postlogin { > # } > #} > > login_log_format_elements = "user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k" > imap_id_log = * > > ssl_cert = </etc/ssl/my-certs/mail.pem > ssl_key = </etc/ssl/private/server.key > ssl_prefer_server_ciphers = yes > > ssl_protocols = !SSLv2 !SSLv3 > ssl_options = no_compression > > #ssl_cipher_list = DHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-ECDSA-AES256-SHA384:DHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:DHE-ECDSA-AES128-GCM-SHA256:DHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-SHA256:ECDHE-RSA-AES256-SHA256:DHE-ECDSA-AES128-SHA256:DHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:DHE-RSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA:EDH-RSA-DES-CBC3-SHA:DHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA:ALL:!LOW:!SSLv2:!EXP:!aNULL > ssl_cipher_list = EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:+CAMELLIA256:+AES256:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!ECDSA:CAMELLIA256-SHA:AES256-SHA:CAMELLIA128-SHA:AES128-SHA > > #ssl_dh_parameters_length = 4096 > > userdb { > driver = passwd > } > protocol imap { > imap_client_workarounds = tb-extra-mailbox-sep > mail_max_userip_connections = 30 > mail_plugins = $mail_plugins imap_zlib > } > protocol lda { > mail_plugins = $mail_plugins sieve > postmaster_address = postmaster(a)server-speed.net > } > protocol lmtp { > postmaster_address = postmaster(a)server-speed.net > mail_plugins = $mail_plugins sieve > } > protocol sieve { > managesieve_logout_format = bytes ( in=%i : out=%o ) > } > plugin { > sieve = ~/.dovecot.sieve > sieve_dir = ~/.sieve > zlib_save_level = 6 > zlib_save = gz > #acl = vfile > } > #plugin { > #fts = lucene > ## Lucene-specific settings, good ones are: > #fts_lucene = whitespace_chars=@. > #fts_autoindex=yes > #} > > auth_failure_delay = 2

2 2

charset-iconv.c panic
by mihaiush 08 Sep '15

08 Sep '15

Hi, I have a mailbox where indexing fails with the following error: # /opt/dovecot2/bin/doveadm -c /tmp/dovecot.conf -o mail_location=/tmp/skesselring index '*' doveadm(root): Panic: file charset-iconv.c: line 132 (charset_to_utf8): assertion failed: (*src_size - pos <= CHARSET_MAX_PENDING_BUF_SIZE) doveadm(root): Error: Raw backtrace: /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7f1b7376f13f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f1b7376f21a] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f1b7371d555] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x754a7) [0x7f1b737684a7] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(message_decoder_decode_next_block+0x528) [0x7f1b7375d8d8] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(fts_build_mail+0x19e) [0x7f1b726fbe3e] -> /opt/dovecot2/lib/dovecot/lib20_fts_plugin.so(+0xfa20) [0x7f1b72701a20] -> /opt/dovecot2/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x19) [0x7f1b73a1fad9] -> /opt/dovecot2/bin/doveadm() [0x4246b1] -> /opt/dovecot2/bin/doveadm() [0x4201d0] -> /opt/dovecot2/bin/doveadm(doveadm_mail_try_run+0x261) [0x421131] -> /opt/dovecot2/bin/doveadm(main+0x34f) [0x41413f] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f1b73386ead] -> /opt/dovecot2/bin/doveadm() [0x414235] Aborted (core dumped) Dovecot 2.2.18 build from sources ./configure --prefix=/opt/dovecot2 --with-mysql --with-sqlite --with-solr --with-ssl --disable-rpath --disable-static. Filesystem is ext4 # /opt/dovecot2/bin/doveadm -c /tmp/dovecot.conf config -n # 2.2.18: /tmp/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.8 auth_master_user_separator = * auth_mechanisms = plain login base_dir = /services/dovecot1/var/run default_client_limit = 10240 default_login_user = dovecot dict { quotadict = mysql:/services/dovecot1/etc/quota.conf } disable_plaintext_auth = no log_path = login_log_format_elements = user=%u session=%{session} mpid=%e rip=%r rrip=%{real_rip} mail_location = mdbox:~/mails mail_log_prefix = "store107: %s(%u): %{session}: " mail_max_userip_connections = 0 mail_plugins = quota virtual fts fts_solr notify mail_log mailbox_list_index = yes mdbox_rotate_size = 256 k mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } namespace virtual { hidden = yes list = no location = virtual:/services/dovecot1/etc/virtual:INDEX=~/mails/virtual mailbox all { auto = create special_use = \All } mailbox unseen { auto = create } prefix = virtual/ separator = / } passdb { args = /services/dovecot1/etc/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { args = /services/dovecot1/etc/mysql.conf driver = sql } plugin { fts = solr fts_solr = break-imap-search url=http://10.78.18.127:8080/solr/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change save mailbox_create mail_log_fields = uid box msgid flags quota = dict:user::proxy::quotadict quota_rule = *:storage=1GB quota_rule2 = Trash:storage=+152M quota_rule3 = Trash:messages=+5 } protocols = imap service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { group = nogroup mode = 0660 } } service dict { process_limit = 400 unix_listener dict { mode = 0600 user = nobody } } service imap-login { chroot = login client_limit = 2048 inet_listener imap { address = 10.78.18.127 port = 143 } process_limit = 1024 service_count = 0 } service imap { process_limit = 10240 vsz_limit = 320 M } service indexer-worker { process_limit = 4 process_min_avail = 2 service_count = 1 vsz_limit = 1 G } shutdown_clients = no ssl = no syslog_facility = local3 userdb { args = /services/dovecot1/etc/mysql.conf driver = sql } protocol imap { mail_plugins = quota virtual fts fts_solr notify mail_log imap_quota } protocol lda { auth_socket_path = /services/dovecot1/var/run/auth-master mail_plugins = quota virtual fts fts_solr notify mail_log sieve event_broker submission_host = osmtp:8090 } # gdb /opt/dovecot2/bin/doveadm core GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /opt/dovecot2_clean/bin/doveadm...done. [New LWP 4172] warning: Can't read pathname for load map: Input/output error. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/opt/dovecot2/bin/doveadm -c /tmp/dovecot.conf -o mail_location=/tmp/skesselrin'. Program terminated with signal 6, Aborted. #0 0x00007f1b7339a165 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) (gdb) (gdb) bt full #0 0x00007f1b7339a165 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f1b7339d3e0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f1b7376f135 in default_fatal_finish (type=<optimized out>, status=status@entry=0) at failures.c:202 backtrace = 0x2304560 "/opt/dovecot2/lib/dovecot/libdovecot.so.0(+0x7c13f) [0x7f1b7376f13f] -> /opt/dovecot2/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f1b7376f21a] -> /opt/dovecot2/lib/dovecot/libdovecot.s"... #3 0x00007f1b7376f21a in default_fatal_handler (ctx=0x7fff678c4510, format=<optimized out>, args=<optimized out>) at failures.c:216 status = 0 #4 0x00007f1b7371d555 in i_panic (format=format@entry=0x7f1b73799298 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:276 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7fff678c4600, reg_save_area = 0x7fff678c4540}} #5 0x00007f1b737684a7 in charset_to_utf8 (t=0x2371a50, src=src@entry=0x23845e0 "\213h\201\347/\364\322*\303\307YpG\a\207\002\222\276\364z\301\350\201\227\335\360<\016(20~\365\254A\373?\326\070ir\364S\270-\006\245\360\237\250\242}iz]ph`<\026T9H\325F\033\301\354\333K\270|\353\345rF3-\277\211\003XOT\375\347\241\273\256\360<\330cy0\327", src_size=src_size@entry=0x7fff678c4668, dest=0x2369320) at charset-iconv.c:132 result = CHARSET_RET_INVALID_INPUT pos = 8226 size = 2183 prev_invalid_pos = 9595 ret = <optimized out> __FUNCTION__ = "charset_to_utf8" #6 0x00007f1b7375d8d8 in message_decode_body (output=0x7fff678c4780, ctx=0x2370b60, input=<optimized out>) at message-decoder.c:342 data = 0x23845e0 "\213h\201\347/\364\322*\303\307YpG\a\207\002\222\276\364z\301\350\201\227\335\360<\016(20~\365\254A\373?\326\070ir\364S\270-\006\245\360\237\250\242}iz]ph`<\026T9H\325F\033\301\354\333K\270|\353\345rF3-\277\211\003XOT\375\347\241\273\256\360<\330cy0\327" ret = <optimized out> pos = 6042 size = 6042 error = 0x7fff678c4760 "\020B0\002" #7 message_decoder_decode_next_block (ctx=0x2370b60, input=input@entry=0x7fff678c4760, output=output@entry=0x7fff678c4780) at message-decoder.c:375 No locals. #8 0x00007f1b726fbe3e in fts_build_mail_real (mail=0x23639b0, update_ctx=0x2355980) at fts-build-mail.c:543 ctx = {mail = 0x23639b0, update_ctx = 0x2355980, content_type = 0x2371540 "text/*", content_disposition = 0x2371fa0 "attachment; filename=\"PTT-20141109-WA0001.amr\"", body_parser = 0x23832a0, word_buf = 0x0, pending_input = 0x0, cur_user_lang = 0x0} parser = 0x2371130 decoder = 0x0 raw_block = {part = 0x2304210, hdr = 0x0, data = 0x236eb50 "\ni2iB5y/00irDx1lwRweHApK+9HrB6IGX3fA8DigyMH71rEH7P9Y4aXL0U7gtBqXwn6iifWl6XXBo\nYDwWVDlI1UYbwezbS7h86+VyRjMtv4kDWE9U/eehu67wPNhjeTDXABPB8tdUnMju+InvVF0WrHjV\ns4DPnnWsU/A8QHFtQIZOQyH2OXXwA/i5uBFaqadFhd/L4"..., size = 8162} prev_part = 0x2304210 skip_body = false block = {part = 0x2304210, hdr = 0x0, data = 0x2391a60 "", size = 0} binary_body = <optimized out> ret = <optimized out> input = 0x2370fa0 parts = 0x7f1b73ab63c1 body_part = true body_added = true #9 fts_build_mail (update_ctx=0x2355980, mail=mail@entry=0x23639b0) at fts-build-mail.c:592 _data_stack_cur_id = 5 ret = 1 #10 0x00007f1b72701a20 in fts_mail_index (_mail=0x23639b0) at fts-storage.c:484 ft = 0x235bdf0 flist = 0x2326868 #11 fts_mail_precache (_mail=0x23639b0) at fts-storage.c:501 _data_stack_cur_id = 4 mail = 0x23639b0 fmail = <optimized out> ft = <optimized out> #12 0x00007f1b73a1fad9 in mail_precache (mail=0x23639b0) at mail.c:401 _data_stack_cur_id = 3 p = 0x23639b0 #13 0x00000000004246b1 in cmd_index_box_precache (box=0x233a360) at doveadm-mail-index.c:75 ctx = 0x235ca40 metadata = {guid = '\000' <repeats 15 times>, virtual_size = 0, cache_fields = 0x0, precache_fields = 2359788, backend_ns_prefix = 0x0, backend_ns_type = 0} counter = 0 max = 1574 status = {messages = 13892, recent = 0, unseen = 0, uidvalidity = 1426760059, uidnext = 20447, first_unseen_seq = 0, first_recent_uid = 1, last_cached_seq = 12318, highest_modseq = 0, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 1, have_save_guids = 1, have_only_guid128 = 0} mail = 0x23639b0 ret = 0 trans = 0x23536d0 search_args = 0x0 seq = <optimized out> #14 cmd_index_box (ctx=0x2318910, info=<optimized out>) at doveadm-mail-index.c:130 box = 0x233a360 status = {messages = 36801008, recent = 0, unseen = 36838224, uidvalidity = 0, uidnext = 1, first_unseen_seq = 0, first_recent_uid = 36805392, last_cached_seq = 0, highest_modseq = 36801016, highest_pvt_modseq = 0, keywords = 0x0, permanent_flags = 1939790736, permanent_keywords = 1, allow_new_keywords = 1, nonpermanent_modseqs = 0, no_modseq_tracking = 1, have_guids = 1, have_save_guids = 0, have_only_guid128 = 0} ret = 0 ---Type <return> to continue, or q <return> to quit--- #15 cmd_index_run (user=0x2321b50, _ctx=0x2318910) at doveadm-mail-index.c:201 _data_stack_cur_id = 2 iter = 0x2332360 info = <optimized out> ret = 0 #16 cmd_index_run (_ctx=0x2318910, user=0x2321b50) at doveadm-mail-index.c:173 ctx = 0x2318910 i = <optimized out> #17 0x00000000004201d0 in doveadm_mail_next_user (error_r=0x7fff678c4aa8, input=<optimized out>, ctx=0x2318910) at doveadm-mail.c:380 error = <optimized out> ret = 0 #18 doveadm_mail_next_user (ctx=0x2318910, input=<optimized out>, error_r=0x7fff678c4aa8) at doveadm-mail.c:333 ip = <optimized out> ret = <optimized out> #19 0x0000000000421131 in doveadm_mail_cmd (argv=0x23093c0, argc=2, cmd=0x2317b90) at doveadm-mail.c:608 input = {module = 0x0, service = 0x44f7aa "doveadm", username = 0x2309600 "root", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} ctx = 0x2318910 getopt_args = 0x2301688 "qn:AF:S:u:" ret = <optimized out> c = <optimized out> wildcard_user = 0x0 error = <optimized out> #20 doveadm_mail_try_run (cmd_name=cmd_name@entry=0x2309421 "index", argc=2, argv=0x23093b8) at doveadm-mail.c:704 cmd = 0x2317b90 #21 0x000000000041413f in main (argc=2, argv=0x23093b8) at doveadm.c:346 cmd_name = 0x2309421 "index" quick_init = false c = <optimized out> (gdb)

2 2

File permissions: system groups for do not work for group/shared mailboxes
by Jens Kirchner 08 Sep '15

08 Sep '15

Hello! I am struggling to set up a group mailbox for users of a certain system group. I want to grant access to the mailbox on a filesystem mode by using the system groups. The problem, the set up works fine and when I use setfacl and grant permissions too each user manually, it works fine. However, I want to use a system user's group membership in order to grant access to these mailboxes insted of manually granting for each user. dovecot version: 2.2.9 This is the config part: namespace { location = maildir:/data/mail/public:LAYOUT=fs prefix = GROUP-MAILBOXES/ separator = / subscriptions = no type = public } ... passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } ... userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } filesystem permissions (getfacl): # file: GroupboxA/ # owner: root # group: root user::rwx user:user1:rwx group::rwx mask::rwx other::--- default:user::rwx default:user:user1:rwx default:group::rwx default:mask::rwx default:other::--- # file: GroupboxB/ # owner: root # group: root user::rwx group::rwx group:group1:rwx mask::rwx other::--- default:user::rwx default:group::rwx default:group:group1:rwx default:mask::rwx default:other::--- user1 is in roup1 When setting username-based permissions (GroupboxA), the mailbox is usable and subsribable; when setting groupname-based permissions (GroupboxB) it is not subscribable/usable. Thanks for your help in advance and best regards, Jens

1 0

bug in acl_defaults_from_inbox option
by Marco Giunta 08 Sep '15

08 Sep '15

Hi at all, there is a bug in in acl_defaults_from_inbox option: if you define it with ANY value ('yes', 'no', 'whatyouwant', 'xxx') it acts like the value is ALWAYS 'yes', and Dovecot enable it; the only way to disable it, is comment it or delete from configuration file. With 'acl_defaults_from_inbox = no', or 'acl_defaults_from_inbox = whatyouwant', all my folders get ACLs from INBOX; in my case I want to only share INBOX, but also all other folders were shared. When you comment 'acl_defaults_from_inbox', Dovecot works like expected. Marco # 2.2.15: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.6 (3e924b1b6c5c+) # OS: Linux 2.6.18-400.1.1.el5 x86_64 Red Hat Enterprise Linux Server auth_master_user_separator = * auth_mechanisms = plain login disable_plaintext_auth = no doveadm_password = XXXXXXXXXXXXXXXXXXXXXXXX doveadm_port = 12345 first_valid_uid = 200 hostname = xxxxxxx.sissa.it imap_client_workarounds = delay-newmail lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lda_original_recipient_header = X-Original-To listen = * login_log_format_elements = user=<%u> PID=%p method=%m rip=%r lip=%l %c login_trusted_networks = XXX.XXX.1.172/30 XXX.XXX.24.0/23 mail_gid = mail mail_home = /var/spool/mail/%1n/%n mail_location = maildir:/var/spool/mail/%1n/%n:INDEX=/var/shared/indexes/%1n/%n mail_plugins = acl fts fts_solr mailbox_alias quota mail_shared_explicit_inbox = yes mail_uid = vmail maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace archives { hidden = no inbox = no list = children location = maildir:/var/spool/archives/%1n/%n:INDEX=/var/shared/indexes/%1n/%n/archives mailbox 2015 { auto = subscribe special_use = \Archive } prefix = Archives. separator = . subscriptions = no type = private } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox INBOX_spam { auto = subscribe special_use = \Junk } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } namespace others { list = children location = maildir:/var/spool/mail/%%1n/%%n:INDEXPVT=/var/shared/indexes/%1n/%n/shared/%%n prefix = Other Users.%%n. separator = . subscriptions = no type = shared } passdb { args = /etc/dovecot/passwd.masterusers driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_defaults_from_inbox = no acl_shared_dict = file:/var/shared/dovecot/shared-mailboxes.dict fts = solr fts_autoindex = yes fts_autoindex_max_recent_msgs = 20 fts_solr = url=http://solr.localdomain:8080/solr/ mailbox_alias_new = INBOX_spam mailbox_alias_old = Junk quota = maildir:User quota:ns= quota2 = maildir:Archive quota:ns=Archives. quota2_rule = *:storage=20GB quota2_warning = storage=95%% quota2-warning 95 %u quota2_warning2 = storage=90%% quota2-warning 90 %u quota2_warning3 = storage=80%% quota2-warning 80 %u quota_rule = *:storage=5GB quota_rule2 = Trash:storage=+20%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Quota exceeded (mailbox for user is full) quota_status_success = DUNNO quota_warning = storage=100%% quota-warning 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=80%% quota-warning 80 %u sieve = file:~/sieve;active=~/sieve/.dovecot.sieve sieve_default = /etc/dovecot/sieve/dovecot.sieve sieve_extensions = +notify +imapflags sieve_max_redirects = 16 } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh postmaster_address = postmaster(a)sissa.it protocols = imap pop3 lmtp sieve rejection_reason = Your message to <%t> was automatically rejected for the following reason: %n%n%r service auth { inet_listener { port = 49494 } unix_listener auth-userdb { user = vmail } } service dict { unix_listener dict { user = vmail } } service doveadm { inet_listener { port = 26001 } } service imap-login { process_min_avail = 16 service_count = 0 } service imap { process_limit = 2048 } service lmtp { inet_listener lmtp { port = 24 } process_min_avail = 5 } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } process_min_avail = 16 service_count = 0 vsz_limit = 256 M } service quota-status { client_limit = 1 executable = /usr/libexec/dovecot/quota-status -p postfix inet_listener { port = 25001 } } service quota-warning { executable = script /usr/local/bin/dovecot-quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } service quota2-warning { executable = script /usr/local/bin/dovecot-quota2-warning.sh unix_listener quota2-warning { user = vmail } user = vmail } ssl_cert = </etc/pki/dovecot/certs/xxxxx-crt.pem ssl_key = </etc/pki/dovecot/private/Xxxxx-key.pem ssl_protocols = !SSLv2 !SSLv3 submission_host = xxxxxx.sissa.it:25 syslog_facility = local2 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl fts fts_solr mailbox_alias quota sieve postmaster_address = xxxxxxx(a)sissa.it } protocol lda { info_log_path = log_path = mail_plugins = acl fts fts_solr mailbox_alias quota sieve syslog_facility = local2 } protocol imap { mail_max_userip_connections = 50 mail_plugins = acl fts fts_solr mailbox_alias quota imap_quota imap_acl } protocol sieve { mail_max_userip_connections = 50 } protocol pop3 { mail_max_userip_connections = 50 } -- ----------------------------------- |Marco Giunta - SISSA Computer Staff| |Via Bonomea, 265 | |34136 - Trieste, Italy | |Tel: +39-40-3787-503 | |Fax: +39-040-3787-244 | |e-mail: giunta(a)sissa.it | -----------------------------------

2 2

[Patch] Fix hang in safe_sendfile on SmartOS
by Sebastian Wiedenroth 08 Sep '15

08 Sep '15

# HG changeset patch # User Sebastian Wiedenroth <sebastian.wiedenroth(a)skylime.net> # Date 1437050484 -7200 # Thu Jul 16 14:41:24 2015 +0200 # Node ID 7ef3a533b097e8e6590e754dc56ad308ab29233b # Parent e3640ccaa76d77a9658126d1f8f306480dad8af7 Fix hang in safe_sendfile on SmartOS The call to sendfile on SmartOS can fail with EOPNOTSUPP. This is a valid error code and documented in the man page. This error code needs to be handled or else dovecot will retry the sendfile call endlessly and hang. diff -r e3640ccaa76d -r 7ef3a533b097 src/lib/sendfile-util.c --- a/src/lib/sendfile-util.c Sat Jan 10 04:32:42 2015 +0200 +++ b/src/lib/sendfile-util.c Thu Jul 16 14:41:24 2015 +0200 @@ -116,7 +116,7 @@ if (errno == EINVAL) { /* most likely trying to read past EOF */ ret = 0; - } else if (errno == EAFNOSUPPORT) { + } else if (errno == EAFNOSUPPORT || errno == EOPNOTSUPP) { /* not supported, return Linux-like EINVAL so caller sees only consistent errnos. */ errno = EINVAL;

2 4

Patch for "doveadm -f table" nit (was Re: Dovecot current number of connections being used.)
by Joseph Tam 08 Sep '15

08 Sep '15

> doveadm who -1 2>/dev/null | wc -l You have to redirect stderr to /dev/null because that's where the first header line is written to. The default format style (table) is inconsistent with the other formats (flow,pager,tab) that write headers and data to stdout. The following patch will pick this nit. This patch will require modifications to scripts that rely on doveadm writing headers to stderr. For example, the above doveadm command could be modified to doveadm who -1 | grep -vc '^username' -------------------------------------------------------------------------------- --- a/dovecot-2.2.16.rc1/src/doveadm/doveadm-print-table.c Wed Mar 18 15:40:40 2015 +++ b/dovecot-2.2.16.rc1/src/doveadm/doveadm-print-table.c Wed Mar 18 15:41:18 2015 @@ -151,3 +151,3 @@ for (i = 0; i < count; i++) { - if (i > 0) fprintf(stderr, " "); + if (i > 0) printf(" "); @@ -155,3 +155,3 @@ DOVEADM_PRINT_HEADER_FLAG_RIGHT_JUSTIFY) == 0) { - fprintf(stderr, "%-*s", (int)headers[i].length, + printf("%-*s", (int)headers[i].length, headers[i].title); @@ -158,3 +158,3 @@ } else { - fprintf(stderr, "%*s", (int)headers[i].length, + printf("%*s", (int)headers[i].length, headers[i].title); @@ -162,3 +162,3 @@ } - fprintf(stderr, "\n"); + printf("\n"); } -------------------------------------------------------------------------------- Joseph Tam <jtam.home(a)gmail.com>

5 9

Re: Null deference pointer in dovecot-2.2.18
by 吴迪 08 Sep '15

08 Sep '15

Dear, use our static analysis tools, I find some bugs (Null deference pointer) for dovecot-2.2.18. Null deference pointer bugs often make program crashes, Please confim them, Thanks! 1. dovecot-2.2.18/src/config/config-request.c 332 'setting_export_section_name(ctx->prefix, def, children[i], i);', pointer 'children' in line 202 assigned NULL and if branch 'case SET_DEFLIST_UNIQUE' not execute, so pointer 'children' is always NULL. It load to a bug of null deference pointer In line 332. The same bugs also appeared in : 1. dovecot-2.2.18/src/lib-index/mail-index-fsck.c line 170 or 174, pointer 'kw_rec ' mybe NULL. 2.dovecot-2.2.18/src/lib-storage/mail-search-args-simplify line 349, pointer 'prev_arg' mybe NULL. best wishes~ Amy

3 2

RFC 5465 (NOTIFY) violation: missing HIGHESTMODSEQ in initial STATUS responses
by Guilhem Moulin 08 Sep '15

08 Sep '15

Quoting RFC 5465 (NOTIFY): “If the NOTIFY command enables MessageNew, MessageExpunge, AnnotationChange, or FlagChange notifications for a mailbox other than the currently selected mailbox, and the client has specified the STATUS indicator parameter, then the server MUST send a STATUS response for that mailbox before NOTIFY's tagged OK. […] If either AnnotationChange or FlagChange are included and the server also supports the CONDSTORE [RFC4551] and/or QRESYNC [RFC5162] extensions, the STATUS response MUST contain UIDVALIDITY and HIGHESTMODSEQ.” — https://tools.ietf.org/html/rfc5465#section-3.1 While unsolicited STATUS responses include HIGHESTMODSEQ indeed, the initial STATUS responses (caused by the presence of the STATUS indicator) do not: ~$ /usr/lib/dovecot/imap * PREAUTH [CAPABILITY IMAP4rev1 … CONDSTORE QRESYNC … NOTIFY SPECIAL-USE] Logged in as guilhem a ENABLE QRESYNC * ENABLED QRESYNC a OK Enabled (0.000 secs). b NOTIFY SET STATUS (SUBSCRIBED (MessageNew MessageExpunge FlagChange)) * STATUS INBOX (MESSAGES 9069 UIDNEXT 109398 UIDVALIDITY 1312585007 UNSEEN 0) […] b OK NOTIFY completed (0.008 secs). [time passes… a new message is delivered to INBOX] * STATUS INBOX (MESSAGES 9070 UIDNEXT 109399 UNSEEN 1 HIGHESTMODSEQ 22216) This defeats the purpose of the STATUS indicator for disconnected clients since they have to issue separate STATUS commands (or a LIST command if LIST-{EXTENDED,STATUS} have been advertized) to find out which mailboxes have got a new HIGHESTMODSEQ. Cheers, -- Guilhem.

2 1