June 2017 - dovecot - dovecot.org

Per-user quota (passwd)
by Evgeniy Korneechev 11 Sep '17

11 Sep '17

Hello! We have passwd=pam, userdb=passwd. passdb { driver = pam #server was entered domain Active Directory } userdb { driver = passwd override_fields = home=/var/vmail/glu_vrem/%u } How can i use per-user quota? Only passwd-file? I tried: userdb { args = /etc/imap.passwd driver = passwd-file override_fields = home=/var/vmail/glu_vrem/%u } /etc/imap.passwd: administrator:*:95400500:95400513:Administrator:/home/DOM/administrator:/bin/bash::userdb_quota_rule=*:bytes=10G Authentication and quota - now OK. But doesn't work sending and receiving mail... postfix say 'Unknown user'... Is there "extra_field" in passwd-file for email? What generally will be advice on quotas in our case? dovecot -n: # 2.2.27 (c0f36b0): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.4.39-std-def-alt0.M80P.1 x86_64 ALT 8.1 Server auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login cram-md5 auth_socket_path = /var/run/dovecot/auth-userdb auth_username_chars = auth_verbose = yes auth_verbose_passwords = plain base_dir = /var/run/dovecot/ debug_log_path = /var/log/dovecot disable_plaintext_auth = no first_valid_gid = 502 first_valid_uid = 502 last_valid_gid = 268999999 last_valid_uid = 268999999 log_path = /var/log/dovecot login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_access_groups = vmail mail_debug = yes mail_gid = 502 mail_location = maildir:/%Lh/Maildir/:INDEX=/%Lh/Maildir/ mail_plugins = " quota autocreate" mail_privileged_group = vmail mail_uid = 502 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify mbox_write_locks = fcntl namespace { list = children location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace inbox { inbox = yes location = prefix = separator = / type = private } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota_rule = *:storage=5G recipient_delimiter = + sieve = /etc/dovecot/sieves/default.sieve sieve_default = /etc/dovecot/sieves/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_redirects = 8 } protocols = imap pop3 lmtp sieve service auth-worker { user = root } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service imap { process_limit = 1024 vsz_limit = 256 M } service lmtp { unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } vsz_limit = 64 M } service pop3-login { inet_listener pop3 { port = 110 } } service pop3 { process_limit = 1024 } ssl_ca = </usr/share/ca-certificates/ca-bundle.crt ssl_cert = </etc/dovecot/server.crt ssl_key = # hidden, use -P to show it userdb { driver = passwd override_fields = home=/var/vmail/glu_vrem/%u } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = " quota autocreate sieve" } protocol lda { mail_plugins = " quota autocreate sieve quota" plugin { quota = dict:user::file:/var/vmail/glu_vrem/%n/.quotausage } } protocol imap { mail_plugins = " quota autocreate autocreate imap_quota" plugin { autocreate = INBOX autocreate2 = Sent autocreate3 = Trash autocreate4 = Drafts autocreate5 = Junk autosubscribe = INBOX autosubscribe2 = Sent autosubscribe3 = Trash autosubscribe4 = Drafts autosubscribe5 = Junk quota = dict:user::file:/var/vmail/glu_vrem/%n/.quotausage } } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } -- WBR, Korneechev Evgeniy BaseALT/ALTLinux Team

2 11

Install locks up my server
by Marc Perkel 19 Aug '17

19 Aug '17

Ever since 2.26 I haven't been able to upgrade. In fact the install locks up my server. I get into and infinite recursive loop where the config-guess program calls itself until the server locks up from overload. I'm running Centos 6 under OpenVZ. What am I missing? I think there's a serious bug. 31233 pts/3 S 0:00 /bin/sh ./config.guess 31235 pts/3 S 0:00 \_ /bin/sh ./config.guess 31238 pts/3 S 0:00 \_ /bin/sh ./config.guess 31240 pts/3 S 0:00 \_ /bin/sh ./config.guess 31241 pts/3 S 0:00 \_ /bin/sh ./config.guess 31267 pts/3 S 0:00 \_ /bin/sh ./config.guess 31272 pts/3 S 0:00 \_ /bin/sh ./config.guess 31279 pts/3 S 0:00 \_ /bin/sh ./config.guess 31280 pts/3 S 0:00 \_ /bin/sh ./config.guess 31281 pts/3 S 0:00 \_ /bin/sh ./config.guess 31283 pts/3 S 0:00 \_ /bin/sh ./config.guess 31284 pts/3 S 0:00 \_ /bin/sh ./config.guess 31285 pts/3 S 0:00 \_ /bin/sh ./config.guess 31292 pts/3 S 0:00 \_ /bin/sh ./config.guess 31303 pts/3 S 0:00 \_ /bin/sh ./config.guess 31304 pts/3 S 0:00 \_ /bin/sh ./config.guess 31305 pts/3 S 0:00 \_ /bin/sh ./config.guess 31306 pts/3 S 0:00 \_ /bin/sh ./config.guess 31307 pts/3 S 0:00 \_ /bin/sh ./config.guess 31321 pts/3 S 0:00 \_ /bin/sh ./config.guess 31340 pts/3 S 0:00 \_ /bin/sh ./config.guess 31341 pts/3 S 0:00 \_ /bin/sh ./config.guess 31426 pts/3 S 0:00 \_ /bin/sh ./config.guess 31530 pts/3 S 0:00 \_ /bin/sh ./config.guess

2 4

[Dovecot] [PATCH, RFC] add APOP authentication mechanism
by Andrey Panin 14 Aug '17

14 Aug '17

Hello all, this patch add APOP authentication mechanism to dovecot 1.0-test23. Please take a look. Best regards. -- Andrey Panin | Linux and UNIX system administrator pazke(a)donpac.ru | PGP key: wwwkeys.pgp.net

3 2

10-ssl ssl = no but dovecot still reads certs
by lists＠lazygranch.com 23 Jul '17

23 Jul '17

I'm bringing up a new email server starting without TLS initially. In 10-ssl.conf I set ssl = no, but the default ssl_cert and ssl_key lines are not commented out. I got the obvious error message: ------------------------------ doveconf: Fatal: Error in configuration file /usr/local/etc/dovecot/conf.d/10-ssl.conf line 12: ssl_cert: Can't open file /etc/ssl/certs/dovecot.pem: No such file or directory /usr/local/etc/rc.d/dovecot: WARNING: failed to start dovecot -------------------------- No big deal, but I don't remember this being an issue the last time I set up a server. You would think if ssl=no, the ssl_cert and ssl_key files would not be opened.

3 2

NOTIFY broken in 2.2.31?
by Bojan Smojver 04 Jul '17

04 Jul '17

Hi, I just updated my Dovecot to the new build in Fedora 26, which is based on 2.2.31. After I did that, Evolution (3.24.3) is no longer receiving notifications about new mail in folders other than inbox (the same version of Evo that worked fine against Dovecot 2.2.30.2). The only folder that still gets notifications is inbox. I see there have been changes to NOTIFY code in this release. What would you like me to send to you in order to debug this problem? When I run Evo with some debugging options turned on, I can see: ---------------- [imapx:B] I/O: 'B00010 NOTIFY SET (selected (MessageNew (UID RFC822.SIZE RFC822.HEADER FLAGS) MessageExpunge FlagChange)) (personal (MessageNew MessageExpunge MailboxName SubscriptionChange))' [imapx:B] I/O: 'B00010 OK NOTIFY completed (0.001 + 0.000 secs).' ---------------- So, notify setting appears to be happening and it looks pretty much the same as it does against version 2.2.30.2. -- Bojan

3 3

dovecot 2.2.31: linking error
by Rupert Gallagher 02 Jul '17

02 Jul '17

-std=gnu99 -mmacosx-version-min=10.12 [...] Undefined symbols for architecture x86_64: "_imapc_client_cmd", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_client_get_capabilities", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_command_sendf", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_simple_callback", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_simple_context_init", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_simple_run", referenced from: _imapc_quota_refresh in quota-imapc.o "_imapc_storage_client_register_untagged", referenced from: _imapc_quota_refresh in quota-imapc.o ld: symbol(s) not found for architecture x86_64 clang-4.0: error: linker command failed with exit code 1 (use -v to see invocation)

5 9

uid '0' from fts_solr?
by Larry Rosenman 01 Jul '17

01 Jul '17

I'm getting lots of: Jun 30 14:41:34 thebighonker dovecot: imap(ler/14135): Error: fts_solr: received invalid uid '0' in my logs. Ideas? doveconf -n: # 2.2.31 (65cde28): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.19 (e5c7051) # OS: FreeBSD 11.1-BETA2 amd64 auth_default_realm = lerctr.org auth_mechanisms = plain login auth_realms = lerctr.org thebighonker.lerctr.org tbh.lerctr.org auth_username_format = %Ln default_vsz_limit = 1 G deliver_log_format = msgid=%m: %$ (subject=%s from=%f size=%w) lda_mailbox_autocreate = yes listen = 192.147.25.65, :: lmtp_save_to_detail_mailbox = yes login_access_sockets = tcpwrap mail_attribute_dict = file:%h/mail/.imap/dovecot-mail-attributes mail_location = mbox:~/mail:INBOX=~/mail/INBOX mail_log_prefix = "%s(%u/%p): " mail_plugins = " fts fts_solr notify stats virtual" mail_privileged_group = mail mail_server_admin = mailto:ler@lerctr.org mail_server_comment = LERCTR Mail Server mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds editheader mboxmetadata servermetadata imapsieve vnd.dovecot.imapsieve namespace archive { hidden = no list = no location = mbox:~/MAIL-ARCHIVE prefix = ARCHIVE/ separator = / } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox INBOX { auto = create } mailbox SENT { special_use = \Sent } mailbox SPAM { special_use = \Junk } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox virtual/Flagged { special_use = \Flagged } mailbox virtual/all { special_use = \All } prefix = } namespace virtual { hidden = no list = yes location = virtual:~/MAIL-VIRTUAL:INDEX=MEMORY prefix = Virtual/ separator = / } passdb { args = failure_show_msg=yes session=yes max_requests=20 driver = pam } plugin { fts = solr fts_autoindex = yes fts_solr = url=http://thebighonker.lerctr.org:8983/solr/dovecot/ fts_tika = http://localhost:9998/tika/ imapsieve_mailbox1_before = file:/usr/local/share/dovecot-pigeonhole/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = SPAM imapsieve_mailbox2_before = file:/usr/local/share/dovecot-pigeonhole/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = SPAM imapsieve_mailbox2_name = * imapsieve_url = sieve://thebighonker.lerctr.org mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename flag_change append mail_log_fields = uid box msgid size from subject vsize flags recipient_delimiter = + sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_execute_bin_dir = /usr/local/share/dovecot-pigeonhole/sieve sieve_extensions = +editheader +vacation-seconds +mboxmetadata +servermetadata sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_pipe_bin_dir = /usr/local/share/dovecot-pigeonhole/sieve sieve_plugins = sieve_imapsieve sieve_extprograms stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_refresh = 5s stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-client { mode = 0666 } unix_listener auth-master { mode = 0666 } } service indexer-worker { drop_priv_before_exec = yes } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } } service stats { chroot = empty client_limit = 0 drop_priv_before_exec = no executable = stats extra_groups = fifo_listener stats-mail { group = mode = 0666 user = } fifo_listener stats-user { group = mode = 0666 user = } group = idle_kill = 4294967295 secs privileged_group = process_limit = 1 process_min_avail = 0 protocol = service_count = 0 type = unix_listener stats { group = mode = 0666 user = } user = $default_internal_user vsz_limit = 18446744073709551615 B } service tcpwrap { unix_listener login/tcpwrap { group = $default_login_user mode = 0600 user = $default_login_user } } ssl_cert = </home/ler/letsencrypt-home/lerctr.org/fullchain.cer ssl_cipher_list = EECDH+ECDSA+AESGCM:EECDH+aRSA+AESGCM:EECDH+ECDSA+SHA384:EECDH+ECDSA+SHA256:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH+AESGCM:EECDH:EDH+AESGCM:EDH+aRSA:HIGH:!MEDIUM:!LOW:!aNULL:!eNULL:!LOW:!RC4:!MD5:!EXP:!PSK:!SRP:!DSS ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { mail_plugins = " fts fts_solr notify stats virtual sieve mail_log" } protocol lda { mail_plugins = " fts fts_solr notify stats virtual sieve mail_log" } protocol pop3 { mail_plugins = " fts fts_solr notify stats virtual mail_log" } protocol !doveadm { mail_plugins = " fts fts_solr notify stats virtual mail_log" } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags imap_logout_format = in=%i out=%o fhc=%{fetch_hdr_count} fhb=%{fetch_hdr_bytes} fbc=%{fetch_body_count} fbb=%{fetch_body_bytes} del=%{deleted} exp=%{expunged} trash=%{trashed} imap_metadata = yes mail_max_userip_connections = 50 mail_plugins = " fts fts_solr notify stats virtual mail_log imap_sieve imap_stats stats" } -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Auth Policy Server
by Daniel Miller 01 Jul '17

01 Jul '17

I've made a preliminary auth policy server in Perl - and it sort of works (mostly) - but I've got some questions on "proper" implementation. It appears the communication is HTTP based - is the intent to talk to a "proper" webserver, or is a simple dedicated daemon appropriate (which is what I made)? Should connections be maintained, or terminated after each response (which is my current setup)? If my implementation is correct, I may have found a bug, as I have some log entries like: Jun 30 08:24:20 bubba dovecot: imap-login: Warning: Auth connection closed with 1 pending requests (max 31 secs, pid=10253, EOF) Jun 30 08:24:20 bubba dovecot: auth: Fatal: master: service(auth): child 31631 killed with signal 11 (core dumped) Guidance would be appreciated. -- Daniel

2 3

imapc making too any connections
by van der Kamp, John 30 Jun '17

30 Jun '17

Hi, I was testing around with 2.2.31, and saw that it made new extra connections to the backend imap server whenever you make a new mailbox. So client does: A001 login username password A002 create subfolder Previously, dovecot would just send the create command to the backend, but now does (including connection IDs): [conn1] 9 CREATE "subfolder" [conn1] 10 EXAMINE "INBOX" [conn2] 12 LOGIN "username" "password" [conn2] 11 SELECT "subfolder" The new EXAMINE Command is a bit weird, but the secondary connection is a complete waste. I also haven't seen any other action on it yet, but it's kept around. If you make more mailboxes, every time you gain an extra connection from dovecot to the backend imap server. And they all stick around. I don't know which changes this behavior triggered, there were loads of imapc fixes the last couple of releases. John

2 1

sieve/vacation: bad parsing of 'References' header
by Krzysztof Witek 30 Jun '17

30 Jun '17

Hello there, I see a strange behavior in the sieve plugin. If I send an email containing the 'References' field with multiple values like this: References: <56CF3A8E.3060603(a)email.com> <74cc03f4-899f-e76f-81ea-d0e8a0efce9e(a)email.com> <CY1PR1001MB11630EC0D1DD48FBB12DDAC1DE090(a)CY1PR1001MB1163.namprd10.prod.outlook.com> <db3ee17f-33eb-b15c-8599-60b6dfa623e0(a)email.com> <YTXPR01MB01112EB28C7BECB5A5EF14C5DEE10(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <734f9013-c4a2-eab4-9c0d-2cfc3deafaee(a)email.com> <YTXPR01MB0111660D7D5A73451F3E5B66DEE00(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <9e3e3c00-a0d8-c061-7c7e-20e660533264(a)email.com> <e702bae4-b1d1-6671-fa74-87349282ce46(a)email.com> <YTXPR01MB01119930E4D876F91008D465DE3A0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <69c6be47-b17f-9f9a-5a0c-f389c6877f82(a)email.com> <YTXPR01MB01116BC86CBA49677A29C607DE3A0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <YTXPR01MB0111564E38C21BB293DCAE97DECA0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <YTXPR01MB01117A258CD09E1E84A1CBC1DECA0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> The vacation sieve script will add extra line breaks into the reply email as follows: References: <56CF3A8E.3060603(a)email.com> <74cc03f4-899f-e76f-81ea-d0e8a0efce9e(a)email.com> <CY1PR1001MB11630EC0D1DD48FBB12DDAC1DE090(a)CY1PR1001MB1163.namprd10.prod.outlook.com> <db3ee17f-33eb-b15c-8599-60b6dfa623e0(a)email.com> <YTXPR01MB01112EB28C7BECB5A5EF14C5DEE10(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <734f9013-c4a2-eab4-9c0d-2cfc3deafaee(a)email.com> <YTXPR01MB0111660D7D5A73451F3E5B66DEE00(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <9e3e3c00-a0d8-c061-7c7e-20e660533264(a)email.com> <e702bae4-b1d1-6671-fa74-87349282ce46(a)email.com> <YTXPR01MB01119930E4D876F91008D465DE3A0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <69c6be47-b17f-9f9a-5a0c-f389c6877f82(a)email.com> <YTXPR01MB01116BC86CBA49677A29C607DE3A0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <YTXPR01MB0111564E38C21BB293DCAE97DECA0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <YTXPR01MB01117A258CD09E1E84A1CBC1DECA0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <d0e5c311-bc89-c085-d597-f3a5744edd59(a)email.com> The problem is this is rendered as follows in the email client (this is what a user will see when he/she receives the auto reply): <CY1PR1001MB11630EC0D1DD48FBB12DDAC1DE090(a)CY1PR1001MB1163.namprd10.prod.outlook.com> <db3ee17f-33eb-b15c-8599-60b6dfa623e0(a)email.com> <YTXPR01MB01112EB28C7BECB5A5EF14C5DEE10(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <734f9013-c4a2-eab4-9c0d-2cfc3deafaee(a)email.com> <YTXPR01MB0111660D7D5A73451F3E5B66DEE00(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <9e3e3c00-a0d8-c061-7c7e-20e660533264(a)email.com> <e702bae4-b1d1-6671-fa74-87349282ce46(a)email.com> <YTXPR01MB01119930E4D876F91008D465DE3A0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <69c6be47-b17f-9f9a-5a0c-f389c6877f82(a)email.com> <YTXPR01MB01116BC86CBA49677A29C607DE3A0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <YTXPR01MB0111564E38C21BB293DCAE97DECA0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <YTXPR01MB01117A258CD09E1E84A1CBC1DECA0(a)YTXPR01MB0111.CANPRD01.PROD.OUTLOOK.COM> <d0e5c311-bc89-c085-d597-f3a5744edd59(a)email.com> Auto-Submitted: auto-replied (vacation) Precedence: bulk MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit I am on holydays right now. I will revert to you ASAP..... I can reproduce this bug on the version 2.2.9 of managersieve/dovecot. Does anyone know how to fix this? Thank you. Krzysztof Witek

3 9