- dovecot - dovecot.org

"search return (min)" is very inefficient
by Jesus Cea 13 Feb '18

13 Feb '18

RFC 4731: " IMAP4 Extension to SEARCH Command for Controlling What Kind of Information Is Returned" https://tools.ietf.org/html/rfc4731 I do this (telnet session): """ a select proveedores/TUHS * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft \*)] Flags permitted. * 8330 EXISTS * 0 RECENT * OK [UNSEEN 6085] First unseen. * OK [UIDVALIDITY 1395814416] UIDs valid * OK [UIDNEXT 8358] Predicted next UID * OK [HIGHESTMODSEQ 3149] Highest a OK [READ-WRITE] Select completed (0.264 + 0.000 + 0.263 secs). a search return (min) since 01-Feb-2018 * ESEARCH (TAG "a") MIN 8156 a OK Search completed (59.451 + 0.000 + 59.450 secs). """ Note that it needs 59 seconds to locate the first message matching the "since" criteria. This is really slow and unusable in practice. Things are worse with bigger mailboxes, of course. Am I missing some performance trick?. I am trying to locate the first message received after a particular date. I don't use the "date" header because it can be falsified and because I care about the receiving date and not the actual sending date. I guess dovecot is scanning every message in the folder (mailbox). Wouldn't those messages be stored in ascending "received" order?. Could that be used for bisection search to locate the right message?. Could that break if I copy/move/edit messages?. Is that the reason for such a awful performance?. Suggestions?. Thanks for your time and knowledge!. -- Jesús Cea Avión _/_/ _/_/_/ _/_/_/ jcea(a)jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea@jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz

1 0

mailbox_list_index documentation?
by tai74＠vfemail.net 12 Feb '18

12 Feb '18

I find mailbox_list_index on some doc pages, but not explaination to find what precisely it does? Would someone care to mind explain? Thank you! ------------------------------------------------- ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the NSA's hands! $24.95 ONETIME Lifetime accounts with Privacy Features! 15GB disk! No bandwidth quotas! Commercial and Bulk Mail Options!

2 1

New mail notification
by Matthew Allen 12 Feb '18

12 Feb '18

Hi, So I'm running dovecot 1.2.17 on Mac OSX using maildir in ~/Mail. After using getmail for a while to download my POP3 email and store it in the right place it started not working so I replaced it with a python script that I wrote. All was good for a while and then I stopped getting new mail notifications in my IMAP client. If I close the connection and restart the new mail shows up as !seen but no amount of re-selecting the folder will show the new mail while the connection is active. There is no untagged responses about new mail while the client is IDLEing. The client is InScribe (http://memecode.com/inscribe.php) but I doubt it's client specific. Seems to be server related. Now the python script in question just puts the .eml file in ~/Mail/tmp and then renames it to the ~/Mail/new folder. Does it need to do something else as well to make the notifications work? There aren't any error messages in the log. Just normal login history. If you can point me in the right direction that'd be appreciated. Regards

2 1

Best mail encryption solution for per-user
by tai74＠vfemail.net 11 Feb '18

11 Feb '18

Hai, Do you have advice about Dovecot plugins for mail encryption: https://wiki2.dovecot.org/Plugins/MailCrypt https://0xacab.org/riseuplabs/trees I like NaCL based encryption but the MailCrypt plugin is better because it's maintained by Dovecot developers (is this correct?) Hard to understand MailCrypt docs so may I ask, may I provide per user encryption? I don't like global because I want every user to have different encryption based on their password. But I don't see the useful of per-folder encryption. Docs for TREES are easier to understand it will work on a per-user encryption using the user password to decrypt the needed keys. How about indexing? Does native fast Dovecot indexing must be turned off for one of these or both? Is this a big performance hit? And how to turn off indexing on a per-user basis? Thank you so very mcuh ------------------------------------------------- ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the NSA's hands! $24.95 ONETIME Lifetime accounts with Privacy Features! 15GB disk! No bandwidth quotas! Commercial and Bulk Mail Options!

2 5

LDAP userdb and dovecot LDA/LMTP - different requirements
by Franta Hanzlík 10 Feb '18

10 Feb '18

Hi, I want to use Dovecot LDA (or rather LMTP) use as local deliver with Postfix MTA. Users are in LDAP DB with structure as: dn: cn=username, ou=rank, o=myorg cn: username objectClass: Person gidNumber: uNNN uidNumber: gNNN userPassword: (somehow hashed, can only bind verification) homeDirectory: /Home/$rank/$username mailActive: 0/1 mail: usera@OneDomain mail: userb@SecDomain (not all users have 2+ addresses] uid: username groupMembership: group DN (can be multiple times for different groups) ... where: - cn = uid = expected IMAP login username (which hasn't @domain part) - user1 (and user2) isn't always same as username Now I not know, how to solve IMO diferent requirements to userdb: - LDA/LMTP need LDAP userdb unit, that can retrieve the name from an email address (ie for "usera@myDomain" returns cn/uid (as dovecot "username"). - IMAP server need LDAP userdb unit, that will have the user login (username) as the input parameter, and which returns information whether or not the user exists. Can be these different requirements solved in one userdb unit? Or is it possible to have one userdb unit for LDA/LMTP, and another one for IMAP and other Dovecot components? I have also encountered entries getting the values from LDAP userdb in the form as: user_attrs = \ =user=%{ldap:uid}, \ @mail=base(%{ldap:mailDN}), \ =uid=%{ldap:uidNumber@mail}, \ =gid=%{ldap:gidNumber@mail}, \ =home=%{ldap:rootPath@mail}/%d/%n or user_attrs = \ =home=%{ldap:homeDirectory}, \ =uid=%{ldap:uidNumber}, =gid=%{ldap:gidNumber}, =quota_rule=*:bytes=%{ldap:quotaBytes}, =namespace/default/separator=%{ldap:mailSeparator} Can anyone explain how these constructions work? And what do mean attribute notations in the form '=attr=' or '@attr=' or 'quota_rule=*:storage=100M' ? Nowhere have I found a sufficiently comprehensible description of these constructions... Help very much appreciated. Thanks, Franta Hanzlik

2 2

doveadm mailbox delete: Wrong docs or bug?
by MRob 09 Feb '18

09 Feb '18

Uhhhhh?? doveadm mailbox delete -u myuser -r -s foldername mailbox: invalid option -- 'r' Docs say -r is recursive. So how do I delete recursive mailbox?? https://wiki2.dovecot.org/Tools/Doveadm/Mailbox

1 0

VarExpandCrypt plugin usecase
by tai74＠vfemail.net 09 Feb '18

09 Feb '18

Hai, I found VarExpandCrypt plugin but not sure the usecase? Somewhere is more documentation for it? https://wiki2.dovecot.org/Plugins/VarExpandCrypt ------------------------------------------------- ONLY AT VFEmail! - Use our Metadata Mitigator to keep your email out of the NSA's hands! $24.95 ONETIME Lifetime accounts with Privacy Features! 15GB disk! No bandwidth quotas! Commercial and Bulk Mail Options!

2 1

Bounced message after update
by Michael A. Peters 09 Feb '18

09 Feb '18

Hi - Updated from 2.2.27 to 2.3.0 server is webmail (roundcube) Sending worked before after update. Now it receives, but trying to send - this is the bounce in the log Feb 9 01:37:45 {hostname} postfix/pipe[22891]: 931FD2577: to=<{user}(a){hostname}.{tld}>, relay=dovecot, delay=0.01, delays=0/0/0/0, dsn=5.3.0, status=bounced (command line usage error. Command output: lda: Fatal: Invalid -f parameter: Missing domain ) Feb 9 01:37:45 deviant postfix/qmgr[16492]: 931FD2577: removed {hostname}, {user}, {tld} are substitutions. Here's my lda config: protocol lda { log_path = /home/{hostname}/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmaster(a){hostname}.{tld} } Any suggestions (other than reverting) ? This worked just before the update. If it matters, Roundcube 1.3.4

1 1

How to grant user access to his .dovecot.sieve.log?
by Sergey Ivanov 08 Feb '18

08 Feb '18

Hi, What are the recommended ways to give access to their .dovecot.sieve.log messages to the users? I am thinking about placing this file into users Maildir/new, or piping to dovecot-lda. -- Regards, Sergey Ivanov

3 6

Dovecot 2.3.0 assertion failure on LMTP delivery
by J. Nick Koston 08 Feb '18

08 Feb '18

Hi, We are seeing a frequent assertion failure on LMTP delivery with 2.3.0. This only appears to happen on CentOS/RHEL 7. Jan 24 08:30:58 smoker-devautomerge-c7-1 dovecot: lmtp(29540): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 08:30:58 smoker-devautomerge-c7-1 dovecot: lmtp(29540): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xc8ec4) [0x7f226d036ec4] -> /usr/lib64/dovecot/libdovecot.so.0(+0xc8f7e) [0x7f226d036f7e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f226cfaa190] -> /usr/lib64/dovecot/libdovecot.so.0(+0xe469b) [0x7f226d05269b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_storage_service_user_unref+0xb4) [0x7f226d334b64] -> dovecot/lmtp(+0x63fa) [0x56438f3673fa] -> dovecot/lmtp(lmtp_local_deinit+0x5c) [0x56438f3678dc] -> dovecot/lmtp(client_state_reset+0x1a) [0x56438f366a5a] -> /usr/lib64/dovecot/libdovecot.so.0(smtp_server_connection_reset_state+0x3c) [0x7f226cfc196c] -> /usr/lib64/dovecot/libdovecot.so.0(smtp_server_command_completed+0x4d) [0x7f226cfbf31d] -> /usr/lib64/dovecot/libdovecot.so.0(+0x54848) [0x7f226cfc2848] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf0970) [0x7f226d05e970] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f226d04e4b5] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10f) [0x7f226d04fd8f] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) [0x7f226d04e5b2] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f226d04e7d8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f226cfccbb3] -> dovecot/lmtp(main+0x226) [0x56438f3661a6] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f226cbccc05] -> dovecot/lmtp(+0x52d5) [0x56438f3662d5] Jan 24 08:30:58 smoker-devautomerge-c7-1 dovecot: lmtp(29540): Fatal: master: service(lmtp): child 29540 killed with signal 6 (core dumps disabled) From the exim log: 'LOG: MAIN cwd=/usr/local/cpanel 3 args: /usr/sbin/sendmail -v bob(a)l56ob1nf.cptestLOG: MAIN <= root(a)smoker-devautomerge-c7-2.dev.cpanel.net U=root P=local S=3146285 T="Ignore this test from Cpanel-Email-Message-Retrieve.t"LOG: MAIN cwd=/var/spool/exim 4 args: /usr/sbin/exim -v -Mc 1eemjH-0006uB-C2delivering 1eemjH-0006uB-C2 LMTP<< 220 smoker-devautomerge-c7-2.dev.cpanel.net Dovecot ready. LMTP>> LHLO smoker-devautomerge-c7-2.dev.cpanel.net LMTP<< 250-smoker-devautomerge-c7-2.dev.cpanel.net LMTP<< 250-8BITMIME LMTP<< 250-CHUNKING LMTP<< 250-ENHANCEDSTATUSCODES LMTP<< 250-PIPELINING LMTP<< 250-STARTTLS LMTP<< 250-VRFY LMTP<< 250 XCLIENT ADDR PORT PROTO HELO LOGIN TTL TIMEOUT LMTP>> MAIL FROM:<root(a)smoker-devautomerge-c7-2.dev.cpanel.net> LMTP<< 250 2.1.0 OK LMTP>> RCPT TO:<bob(a)l56ob1nf.cptest> LMTP<< 250 2.1.5 OK LMTP>> DATA LMTP<< 354 OK LMTP>> writing message and terminating "." LMTP>> QUIT LOG: MAIN == bob(a)l56ob1nf.cptest R=virtual_user T=dovecot_virtual_delivery defer (-1): LMTP connection closed after end of data’, Jan 24 10:00:55 smoker-devautomerge-c7-1 dovecot: lmtp(30217): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:00:55 smoker-devautomerge-c7-1 dovecot: lmtp(30233): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:15 smoker-devautomerge-c7-1 dovecot: lmtp(32618): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:52 smoker-devautomerge-c7-1 dovecot: lmtp(375): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:52 smoker-devautomerge-c7-1 dovecot: lmtp(403): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:52 smoker-devautomerge-c7-1 dovecot: lmtp(424): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 10:05:52 smoker-devautomerge-c7-1 dovecot: lmtp(430): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 12:32:16 smoker-devautomerge-c7-1 dovecot: lmtp(4435): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 12:54:53 smoker-devautomerge-c7-1 dovecot: lmtp(15232): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 12:54:53 smoker-devautomerge-c7-1 dovecot: lmtp(15238): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) Jan 24 12:54:53 smoker-devautomerge-c7-1 dovecot: lmtp(15244): Panic: file lib-event.c: line 148 (event_unref): assertion failed: (event != current_global_event) doveconf -n: # 2.3.0 (c8b89eb): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-693.2.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) auth_cache_size = 1 M auth_mechanisms = plain login auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" disable_plaintext_auth = no first_valid_uid = 201 lda_mailbox_autocreate = yes lmtp_rcpt_check_quota = yes lmtp_save_to_detail_mailbox = yes lmtp_user_concurrency_limit = 4 mail_access_groups = dovecot mail_plugins = quota quota_clone zlib mail_prefetch_count = 20 maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = create special_use = \Junk } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict result_failure = return-fail } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword skip = authenticated } plugin { acl = vfile:cache_secs=86400 quota_exceeded_message = Mailbox is full / Blocks limit exceeded / Inode limit exceeded } protocols = lmtp imap pop3 service auth { unix_listener auth-client { mode = 0666 } } service config { vsz_limit = 2 G } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { client_limit = 500 inet_listener imap { address = *,:: } inet_listener imaps { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 512 vsz_limit = 512 M } service lmtp { client_limit = 1 process_limit = 500 unix_listener lmtp { group = mail mode = 0660 user = mailnull } vsz_limit = 512 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service managesieve { process_limit = 512 vsz_limit = 512 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = *,:: } inet_listener pop3s { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 512 vsz_limit = 512 M } service quota-status { executable = quota-status -p postfix unix_listener quota-status { mode = 0666 } } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256 ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = prefetch } userdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 20 mail_plugins = acl quota imap_quota zlib imap_zlib quota_clone virtual namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u/sent prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u/spam prefix = spam separator = . } } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota quota quota_clone virtual zlib namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u/sent prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u/spam prefix = spam separator = . } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lmtp { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } protocol lda { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } local_name smoker-devautomerge-c7-1.dev.cpanel.net { ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_key = # hidden, use -P to show it }

3 3