May 2017 - dovecot - dovecot.org

Re: v2.2.30 released
by Joseph Tam 31 May '17

31 May '17

Timo Sirainen announced > + If dovecot.index.cache corruption is detected, reset only the one > corrupted mail instead of the whole file. Is this a big performance win? I still have users with jumbo mailboxes who insist on direct mailbox file access using procmail or mail readers, which trigger index rebuilds when dovecot accesses them. Joseph Tam <jtam.home(a)gmail.com>

2 1

mailserver.users does not exist
by Amaechi Janneh 31 May '17

31 May '17

Hello. It appears that I have an issue with my dovecot setup. When trying to authenticate, i get this error: May 28 20:18:26 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10879, TLS, ses...QOQBg9rlR> May 28 20:18:42 AmaechiJ dovecot[10516]: imap(aj(a)example.com): Connection closed in=116 out=1311 May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Warning: mysql: Query failed, retrying: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Error: sql( aj(a)example.com,): User query failed: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10894, TLS, ses...QZwBg9rlR> But I already have the users data under virtual_users. So what should I do? Regards, Amaechi Janneh

2 1

Re: SSL problem - no banner
by Joseph Tam 30 May '17

30 May '17

Marcio Merlone <marcio.merlone(a)a1.ind.br> writes: > Only openssl s_client -connect localhost:993 works fine and fast, while > all MUA's and telnet does not. Telnet timeouts waiting for banner after > a minute or so: > > root@netuno:~# openssl s_client -connect localhost:993 > ... > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready. > ... > root@netuno:~# telnet localhost 993 > Trying 127.0.0.1... > Connected to localhost. > Escape character is '^]'. > (about 1 minute later...) > Connection closed by foreign host. You misundertand how SSL (or TLS) vs STARTTLS works. SSL/TLS (on port 993) starts negotiating a secure session protocol right after connection, which involves binary exchange of data, certificates, etc.. This is what "openssl s_client ..." does, but telnet does not. Only after the SSL handshake completes will you get banners, etc. STARTTLS starts out as a unencrypted session and thus, you'll get the initial banner. The client is then expected to initiate a secure session by issuing a STARTTLS directive, whereupon client and server starts the secure session negotiation like above. To test this, you would use openssl s_client -starttls imap -connect localhost:143 So telnet doesn't work because it does not do SSL. Your MUA don't work because of the same misunderstanding, or there's some network issue at play. You need to align your clients to use the security protocol you've enabled. Joseph Tam <jtam.home(a)gmail.com>

1 0

Fatal error with IMAP MOVE from a shared mailbox to Trash folder
by Daniele Barresi 30 May '17

30 May '17

Hello everyone. I have a problem using Dovecot 2.2.26 with ACL plugin and deleting e-mails from a shared mailbox. My user doesn't have the "expunge" permission on the shared mailbox, but it has the "write-deleted" permission. So, when I delete a message from the shared mailbox using a client that implements the IMAP MOVE command, it tries to move the message to my Trash folder. Then the server closes the connection to the client (process aborted) and I get three lines in the log file with a backtrace and "Fatal" error. In this case the message doesn't get copied or moved from the shared folder and the client complaints. I found the same thing happens whenever I try to move anything between folders of the shared mailbox itself, while logged in with my user. I can move messages inside my own mailbox just fine. If I try the same operation from a client that uses the IMAP COPY + DELETE commands, no errors are logged and the outcome is as expected: the message gets copied from the shared folder to my Trash and gets the flag "\Deleted" set on the shared folder. My setup is as follows: Dovecot: 2.2.26.0 OS: Ubuntu 16.04.1 LTS CPU architecture: x86_64 Filesystem: ext4 The relevant lines from mail.err log: Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Panic: file mail-storage.c: line 2143 (mailbox_save_context_reset): assertion failed: (ctx->copying_via_save) Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x9438e) [0x7fbcd478538e] -> /usr/lib/dovecot/libdovecot.so.0(+0x9447c) [0x7fbcd478547c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbcd471ea4e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x41b78) [0x7fbcd4a50b78] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x73) [0x7fbcd4a53d73] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(+0xe142) [0x7fbcd3f1d142] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x4516d) [0x7fbcd4a5416d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x23) [0x7fbcd4a54333] -> dovecot/imap(+0xf9c5) [0x557cf98629c5] -> dovecot/imap(command_exec+0xa6) [0x557cf986f196] -> dovecot/imap(+0x1a4c2) [0x557cf986d4c2] -> dovecot/imap(+0x1a550) [0x557cf986d550] -> dovecot/imap(client_handle_input+0x195) [0x557cf986d915] -> dovecot/imap(client_input+0x85) [0x557cf986de25] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fbcd4799bdc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10a) [0x7fbcd479b09a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fbcd4799c65] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fbcd4799e08] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fbcd4724f53] -> dovecot/imap(main+0x322) [0x557cf9860ca2] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7fbcd4348830] -> dovecot/imap(+0xde1f) [0x557cf9860e1f] Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Fatal: master: service(imap): child 6907 killed with signal 6 (core dumped) Dovecot configuration (doveadm -n): # 2.2.26.0 (23d1de6): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.4.0-57-generic x86_64 Ubuntu 16.04.1 LTS auth_cache_negative_ttl = 10 mins auth_cache_size = 2 M auth_master_user_separator = * auth_mechanisms = plain login first_valid_uid = 12 last_valid_uid = 12 mail_location = maildir:~/Maildir mail_plugins = acl quota notify mail_log stats lazy_expunge managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace casellecondivise { list = children location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%u prefix = Caselle condivise/%%u/ separator = / subscriptions = no type = shared } namespace expunged { hidden = yes list = no location = maildir:/var/expunged/%n/Expunged prefix = EXPUNGED/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/etc/dovecot/shared/shared-mailboxes lazy_expunge = EXPUNGED/ lazy_expunge_only_last_instance = yes mail_log_events = delete copy flag_change save undelete expunge mail_log_fields = uid box msgid size quota = maildir:user quota quota_exceeded_message = (Quota exceeded) La casella di posta elettronica del destinatario è piena. quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=100%% quota-warning 100 %u sieve = file:~/sieve;active=~/.dovecot.sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 32 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } protocols = " imap sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0666 user = postfix } unix_listener auth-userdb { group = mail user = mail } } service dict { unix_listener dict { group = mail mode = 0600 user = mail } } service imap-login { process_limit = 300 process_min_avail = 2 } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { group = mail user = mail } } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl = required ssl_cert = </etc/ssl/certs/pac.apg23.org.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext default_fields = uid=mail gid=mail home=/var/mail/%u master_user=%u driver = sql } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = uid=mail gid=mail home=/var/mail/%u master_user=%u driver = ldap } protocol lda { mail_plugins = acl quota notify mail_log stats lazy_expunge sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = acl quota notify mail_log stats lazy_expunge imap_quota imap_stats } I tested this with different users with the same result. I tested and reproduced the error with Thunderbird and Roundcube. The Apple Mail client uses IMAP COPY + DELETE, instead of IMAP MOVE, and no errors are reported. So I think it's related to the IMAP MOVE implementation on Dovecot server. Has anyone seen the same error? Any suggestions? Is this a Dovecot bug? --- Daniele Barresi

3 4

virtual folder: how to store in mysql?
by dovecot＠avv.solutions 30 May '17

30 May '17

Hello Community, Now that virtual folders seem to work fine, I stil lhave 2 questions : 1° Is it possible to store the virtual folder definition (aka content of Folder/dovecot-virtual) in mysql? 2° I have duplicates in my "Unseen", which both correctly disappear once handled one of them Example: !Inbox * -Inbox (tried this but does not succeed -Trash -Trash/* Public/* Unseen 2°bis :) I tried to put the "common defs" in a shared folder (/etc/dovecot/virtual) using personal index location = virtual:/etc/dovecot/virtual:INDEX=/sd/MAIL_IMAP_POP/%d/%n/__Virtual/ This does not work, I have to *copy* (even symlinks do not succeed) the definitions and use location = virtual:/sd/MAIL_IMAP_POP/%d/%n/__Virtual:INDEX=/sd/MAIL_IMAP_POP/%d/%n/__Virtual/ I already tried to set perms on /etc/dovecot/virtual to: vmail.vmail rw(x)------ Thank you! Cheers

1 0

Question about how to serve many imap users on some mailbox.
by Oleksandr Lystopad 30 May '17

30 May '17

Hi, dear dovecot users! I am running 2.2.29.1 (e0b76e3) on FreeBSD. In my case, one mailbox info(a)example.com is shared between 5-10 managers. Sometimes they complains that no new messages displayed in folder message count list in brackets (bold number if new messages exists), but when they click on the imap folder (for example Inbox) they could see many new mails. There not only Inbox folder, they have 10-30 folders with quite big flow of new messages. Almost all users are using Microsoft Outlook MUA. Please, help me to solve the issue. My config could be found bellow (dovecot -n): auth_failure_delay = 12 secs auth_mechanisms = login cram-md5 plain auth_verbose = yes disable_plaintext_auth = no first_valid_gid = 26 first_valid_uid = 26 lda_mailbox_autocreate = yes listen = * login_greeting = imap/pop mailserver ready mail_location = maildir:~/Maildir mail_max_userip_connections = 50 mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } protocols = pop3 imap sieve service auth { unix_listener auth-client { group = mailnull mode = 0600 user = mailnull } unix_listener auth-login { group = mailnull mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mailnull mode = 0600 user = mailnull } unix_listener auth-userdb { group = mailnull mode = 0600 user = mailnull } user = root } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } service imap { process_limit = 512 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 } } service pop3 { process_limit = 512 } ssl_cert = </usr/local/etc/SSL/my.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep } protocol lda { mail_plugins = sieve }

2 1

MySQL issue
by Amaechi Janneh 30 May '17

30 May '17

Hello. It appears that I have an issue with my dovecot setup. When trying to authenticate, i get this error: May 28 20:18:26 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10879, TLS, ses...QOQBg9rlR> May 28 20:18:42 AmaechiJ dovecot[10516]: imap(aj(a)example.com): Connection closed in=116 out=1311 May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Warning: mysql: Query failed, retrying: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Error: sql( aj(a)example.com,): User query failed: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10894, TLS, ses...QZwBg9rlR> But I already have the users data under virtual_users. So what should I do? Regards, Amaechi Janneh I am running dovecot 2.2.13 Debian 8

3 4

Can only enable Sieve scripts not edit them (Roundcube)
by Paul Littlefield 29 May '17

29 May '17

Hello, (my first post so be gentle) I will be posting this to the Roundcube mailing list too, but thought it worth asking here as well. I have a Roundcube installation running Apache with Dovecot and Sieve. When logged in to Roundcube, a user can see the Sieve scripts and enable or disable them but NOT edit them or create new scripts. In other words, Dovecot will happily EDIT the script to mark it as 'false' but will not edit the actual rules or create a new rule... e.g. require ["fileinto","vacation"]; # rule:[Out of Office] if false # true { vacation :days 1 :addresses "me(a)mydomain.com" :subject "Out of Office" :from "me(a)mydomain.com" "I am out of the office."; } # rule:[Spam] if header :contains "subject" "{Spam}" { fileinto "Spam"; } Any ideas? Thanks, -- Paul Littlefield

3 3

user-defined special-use folders
by Fabian Schmidt 29 May '17

29 May '17

I plan to define SPECIAL-USE mailboxes and think about defining per user special-use folders for those who don't use the default folder names. Is this possible in dovecot? What I try: $ doveadm exec imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SEARCH=FUZZY METADATA SPECIAL-USE] Logged in as fschmidt a1 SETMETADATA "sent-mail" (/private/specialuse "\\Sent") a1 NO [CANNOT] The /private/specialuse attribute cannot be changed (0.008 + 0.000 + 0.008 secs). using dovecot 2.2.29.1, following the example in RFC 6154, sect. 5.4 (How is MAIL_ATTRIBUTE_INTERNAL_RANK_AUTHORITY defined or set?) Fabian.

2 1

When will passdb callback to mechanism yield PASSDB_RESULT_NEXT?
by Peter Mogensen 29 May '17

29 May '17

Hi, code question... I've been trying to figure out the implications of the new "noauthenticate" passdb field. Internally it causes a passdb to result in PASSDB_RESULT_NEXT. When a SASL mechanism calls auth_request_lookup_credentials(...,callback) the passdb result is passed to the callback. But I can't really figure out when that result will ever be PASSDB_RESULT_NEXT. It seems the passdb fallthrough resolver will always replace it with PASSDB_RESULT_INTERNAL_FAILURE if it ends up being the last result. Can it ever leak into the callback or is it an internal intermediate value or the passdb resolver? /Peter

2 1