- dovecot - dovecot.org

Fatal error with IMAP MOVE from a shared mailbox to Trash folder
by Daniele Barresi 30 May '17

30 May '17

Hello everyone. I have a problem using Dovecot 2.2.26 with ACL plugin and deleting e-mails from a shared mailbox. My user doesn't have the "expunge" permission on the shared mailbox, but it has the "write-deleted" permission. So, when I delete a message from the shared mailbox using a client that implements the IMAP MOVE command, it tries to move the message to my Trash folder. Then the server closes the connection to the client (process aborted) and I get three lines in the log file with a backtrace and "Fatal" error. In this case the message doesn't get copied or moved from the shared folder and the client complaints. I found the same thing happens whenever I try to move anything between folders of the shared mailbox itself, while logged in with my user. I can move messages inside my own mailbox just fine. If I try the same operation from a client that uses the IMAP COPY + DELETE commands, no errors are logged and the outcome is as expected: the message gets copied from the shared folder to my Trash and gets the flag "\Deleted" set on the shared folder. My setup is as follows: Dovecot: 2.2.26.0 OS: Ubuntu 16.04.1 LTS CPU architecture: x86_64 Filesystem: ext4 The relevant lines from mail.err log: Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Panic: file mail-storage.c: line 2143 (mailbox_save_context_reset): assertion failed: (ctx->copying_via_save) Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x9438e) [0x7fbcd478538e] -> /usr/lib/dovecot/libdovecot.so.0(+0x9447c) [0x7fbcd478547c] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbcd471ea4e] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x41b78) [0x7fbcd4a50b78] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_cancel+0x73) [0x7fbcd4a53d73] -> /usr/lib/dovecot/modules/lib01_acl_plugin.so(+0xe142) [0x7fbcd3f1d142] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x4516d) [0x7fbcd4a5416d] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x23) [0x7fbcd4a54333] -> dovecot/imap(+0xf9c5) [0x557cf98629c5] -> dovecot/imap(command_exec+0xa6) [0x557cf986f196] -> dovecot/imap(+0x1a4c2) [0x557cf986d4c2] -> dovecot/imap(+0x1a550) [0x557cf986d550] -> dovecot/imap(client_handle_input+0x195) [0x557cf986d915] -> dovecot/imap(client_input+0x85) [0x557cf986de25] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fbcd4799bdc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x10a) [0x7fbcd479b09a] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fbcd4799c65] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fbcd4799e08] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fbcd4724f53] -> dovecot/imap(main+0x322) [0x557cf9860ca2] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0) [0x7fbcd4348830] -> dovecot/imap(+0xde1f) [0x557cf9860e1f] Dec 27 15:21:18 dovecot dovecot: imap(danielebarresi): Fatal: master: service(imap): child 6907 killed with signal 6 (core dumped) Dovecot configuration (doveadm -n): # 2.2.26.0 (23d1de6): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 (fed8554) # OS: Linux 4.4.0-57-generic x86_64 Ubuntu 16.04.1 LTS auth_cache_negative_ttl = 10 mins auth_cache_size = 2 M auth_master_user_separator = * auth_mechanisms = plain login first_valid_uid = 12 last_valid_uid = 12 mail_location = maildir:~/Maildir mail_plugins = acl quota notify mail_log stats lazy_expunge managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace casellecondivise { list = children location = maildir:%%h/Maildir:INDEXPVT=~/Maildir/shared/%%u prefix = Caselle condivise/%%u/ separator = / subscriptions = no type = shared } namespace expunged { hidden = yes list = no location = maildir:/var/expunged/%n/Expunged prefix = EXPUNGED/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { acl = vfile:/etc/dovecot/global-acls:cache_secs=300 acl_shared_dict = file:/etc/dovecot/shared/shared-mailboxes lazy_expunge = EXPUNGED/ lazy_expunge_only_last_instance = yes mail_log_events = delete copy flag_change save undelete expunge mail_log_fields = uid box msgid size quota = maildir:user quota quota_exceeded_message = (Quota exceeded) La casella di posta elettronica del destinatario è piena. quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=100%% quota-warning 100 %u sieve = file:~/sieve;active=~/.dovecot.sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 32 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } protocols = " imap sieve" service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0666 user = postfix } unix_listener auth-userdb { group = mail user = mail } } service dict { unix_listener dict { group = mail mode = 0600 user = mail } } service imap-login { process_limit = 300 process_min_avail = 2 } service managesieve-login { inet_listener sieve { port = 4190 } } service quota-warning { executable = script /etc/dovecot/scripts/quota-warning.sh unix_listener quota-warning { group = mail user = mail } } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl = required ssl_cert = </etc/ssl/certs/pac.apg23.org.pem ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-sql.conf.ext default_fields = uid=mail gid=mail home=/var/mail/%u master_user=%u driver = sql } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext default_fields = uid=mail gid=mail home=/var/mail/%u master_user=%u driver = ldap } protocol lda { mail_plugins = acl quota notify mail_log stats lazy_expunge sieve } protocol imap { mail_max_userip_connections = 25 mail_plugins = acl quota notify mail_log stats lazy_expunge imap_quota imap_stats } I tested this with different users with the same result. I tested and reproduced the error with Thunderbird and Roundcube. The Apple Mail client uses IMAP COPY + DELETE, instead of IMAP MOVE, and no errors are reported. So I think it's related to the IMAP MOVE implementation on Dovecot server. Has anyone seen the same error? Any suggestions? Is this a Dovecot bug? --- Daniele Barresi

3 4

virtual folder: how to store in mysql?
by dovecot＠avv.solutions 30 May '17

30 May '17

Hello Community, Now that virtual folders seem to work fine, I stil lhave 2 questions : 1° Is it possible to store the virtual folder definition (aka content of Folder/dovecot-virtual) in mysql? 2° I have duplicates in my "Unseen", which both correctly disappear once handled one of them Example: !Inbox * -Inbox (tried this but does not succeed -Trash -Trash/* Public/* Unseen 2°bis :) I tried to put the "common defs" in a shared folder (/etc/dovecot/virtual) using personal index location = virtual:/etc/dovecot/virtual:INDEX=/sd/MAIL_IMAP_POP/%d/%n/__Virtual/ This does not work, I have to *copy* (even symlinks do not succeed) the definitions and use location = virtual:/sd/MAIL_IMAP_POP/%d/%n/__Virtual:INDEX=/sd/MAIL_IMAP_POP/%d/%n/__Virtual/ I already tried to set perms on /etc/dovecot/virtual to: vmail.vmail rw(x)------ Thank you! Cheers

1 0

Question about how to serve many imap users on some mailbox.
by Oleksandr Lystopad 30 May '17

30 May '17

Hi, dear dovecot users! I am running 2.2.29.1 (e0b76e3) on FreeBSD. In my case, one mailbox info(a)example.com is shared between 5-10 managers. Sometimes they complains that no new messages displayed in folder message count list in brackets (bold number if new messages exists), but when they click on the imap folder (for example Inbox) they could see many new mails. There not only Inbox folder, they have 10-30 folders with quite big flow of new messages. Almost all users are using Microsoft Outlook MUA. Please, help me to solve the issue. My config could be found bellow (dovecot -n): auth_failure_delay = 12 secs auth_mechanisms = login cram-md5 plain auth_verbose = yes disable_plaintext_auth = no first_valid_gid = 26 first_valid_uid = 26 lda_mailbox_autocreate = yes listen = * login_greeting = imap/pop mailserver ready mail_location = maildir:~/Maildir mail_max_userip_connections = 50 mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } protocols = pop3 imap sieve service auth { unix_listener auth-client { group = mailnull mode = 0600 user = mailnull } unix_listener auth-login { group = mailnull mode = 0600 user = $default_internal_user } unix_listener auth-master { group = mailnull mode = 0600 user = mailnull } unix_listener auth-userdb { group = mailnull mode = 0600 user = mailnull } user = root } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } service imap { process_limit = 512 } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 } } service pop3 { process_limit = 512 } ssl_cert = </usr/local/etc/SSL/my.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep } protocol lda { mail_plugins = sieve }

2 1

MySQL issue
by Amaechi Janneh 30 May '17

30 May '17

Hello. It appears that I have an issue with my dovecot setup. When trying to authenticate, i get this error: May 28 20:18:26 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10879, TLS, ses...QOQBg9rlR> May 28 20:18:42 AmaechiJ dovecot[10516]: imap(aj(a)example.com): Connection closed in=116 out=1311 May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Warning: mysql: Query failed, retrying: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: auth-worker(10892): Error: sql( aj(a)example.com,) User query failed: Table 'mailserver.users' doesn't exist May 28 20:20:32 AmaechiJ dovecot[10516]: imap-login: Login: user=< aj(a)example.com>, method=PLAIN, rip=, lip=, mpid=10894, TLS, ses...QZwBg9rlR> But I already have the users data under virtual_users. So what should I do? Regards, Amaechi Janneh I am running dovecot 2.2.13 Debian 8

3 4

Can only enable Sieve scripts not edit them (Roundcube)
by Paul Littlefield 29 May '17

29 May '17

Hello, (my first post so be gentle) I will be posting this to the Roundcube mailing list too, but thought it worth asking here as well. I have a Roundcube installation running Apache with Dovecot and Sieve. When logged in to Roundcube, a user can see the Sieve scripts and enable or disable them but NOT edit them or create new scripts. In other words, Dovecot will happily EDIT the script to mark it as 'false' but will not edit the actual rules or create a new rule... e.g. require ["fileinto","vacation"]; # rule:[Out of Office] if false # true { vacation :days 1 :addresses "me(a)mydomain.com" :subject "Out of Office" :from "me(a)mydomain.com" "I am out of the office."; } # rule:[Spam] if header :contains "subject" "{Spam}" { fileinto "Spam"; } Any ideas? Thanks, -- Paul Littlefield

3 3

user-defined special-use folders
by Fabian Schmidt 29 May '17

29 May '17

I plan to define SPECIAL-USE mailboxes and think about defining per user special-use folders for those who don't use the default folder names. Is this possible in dovecot? What I try: $ doveadm exec imap * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SEARCH=FUZZY METADATA SPECIAL-USE] Logged in as fschmidt a1 SETMETADATA "sent-mail" (/private/specialuse "\\Sent") a1 NO [CANNOT] The /private/specialuse attribute cannot be changed (0.008 + 0.000 + 0.008 secs). using dovecot 2.2.29.1, following the example in RFC 6154, sect. 5.4 (How is MAIL_ATTRIBUTE_INTERNAL_RANK_AUTHORITY defined or set?) Fabian.

2 1

When will passdb callback to mechanism yield PASSDB_RESULT_NEXT?
by Peter Mogensen 29 May '17

29 May '17

Hi, code question... I've been trying to figure out the implications of the new "noauthenticate" passdb field. Internally it causes a passdb to result in PASSDB_RESULT_NEXT. When a SASL mechanism calls auth_request_lookup_credentials(...,callback) the passdb result is passed to the callback. But I can't really figure out when that result will ever be PASSDB_RESULT_NEXT. It seems the passdb fallthrough resolver will always replace it with PASSDB_RESULT_INTERNAL_FAILURE if it ends up being the last result. Can it ever leak into the callback or is it an internal intermediate value or the passdb resolver? /Peter

2 1

No doveadm-save in wiki2?
by KT Walrus 29 May '17

29 May '17

Is “doveadm save” an undocumented feature? Or, just well-hidden? https://wiki2.dovecot.org/Tools/Doveadm <https://wiki2.dovecot.org/Tools/Doveadm> Kevin

3 5

Another mail_crypt question: figure out to password secure using mysql
by dovecot＠avv.solutions 26 May '17

26 May '17

Hello Community, (sorry to be more busy, hence more running questions in parallel :) ) As mentioned in another post, I am testing mail_crypt plugin. I was wondering how to really secure the process sothat even the admin cannot have any access to the other users mail content. My current config is simple: - using per-folder keys (hence the per-user spaces are preserved) - put the public/private global keys in base64 format into the sql DB (elliptic algo) This obviously allows anyone with read access to the table to decrypt the mails from the filesystem... which I try to prevent. Considering of course that all mail users are virtual and do not (and may not) have access to the box itself: - how can I secure the keys? I do not see how to handle a assword for them? - a solution might be to crypt/decrypt the keys using the user's password? - other? Thank you for you help.

2 2

dovecot: auth-worker: Fatal: master: service(auth-worker): child XXXXX killed with signal 11
by dovecot＠jeffandjessi.com 26 May '17

26 May '17

Still Trying to track down a dovecot issue .... The error message is: dovecot: auth-worker: Fatal: master: service(auth-worker): child XXXXX killed with signal 11 (core not dumped - set service auth-worker { drop_priv_before_exec=yes }) The setup is dovecot 2.2.29.1 with passwd and mysql auth db's and a very basic config. both authentications work ... the symptom is that after a connection is made the auth worker loads and emails are downloaded and everything "is fine". However, about 30 second to a minute after the connection is done the process dies with the error message. Then the process starts all over with on the next checking of email ,but again everything "works" just seeing this error and the process dieing each time? enabled all extra verbose logging ,but nothing gives any clues.... Tried to enable core dumps ,but couldnt get core dumps to work ? The only thing is that a recently pkgsrc (netbsd) update create 2 packages, one for dovecot and one for mysql plugin , sense then now this error appears. ,but it appears the .so lib files are installed and linked correctly. Double checked all file permissions and user permissions as well as chroot , etc, etc, ,etc.... cant seem to narrow this one down .... any ideas on trouble shooting would be great .... even tried running a trace with gdb -p on the process ,but it just dies with a signal 11 .... anybody have any ideas how to trouble shoot this or is this a bug in the software .... help !!

2 1