May 2016 - dovecot - dovecot.org

Bug Report - Crash on imap with core dump - Alternate storage related
by Daniel van Ham Colchete 12 May '16

12 May '16

I would like to report a bug we are seeing on an new deployment here: Linux: Debian Jessie, inside a Docker container Dovecot version: 2.2.23 (806d709) / 2.2.23-1~bpo8+1 doveconf -n: http://pastebin.com/2xA2xuRw Filesystem: CephFS - Jewel After migrating our users from our old server to our new one we can't access a few mailboxes. Backtrace follows: root@dovecot:/# gdb --args /usr/lib/dovecot/imap -u daniel.colchete(a)mav.com.br GNU gdb (Debian 7.7.1+dfsg-5) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/lib/dovecot/imap...Reading symbols from /usr/lib/debug/.build-id/e2/488f839ac2b10504ef74b1b2f2146891ca2f62.debug...done. done. (gdb) run Starting program: /usr/lib/dovecot/imap -u daniel.colchete(a)mav.com.br * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SPECIAL-USE QUOTA] Logged in as daniel.colchete(a)mav.com.br a select INBOX Program received signal SIGSEGV, Segmentation fault. strrchr () at ../sysdeps/x86_64/strrchr.S:32 32 ../sysdeps/x86_64/strrchr.S: No such file or directory. (gdb) where #0 strrchr () at ../sysdeps/x86_64/strrchr.S:32 #1 0x00007ffff7b0a261 in sdbox_file_move (file=file@entry=0x5555557e6530, alt_path=alt_path@entry=true) at sdbox-file.c:312 #2 0x00007ffff7b0cd11 in dbox_sync_file_move_if_needed (type=SDBOX_SYNC_ENTRY_TYPE_MOVE_TO_ALT, file=0x5555557e6530) at sdbox-sync.c:30 #3 sdbox_sync_file (type=SDBOX_SYNC_ENTRY_TYPE_MOVE_TO_ALT, uid=13120, seq=819, ctx=0x5555557e32e0) at sdbox-sync.c:58 #4 sdbox_sync_add (sync_rec=0x7fffffffe570, ctx=0x5555557e32e0) at sdbox-sync.c:96 #5 sdbox_sync_index (ctx=0x5555557e32e0) at sdbox-sync.c:131 #6 sdbox_sync_begin (mbox=mbox@entry=0x5555557ce500, flags=flags@entry=(unknown: 0), ctx_r=ctx_r@entry=0x7fffffffe680) at sdbox-sync.c:234 #7 0x00007ffff7b0d07d in sdbox_sync (mbox=mbox@entry=0x5555557ce500, flags=flags@entry=(unknown: 0)) at sdbox-sync.c:297 #8 0x00007ffff7b0d108 in sdbox_storage_sync_init (box=0x5555557ce500, flags=(MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FIX_INCONSISTENT)) at sdbox-sync.c:323 #9 0x00007ffff7aea85b in mailbox_sync_init (box=0x5555557ce500, flags=(MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FIX_INCONSISTENT)) at mail-storage.c:1664 #10 0x00007ffff7aea9a7 in mailbox_sync (box=<optimized out>, flags=<optimized out>, flags@entry=MAILBOX_SYNC_FLAG_FULL_READ) at mail-storage.c:1712 #11 0x0000555555568fa0 in select_open (readonly=false, mailbox=<optimized out>, ctx=0x5555557c9928) at cmd-select.c:303 #12 cmd_select_full (cmd=<optimized out>, readonly=<optimized out>) at cmd-select.c:426 #13 0x000055555556fdbd in command_exec (cmd=cmd@entry=0x5555557c9800) at imap-commands.c:180 #14 0x000055555556e182 in client_command_input (cmd=cmd@entry=0x5555557c9800) at imap-client.c:958 #15 0x000055555556e210 in client_command_input (cmd=0x5555557c9800) at imap-client.c:1018 #16 0x000055555556e5d5 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x5555557c8c00) at imap-client.c:1058 #17 client_handle_input (client=0x5555557c8c00) at imap-client.c:1070 #18 0x000055555556ead5 in client_input (client=0x5555557c8c00) at imap-client.c:1117 #19 0x00007ffff7837c3c in io_loop_call_io (io=0x5555557c96f0) at ioloop.c:564 #20 0x00007ffff78390a1 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x5555557966e0) at ioloop-epoll.c:220 #21 0x00007ffff7837cc5 in io_loop_handler_run (ioloop=ioloop@entry=0x5555557966e0) at ioloop.c:612 #22 0x00007ffff7837e68 in io_loop_run (ioloop=0x5555557966e0) at ioloop.c:588 #23 0x00007ffff77ce0e3 in master_service_run (service=0x555555796580, callback=<optimized out>) at master-service.c:640 #24 0x0000555555561ab2 in main (argc=3, argv=0x555555796390) at main.c:454 (gdb) One important info is that I used to use Alternate Storage on the older servers, but the not on the new one. Code seems to be trying to move a message to an alternate storage that doesn't exist. doveadm dump dovecot.index will show that we still have the ALTERNATE_STORAGE flag set: root@dovecot:/srv/dovecot/mail/ mav.com.br/daniel.colchete/mailboxes/INBOX/dbox-Mails# doveadm dump dovecot.index|grep RECORD|head -- RECORDS: 932 RECORD: seq=1, uid=9393, flags=0x49 (Seen Answered) RECORD: seq=2, uid=9442, flags=0x40 RECORD: seq=3, uid=10253, flags=0x48 (Seen) RECORD: seq=4, uid=10268, flags=0x48 (Seen) RECORD: seq=5, uid=10283, flags=0x48 (Seen) RECORD: seq=6, uid=10309, flags=0x48 (Seen) RECORD: seq=7, uid=10311, flags=0x40 RECORD: seq=8, uid=10324, flags=0x49 (Seen Answered) RECORD: seq=9, uid=10330, flags=0x48 (Seen) Thank you very much. Best, Daniel Colchete

2 4

Dovecot + libsodium
by Andreas Meyer 12 May '16

12 May '16

Hi, Thank you very much for creating and maintaining dovecot! In my scenario, I want to use the password hash algorithms provided by libsodium: https://download.libsodium.org/doc/ So my difficulty is to have dovecot support libsodium's hash algorithms, particularly: crypto_pwhash_scryptsalsa208sha256_str On the sodium maillinglist I asked for help and received an adjusted dovecot code, which exactly does what I need. You find it here: https://github.com/jedisct1/core/tree/scrypt-argon2 Obviously I need to apply these changes everytime I upgrade to a new dovecot version now. So my question ist, what do I need to do so that you will include libsodium support in future versions of dovecot? Thank you very much for your attention, Andreas

3 3

Automatic packages for Dovecot v2.3
by Stephan Bosch 11 May '16

11 May '16

Hi, The Xi repository for v2.3 is now public. The information is updated here: http://wiki2.dovecot.org/PrebuiltBinaries#Automatically_Built_Packages Xi now modifies the version string in the Dovecot sources. This way `dovecot -n` output includes the Xi package version. This is currently only true for the v2.3 packages though. I am still testing a new v2.2 builder that follows both the master and latest release branch. Packages from the release branch are published in a separate repository, so that a more stable package stream is obtained; it is only updated when the developers start working on making a release. The intermittent beta or rc release tags on that release branch are recognized and reflected in the package versions. If a new release branch is detected, the the development packages for the master branch get an alpha version with a lower version digit that is one higher than the upcoming release. For example, when a release-2.2.25 branch is created, packages from the master branch will get version 2.2.26~alpha0-1 in anticipation of the next release in this series. Packages from the release branch will have version 2.2.25~beta0-1 until the first release tag is seen. Regards, Stephan.

2 1

Undeletable mailboxes
by thomas.hofmann＠post.ch 11 May '16

11 May '16

Hi I have to maintain a dovcot installation where users may access there mails through IMAPS and/or via self-developed portal. >From time to time users complain about mailboxes showing up they have deleted bevor. The only way to get these mailboxes away is to do a backup of the user and delete dovecot home of the user and do a selective restore. hostname:~ # doveadm mailbox list -u $u -s 'INBOX/01_OHO/*' hostname:~ # doveadm mailbox list -u $u 'INBOX/01_OHO/*' INBOX/01_OHO/02_Orchestermatinée 10.01.16 hostname:~ # doveadm mailbox delete -u $u 'INBOX/01_OHO/02_Orchestermatinée 10.01.16' doveadm(username(a)domain.com): Info: Mailbox deleted: INBOX/01_OHO/02_Orchestermatinée 10.01.16 hostname:~ # doveadm mailbox list -u $u 'INBOX/01_OHO/*' INBOX/01_OHO/02_Orchestermatinée 10.01.16 hostname:~ # doveadm -v purge -u $u hostname:~ # doveadm mailbox list -u $u 'INBOX/01_OHO/*' INBOX/01_OHO/02_Orchestermatinée 10.01.16 hostname:~ # doveadm mailbox metadata list -u $u 'INBOX/01_OHO/02_Orchestermatinée 10.01.16' doveadm(username(a)domain.com): Error: Failed to open mailbox: Mailbox doesn't exist: INBOX/01_OHO/02_Orchestermatinée 10.01.16 hostname:~ # hostname:~ # dovecot --version 2.2.21 (5345f22) hostname:~ # Is there another (simpler) way to rid of these "deleted" mailboxes? Thanks for any help! Regards Thom

1 0

ACLs over imapc
by abi＠oleane.net 10 May '16

10 May '16

hello i've struggled various times trying to setup shared mailboxes to no avail. the same setup with local file access works imapc seems to work with generic shared mailboxes nevertheless, i never managed to get a working setup with both user-defined acls and imapc has anyone been successful in doing so ? is this supposed to work ? i've been experimenting with dovecot 2.2.9 and 2.2.22 and never saw any imap acl commands issued by the builtin imap client. thanks abi(a)oleane.net

1 0

Mailbox doesn't exist response
by Cornelius Charlie 10 May '16

10 May '16

Hello, Using the latest dovecot version, selecting a non-existing mailbox with non printable characters encoded in utf7, the mailbox doesn't exist response contains the folder name encoded in utf8. Is that legal regarding the rfc ? If yes, how the client can be aware of the used encoding ? Thanks.

2 1

Workaround for rcpt suffix
by Robban 10 May '16

10 May '16

Hi all! I'm stuck again, let me start with explaining my setup. The PassDB and UserDB is LDAP (FreeIPA) and I'm using ldap mail attribute to search after the recipient so one user can have multiple mail aliases. So far so good. Next is to have an catchall(a)domain.tld, that is done via an static userdb backend (I know you are strongly against catchall adresses), and they are delivered to public folders (${mail_location}/domain.tld). I also use address extension so sort a mail to correct folder (+ sign). Now I need to fix so mail to <mail attr>-sievetest is handled by the user assigned to <mail attr>, is this somehow possible? //Robban

2 1

resorting emails by date order after move/copy to sub folder ?
by voytek＠sbt.net.au 10 May '16

10 May '16

I have just used Squirrel web client to re organize some old emails to subfolders. that worked OK, EXCEPT, all these emails are now in order that I have moved them rather than original date, is that some 'simple' way to re-sort them back by original date ? thanks for any pointers, sorry for dumb question Voytek

2 2

more info about deleting users
by Matteo Gaito Test Account 09 May '16

09 May '16

Hi, i've search a lot in order to find a way to delete account by dovecot but i found only this way http://dovecot.org/list/dovecot/2011-November/079273.html It's possible today delete a maildir remotely with doveadm or with dovecot api? Thanks Matteo

6 8

Panic: file doveadm-mail.c: line 417 (doveadm_mail_single_user): assertion failed: (cctx->username != NULL)
by Daniel van Ham Colchete 08 May '16

08 May '16

Hello everyone! So, I'm trying to move away from a few older servers into new ones but I can't get dsync to work this time (the 2013 migration went perfectly). This is what I get: root@dovecot:/# dsync sync -u user(a)domain.org.br tcp:XXXX:12345 Panic: file doveadm-mail.c: line 417 (doveadm_mail_single_user): assertion failed: (cctx->username != NULL) Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x85dee) [0x7f500d3cddee] -> /usr/lib/dovecot/libdovecot.so.0(+0x85e68) [0x7f500d3cde68] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f500d3725be] -> dsync(+0x28d50) [0x55dcb11bad50] -> dsync(+0x28ded) [0x55dcb11baded] -> dsync(doveadm_mail_try_run+0x219) [0x55dcb11bb779] -> dsync(main+0x441) [0x55dcb11aba91] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf5) [0x7f500cfbeb45] -> dsync(+0x19c06) [0x55dcb11abc06] Aborted (core dumped) root@dovecot:/# doveconf -N is here: http://pastebin.ca/3594094 doveadm user '*" will list all the users correctly doveadm user user(a)domain.org.br will show all the user info correctly. Thank you very much! Best, Daniel Colchete

1 0