January 2018 - dovecot

Duplicate mail id issue, mailbox does not exist when dovecot tries to generate a new guid so replication can take place
by Daniel Botting 15 Jan '18

15 Jan '18

Hi all, When we run the below one user constantly shows as failed (dovecot version is 2.2.13): sudo doveadm replicator status "*" mail.log shows the below for the user: Jan 3 16:20:57 hostname dovecot: dsync-server(user): Error: Duplicate mailbox GUID <guid number> for mailboxes <mailbox name.sub folder> and <mailbox name.sub folder> - giving a new GUID <guid number> to <mailbox name.subfolder> Jan 3 16:20:57 hostname dovecot: dsync-server(user): Error: Couldn't update mailbox <sub folder name> GUID: Mailbox doesn't exist: <sub folder name> Looking at their mailbox the folder does exist. Has anybody seen this before and would be aware of the way to resolve? Kind regards Daniel Botting Codethink Ltd

2 2

Non-destructive deduplication
by Tristan Miller 15 Jan '18

15 Jan '18

Greetings. I use Dovecot 2.2.29.1 as my IMAP server. Owing to a bug in my mail client [1], several unique messages (mostly in my Sent folder) have duplicate Message-ID headers. Dovecot itself doesn't seem to be bothered by this, though my mail client is confused by the false duplicates. (It screws up the threading display, and results in data loss when I run the client's deduplication filter.) I would like to change the Message-ID headers in the "duplicate" message files stored in my IMAP server so that they are unique. I realize that this has disadvantages of its own, but I can't think of a better alternative. So this leads me to two questions: 1) Will Dovecot get confused if I simply open the message files in a text editor and manually change their Message-ID headers? If so, how should I go about changing the Message-ID headers? 2) Does there exist any tool that will scan a maildir folder to find messages with duplicate Message-IDs, and automatically rewrite the Message-ID headers so that they are (probably) unique? I could probably kludge together a quick shell script, but if someone's already gone to the trouble of writing such a tool and making it relatively robust, I'd rather use that instead. Regards, Tristan [1] http://www.thewildbeast.co.uk/claws-mail/bugzilla/show_bug.cgi?id=3828 -- =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Tristan Miller Free Software developer, ferret herder, logologist https://logological.org/ =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

2 3

Re: Questions about SPECIAL-USE IMAP extension
by Joseph Tam 15 Jan '18

15 Jan '18

Steffen Kaiser <skdovecot(a)inf.h-brs.de> wrote: >> I'd like to configure my dovecot service to use the IMAP SPECIAL-USE > > well, in my experience SPECIAL-USE is just a suggestions to clients. Check > RFC 6154 for MUSTs, you'll find only few. Hence, how the client (or the > server) behaves in a special case is implementor-defined. In other words, expect the unexpected. I'm especially curious what happends when you have multiple mailboxes with the same special-use. Tanstaafl <tanstaafl(a)libertytrek.org> wrote: > There was a similar discussion about this on list some time ago, about > whether or not Dovecot could utilize special use 'aliases' that your > clients may want to use by default, and Dovecot would automatically map > those requests to a single mailbox. > ... > Personally I would love to see this implemented. Yeah, that would be cool. For an existing installation, though, an admin might have merge all existing mailboxes into the one actual mailbox to keep the confusion down. Joseph Tam <jtam.home(a)gmail.com>

2 1

Lmtp Memory Limit
by Thomas Manninger 15 Jan '18

15 Jan '18

Hi, i am using dovecot 2.2.33.2 on CentOS 7.4. Since i upgraded from CentOS 7.2. to CentOS 7.4. (without upgrading dovecot), my dovecot sieve-pipe scripts crash with Out of memory: Out of memory (allocated 262144) (tried to allocate 8793 bytes) There are some memory limits in dovecot or sieve? Can i change this value? Kernel limitks: [root@xxx software]# ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 26505 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 26505 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited Dovecot is running as user mail: su mail bash-4.2$ ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 26505 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 4096 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited Can someone help me? Thanks for help! Best regards Thomas Manninger

2 3

Re: Mailbox from virtual mailbox in other namespace
by Aki Tuomi 15 Jan '18

15 Jan '18

On 15.01.2018 10:31, Jakobus Schürz wrote: > > > Am 15.01.2018 um 08:17 schrieb Aki Tuomi: >> >> On 14.01.2018 02:11, Jakob Schürz wrote: >>> Hi there! >>> >>> I have more namespaces. One for subscription, another one "inbox", then >>> one for the archiv and a shared and a public namespace. >>> And than is there a namespace for virtual mailboxes. >>> >>> In the namespace for virtual mailboxes is one mailbox wich gives me all >>> emails in the archiv namespace >>> >>> #cat dovecot-virtual >>> Archiv/* >>> all >>> >>> The namespace is normally hidden, but for debugging i make it visible. >>> >>> doveadm search -u jakob mailbox Real/Archiv all >>> >>> lists all the emails. >>> >>> So i want to integrate this virtual mailbox in another namespace. >>> The namespace is Archiv >>> >>> namespace Archiv { >>> ... >>> ... >>> ... >>> mailbox Real/Archiv { >>> auto = subscription >>> } >>> ... >>> ... >>> } >>> >>> doveadm mailbox list -u jakob >>> >>> gives >>> Archiv/Real/Archiv >>> >>> But >>> >>> doveadm search -u jakob mailbox Archiv/Real/Archiv all >>> >>> gives no result. >>> >>> What's wrong? >>> >>> jakob >> Do you have dovecot-virtual file for Archiv/Real/Archiv? >> >> Aki > > Hmmm... I see... no. I thought it is possible to integrate a specific > mailbox from another namespace in a namespace giving the mailbox-name > in mailbox-definition. So... it is not possible? > Can I mix real and virtual mailboxes in one namespace? > > jakob Not possible, sorry. The only way to do this is to have a dovecot-virtual file which will operate on the real folder, such as Real/Archiv !Real/Archiv all Aki

2 1

Mailbox from virtual mailbox in other namespace
by Jakob Schürz 15 Jan '18

15 Jan '18

Hi there! I have more namespaces. One for subscription, another one "inbox", then one for the archiv and a shared and a public namespace. And than is there a namespace for virtual mailboxes. In the namespace for virtual mailboxes is one mailbox wich gives me all emails in the archiv namespace #cat dovecot-virtual Archiv/* all The namespace is normally hidden, but for debugging i make it visible. doveadm search -u jakob mailbox Real/Archiv all lists all the emails. So i want to integrate this virtual mailbox in another namespace. The namespace is Archiv namespace Archiv { ... ... ... mailbox Real/Archiv { auto = subscription } ... ... } doveadm mailbox list -u jakob gives Archiv/Real/Archiv But doveadm search -u jakob mailbox Archiv/Real/Archiv all gives no result. What's wrong? jakob

3 2

Save login's to a table
by Jorge Bastos 12 Jan '18

12 Jan '18

Hi, I'd like to have the logins that the accounts do, saved in a *sql table, with login name | IP | datetime, for audit porposes. How could I achieve that, if possible? Thanks in advanced,

3 3

Client Identification
by spaceman 12 Jan '18

12 Jan '18

I have two seperate clients (using fetchmail) on two seperate machines that use the same login and the same ip address as each other fetching their mail over IMAP using IMAP idle. Naturally Dovecot assumes that they are the same machine but they are not so messages only get downloaded to one of the machines rather than both which is what I want. How do I get Dovecot to recognize them as two individual clients so that mail downloads to both of them? Regards, spaceman

2 1

login failure "reason" not returned (dovecot-2.2.32)
by Pedro Ribeiro 11 Jan '18

11 Jan '18

Hello, In the past (older dovecot versions) I've tuned the SQL "password_query" of our mail server so that when the user has the account blocked for some reason (expired, need password change, etc.) the query returns nologin=1 and a verbose reason like reason="Your account is expired please change the password" and it worked very well with IMAP clients. I'm now seeing that despite the message returned by the SQL, the IMAP server always returns a generic error "NO [AUTHENTICATIONFAILED] Authentication failed." I've setup an "always fail" query in a test installation (see below) and with that, a simple openssl/telnet login simulation fails without reporting the "ERRORDEBUG" reason. > password_query = SELECT '%n' AS username, '%d' AS domain, 'ERRORDEBUG' > AS reason, '1' AS nologin, CONCAT('{PLAIN}',RAND()) AS password; Tested with: > imapsrv# openssl s_client -connect imap2:993 > --- > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE AUTH=PLAIN] IPLNet IMAP ready. > a login "someouser@dom" "password" > a NO [AUTHENTICATIONFAILED] Authentication failed. Also using doveadm auth: > imapsrv# doveadm auth test someuser@dom > Password: > passdb: someuser@dom auth failed > extra fields: > user=someuser@dom I've already done some source digging without conclusions, the code to return the reason seem to be in place in the function "imap_client_auth_result" at src/imap-login/client-authenticate.c What am I doing wrong? Should the behaviour now be done in another way? Best regards, keep the good work in this fine software! -- Best regards, =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Pedro Ribeiro Politécnico de Lisboa, Serviços da Presidência Departamento de Sistemas de Informação e Comunicações Phone: +351 210 464 700 (general) / VoIP: 80100 Helpdesk: helpdesk(a)net.ipl.pt / https://www.net.ipl.pt =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

1 0

Dovecot 2.3.0 imap-login using 100% CPU
by Jason Kiniry 11 Jan '18

11 Jan '18

When in the process of testing out the 2.3.0 version of Dovecot, we noticed that on a busy server, imap-login can sometimes take 100% CPU and remain there indefinitely. We grabbed a gdb trace while it was happening: dovenull 36053 31.2 0.0 60460 17316 ? R 04:38 11:55 dovecot/imap-login root@server [~]# strace -p 36053 Process 36053 attached ^CProcess 36053 detached root@server [~]# gdb atGNU gdb (GDB) Red Hat Enterprise Linux (7.2-92.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. (gdb) attach 36053 Attaching to process 36053 Reading symbols from /usr/libexec/dovecot/imap-login...done. Reading symbols from /usr/lib64/dovecot/libdovecot-login.so.0...done. Loaded symbols for /usr/lib64/dovecot/libdovecot-login.so.0 Reading symbols from /usr/lib64/dovecot/libdovecot.so.0...done. Loaded symbols for /usr/lib64/dovecot/libdovecot.so.0 Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib64/libc.so.6 Reading symbols from /usr/lib64/libssl.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libssl.so.10 Reading symbols from /usr/lib64/libcrypto.so.10...(no debugging symbols found)...done. Loaded symbols for /usr/lib64/libcrypto.so.10 Reading symbols from /lib64/librt.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/librt.so.1 Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libdl.so.2 Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/ld-linux-x86-64.so.2 Reading symbols from /lib64/libgssapi_krb5.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libgssapi_krb5.so.2 Reading symbols from /lib64/libkrb5.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5.so.3 Reading symbols from /lib64/libcom_err.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libcom_err.so.2 Reading symbols from /lib64/libk5crypto.so.3...(no debugging symbols found)...done. Loaded symbols for /lib64/libk5crypto.so.3 Reading symbols from /lib64/libz.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libz.so.1 Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done. [Thread debugging using libthread_db enabled] Loaded symbols for /lib64/libpthread.so.0 Reading symbols from /lib64/libkrb5support.so.0...(no debugging symbols found)...done. Loaded symbols for /lib64/libkrb5support.so.0 Reading symbols from /lib64/libkeyutils.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libkeyutils.so.1 Reading symbols from /lib64/libresolv.so.2...(no debugging symbols found)...done. Loaded symbols for /lib64/libresolv.so.2 Reading symbols from /lib64/libselinux.so.1...(no debugging symbols found)...done. Loaded symbols for /lib64/libselinux.so.1 Reading symbols from /usr/lib64/dovecot/libssl_iostream_openssl.so...done. Loaded symbols for /usr/lib64/dovecot/libssl_iostream_openssl.so 0x00007f758fb8dd18 in client_notify_auth_ready@plt () from /usr/lib64/dovecot/libdovecot-login.so.0 Missing separate debuginfos, use: debuginfo-install dovecot-2.3.0-4.cp1162.x86_64 (gdb) back #0 0x00007f758fb8dd18 in client_notify_auth_ready@plt () from /usr/lib64/dovecot/libdovecot-login.so.0 #1 0x00007f758fb90af0 in clients_notify_auth_connected () at client-common-auth.c:837 #2 0x00007f758f8cfc04 in auth_server_input_done (conn=0x7f7591911838) at auth-server-connection.c:127 #3 auth_server_connection_input_line (conn=0x7f7591911838) at auth-server-connection.c:229 #4 auth_server_connection_input (conn=0x7f7591911838) at auth-server-connection.c:281 #5 0x00007f758f8f5e35 in io_loop_call_io (io=0x7f759277e2a0) at ioloop.c:614 #6 0x00007f758f8f7d3f in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:222 #7 0x00007f758f8f5f25 in io_loop_handler_run (ioloop=0x7f75918e4d00) at ioloop.c:666 #8 0x00007f758f8f6148 in io_loop_run (ioloop=0x7f75918e4d00) at ioloop.c:639 #9 0x00007f758f875ab3 in master_service_run (service=0x7f75918e4b90, callback=<value optimized out>) at master-service.c:767 #10 0x00007f758fb96156 in login_binary_run (binary=<value optimized out>, argc=1, argv=0x7f75918e4890) at main.c:549 #11 0x00007f758f4a2d1d in __libc_start_main () from /lib64/libc.so.6 #12 0x00007f758ffc4469 in _start () (gdb) run The program being debugged has been started already. Start it from the beginning? (y or n) n Program not restarted. (gdb) continue Continuing. ^C Program received signal SIGINT, Interrupt. client_notify_auth_ready (client=0x7f7592775140) at client-common.c:1031 1031 client-common.c: No such file or directory. in client-common.c (gdb) back #0 client_notify_auth_ready (client=0x7f7592775140) at client-common.c:1031 #1 0x00007f758fb90af0 in clients_notify_auth_connected () at client-common-auth.c:837 #2 0x00007f758f8cfc04 in auth_server_input_done (conn=0x7f7591911838) at auth-server-connection.c:127 #3 auth_server_connection_input_line (conn=0x7f7591911838) at auth-server-connection.c:229 #4 auth_server_connection_input (conn=0x7f7591911838) at auth-server-connection.c:281 #5 0x00007f758f8f5e35 in io_loop_call_io (io=0x7f759277e2a0) at ioloop.c:614 #6 0x00007f758f8f7d3f in io_loop_handler_run_internal (ioloop=<value optimized out>) at ioloop-epoll.c:222 #7 0x00007f758f8f5f25 in io_loop_handler_run (ioloop=0x7f75918e4d00) at ioloop.c:666 #8 0x00007f758f8f6148 in io_loop_run (ioloop=0x7f75918e4d00) at ioloop.c:639 #9 0x00007f758f875ab3 in master_service_run (service=0x7f75918e4b90, callback=<value optimized out>) at master-service.c:767 #10 0x00007f758fb96156 in login_binary_run (binary=<value optimized out>, argc=1, argv=0x7f75918e4890) at main.c:549 #11 0x00007f758f4a2d1d in __libc_start_main () from /lib64/libc.so.6 #12 0x00007f758ffc4469 in _start () (gdb) Anyone have any thoughts? Regards, Jason Kiniry

3 4