- dovecot - dovecot.org

[Dovecot] Bug when a duplicated file is found
by Angel L. Mateo 25 Feb '13

25 Feb '13

Hello, Last days we had to restore some mailboxes from backup. Our mailboxes are in maildir format and during restore, some duplicated files appeared. The situation is: * A user has messages in his new directory when the backup is made * In some moment after the backup is done, the user accesses to his mailbox, so the message is move to the cur directory. * We restore his mailbox directly to his maildir path, so the message is now at new directory too. When this happens, dovecot detect it and it renames one of the files. This is the reported log: Feb 13 23:08:05 myotis31 dovecot: imap(<user>): Warning: Fixed a duplicate: /home/alumnos/59/122559/Maildir/cur/1360169810.M670208P13643.myotis31,S=6282,W=6409:2, -> 1360793285.M721935P29136.myotis31 The problem with this is that we are using zlib plugin so messages are compressed. When the rename is done, the rename is to a name without the S=XXXX field (neither the W=XXX, although this field is less sensible), so the result is that user's can't access to any message after this one. I think than in this situation, rename one of the files is a good solution (although it provokes duplicate mails, but this an expected/acceptable situation after the restore), but the rename should maintain the S= and W= fields (and even other maildir flags). -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

3 3

[Dovecot] SSL errors for just one client after updaing both dovecot and openssl
by Charles Marcus 25 Feb '13

25 Feb '13

Hi all, Ok, I have a strange problem after updating both dovecot and openssl... OpenSSL was 1.0.0j, now updated to 1.0.1c Dovecot was 2.1.13, now updated to 2.1.15 I'm getting a bunch of lines like the following: Feb 23 10:48:01 myhost dovecot: imap-login: Disconnected (no auth attempts in 29 secs): user=<>, rip=#.#.#.#, lport=993, TLS handshaking: SSL_accept() syscall failed: Connection reset by peer, session=<In+cO2bWngCthJz2> where only the session id (and number of seconds for no auth attempts) is different... This is happening for only the one client. All other clients - I've counted about 25 so far - are working fine. Anyone have any ideas? I can't believe it is a generic openssl problem, since it is only affecting the one client. I've contacted him and asked him to reboot any/all devices that connect to our mail to see if that helps... -- Best regards, */Charles/*

3 3

[Dovecot] understanding namespace configuration
by btb＠bitrate.net 25 Feb '13

25 Feb '13

i'm a little confused about namespace configuration. reading http://wiki2.dovecot.org/Namespaces , and looking at the examples, it seems that when a namespace is declared, you can either do "namespace { ..." or "namespace foo { ..." - i'm having trouble finding clarity on the significance of "foo" though. it would appear it's not required, but then what is its purpose? what does it mean? does it imply something? it's also unclear to me how to create the "default private namespace". i see that there are three types of namespaces, but the list of namespace settings doesn't seem to include a parameter to set the namespace type. what am i missing? it's also not quite clear how to denote a namespace as "default". from coming across this thread [ http://mailman2.u.washington.edu/pipermail/imap-protocol/2010-May/001077.ht… ] it would indicate in theory that a namespace is denoted as default by using an empty prefix - but i wasn't able to find corroboration of that in dovecot's documentation. thanks -ben

2 3

[Dovecot] dovecot-2.2: broken domain quota calculation
by Evgeny Basov 25 Feb '13

25 Feb '13

Hello. Used next version of dovecot: # dovecot --version 20130205 (03a0af22100d+) Quota configuration: plugin { quota = dict:Domain quota:%d:redis:host=127.0.0.1:prefix=domain/ quota_rule = *:storage=0 quota_rule2 = Trash:storage=+5%% quota2 = dict:User quota::redis:host=127.0.0.1:prefix=user/ quota2_rule = *:storage=0 quota2_rule2 = Trash:storage=+5%% } Problem: incorrect quota calculations. Dovecot gets size and messages count of all domain from last user in list. In 2.1 works fine. Steps to reproduce problem: 1. install dovecot 2. create over 50 users with e-mails 3. execute: doveadm quota recalc -A 4. execute: doveadm quota get -A 5. get count of all users message: sum in some application result of execution doveadm quota get -A | grep MESSAGE | grep 'User quota' | awk '{print $5}' (139443 messages) 6. get size of all users message: sum in some application result of execution doveadm quota get -A | grep STORAGE | grep 'User quota' | awk '{print $5}' (2304399 Kb) 7. look at some user user(a)example.org Domain quota STORAGE 82408 51200000 0 user(a)example.org Domain quota MESSAGE 1078 - 0 user(a)example.org User quota STORAGE 0 209715200 0 user(a)example.org User quota MESSAGE 0 - 0 and see 1078 messages and 82408 Kb in domain quota 8. look at last user in list z(a)example.org Domain quota STORAGE 82408 51200000 0 z(a)example.org Domain quota MESSAGE 1078 - 0 z(a)example.org User quota STORAGE 82408 209715200 0 z(a)example.org User quota MESSAGE 1078 - 0 and see matching values.

2 2

[Dovecot] Possible sort optimization (?)
by Michael M Slusarz 25 Feb '13

25 Feb '13

Maybe this is just noise... but I can reproduce this fairly reliably. Mailbox with 21,000+ messages This query: a UID SORT RETURN (ALL COUNT) (DATE) UTF-8 SUBJECT "foo" is always about 10 percent slower than this split query (I've done this 4-5 times, and the numbers are similar): a UID SEARCH RETURN (SAVE) CHARSET UTF-8 SUBJECT "foo" b UID SORT RETURN (ALL COUNT) (DATE) UTF-8 UID $ (The particular query I used matched 5 messages out of the 21,000+) My not-very-scientific benchmarking process: 1.) Stop dovecot process 2.) Delete all dovecot index files for that mailbox 3.) Flush linux paging cache (sync && echo 3 > /proc/sys/vm/drop_caches) 4.) Restart dovecot 5.) Access dovecot via command-line (PREAUTH) 6.) SELECT mailbox 7.) Issue command(s) Could be a potential area for performance improvement or could simply be lazy benchmarking. michael

2 2

[Dovecot] Problem with the command hooks api
by Tony 24 Feb '13

24 Feb '13

I have been trying to use the command hook api in an experimental plugin I have written. The hook is registered using the command_hook_register function, and for most commands my hook functions get called once as expected. But when the client uses one of the "UID" commands (e.g. "UID FETCH" ) the hook functions are executed twice. I am using dovecot version 2.1.12. Am I correct in thinking this is a bug? If I am wrong and this is the intended behaviour, how should I detect whether the hook function call is the first or second for a client's command (in particular for the 'post command' hook)? Assuming it is a bug, I modified the code in the command_exec function to stop the second hook call, a patch for this is below. This appears to apply to later dovecot releases as well. I am happy for this code to be included in future releases of dovecot. Thanks, Tony. diff -ur -x .deps -x Makefile dovecot-2.1.12-orig/src/imap/imap-commands.c dovecot-2.1.12-mod/src/imap/imap-commands.c --- dovecot-2.1.12-orig/src/imap/imap-commands.c 2012-03-22 12:59:17.000000000 +0000 +++ dovecot-2.1.12-mod/src/imap/imap-commands.c 2013-02-20 17:15:50.000000000 +0000 @@ -38,7 +38,7 @@ { "FETCH", cmd_fetch, COMMAND_FLAG_USES_SEQS }, { "SEARCH", cmd_search, COMMAND_FLAG_USES_SEQS }, { "STORE", cmd_store, COMMAND_FLAG_USES_SEQS }, - { "UID", cmd_uid, 0 }, + { "UID", cmd_uid, COMMAND_FLAG_HOOKS_DELAY }, { "UID COPY", cmd_copy, COMMAND_FLAG_BREAKS_SEQS }, { "UID FETCH", cmd_fetch, COMMAND_FLAG_BREAKS_SEQS }, { "UID SEARCH", cmd_search, COMMAND_FLAG_BREAKS_SEQS }, @@ -142,12 +142,20 @@ { const struct command_hook *hook; bool ret; + bool exec_hooks = FALSE; - array_foreach(&command_hooks, hook) - hook->pre(cmd); + if ( !(cmd->cmd_flags & COMMAND_FLAG_HOOKS_DELAY)) { + exec_hooks = TRUE; + array_foreach(&command_hooks, hook) + hook->pre(cmd); + } ret = cmd->func(cmd); - array_foreach(&command_hooks, hook) - hook->post(cmd); + + if (exec_hooks != FALSE) + { + array_foreach(&command_hooks, hook) + hook->post(cmd); + } return ret; } diff -ur -x .deps -x Makefile dovecot-2.1.12-orig/src/imap/imap-commands.h dovecot-2.1.12-mod/src/imap/imap-commands.h --- dovecot-2.1.12-orig/src/imap/imap-commands.h 2011-12-13 11:35:28.000000000 +0000 +++ dovecot-2.1.12-mod/src/imap/imap-commands.h 2013-02-20 17:15:44.000000000 +0000 @@ -30,7 +30,9 @@ Dovecot internally returns it for all kinds of commands, but unfortunately RFC 5530 specifies it only for "delete something" operations. */ - COMMAND_FLAG_USE_NONEXISTENT = 0x10 + COMMAND_FLAG_USE_NONEXISTENT = 0x10, + /* Set when need to delay command hook function calls due to recursive command_exec() */ + COMMAND_FLAG_HOOKS_DELAY = 0x20 }; struct command {

2 1

[Dovecot] LMTP logging
by Peter Rindfuss 24 Feb '13

24 Feb '13

Hi, Is there a way (in Dovecot 2.1.14) to sent LMTP log entries and IMAP log entries to different files? I know I could achieve this with syslog-ng, but as LDA has a log file of its own, I am wondering if this is possible with LMTP as well. I apologize if I missed something in the wiki. Thanks, Peter

3 5

[Dovecot] Problem importing mail from maildir directory
by Thomas Koeller 24 Feb '13

24 Feb '13

Hi, I am trying to import mail from a maildir directory into dovecot using the 'doveadm import' command: ----------- bash-4.0$ doveadm -D import -u marion maildir:${HOME}/Mail '' ALL doveadm(marion): Debug: Loading modules from directory: /usr/lib64/dovecot doveadm(marion): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so doveadm(marion): Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm doveadm(marion): Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so doveadm(marion): Debug: Skipping module doveadm_zlib_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_zlib_plugin.so: undefined symbol: i_stream_create_deflate (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_backend_rescan (this is usually intentional, so just ignore this message) doveadm(marion): Debug: Effective uid=10001, gid=10000, home=/home/marion doveadm(marion): Debug: quota: No quota setting - plugin disabled doveadm(marion): Debug: maildir++: root=/home/marion/Mail, index=, control=, inbox=/home/marion/Mail, alt= doveadm(marion): Debug: Effective uid=10001, gid=10000, home=/home/marion doveadm(marion): Debug: quota: No quota setting - plugin disabled doveadm(marion): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mbox:~/mail:INBOX=/var/spool/mail/marion doveadm(marion): Debug: fs: root=/home/marion/mail, index=, control=, inbox=/var/spool/mail/marion, alt= ----------- What I get is - no mails are imported - no error messages are output - nothing is written to the system log in other words, nothing happens at all. Any hints? tk

2 1

[Dovecot] make install fails on Solaris 10
by Henrik Johansson 24 Feb '13

24 Feb '13

Hello, I am trying to build dovecot-2.1.15 on Solaris 10 update 10 with Solaris Studio 12.3 and get this error: /bin/bash ../../libtool --tag=CC --mode=link /opt/SUNWspro/bin/cc -fast -xipo=2 -I/usr/sfw/include -I/usr/sfw/include -no-undefined -o doveadm doveadm-mail.o doveadm-mail-altmove.o doveadm-mail-expunge.o doveadm-mail-fetch.o doveadm-mail-import.o doveadm-mail-index.o doveadm-mail-iter.o doveadm-mail-mailbox.o doveadm-mail-mailbox-status.o doveadm-mail-copymove.o doveadm-mailbox-list-iter.o doveadm-mail-search.o doveadm-mail-server.o doveadm-print.o doveadm-settings.o doveadm-util.o server-connection.o doveadm.o doveadm-auth.o doveadm-director.o doveadm-dump.o doveadm-dump-dbox.o doveadm-dump-index.o doveadm-dump-log.o doveadm-dump-mailboxlog.o doveadm-dump-thread.o doveadm-instance.o doveadm-kick.o doveadm-log.o doveadm-master.o doveadm-mount.o doveadm-mutf7.o doveadm-penalty.o doveadm-print-flow.o doveadm-print-pager.o doveadm-print-tab.o doveadm-print-table.o doveadm-proxy.o doveadm-pw.o doveadm-sis.o doveadm-stats.o doveadm-who.o dsync/libdsync.a ../auth/libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-storage/libdovecot-storage.la -R/usr/sfw/lib -L/usr/sfw/lib -lssl -lcrypto -lsocket -lnsl -ldl ../../src/lib-dovecot/libdovecot.la -export-dynamic -lnsl -lsocket -lrt -lsendfile libtool: link: /opt/SUNWspro/bin/cc -fast -xipo=2 -I/usr/sfw/include -I/usr/sfw/include -o .libs/doveadm doveadm-mail.o doveadm-mail-altmove.o doveadm-mail-expunge.o doveadm-mail-fetch.o doveadm-mail-import.o doveadm-mail-index.o doveadm-mail-iter.o doveadm-mail-mailbox.o doveadm-mail-mailbox-status.o doveadm-mail-copymove.o doveadm-mailbox-list-iter.o doveadm-mail-search.o doveadm-mail-server.o doveadm-print.o doveadm-settings.o doveadm-util.o server-connection.o doveadm.o doveadm-auth.o doveadm-director.o doveadm-dump.o doveadm-dump-dbox.o doveadm-dump-index.o doveadm-dump-log.o doveadm-dump-mailboxlog.o doveadm-dump-thread.o doveadm-instance.o doveadm-kick.o doveadm-log.o doveadm-master.o doveadm-mount.o doveadm-mutf7.o doveadm-penalty.o doveadm-print-flow.o doveadm-print-pager.o doveadm-print-tab.o doveadm-print-table.o doveadm-proxy.o doveadm-pw.o doveadm-sis.o doveadm-stats.o doveadm-who.o dsync/libdsync.a ../auth/libpassword.a ../lib-ntlm/libntlm.a ../lib-otp/libotp.a ../../src/lib-storage/.libs/libdovecot-storage.so -L/usr/sfw/lib /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so -lssl -lcrypto -ldl ../../src/lib-dovecot/.libs/libdovecot.so -lnsl -lsocket -lrt -lsendfile -R/opt/HNKSdovecot/lib/dovecot -R/usr/sfw/lib ld: warning: file ../../src/lib-dovecot/.libs/libdovecot.so: linked to /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so: attempted multiple inclusion of file ld: warning: file ../../src/lib-dovecot/.libs/libdovecot.so: linked to /home/henrikj/Build/dovecot-2.1.15/src/lib-dovecot/.libs/libdovecot.so: attempted multiple inclusion of file Undefined first referenced symbol in file $XBKaiwbjOCHRV5w.array_append_array_i..L93 dsync/libdsync.a(dsync-brain.o) $XBKaiwbjOCHRV5w.array_append_array_i..L94 dsync/libdsync.a(dsync-brain.o) $XBKaiwbjOCHRV5w.array_append_array_i..L95 dsync/libdsync.a(dsync-brain.o) ld: fatal: symbol referencing errors. No output written to .libs/doveadm *** Error code 2 make: Fatal error: Command failed for target `doveadm' Current working directory /home/henrikj/Build/dovecot-2.1.15/src/doveadm *** Error code 1 Any suggestions? Thanks Henrik

1 0

Re: [Dovecot] problems with imaps
by Joseph Tam 23 Feb '13

23 Feb '13

On 2013-02-22, Matthias Leopold wrote: > with thunderbird 10.0.12 i can't connect to port 993 and get errors in > the logs like > > TLS: SSL_read() failed: error:14094412:SSL > routines:SSL3_READ_BYTES:sslv3 alert bad certificate > > (certificate generated by dovecot mkcert.sh) I haven't come across any problems with our use of self-signed certificates, but I run the latest 2.1.x dovecot so maybe there's some SSL changes between our version and your's. The fact that the same certificate works for other clients, and also for TLS on Thunderbird seem to suggest Thunderbird is fumbling it. But maybe you can try the command diagnostic from the command line "openssl s_client -connect yourserver:993 ..." or use one of the online certificate checkers to get some useful diagnostics. > TLS: SSL_read() failed: error:14094418:SSL > routines:SSL3_READ_BYTES:tlsv1 alert unknown ca This error entry pops up in my logs once in a while. I think the error might be misleading since the error message happen in the middle of a long sequence of successful connections. Also check that the client is actually using the right security mode (not TLS or clear), perhaps by doing a network snoop. Joseph Tam <jtam.home(a)gmail.com>

2 1