- dovecot - dovecot.org

[Dovecot] Speed up mail retrieval by keyword
by Manfred Usselmann 09 Jun '13

09 Jun '13

Hi, I' m using a roundcube plugin for adding attributes to mails, which are stored as IMAP keywords (https://github.com/umount/message_label [1]). This plugin allows me to retrieve mails with a certain attribute across all my mail folders. Selecting mails this way is very convenient, but also very slow, probably because I've got a lot of mails and folders. Is there a way to speed this up somehow by changing any configuration options? Versions in use are Roundcube 0.9.0 and Dovecot 2.1.10 (Maildir). Thanks Manfred Links: ------ [1] https://github.com/umount/message_label

2 1

[Dovecot] search and UTF-8 normalization forms (NFD)
by Lutz Preßler 09 Jun '13

09 Jun '13

Hello, on a system with dovecot 2.2 I've got a mailbox containing multiple mails from a person called Krüger, but From: header encoded differently. Some are encoded in UTF-8 normalization form decomposed (as used by Mac OSX), that is u and umlaut accent as sperate combined codepoints instead of one ü: From: =?utf-8?Q?replaced_Kru=CC=88ger?= <krueger(a)some.domain> Searching within roundcube webmail for "krüger" as sender missis this mails. Roundcube sends (dovecot rawlog): A0003 UID THREAD REFS UTF-8 ALL HEADER FROM {7+}krüger Is this supposed to work? Haven't done any more debugging (other search variants) or read RFCs. As a user I would expect Unicode equivalence rules be applied (see http://en.wikipedia.org/wiki/Unicode_equivalence) Regards, Lutz

3 7

[Dovecot] Question on Director setup
by Joe Wong 07 Jun '13

07 Jun '13

Hello, I am following the wiki page to setup 2 IMAP servers Director. in each server, I have created 2 sets of dovecot config file where the first set is for imap proxy with director the second set is for the imap backend after this, I attempt to login IMAP through the imap-proxy on any machine with several users. from the log, all users always go to the same IMAP backend in Server 2, I don't see any user go to the IMAP backend in Server 1 at all. What could be the problem I have ? - Joe

1 0

[Dovecot] Dovecot IMAP
by Alex Dubinin 07 Jun '13

07 Jun '13

This is my first experience of the mail server. Set up a mail server from Postfix + Dovecot with the MySQL authorization. When you create a new user dovecot makes strange folder structure: the 'inbox' contains 'juncus', 'tash', 'sent' etc. ie 'sent' and other folders are subdir to the 'inbox'. My result: 04 LIST "" "*" * LIST (\HasChildren) "." "INBOX" * LIST (\HasNoChildren) "." "INBOX.Trash" I want: 04 LIST "" "*" * LIST (\HasNoChildren) "." "INBOX" * LIST (\HasNoChildren) "." "Trash" # dovecot --version 2.1.7 # dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.0 ext4 auth_debug = yes auth_debug_passwords = yes auth_verbose = yes auth_verbose_passwords = plain base_dir = /run/dovecot/ debug_log_path = /var/vmail/dovecot.log disable_plaintext_auth = no info_log_path = /var/vmail/dovecot.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = MY_IP log_path = /var/vmail/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " login_greeting = MAIL_DOMAIN_NAME IMAP server ready. mail_debug = yes mail_location = maildir:/var/vmail/%d/%n/Maildir mail_plugins = " quota" namespace inbox { hidden = no inbox = yes list = yes location = mailbox Drafts { special_use = \Drafts } mailbox Trash { special_use = \Trash } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota quota_rule = *:storage=1G quota_rule2 = Trash:storage=+10%% quota_rule3 = Junk:storage=+10%% quota_rule4 = Drafts:storage=+10%% quota_warning = storage=95%% quota-warning 95 %u } postmaster_address = admin@ MAIL_DOMAIN_NAME protocols = " imap pop3" service auth-worker { executable = auth -w unix_listener auth-worker { group = mode = 0600 } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0600 user = vmail } unix_listener auth-userdb { group = mode = 0600 user = } user = root } service dict { unix_listener dict { group = mode = 0600 user = } } service imap-login { inet_listener imap { port = 0 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 0 service_count = 1 } service imap { unix_listener login/imap { group = mode = 0666 user = } } service lmtp { unix_listener lmtp { group = mode = 0666 user = } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 ssl = yes } } service pop3 { unix_listener login/pop3 { group = mode = 0666 user = } } ssl = required ssl_ca = </etc/dovecot/MAIL_SERVER_NAME-ca.crt ssl_cert = </etc/dovecot/MAIL_SERVER_NAME .crt ssl_key = </etc/dovecot/private/MAIL_SERVER_NAME .key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_ssl = yes protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /var/vmail/dovecot-deliver.log postmaster_address = admin@ MAIL_DOMAIN_NAME } protocol imap { mail_plugins = " quota autocreate imap_quota" } How to make the imap folders 'sent', 'trash' and others were not affiliated? P.S. Sorry for my english.

3 2

[Dovecot] v2.2.2 (e5bd0a7c6a1e) Core Dump
by Thomas Leuxner 07 Jun '13

07 Jun '13

(gdb) bt full #0 mailbox_list_default_get_vname (list=0x21ceec0, storage_name=0x0) at mailbox-list.c:655 __s2_len = <optimized out> i = <optimized out> prefix_len = <optimized out> name_len = <optimized out> vname = 0x0 list_sep = <optimized out> ns_sep = <optimized out> ret = <optimized out> #1 0x00007fecd7cf4585 in acl_backend_vfile_get_local_dir (name=0x0, name@entry=0x7fecd7cfada8 "", backend=<error reading variable: Unhandled dwarf expression opcode 0xfa>) at acl-backend-vfile.c:147 ns = 0x21ca6d0 list = 0x21ceec0 storage = <optimized out> type = <optimized out> dir = <optimized out> inbox = <optimized out> vname = <optimized out> error = 0x221a100 "\320\"\035\002" #2 0x00007fecd7cf470e in acl_backend_vfile_object_init (_backend=0x21d22d0, name=0x7fecd7cfada8 "") at acl-backend-vfile.c:195 _data_stack_cur_id = 6 backend = 0x21d22d0 aclobj = 0x221a100 dir = <optimized out> vname = <optimized out> #3 0x00007fecd7cf3c8e in acl_backend_get_default_object (backend=backend@entry=0x21d22d0) at acl-backend.c:177 user = 0x21caeb0 ns = 0x21ca6d0 default_name = <optimized out> #4 0x00007fecd7cf3cce in acl_backend_get_default_rights (backend=0x21d22d0, mask_r=mask_r@entry=0x7fffc5835d78) at acl-backend.c:184 aclobj = <optimized out> #5 0x00007fecd7cf9c51 in acl_mailbox_try_list_fast (ctx=0x221b4b0) at acl-mailbox-list.c:107 alist = 0x21cf1a8 nonowner_list_ctx = <optimized out> ret = <optimized out> backend = <optimized out> idxp = 0x21cf278 acl_mask = 0x0 ns = 0x21ca6d0 update_ctx = {iter_ctx = 0x1, tree_ctx = 0x7fecd90aa548, glob = 0x6, leaf_flags = 35726664, parent_flags = 0, update_only = 0, match_parents = 0} name = <optimized out> #6 acl_mailbox_list_iter_init (list=0x21ceec0, patterns=0x21d92f8, flags=49152) at acl-mailbox-list.c:194 _data_stack_cur_id = 5 alist = 0x21cf1a8 ctx = 0x221b4b0 pool = <optimized out> p = <optimized out> i = <optimized out> inboxcase = <optimized out> #7 0x00007fecd8c0c09d in mailbox_list_iter_init_multiple (list=0x21ceec0, patterns=<optimized out>, flags=49152) at mailbox-list-iter.c:173 ctx = <optimized out> ret = 0 #8 0x00007fecd8c0d35b in mailbox_list_ns_iter_try_next (info_r=<synthetic pointer>, _ctx=0x21d9020) at mailbox-list-iter.c:574 ctx = 0x21d9020 info = <optimized out> errstr = <optimized out> has_children = <optimized out> ns = <optimized out> error = 4294967295 #9 mailbox_list_ns_iter_next (_ctx=0x21d9020) at mailbox-list-iter.c:645 info = <optimized out> #10 0x00007fecd8c0bd17 in mailbox_list_iter_next_call (ctx=ctx@entry=0x21d9020) at mailbox-list-iter.c:941 info = <optimized out> set = <optimized out> #11 0x00007fecd8c0c9a8 in mailbox_list_iter_next (ctx=0x21d9020) at mailbox-list-iter.c:1012 _data_stack_cur_id = 4 info = <optimized out> #12 0x000000000040f209 in cmd_list_continue (cmd=cmd@entry=0x21ddf40) at cmd-list.c:229 ctx = 0x21de188 info = <optimized out> flags = <optimized out> str = 0x21af518 mutf7_name = 0x21af668 name = <optimized out> ret = <optimized out> #13 0x000000000040fa4f in cmd_list_full (cmd=0x21ddf40, lsub=<optimized out>) at cmd-list.c:463 client = <optimized out> args = 0x21bab18 list_args = 0x21ddf40 arg_count = <optimized out> ctx = 0x21de188 patterns = {arr = {buffer = 0x21de1c8, element_size = 8}, v = 0x21de1c8, v_modifiable = 0x21de1c8} ref = 0x21de1b8 "" pattern = 0x21de1c0 "%" patterns_strarr = 0x21de200 str = <optimized out> #14 0x000000000041675c in command_exec (cmd=cmd@entry=0x21ddf40) at imap-commands.c:156 hook = 0x21b8d90 ret = <optimized out> #15 0x00000000004157c0 in client_command_input (cmd=0x21ddf40) at imap-client.c:775 client = 0x21dd360 command = <optimized out> __FUNCTION__ = "client_command_input" #16 0x000000000041587a in client_command_input (cmd=0x21ddf40) at imap-client.c:836 client = 0x21dd360 command = <optimized out> __FUNCTION__ = "client_command_input" #17 0x0000000000415b35 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x21dd360) at imap-client.c:874 No locals. #18 client_handle_input (client=client@entry=0x21dd360) at imap-client.c:886 _data_stack_cur_id = 3 ret = 32 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #19 0x0000000000415ee2 in client_input (client=0x21dd360) at imap-client.c:928 cmd = <optimized out> output = 0x21ddd78 bytes = 19 __FUNCTION__ = "client_input" #20 0x00007fecd8922d06 in io_loop_call_io (io=0x21dde40) at ioloop.c:387 ioloop = 0x21b7720 t_id = 2 #21 0x00007fecd8923b77 in io_loop_handler_run (ioloop=ioloop@entry=0x21b7720) at ioloop-epoll.c:215 ctx = 0x21b7a90 events = 0x21ca6d0 event = 0x21b7b00 list = 0x21dde90 io = <optimized out> tv = {tv_sec = 3, tv_usec = 876580} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run" #22 0x00007fecd8922848 in io_loop_run (ioloop=0x21b7720) at ioloop.c:406 No locals. #23 0x00007fecd88d8b53 in master_service_run (service=0x21b75b0, callback=callback@entry=0x41ed00 <client_connected>) at master-service.c:560 No locals. #24 0x000000000040baf8 in main (argc=1, argv=0x21b7390) at main.c:400 set_roots = {0x4262e0, 0x0} login_set = {auth_socket_path = 0x21af040 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41ebb0 <login_client_connected>, failure_callback = 0x41e8c0 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out>

1 1

[Dovecot] Load Balancing and HA
by Romer Ventura 06 Jun '13

06 Jun '13

Hello, I've been thinking about the best way to achieve load balancing and making my mail servers highly available. So far I believe I have 2 scenarios: Scenario1: This should allow any to lose any of the servers and clients still have access to their emails (although I am not sure how the indexes would react to this and sudden disconnection) - 2 Dovecot Proxy servers, using a virtual IP to where the clients will connect to from the WAN and LAN - 2 Dovecot+Postfix servers with local cache - 2 NFS servers and synced with dsync (mirror, 1 server writes to its own NFS and changes synced to the other via dsync) Scenario2: Pretty much as above on the back end. However, with this there is no way to load balance users. - 2 Dovecot+Postfix server with local cache - 2 NFS servers synced with dsync - Make use of DNS MX record priority to provide access to secondary email server Anyone care to comment? Thanks. <BR CLEAR="ALL"> <hr style="border: 1px solid #CCC;"> <p style="font-style:italic; font-size:8pt; font-family:verdana; color:gray;">This document and attachments may contain technical data controlled under the U.S. International Traffic in Arms Regulations (ITAR) or the Export Administration Regulations (EAR) and may not be exported to a Foreign Person, either in the U.S. or abroad, without the proper authorization by the U.S. Department of State or Department of Commerce, whichever is applicable. CONFIDENTIALITY NOTE: This electronic transmission, including all attachments, is directed in confidence solely to the person(s) to whom it is addressed, or an authorized recipient, and may not otherwise be distributed, copied or disclosed. The contents of the transmission may also be subject to intellectual property rights and such rights are expressly claimed and are not waived. If you have received this transmission in error, please notify the sender immediately by return electronic transmission and then immediately delete this transmission, including all attachments, without copying, distributing or disclosing same. The recipient should check this e-mail and any attachments for the presence of viruses. Houston Sigma Technologies L.P. accepts no liability for any damage caused by any virus transmitted by this e-mail.</p>

6 8

[Dovecot] Dovecot mysql replication
by Edwardo Garcia 06 Jun '13

06 Jun '13

Halo, (First time posting, please forgive English is not native) Change from Courier to Dovecot 2.1.16 Having two server. Having mysql on thiz two server, one master, one slave. What we wish is slave Dovecot only ask slave mysql, unless slave mysql not work when then ask master, we have Postfix do thiz fallover good, but Dovecot talk to slave and master no mater what, we think thiz defeat fallover as we not want this aktion, but aktion like Postfix. The problemo is can not find Dovecot option for thiz in wiki2.dovecot.org, is possible?

9 26

[Dovecot] Error: Threading lost Message ID
by Oscar A. Jara 05 Jun '13

05 Jun '13

Hello everyone, I have just put in production dovecot imap and pop3 in replacement of courier in a setup of 700 accounts aprox. Dovecot release running is 1.2.16 in a Linux CentOS 5.8. Seems like some accounts are having problems dealing with message threading, as I read lines like this one in my logs: IMAP(some_user): Error: Threading lost Message ID ...and some of those accounts cannot even list the emails. I temporarily got rid of this problem deactivating threading on those accounts but I would like to solve it. I found a patch that seams to deal with this problem at http://hg.dovecot.org/dovecot-1.2/rev/76023d59c3b2 but it would be weird that CentOS wouldn't have release a patched version of the package. Am I missing something here? Thanks in advance! __________ Information from ESET Mail Security, version of virus signature database 8412 (20130604) __________ The message was checked by ESET Mail Security. http://www.eset.com

2 3

[Dovecot] Crash dovecot 1.2.15
by ib 05 Jun '13

05 Jun '13

Hi everybody We have a probleme with dovecot Jun 05 06:26:01 dovecot: Warning: SIGHUP received - reloading configuration Jun 05 06:26:02 dovecot: Error: Raw backtrace: /usr/sbin/dovecot() [0x41348a] -> /usr/sbin/dovecot() [0x413584] -> /usr/sbin/dovecot() [0x40b290] -> /usr/sbin/dovecot() [0x412bf6] -> /usr/sbin/dovecot() [0x405c9a] -> /usr/sbin/dovecot() [0x416f3d] -> /usr/sbin/dovecot() [0x4163b8] -> /usr/sbin/dovecot() [0x40bb39] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f2bad861c8d] -> /usr/sbin/dovecot() [0x403859] Jun 05 07:58:09 dovecot: Info: Dovecot v1.2.15 starting up (core dumps disabled) -- Cordialement, <http://www.ice-dev.com> *Ivan BERTHELOT* Administrateur Réseaux ICE DEVELOPMENT 16 rue Maurice Bouchor Tel : 08 21 23 03 54 http://www.ice-dev.com

2 1

Re: [Dovecot] dovecot and time
by Rick Romero 05 Jun '13

05 Jun '13

I found something interesting via strace. lda is writing a timestamp with utime before doign the fsync, but I'm really not a C guy, so I have no idea why that's going on via procmail and not via commandline. I assume it's related to the choice of pread64 vs read. when called from commandline (working): read(0, "July 14-20, 2013\n10 courses. Bon"..., 4096) = 4096 read(0, "s bigger\nthan most realistic cyb"..., 4096) = 4096 read(0, "olina company in\nnumerous small,"..., 4096) = 4096 read(0, "on't have any way to tell you\". "..., 4096) = 4096 read(0, "rer. This version of Chrome addr"..., 4096) = 4096 read(0, "edu.\n\nDr. Johannes Ullrich is Ch"..., 4096) = 3164 read(0, "", 932) = 0 umask(0177) = 077 open("/usr/home/vpopmail/domains/havokmon.com/rick/Maildir/tmp/1370448645.M589211P14191.smtp101", O_WRONLY|O_CREAT|O_EXCL|O_TRUNC|O_LARGEFILE, 0777) = 11 umask(077) = 0177 open("/usr/home/vpopmail/domains/havokmon.com/rick/Maildir/dovecot.index.cache", O_RDWR|O_LARGEFILE) = 12 fstat64(12, {st_mode=S_IFREG|0600, st_size=1568768, ...}) = 0 mmap2(NULL, 1568768, PROT_READ, MAP_SHARED, 12, 0) = 0xb7064000 fstat64(11, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 write(11, "Return-Path: <newsbites(a)sans.org"..., 8192) = 8192 write(11, "s bigger\nthan most realistic cyb"..., 8192) = 8192 write(11, "on't have any way to tell you\". "..., 11356) = 11356 fstat64(11, {st_mode=S_IFREG|0600, st_size=27740, ...}) = 0 fsync(11) = 0 _llseek(11, 0, [27740], SEEK_END) = 0 close(11) = 0 time(NULL) = 1370448645 umask(0177) = 077 when called from procmail (not working): pread64(10, "00.vfemail.net,S=10941\n968 W2552"..., 4064, 52993) = 4064 pread64(10, "53 :1361943010.39085.mx100.vfema"..., 4087, 57057) = 4087 pread64(10, " :1364597743.43999.mx100.vfemail"..., 4085, 61144) = 4085 pread64(10, "mx100.vfemail.net,S=15951\n17287 "..., 4065, 65229) = 4065 pread64(10, "637P32360.smtp101.vfemail.net,S="..., 4074, 69294) = 3967 pread64(10, "", 107, 73261) = 0 umask(0177) = 077 open("/usr/home/vpopmail/domains/havokmon.com/rick/Maildir/tmp/1370449940.M313792P17436.smtp101", O_WRONLY|O_CREAT|O_EXCL|O_TRUNC|O_LARGEFILE, 0777) = 11 umask(077) = 0177 open("/usr/home/vpopmail/domains/havokmon.com/rick/Maildir/dovecot.index.cache", O_RDWR|O_LARGEFILE) = 12 fstat64(12, {st_mode=S_IFREG|0600, st_size=1575936, ...}) = 0 mmap2(NULL, 1575936, PROT_READ, MAP_SHARED, 12, 0) = 0xb70b0000 fstat64(11, {st_mode=S_IFREG|0600, st_size=0, ...}) = 0 read(0, "", 1127) = 0 write(11, "Return-Path: <dovecot-bounces@do"..., 2911) = 2911 utime("/usr/home/vpopmail/domains/havokmon.com/rick/Maildir/tmp/1370449940.M313792P17436.smtp101", [2013/06/05-16:32:20, 2013/06/05-21:32:18]) = fsync(11) = 0 _llseek(11, 0, [2911], SEEK_END) = 0 close(11) = 0 time(NULL) = 1370449940 umask(0177) = 077 Should I attach full traces? They're 32k and 64k respectively. Sorry about the lack of threading, I had my subscription off and didn't get a copy to reply to :/ Rick

2 2