- dovecot - dovecot.org

Integrity check of mailboxes before dsync
by Murray Trainer 15 Jul '14

15 Jul '14

Hi All, I am migrating a large number of Dovecot mailboxes - some of them are quite old. I hit an issue yesterday with a corrupt file (index?) that was preventing the mailbox from being synced properly As soon as I removed the file the dsync worked. Is there a way to check the integrity of each mailbox / indexes before I dsync it? Thanks Murray

1 0

director / main instance
by Will Yardley 15 Jul '14

15 Jul '14

I have directors and backend servers running on the same systems (x3). To be able to run doveadm foo with a minimum of fuss (without having to list socket paths explicitly), should it be the director that's the "default"? If so, is it safe to symlink '/var/run/dovecot' to '/var/run/dovecot-director', or should I just make the director's base path /var/run/dovecot directly? in dovecot-director.conf, I have: service doveadm { inet_listener { port = 8889 } } local 192.168.x.0/24 { doveadm_password = Foo } doveadm_proxy_port = 8888 and in dovecot-main.conf, I have: service doveadm { inet_listener { port = 8888 } } local 192.168.x.0/24 { doveadm_password = Foo } protocol doveadm { auth_socket_path = director-userdb } Is this correct (and is there anything unneeded / redundant there)? # dovecot instance list path name last used running /var/run/dovecot-director director 2014-07-14 20:36:49 yes /var/run/dovecot-main main 2014-07-14 20:36:49 yes # dovecot director status mail server ip vhosts users 192.168.x.xx 100 2 192.168.x.xx 100 0 192.168.x.xx 100 0

1 0

Transition from one server to another.
by Anders Wegge Keller 15 Jul '14

15 Jul '14

A frind of mine and I are running a dedicated server, that among other things host mail for ourselves and friends and families. All in all about 15 different domains with 35-40 users. The machine in question is old, so we are doing a slow transition from the old server to the new one. So far, we've managed to move web hosts seamlessly. Due to the technical capabilities at some of the user base, it would be nice to get to a setup, where we can move individual users imaps from the old server to the new one, as we get the time to visit them. I have an idea how such a transition could go: 1. Upgrade the old dovecot 1.2.15 to 2.1.whateveritis from debian squeeze backports. 2. Set dsync up to replicate mails from the old server to the new server. I know that 2.2 is recommended, but with a limited amount of user, I'm willing to take a performance hit. 3. Migrate my parents &c to use the new server. 4. When all users have been moved on to using the new server, upgrade MX records for the domain to point at the new server. 5. When all MX records are updated, decalre success. Is this feasible, and what would the risks be. For instance, during step 4, mails are bound to arrive at bothe the old and new server for some time. Will this cause problems? Is there a simpler solution to the problem? -- /Wegge Leder efter redundant peering af dk.*,linux.debian.*

4 3

Re: Fatal: master: service(imap): child 20258 killed with, signal 6 (core not dumped - set service imap {, drop_priv_before_exec=yes }) (CJ Keist)
by Edgar Pettijohn 15 Jul '14

15 Jul '14

Have you tried: 10-master.conf service imap { drop_priv_before_exec=yes } as suggested by the error?

1 0

how many connection by pop3 ?
by ihab 14 Jul '14

14 Jul '14

how many connection by pop3 ? Thanks, Best regrades, -- View this message in context: http://dovecot.2317879.n4.nabble.com/how-many-connection-by-pop3-tp48876.ht… Sent from the Dovecot mailing list archive at Nabble.com.

4 3

OOM in Dovecot 2.2.13 imap
by Bernhard Schmidt 14 Jul '14

14 Jul '14

Hi, we run Dovecot 2.2.13 on Debian Wheezy with a couple thousand mailboxes. We have two users that repeatedly trigger an OOM condition with IMAP. Jun 23 12:53:21 lxmhs74 dovecot: imap(USER): Fatal: pool_system_realloc(268435456): Out of memory Jun 23 12:53:21 lxmhs74 dovecot: imap(USER): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x6c15f) [0x7f11766cc15f] -> /usr/lib/dovecot/libdovecot.so.0(+0x6c1be) [0x7f11766cc1be] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f1176685568] -> /usr/lib/dovecot/libdovecot.so.0(+0x81e80) [0x7f11766e1e80] -> /usr/lib/dovecot/libdovecot.so.0(+0x86cda) [0x7f11766e6cda] -> /usr/lib/dovecot/libdovecot.so.0(+0x86f96) [0x7f11766e6f96] -> /usr/lib/dovecot/libdovecot.so.0(+0x87b48) [0x7f11766e7b48] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_sendv+0xcd) [0x7f11766e60cd] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_send+0x1a) [0x7f11766e615a] -> /usr/lib/dovecot/modules/lib30_imap_zlib_plugin.so(+0x5849) [0x7f1175692849] -> /usr/lib/dovecot/modules/lib30_imap_zlib_plugin.so(+0x5982) [0x7f1175692982] -> /usr/lib/dovecot/modules/lib30_imap_zlib_plugin.so(+0x5b62) [0x7f1175692b62] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_flush+0x4d) [0x7f11766e5d6d] -> /usr/lib/dovecot/libdovecot.so.0(+0x85e2c) [0x7f11766e5e2c] -> dovecot/imap [USER IP UID fetch](client_output+0xe9) [0x7f1176e8d269] -> /usr/lib/dovecot/libdovecot.so.0(+0x879d5) [0x7f11766e79d5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4e) [0x7f11766dcfbe] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) [0x7f11766ddfb7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x9) [0x7f11766dd049] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f11766dd0c8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f117668a7b3] -> dovecot/imap [USER IP UID fetch](main+0x2ae) [0x7f1176e8152e] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f11762f3ead] -> dovecot/imap [USER IP UID fetch](+0xd69d) [0x7f1176e8169d] Jun 23 12:53:21 lxmhs74 dovecot: imap(USER): Fatal: master: service(imap): child 33659 killed with signal 6 (core dumped) The gdb backtrace looks like this: gdb) bt full #0 0x00007f1176307475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f117630a6f0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f11766cc155 in default_fatal_finish (type=<optimized out>, status=status@entry=83) at failures.c:193 backtrace = 0x7f11789d4088 "/usr/lib/dovecot/libdovecot.so.0(+0x6c15f) [0x7f11766cc15f] -> /usr/lib/dovecot/libdovecot.so.0(+0x6c1be) [0x7f11766cc1be] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f1176685568] -> /usr/lib/d"... #3 0x00007f11766cc1be in i_internal_fatal_handler (ctx=0x7fff5ffedfb0, format=<optimized out>, args=<optimized out>) at failures.c:657 status = 83 #4 0x00007f1176685568 in i_fatal_status (status=status@entry=83, format=format@entry=0x7f1176702ba8 "pool_system_realloc(%lu): Out of memory") at failures.c:295 ctx = {type = LOG_TYPE_FATAL, exit_status = 83, timestamp = 0x0} args = {{gp_offset = 24, fp_offset = 48, overflow_arg_area = 0x7fff5ffee0a0, reg_save_area = 0x7fff5ffedfe0}} #5 0x00007f11766e1e80 in pool_system_realloc (pool=<optimized out>, mem=0x0, old_size=134217728, new_size=268435456) at mempool-system.c:134 __FUNCTION__ = "pool_system_realloc" #6 0x00007f11766e6cda in o_stream_grow_buffer (fstream=fstream@entry=0x7f11789f41c0, bytes=<optimized out>) at ostream-file.c:440 size = 268435456 new_size = <optimized out> end_size = <optimized out> #7 0x00007f11766e6f96 in o_stream_add (fstream=fstream@entry=0x7f11789f41c0, data=0x7f11789fe549, size=12113) at ostream-file.c:501 unused = <optimized out> sent = <optimized out> i = <optimized out> #8 0x00007f11766e7b48 in o_stream_file_sendv (stream=0x7f11789f41c0, iov=<optimized out>, iov_count=<optimized out>) at ostream-file.c:588 fstream = 0x7f11789f41c0 size = <optimized out> total_size = <optimized out> added = <optimized out> optimal_size = <optimized out> i = <optimized out> ret = 0 __FUNCTION__ = "o_stream_file_sendv" #9 0x00007f11766e60cd in o_stream_sendv (stream=0x7f11789f4250, iov=iov@entry=0x7fff5ffee1a0, iov_count=iov_count@entry=1) at ostream.c:239 _stream = 0x7f11789f41c0 i = <optimized out> total_size = 12113 ret = <optimized out> __FUNCTION__ = "o_stream_sendv" #10 0x00007f11766e615a in o_stream_send (stream=<optimized out>, data=<optimized out>, size=size@entry=12113) at ostream.c:217 iov = {iov_base = 0x7f11789fe549, iov_len = 12113} #11 0x00007f1175692849 in o_stream_zlib_send_outbuf (zstream=0x7f11789f9340) at ostream-zlib.c:94 ret = <optimized out> size = 12113 #12 0x00007f1175692982 in o_stream_zlib_send_flush (zstream=zstream@entry=0x7f11789f9340, final=final@entry=true) at ostream-zlib.c:189 zs = 0x7f11789f9420 len = <optimized out> done = false ret = <optimized out> flush = <optimized out> __FUNCTION__ = "o_stream_zlib_send_flush" #13 0x00007f1175692b62 in o_stream_zlib_flush (stream=0x7f11789f9340) at ostream-zlib.c:235 zstream = 0x7f11789f9340 ret = <optimized out> #14 0x00007f11766e5d6d in o_stream_flush (stream=stream@entry=0x7f11789f93d0) at ostream.c:157 _stream = 0x7f11789f9340 ret = 1 __FUNCTION__ = "o_stream_flush" #15 0x00007f11766e5e2c in o_stream_default_cork (_stream=0x7f11789f9340, set=<optimized out>) at ostream.c:429 No locals. #16 o_stream_default_cork (_stream=0x7f11789f9340, set=<optimized out>) at ostream.c:422 No locals. #17 0x00007f1176e8d269 in client_output (client=0x7f11789f4470) at imap-client.c:1019 ret = 0 __FUNCTION__ = "client_output" #18 0x00007f11766e79d5 in stream_send_io (fstream=0x7f11789f41c0) at ostream-file.c:468 ostream = 0x7f11789f4250 ret = <optimized out> #19 0x00007f11766dcfbe in io_loop_call_io (io=0x7f1178a5bbe0) at ioloop.c:441 ioloop = 0x7f11789dc750 t_id = 2 __FUNCTION__ = "io_loop_call_io" #20 0x00007f11766ddfb7 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x7f11789dc750) at ioloop-epoll.c:220 ctx = 0x7f11789dd3e0 events = 0x0 event = 0x7f11789de250 list = 0x7f11789dee40 io = <optimized out> tv = {tv_sec = 297, tv_usec = 43980} events_count = <optimized out> msecs = <optimized out> ret = 1 i = <optimized out> call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #21 0x00007f11766dd049 in io_loop_handler_run (ioloop=ioloop@entry=0x7f11789dc750) at ioloop.c:488 No locals. #22 0x00007f11766dd0c8 in io_loop_run (ioloop=0x7f11789dc750) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #23 0x00007f117668a7b3 in master_service_run (service=0x7f11789dc5e0, callback=callback@entry=0x7f1176e96a00 <client_connected>) at master-service.c:566 No locals. #24 0x00007f1176e8152e in main (argc=1, argv=0x7f11789dc390) at main.c:400 set_roots = {0x7f11770a4960, 0x0} login_set = {auth_socket_path = 0x7f11789d4048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x7f1176e96880 <login_client_connected>, failure_callback = 0x7f1176e96580 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> I already deleted the index, but the issue persists. Bernhard

4 8

protocol specific AuthDatabase Queries
by claus 14 Jul '14

14 Jul '14

Hi, i have to configure different sql-queries for protocol lmtp, another for protocol smtp and one query for other protocols. I have configured in "/etc/dovecot/conf.d/auth-sql.conf.ext" one entry for all protocols and 2 protocol specific entries: protocol lmtp { passdb { driver = sql args = /etc/dovecot/dovecot-lmtp-sql.conf.ext } } protocol smtp { passdb { driver = sql args = /etc/dovecot/dovecot-smtp-sql.conf.ext } } passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf.ext } is this correct or do i have to configure all possible protocols seperately? First i had a working configuration for all protocols except for lmtp (but now i need additionally a special query for smtp): protocol !lmtp { .. } protocol lmtp { .. } Can you tell me whats the prefered configuration? Thanks Claus

1 0

doveadm dump ignores .pvt
by Thomas Herrmann 14 Jul '14

14 Jul '14

While debugging a different problem, I used "doveadm dump" to show information about a maildir folder; it happily reported values from dovecot.index and dovecot.index.log (confirmed by strace): [...] messages count ........... = 978 seen messages count ...... = 967 [...] However, mail clients reported different values, I guess because the Seen flags were actually stored in the dovecot.index.pvt.log files. Is this a known problem or a result of my (maybe unsupported?) setup? My public maildir folder contains only links to mailboxes of the private maildir of the mail admin, i.e.: /home/vmail/public/.Info -> ../adwin.de/mail-admin/Maildir/.Info namespace { list = children location = maildir:/home/vmail/public:INDEXPVT=/home/vmail/adwin.de/%n/public prefix = ADwin/ separator = / subscriptions = no type = public } My setups leads to .pvt-files in the public namespace, could this be a problem? http://wiki2.dovecot.org/SharedMailboxes/Symlinks explicitly states that symlinking _should_ work. Using version 2.2.13 (debian packages). Regards, Thomas

1 0

Flags in public folders disappear when more than 25 flags are used
by Thomas Herrmann 14 Jul '14

14 Jul '14

Hello, I have been using flags in public folders for quite a while with no problems. Once the flags were added to all clients (Thunderbird), they were visible and synchronized properly. Now I have added some new flags, and in the dovecot-keywords files I see that I am now using more than 25 flags (in which case they are not stored using an additional letter in the filename). Now I see that newly added flags are only visible in the client for a short time and then suddenly disappear. How can I debug this, or what may be a reason for this? Regards Thomas Herrmann root@mailsrv2:~# dovecot --version 2.1.7 root@mailsrv2:~# dovecot -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.5 xfs disable_plaintext_auth = no log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = never mail_location = maildir:/home/vmail/adwin.de/%n/Maildir mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags namespace { inbox = yes location = prefix = separator = / subscriptions = yes type = private } namespace { list = children location = maildir:/home/vmail/public:INDEX=/home/vmail/adwin.de/%n/public prefix = ADwin/ separator = / subscriptions = no type = public } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { acl = vfile sieve = /home/vmail/adwin.de/%n/dovecot.sieve sieve_dir = /home/vmail/adwin.de/%n/sieve sieve_extensions = +imapflags +imap4flags } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { mode = 0600 user = vmail } user = root } service imap-login { inet_listener imap { address = *,:: port = 56143 } inet_listener imaps { address = *,:: port = 56993 ssl = yes } service_count = 0 } service imap { vsz_limit = 512 M } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { executable = /usr/lib/dovecot/managesieve-login service_count = 0 } service managesieve { executable = /usr/lib/dovecot/managesieve } ssl_ca = </etc/dovecot/ca-bundle.crt ssl_cert = </etc/dovecot/XXXXXXXXXXXXXX.crt ssl_key = </etc/dovecot/XXXXXXXXXXXXXXX.key userdb { driver = passwd } userdb { args = uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes driver = static } protocol imap { mail_max_userip_connections = 100 mail_plugins = acl imap_acl } protocol imaps { mail_max_userip_connections = 100 mail_plugins = acl imap_acl } protocol lda { auth_socket_path = /var/run/dovecot/auth-master log_path = /home/vmail/dovecot-deliver.log mail_fsync = optimized mail_plugins = sieve acl postmaster_address = XXXXXXXX(a)XXXXX.de } protocol lmtp { mail_plugins = sieve acl }

2 4

Panic: file mail-index.c: line 650 (mail_index_close): assertion failed: (index->open_count > 0)
by Hardy Flor 14 Jul '14

14 Jul '14

Hello, I'm use the virtual plugin for list all unread messages in the public namespace. Every time the connection is terminated with this error message when I select the virtual/projekte mailbox. Do not show any emails. The version is build today from source 2.2.13.auto+102 Hardy *** dovecot-virtual *** !INBOX Projekte/* unseen ********************** *** part of dovecot -n *** # 2.2.13 (fd0616d553b0): /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.5 ext4 namespace { list = children location = mdbox:/var/mail/projekte/:INDEXPVT=/var/mail/user/%n/projekte prefix = Projekte/ separator = / subscriptions = no type = public } ************************* GNU gdb (GDB) 7.4.1-debian Copyright (C) 2012 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>... Reading symbols from /usr/lib/dovecot/imap...(no debugging symbols found)...done. Attaching to program: /usr/lib/dovecot/imap, process 6839 ptrace: Kein passender Prozess gefunden. [New LWP 6839] warning: Can't read pathname for load map: Eingabe-/Ausgabefehler. [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `dovecot/imap imap-postlogin'. Program terminated with signal 6, Aborted. #0 0x00007f38fc37c475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 (gdb) bt full #0 0x00007f38fc37c475 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f38fc37f6f0 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f38fc742395 in ?? () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #3 0x00007f38fc7423fe in ?? () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #4 0x00007f38fc6fa96e in i_panic () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #5 0x00007f38fca6a1e1 in mail_index_close () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #6 0x00007f38fca5c46c in index_storage_mailbox_close () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #7 0x00007f38fca2fb8d in mailbox_close () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #8 0x00007f38fb0f600d in ?? () from /usr/lib/dovecot/modules/lib20_virtual_plugin.so No symbol table info available. #9 0x00007f38fb0f61b0 in virtual_backend_box_open () from /usr/lib/dovecot/modules/lib20_virtual_plugin.so No symbol table info available. #10 0x00007f38fb0f7860 in virtual_storage_sync_init () from /usr/lib/dovecot/modules/lib20_virtual_plugin.so No symbol table info available. #11 0x00007f38fca30703 in mailbox_sync_init () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #12 0x00007f38fca30827 in mailbox_sync () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #13 0x00007f38fca5afd0 in index_storage_get_status () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #14 0x00007f38fb0f5458 in ?? () from /usr/lib/dovecot/modules/lib20_virtual_plugin.so No symbol table info available. #15 0x00007f38fbb1b794 in ?? () from /usr/lib/dovecot/modules/lib01_acl_plugin.so No symbol table info available. #16 0x00007f38fca31a30 in mailbox_get_status () from /usr/lib/dovecot/libdovecot-storage.so.0 No symbol table info available. #17 0x000000000041eb4b in imap_status_get () No symbol table info available. #18 0x0000000000414329 in cmd_status () No symbol table info available. #19 0x000000000041849c in command_exec () No symbol table info available. #20 0x00000000004174e0 in ?? () No symbol table info available. #21 0x0000000000417574 in ?? () No symbol table info available. ---Type <return> to continue, or q <return> to quit--- #22 0x0000000000417855 in client_handle_input () No symbol table info available. #23 0x0000000000417c02 in client_input () No symbol table info available. #24 0x00007f38fc7538be in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #25 0x00007f38fc7548cb in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #26 0x00007f38fc753949 in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #27 0x00007f38fc7539c8 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #28 0x00007f38fc6ffe13 in master_service_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #29 0x000000000040c238 in main () No symbol table info available. (gdb)

1 0

High user number tune
by Edwardo Garcia 13 Jul '14

13 Jul '14

Halo, This might seem like another indirect thread. I Monday started new job, first task must replace courier. The job use POP3. and IMAP only for webmail, but must server support 4K POP3 at one times. I see from similar thread current settings not adequate , we will use TLS and if wiki read right Iprotocol So am close in think that need ? service pop3-login { process_limit = 4096 } service pop3 { process_limit = 4096 } service imap-login { process_limit = 2048 } service imap { process_limit = 2048 } then we have service managesieve { process_limit = 1024 } is that all we need change? I see in other thread someone says service anvil but I can not find out about it, does need change as well ? Why is it so complicated to change to let more user on, most other change one setting, dovecot want dozen :(

2 1

Pigeonhole sieve misfile
by Patrick Domack 13 Jul '14

13 Jul '14

I'm having an issue with sieve putting some emails into the spam folder, that should not be matching the spam rule. I tried looking but can't seem to find a debug option. Is there any way I can get a log of what the sieve rule path that matches so I can locate the misfiring rule? or maybe something else that is going on. I already checked the dovecot sieve log file, and there is nothing in there.

2 1

macros
by Arkadiusz Miśkiewicz 13 Jul '14

13 Jul '14

Does dovecot support any form of macros? I would like to share configuration file between several servers. Configs are different only in tiny aspects. Somethine like: dovecot-server.conf (different on each server): %define ID 55 %define SOMETHING SELECT FROM * WHERE something %define MECHANISMS digest-md5 dovecot-main.conf (common, shared config) !include dovecot-server.conf user_query = ${SOMETHING} AND id=${ID} auth_mechanisms = plain login ${MECHANISMS} etc -- Arkadiusz Miśkiewicz, arekm / maven.pl

2 1

imap(hardy): Panic: file istream-tee.c: line 138 (i_stream_tee_read): assertion failed: (last_high_offset == input->v_offset + size)
by Hardy Flor 12 Jul '14

12 Jul '14

Hello, I'm copy with imapsync (on the new server with dovecot) with a single user all mails from a old server to the new server. The error-message ist after 20-30 minutes in the log, and I must restart the imapsync. The next mail is normal store on the destination box. Hardy

2 4

Replication on dovecot 2.0
by Tom Barber(Alabs) 11 Jul '14

11 Jul '14

Hi Guys I'm running an Ubuntu 12.04 LTS server and not being particually inclined to upgrade I'm wondering what options I have for replication as it appears to be running dovecot 2.0.19. I saw the wiki page about replication and whilst it says you should use 2.2+ it doesn't say what the minimum requirements are, so I tried doing what it says but I get: Fatal: Plugin 'replication' not found from directory /usr/lib/dovecot/modules Any ideas or tips. Thanks Tom

2 2

1.2.4 disk full errors
by Iain Hallam 11 Jul '14

11 Jul '14

Hi. A user on a rather old mail system we have filled their disk space, and Dovecot has started to give lots of errors in the logs about "Expunged message reappeared" and "Duplicate file entry". The user can only see a few new messages, not the 33,551 in their inbox. In the TODO file in the current source code[1], Timo notes that (line 147): maildir: out-of-disk-space failures apparently cause all kinds of problems, e.g. "Expunged message reappeared", "Duplicate file entry"? [1] http://hg.dovecot.org/dovecot-2.2/file/c55c660d6e9d/TODO Does anyone know what's happening with Dovecot here and how to recover so that this user can see mail again? Unforuntately we're on a very old version, 1.2.4. Though there is a plan for migrating to a newer platform, I need to get this user accessing email again rather more urgently. Thanks, Iain Hallam.

2 1

dovecot lda invalid user settings
by CJ Keist 10 Jul '14

10 Jul '14

I'm now dealing with issue with some users on mbox getting invalid user settings in /var/adm/messages. /var/log/syslog has: Jul 10 11:21:42 mail2 dovecot: [ID 583609 mail.error] lda(ejames): Error: user ejames: Initialization failed: Namespace '': Mail storage autodetection failed with home=/top/academic/Atmos/people/ejames/home Jul 10 11:21:42 mail2 dovecot: [ID 583609 mail.crit] lda(ejames): Fatal: Invalid user settings. Refer to server log for more information. I checked this users home directory and the mail folder is there and permissions are all correct. I'm running in a mixed mbox and Maildir environment. I read to support this environment you simply comment out the mail_location lines in 10-mail.conf file which will force dovecot to auto detect what format a user is using. This worked fine in dovecot 1.2.12, but seems to failing here. root@mail2:/userM/mail-services/dovecot/sbin# ./dovecot -n # 2.2.13: /userM/mail-services/dovecot/etc/dovecot/dovecot.conf # OS: SunOS 5.11 i86pc auth_failure_delay = 5 secs auth_mechanisms = plain login cram-md5 auth_worker_max_count = 3000 base_dir = /userM/mail-services/dovecot/var/run/dovecot/ default_client_limit = 30000 default_process_limit = 5000 disable_plaintext_auth = no hostname = mail2.engr.colostate.edu managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { driver = passwd } postmaster_address = cjay(a)engr.colostate.edu service auth { unix_listener /var/lib/postfix/private/auth { mode = 0666 } unix_listener auth-userdb { group = postfix mode = 0666 user = postfix } user = root } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } ssl_cert = </userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key = </userM/mail-services/dovecot/etc/ssl/privkey.pem userdb { args = blocking=yes driver = passwd } protocol imap { mail_max_userip_connections = 50 } protocol lda { mail_plugins = sieve } protocol pop3 { mail_max_userip_connections = 50 } -- C. J. Keist Email: cj.keist(a)colostate.edu Systems Group Manager Solaris 10 OS (SAI) Engineering Network Services Phone: 970-491-0630 College of Engineering, CSU Fax: 970-491-5569 Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness'

1 0

SIGSEGV in 2.2.13 with IMAP Proxying to an Exchange Server
by Ralf Hildebrandt 10 Jul '14

10 Jul '14

100% reproducible. User is using alpine to write an email. Continue postponed composition (answering "No" won't erase it)? y -> [>Empty folder! No messages really postponed!<] Can't delete {mproxy.charite.de/ssl/novalidate-cert/user=theusername}postponed-msgs Setup: ====== http://wiki2.dovecot.org/HowTo/ImapcProxy coredump available for further inspection Full backtrace: =============== Attaching to program: /usr/lib/dovecot/imap, process 15573 [New LWP 15573] Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. #0 imapc_client_mailbox_cmd (box=0x0, callback=callback@entry=0x7f6ba2ed40e0 <imapc_simple_callback>, context=context@entry=0x7fff68b7f1a0) at imapc-client.c:351 #0 imapc_client_mailbox_cmd (box=0x0, callback=callback@entry=0x7f6ba2ed40e0 <imapc_simple_callback>, context=context@entry=0x7fff68b7f1a0) at imapc-client.c:351 cmd = <optimized out> __FUNCTION__ = "imapc_client_mailbox_cmd" #1 0x00007f6ba2ed4815 in imapc_mailbox_noop (mbox=mbox@entry=0x1294060) at imapc-storage.c:154 cmd = <optimized out> sctx = {client = 0x123b400, ret = -2} #2 0x00007f6ba2ed2d30 in imapc_mailbox_sync_init (box=0x1294060, flags=(MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FIX_INCONSISTENT)) at imapc-sync.c:476 mbox = 0x1294060 list = <optimized out> capabilities = <optimized out> changes = true ret = 0 #3 0x00007f6ba2ee53c9 in mailbox_sync_init (box=box@entry=0x1294060, flags=(MAILBOX_SYNC_FLAG_FULL_READ | MAILBOX_SYNC_FLAG_FIX_INCONSISTENT)) at mail-storage.c:1677 _data_stack_cur_id = 4 ctx = <optimized out> #4 0x00007f6ba2ee54d7 in mailbox_sync (box=box@entry=0x1294060, flags=<optimized out>, flags@entry=MAILBOX_SYNC_FLAG_FULL_READ) at mail-storage.c:1725 ctx = 0x1294060 status = {sync_delayed_expunges = 0} #5 0x00007f6ba2f0fdcb in mailbox_expunge_all_data (box=0x1294060) at index-storage.c:648 ctx = 0x7fff68b7f35c t = 0x7fff68b7f35c mail = 0x0 search_args = 0x0 #6 index_storage_mailbox_delete (box=0x1294060) at index-storage.c:701 metadata = {guid = "\000\000\000\000\000\000\000\000\030\377\347\242\000\000\000", virtual_size = 19480672, cache_fields = 0x0, precache_fields = (MAIL_FETCH_RECEIVED_DATE | MAIL_FETCH_SAVE_DATE | MAIL_FETCH_PHYSICAL_SIZE | MAIL_FETCH_IMAP_ENVELOPE | MAIL_FETCH_UIDL_FILE_NAME | MAIL_FETCH_GUID | unknown: 16777216), backend_ns_prefix = 0x7f6ba2ee64b0 <mailbox_open+16> "\211\302\061\300\205\322x\bH\203\304\030[]Ð\366\203\230\002", backend_ns_type = (unknown: 0)} status = {messages = 0, recent = 0, unseen = 19029536, uidvalidity = 0, uidnext = 1, first_unseen_seq = 0, first_recent_uid = 2730247353, last_cached_seq = 32619, highest_modseq = 19480672, highest_pvt_modseq = 140100271760191, keywords = 0x1, permanent_flags = 0, permanent_keywords = 0, allow_new_keywords = 0, nonpermanent_modseqs = 0, no_modseq_tracking = 0, have_guids = 0, have_save_guids = 0, have_only_guid128 = 0} ret_guid = <optimized out> #7 0x00007f6ba2ee66a7 in mailbox_delete (box=0x1294060) at mail-storage.c:1319 ret = <optimized out> #8 0x000000000040d0e1 in cmd_delete (cmd=0x125ce40) at cmd-delete.c:39 client = <optimized out> ns = <optimized out> box = 0x1294060 name = 0x121b2b8 "postponed-msgs" errstr = <optimized out> error = 32767 disconnect = false #9 0x0000000000416cfc in command_exec (cmd=0x125ce40) at imap-commands.c:158 hook = 0x12240e0 ret = <optimized out> #10 0x0000000000415d5f in client_command_input (cmd=0x125ce40) at imap-client.c:778 client = 0x1268c10 command = <optimized out> __FUNCTION__ = "client_command_input" #11 0x0000000000415e15 in client_command_input (cmd=0x125ce40) at imap-client.c:839 client = 0x1268c10 command = <optimized out> __FUNCTION__ = "client_command_input" #12 0x0000000000416115 in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x1268c10) at imap-client.c:877 No locals. #13 client_handle_input (client=client@entry=0x1268c10) at imap-client.c:889 _data_stack_cur_id = 3 remove_io = false handled_commands = false __FUNCTION__ = "client_handle_input" #14 0x00000000004164a2 in client_input (client=0x1268c10) at imap-client.c:931 cmd = 0x1234630 output = 0x125cd30 bytes = 32 __FUNCTION__ = "client_input" #15 0x00007f6ba2c19e6f in io_loop_call_io (io=0x125ae10) at ioloop.c:441 ioloop = 0x1223730 t_id = 2 __FUNCTION__ = "io_loop_call_io" #16 0x00007f6ba2c1ad77 in io_loop_handler_run_internal (ioloop=ioloop@entry=0x1223730) at ioloop-epoll.c:220 ctx = 0x12243c0 list = 0x1225e20 io = <optimized out> tv = {tv_sec = 1739, tv_usec = 977960} events_count = <optimized out> msecs = <optimized out> ret = 1 i = 0 call = <optimized out> __FUNCTION__ = "io_loop_handler_run_internal" #17 0x00007f6ba2c19ed9 in io_loop_handler_run (ioloop=ioloop@entry=0x1223730) at ioloop.c:488 No locals. #18 0x00007f6ba2c19f58 in io_loop_run (ioloop=0x1223730) at ioloop.c:465 __FUNCTION__ = "io_loop_run" #19 0x00007f6ba2bc9133 in master_service_run (service=0x12235c0, callback=callback@entry=0x41ee50 <client_connected>) at master-service.c:566 No locals. #20 0x000000000040b06f in main (argc=1, argv=0x1223390) at main.c:400 set_roots = {0x426ca0 <imap_setting_parser_info>, 0x0} login_set = {auth_socket_path = 0x121b048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x41f200 <login_client_connected>, failure_callback = 0x41ef30 <login_client_failed>, request_auth_token = 1} service_flags = <optimized out> storage_service_flags = <optimized out> username = 0x0 c = <optimized out> -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt(a)charite.de | http://www.charite.de

2 1

Dovecot ldap quotas in MB
by Murray Trainer 10 Jul '14

10 Jul '14

Hi All, I have the Dovecot quota value coming from LDAP using the line below but my values are stored in MB, not bytes. What can I put in the line to set quotas in MB? user_attrs = homeDirectory=home,mailUID=uid,mailGID=gid,mailQuota=quota_rule=*:bytes=%$ Thanks Murray

2 1

Trigger for using an sqlite dictionary for quota
by David Anderson 10 Jul '14

10 Jul '14

Hi, I'm using Dovecot 2.0.9, and was trying to set up a dictionary process to use an sqlite database for quota management. The wiki page has examples for MySQL and PostgreSQL: http://wiki2.dovecot.org/Quota/Dict For sqlite, a trigger needs to be created to get it to work. But I was not sufficiently skilled in sqlite to adapt the PostgreSQL trigger (given on the above URL) for use. Nor did Googling find any example of anyone else who had done it. Does anyone here have an example, or the ability? (Through Googling I found an example trigger for using sqlite with expiries - but I was looking at quotas). Best wishes, David -- UpdraftPlus - best WordPress backups - http://updraftplus.com WordShell - WordPress fast from the CLI - http://wordshell.net

2 1

HIGHESTMODSEQ tracking
by Kostya Vasilyev 10 Jul '14

10 Jul '14

Hello, I'd like to follow up on someone else's old thread: http://dovecot.org/list/dovecot/2012-April/082624.html I understand that Dovecot (that 2012 discussion was about version 2.0.18) can return "HIGHESTMODSEQ 1" upon SELECT if persistent modseq tracking was never enabled for a mailbox. I'd like to get a clarification on how to enable proper persistent modseq tracking. Per RFC 4551, "A client supporting CONDSTORE.... indicates its willingness to receive mod-sequence updates... by issuing:" SELECT mailbox (CONDSTORE) STATUS (... HIGHESTMODSEQ ...) ... others ... It seems that Dovecot 2.1.7 (Debian 7.5) enables persistent modseq tracking after one of the above two commands (and maybe others). So far so good. So my questions are: 1 - Is this (enabling persistent modseq) also the case for all Dovecot versions prior to 2.1.7 that advertise CONDSTORE? There must be people running older versions out there, older than 2.1.7. If not, how can I branch my logic to not use HIGHESTMODSEQ, given that Dovecot doesn't appear to return any version info via its greeting or via the ID command? 2 - Is persistent modseq tracking (assuming it's been enabled) available for all types of backend mailbox formats that Dovecot might be using? To be more specific, can it ever be the case that Dovecot appears to enable modseq tracking, returning nice looking HIGHESTMODSEQ values from SELECT / STATUS, but the actual values get reset or not get updated because they're not properly persistent? I'm excluding changes to UIDVALIDITY here, obviously when that changes, the entire mailbox state must be assumed to have changed completely. 3 - I guess the change to return NOMOSEQ instead of "1" for mailboxes with modseq tracking disabled, as mentioned in that discussion from 2012, never happened? At least on the 2.1 branch? Thanks, -- K

2 1

Multiple email clients not in sync
by Marc Perkel 09 Jul '14

09 Jul '14

Hello everyone, I'm not sure if this is an issue with dovecot or my various email clients, or my settings. I'm running 2.2.13 and I have Thunderbird on my desktop and K@mail on my android phone. In theory if I delete email on one it should delete it on the other. It does delete it on the server - but the other client isn't always "aware" of it. Same thing sometimes with read messages. I read on one device but the other didn't know it's read unless I shut down and restart the app. Not knowing the details of how this all works I'm assuming there is some form of notification that goes on in the background so as to let other clients know what other clients do so they can sync up. And that where my setup isn't working consistently. Maybe my expectations are just too high? Maybe I don't have things set up correctly? What am I missing? Thanks in advance.

2 4

Problem with virtual mailbox when using K9 mail (android)
by Henrik Kjölhede 08 Jul '14

08 Jul '14

Hi! I've managed to setup a virtual mailbox that shows all unread or flagged mail from a selection of IMAP folders. This works great with Roundcube, which I use as webmail client. However, using K9 mail on my android phone, a mail that is opened seems to be immediately marked as read, and any flagging I do doesn't take. Presumably this is because it can't be reached any longer in the virtual folder. I tried adding the recent flag to the virtual search line, but that doesn't make any difference. I haven't been able to locate any information about anyone else experiencing this problem, so I was hoping that someone here could help. I realise that this is not exactly a "dovecot problem", but perhaps someone here has found a solution that they are willing to share. The search line in dovecot-virtual is currently "OR RECENT (OR UNSEEN FLAGGED). Regards

1 0

Limit confusion
by Micah Anderson 08 Jul '14

08 Jul '14

Hi, On one of my dovecot servers, i've got a limit problem... and I'm a little confused about which knobs I should adjust to solve it. I've been getting both of these: Error: net_connect_unix(imap) failed: Resource temporarily unavailable - http://wiki2.dovecot.org/SocketUnavailableess This one caused me to go read that wiki page, but none of those seem to apply to me: . i'm running 2.2.9 . i dont have service imap { client_limit }, although I do have service auth ( client_limit = 1024 } . my dovecot/auth process shows: dovecot/auth [91 wait, 0 passdb, 0 userdb] . it doesn't appear the master process is using very much cpu (in fact the system is mostly low load in general) . I have service_count = 0 set for imap-login for the 'high performance mode' dovecot: master: Warning: service(imap): process_limit (2560) reached, client connections are being dropped The second is because I have process_limit of 2560 for the imap service... I can raise that to 4096, but I suspect there are other limits I need to juggle? Thanks a lot for any suggestions! I have ulimit -n 2048 set for the dovecot processes (in /etc/default/dovecot) and the following is my dovecot -n: # 2.2.9: /etc/dovecot/dovecot.conf auth_verbose = yes default_process_limit = 256 default_vsz_limit = 512 M dict { expire = mysql:/etc/dovecot/dovecot-dict-sql.conf quota = mysql:/etc/dovecot/dovecot-dict-sql.conf } disable_plaintext_auth = no first_valid_gid = 8 first_valid_uid = 8 last_valid_gid = 8 last_valid_uid = 8 listen = * login_greeting = howdy, ready. mail_location = mdbox:~/mdbox:INDEX=/srv/dovecot_indexes/%d/%1n/%n mail_plugins = expire quota zlib maildir_very_dirty_syncs = yes namespace { inbox = yes location = prefix = separator = . } namespace { alias_for = hidden = yes inbox = no list = no location = prefix = INBOX. separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_allow_append_to_spam = yes antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/local/bin/train_spam antispam_pipe_program_args = -d;10.0.1.109 antispam_pipe_program_notspam_arg = ham antispam_pipe_program_spam_arg = spam antispam_pipe_tmpdir = /var/tmp antispam_signature = X-Spam-Flag antispam_signature_missing = error antispam_spam_pattern_ignorecase = SPAM antispam_trash_pattern = trash;Trash;Deleted * expire = Trash expire2 = Trash/* expire3 = Spam expire_dict = proxy::expire quota = dict:Your mail quota::proxy::quota quota_rule = *:bytes=100663296 quota_rule2 = Trash:bytes=+20%% quota_rule3 = Spam:bytes=+10%% quota_rule4 = INBOX.Trash:bytes=+20%% quota_rule5 = INBOX.Spam:bytes=+10%% sieve = ~/.dovecot.sieve sieve_after = /var/lib/dovecot/sieve/after.sieve sieve_before = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve zlib_save = gz zlib_save_level = 6 } protocols = " imap pop3" service anvil { unix_listener anvil { group = dovecot mode = 0660 user = root } } service auth { client_limit = 1024 unix_listener auth-userdb { group = mail mode = 0600 user = mail } } service dict { unix_listener dict { group = mail mode = 0600 user = mail } } service imap-login { process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service imap-postlogin { executable = script-login /usr/local/sbin/postlogin_imap } service imap { executable = imap imap-postlogin process_limit = 4096 } service pop3-login { process_min_avail = 10 service_count = 0 vsz_limit = 512 M } service pop3-postlogin { executable = script-login /usr/local/sbin/postlogin_pop } service pop3 { executable = pop3 pop3-postlogin } service stats { fifo_listener stats-mail { mode = 0600 user = mail } } ssl_cert = </etc/certs/wildcard/cert.pem ssl_cipher_list = HIGH:-ADH:-aNULL ssl_key = </etc/certs/wildcard/key.pem userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_plugins = expire quota zlib sieve plugin { quota_exceeded_message = Sorry, your message cannot be delivered to that person because their mailbox is full. If you can contact them another way, you may wish to tell them of this problem. quota_rule7 = INBOX:bytes=+10%% } } protocol imap { imap_client_workarounds = delay-newmail tb-extra-mailbox-sep mail_max_userip_connections = 10 mail_plugins = expire quota zlib imap_quota imap_zlib antispam plugin { quota_exceeded_message = You are over quota. To avoid losing mail, immediately empty your Trash and Sent folders and delete emails with large attachments. } } protocol pop3 { mail_plugins = expire quota zlib pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %g }

1 0

Dovecot ignores existing mailboxes and creates its own
by Martin Vegter 08 Jul '14

08 Jul '14

Hello, I have Postfix with Maildir format. User's emails are being delivered into $HOME/mail/inbox Apart from ~/mail/inbox, there are the usual folders: $HOME/mail/archive $HOME/mail/drafts $HOME/mail/inbox $HOME/mail/trash Now I have installed dovecot, and set mail_location = maildir:~/mail:LAYOUT=fs additionally, I have defined mailboxes as follows: namespace inbox { mailbox drafts { special_use = \Drafts } mailbox sent { special_use = \Sent } mailbox trash { special_use = \Trash } } The problem I am having is following: 1) dovecot ignores the folders (drafts, sent, trash) and creates its own folders begining with capiotal letter: Drafts Sent Trash 2) dovecot ignores ~/mail/inbox and instead creates ~/mail/cur ~/mail/new ~/mail/tmp can somebody please advise how to tell dovecot, to use my existing folder structure, ie: ~/mail/inbox/{cur,new,tmp} ~/mail/drafts/{cur,new,tmp} ~/mail/sent/{cur,new,tmp} ~/mail/trash/{cur,new,tmp} any advice would be much appreciated thanks, Martin

1 0