- dovecot - dovecot.org

[Dovecot] Dovecot 2.1.15 on CentOS 6.4 with metadata-plugin
by Bruce Marriner 25 Mar '13

25 Mar '13

Hello, I hope somebody can help me with this :) I am trying to get Dovecot 2.1 working with Kolab 3.0 and to start that processes I need? to compile the Dovecot metadata plugin with Dovecot. For the plugin to compile correctly against the Dovecot source code Dovecot must first be patched with a patch from the plugin author (Dennis Schridde) that is currently not part of the Dovecot code (Timo, could this be added to Dovecot?) I am documenting this entire process and once it's finished it may also be helpful to the Dovecot community. You can see some of my progress, or lack of, and errors here : http://bmts.us/wiki/doku.php?id=article:kolab:dovecot In order to compile the plugin I have removed CentOS yum packages for autoconf, automake, and libtool and downloaded, compiled, and installed versions autoconf 2.69, automake 1.12.6, and libtool 2.4.2. If I download Dovecot (not from hg) I can run ./configure and make without any problems. But, to add the patch to Dovecot I need to run the autoreconf command and this is where I have trouble. [root@kolab dovecot-2.1.15]# autoreconf aclocal: warning: autoconf input should be named 'configure.ac', not 'configure.in' configure.in:284: warning: macro 'AM_ICONV' not found in library configure.in:284: error: possibly undefined macro: AM_ICONV If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. autoreconf: /usr/local/bin/autoconf failed with exit status: 1 I read this is related to gettext, so I installed gettext 0.18.2 from source and now I get the following errors : [root@kolab dovecot-2.1.15]# autoreconf aclocal: warning: autoconf input should be named 'configure.ac', not 'configure.in' automake: warning: autoconf input should be named 'configure.ac', not 'configure.in' automake: warning: autoconf input should be named 'configure.ac', not 'configure.in' src/plugins/acl/Makefile.am:16: error: 'module_LTLIBRARIES' is used but 'moduledir' is undefined src/plugins/acl/Makefile.am:19: warning: variable 'lib01_acl_plugin_la_SOURCES' is defined but no program or src/plugins/acl/Makefile.am:19: library has 'lib01_acl_plugin_la' as canonical name (possible typo) src/plugins/acl/Makefile.am:14: warning: variable 'lib01_acl_plugin_la_LDFLAGS' is defined but no program or src/plugins/acl/Makefile.am:14: library has 'lib01_acl_plugin_la' as canonical name (possible typo) src/plugins/autocreate/Makefile.am:11: error: 'module_LTLIBRARIES' is used but 'moduledir' is undefined src/plugins/autocreate/Makefile.am:14: warning: variable 'lib20_autocreate_plugin_la_SOURCES' is defined but no program or src/plugins/autocreate/Makefile.am:14: library has 'lib20_autocreate_plugin_la' as canonical name (possible typo) src/plugins/autocreate/Makefile.am:9: warning: variable 'lib20_autocreate_plugin_la_LDFLAGS' is defined but no program or src/plugins/autocreate/Makefile.am:9: library has 'lib20_autocreate_plugin_la' as canonical name (possible typo) ... ... ... ... autoreconf: automake failed with exit status: 1

1 0

[Dovecot] doveadm with multiple commands
by Timo Sirainen 25 Mar '13

25 Mar '13

This has been in my TODO for a while and today I implemented it (but didn't dare to test it yet :) So the problem has been that you want to run for example: doveadm expunge -A mailbox Trash savedbefore 7d doveadm purge -A This is annoying because it scans through the users' mailboxes twice, wasting disk IO and CPU. So how to make it do the scan only once? The syntax I thought of today would be: doveadm multi [-A | -u wildcards] <separator string> <comand 1> [<separator string> <command 2> [...]] So the first two commands could be for example: doveadm multi -A : expunge mailbox Trash savedbefore 7d : purge The ':' character is the separator. Any other string could be used as well, for example "?SEP?" or whatever. Thoughts? Any better name for the command than "multi"?

6 13

[Dovecot] dsync replication: assertion failed: (ibc->value_input == NULL)
by Oli Schacher 25 Mar '13

25 Mar '13

current hg (33e78edac8f5) Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Panic: file dsync-ibc-stream.c: line 527 (dsync_ibc_stream_input_next): assertion failed: (ibc->value_input == NULL) Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x5ebea) [0x7f67d85ffbea] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5ec36) [0x7f67d85ffc36] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1fcea) [0x7f67d85c0cea] -> dovecot/doveadm-server() [0x4258ec] -> dovecot/doveadm-server() [0x4268f6] -> dovecot/doveadm-server(dsync_brain_sync_mails+0x426) [0x41aa66] -> dovecot/doveadm-server(dsync_brain_run+0x162) [0x4172a2] -> dovecot/doveadm-server() [0x417940] -> dovecot/doveadm-server() [0x428410] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f67d860ed36] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f67d860fde7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f67d860ecd8] -> dovecot/doveadm-server() [0x414fda] -> dovecot/doveadm-server() [0x40c71f] -> dovecot/doveadm-server() [0x41459a] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f67d860ed36] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f67d860fde7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f67d860ecd8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f67d85c5743] -> dovecot/doveadm-server(main+0x121) [0x414ce1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x3400a1ecdd] -> dovecot/doveadm-server() [0x40c109] Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Fatal: master: service(doveadm): child 27336 killed with signal 6 (core dumped) (gdb) bt full #0 0x0000003400a328a5 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x0000003400a34085 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f67d85ffbf8 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:191 backtrace = 0x1baf510 "/usr/lib64/dovecot/libdovecot.so.0(+0x5ebea) [0x7f67d85ffbea] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5ec36) [0x7f67d85ffc36] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1fcea) [0x7f67d85c0cea] -> dovec"... #3 0x00007f67d85ffc36 in i_internal_fatal_handler (ctx=0x7ffffc4466c0, format=<value optimized out>, args=<value optimized out>) at failures.c:652 status = 0 #4 0x00007f67d85c0cea in i_panic (format=0x6ac8 <Address 0x6ac8 out of bounds>) at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffffc446790, reg_save_area = 0x7ffffc4466d0}} #5 0x00000000004258ec in dsync_ibc_stream_input_next (ibc=0x1bda990, item=ITEM_MAILBOX_ATTRIBUTE, decoder_r=0x7ffffc446808) at dsync-ibc-stream.c:527 line_item = ITEM_NONE line = <value optimized out> error = <value optimized out> i = <value optimized out> __FUNCTION__ = "dsync_ibc_stream_input_next" #6 0x00000000004268f6 in dsync_ibc_stream_recv_mailbox_attribute (_ibc=0x1bda990, attr_r=0x7ffffc446878) at dsync-ibc-stream.c:1311 ibc = 0x1bda990 pool = 0x1bdabc0 decoder = <value optimized out> attr = 0x1bdabe0 value = <value optimized out> ret = <value optimized out> __FUNCTION__ = "dsync_ibc_stream_recv_mailbox_attribute" #7 0x000000000041aa66 in dsync_brain_recv_mailbox_attribute (brain=0x1bdc890) at dsync-brain-mails.c:68 attr = <value optimized out> input = <value optimized out> ret = <value optimized out> #8 dsync_brain_sync_mails (brain=0x1bdc890) at dsync-brain-mails.c:316 changed = false __FUNCTION__ = "dsync_brain_sync_mails" #9 0x00000000004172a2 in dsync_brain_run_real (brain=0x1bdc890, changed_r=0x7ffffc44698f) at dsync-brain.c:423 changed = false ret = true #10 dsync_brain_run (brain=0x1bdc890, changed_r=0x7ffffc44698f) at dsync-brain.c:452 _data_stack_cur_id = 5 ret = true #11 0x0000000000417940 in dsync_brain_run_io (context=0x1bdc890) at dsync-brain.c:41 brain = 0x1bdc890 changed = false try_pending = true #12 0x0000000000428410 in dsync_ibc_stream_input (ibc=0x1bda990) at dsync-ibc-stream.c:194 No locals. #13 0x00007f67d860ed36 in io_loop_call_io (io=0x1bc9f30) at ioloop.c:387 ioloop = 0x1bb5720 t_id = 4 #14 0x00007f67d860fde7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:215 ctx = 0x1bb8550 events = <value optimized out> event = 0x1bb85c0 ---Type <return> to continue, or q <return> to quit--- list = 0x1bbe320 io = <value optimized out> tv = {tv_sec = 4, tv_usec = 891617} msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run" #15 0x00007f67d860ecd8 in io_loop_run (ioloop=0x1bb5720) at ioloop.c:406 No locals. #16 0x0000000000414fda in cmd_dsync_server_run (_ctx=0x1bcb560, user=0x1bd49b0) at doveadm-dsync.c:862 ctx = 0x1bcb560 ibc = 0x1bda990 brain = 0x1bdc890 temp_prefix = 0x1baf378 #17 0x000000000040c71f in doveadm_mail_next_user (ctx=0x1bcb560, input=<value optimized out>, error_r=0x7ffffc446ae0) at doveadm-mail.c:309 error = <value optimized out> ret = 0 __FUNCTION__ = "doveadm_mail_next_user" #18 0x000000000041459a in doveadm_mail_cmd_server_run (conn=0x1bbe510) at client-connection.c:115 error = 0x7f67d85a1000 "\177ELF\002\001\001" ret = <value optimized out> #19 client_handle_command (conn=0x1bbe510) at client-connection.c:217 ctx = 0x1bcb560 flags = <value optimized out> cmd_name = <value optimized out> input = {module = 0x0, service = 0x42ce7c "doveadm", username = 0x1bad569 "<munged>", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} argc = 2 #20 client_connection_input (conn=0x1bbe510) at client-connection.c:317 args = 0x1bad5b0 _data_stack_cur_id = 3 line = <value optimized out> ok = true #21 0x00007f67d860ed36 in io_loop_call_io (io=0x1bbe2d0) at ioloop.c:387 ioloop = 0x1bb5720 t_id = 2 #22 0x00007f67d860fde7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:215 ctx = 0x1bb8550 events = <value optimized out> event = 0x1bb85c0 list = 0x1bbe320 io = <value optimized out> tv = {tv_sec = 2147483, tv_usec = 0} msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run" #23 0x00007f67d860ecd8 in io_loop_run (ioloop=0x1bb5720) at ioloop.c:406 ---Type <return> to continue, or q <return> to quit--- No locals. #24 0x00007f67d85c5743 in master_service_run (service=0x1bb55c0, callback=<value optimized out>) at master-service.c:550 No locals. #25 0x0000000000414ce1 in main (argc=1, argv=0x1bb53a0) at main.c:91 set_roots = {0x42cc00, 0x0} error = 0x0

2 1

[Dovecot] nopassword not working in Dovecot 2.2rc3?
by Christian Felsing 25 Mar '13

25 Mar '13

Hello, I got some problems while set up a test system for Client Cert Auth, therefore passwords are not requred. SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM users WHERE userid = 'user(a)example.net' shows exactly what is expected, bur Dovecot does net regongnize 'Y' as nopassword: Mar 25 11:18:04 dovecot dovecot: auth: Debug: sql(user(a)example.net,192.168.200.6,<gndyHr3Y/gCwxigG>): query: SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM users WHERE userid = 'user(a)example.net' Mar 25 11:18:04 dovecot dovecot: auth: sql(user(a)example.net,192.168.200.6,<gndyHr3Y/gCwxigG>): Empty password returned without nopassword Mar 25 11:18:06 dovecot dovecot: auth: Debug: client passdb out: FAIL#0112#011user=user(a)example.net Mar 25 11:18:07 dovecot dovecot: imap-login: Disconnected (auth failed, 2 attempts in 9 secs): user=<user(a)example.net>, method=PLAIN, rip=192.168.200.6, lip=192.168.200.22, TLS As shown on http://wiki2.dovecot.org/AuthDatabase/SQL select statement above should prevent Dovecot from verifying password. any hints? best regards Christian

1 0

[Dovecot] Dovecot v2 multiple domains
by Pavel Dimow 25 Mar '13

25 Mar '13

Hello, I would like to have multiple domains on same server (with different ip's) and I want that user logs with username with domain part for every domain, but I can't find any documentation on this. To be more precise I found a post regarding dovecot v1 that suggest making separate init scripts for every domain but it also suggest that dovecot v2 will support this in code. This is the post http://dovecot.org/pipermail/dovecot/2006-April/012455.html Am I missing something or this is not still possible?

2 2

[Dovecot] Dovecot DNS queries its own host many times a second
by Dominic Malolepszy 25 Mar '13

25 Mar '13

Hi, We have observed that Dovecot appears to make a DNS lookup of its own hostname many times a second. Each Dovecot server in our cluster appears to be doing around 50 queries per second to find out its own hostname. Rsyslog was the first thing we assumed was the cause, however stopping it did not help. Also the fact that at the time Dovecot was doing around 50 logins a second, seemed to correlate with it making these queries. Is there any reason why Dovecot would need to do a lookup of its own hosts IP address every time? Seems like a strange thing to do and not cache its own hostname. Dominic

3 2

[Dovecot] Confirmation Please - Dovecot for Email Delivery
by craig.dovecot＠noboost.org 25 Mar '13

25 Mar '13

Hi All, Spec: Centos 6.3x64 Dovecot-2.0.9-5.el6.x86_64 Goal: 1) Inbound emails are delivered by Dovecot and the UID/GID is determined by a local /etc/dovecot/users file. 2) I'd like to have IMAPS clients authenticate with Dovecot via LDAP. Questions: 1) I've attempted to ensure that Dovecot will always use the local password file for mail delivery as no actual password is needed. Then the LDAP server for when the IMAPS email client connects. This appears to be working as I expect, can anyone confirm/deny the below settings are correct? 2) Is there a Dovecot architecture diagram/documentation anywhere? Settings: ------------------------------------------------------------------------- File: dovecot.conf protocols = imap lmtp listen = * File: 10-auth.conf disable_plaintext_auth = yes auth_username_format = %Ln auth_mechanisms = plain !include auth-passwdfile.conf.ext !include auth-ldap.conf.ext File: auth-passwdfile.conf.ext mail_location = maildir:/home/%n/Maildir #passdb { # driver = passwd-file # args = username_format=%n /etc/dovecot/users #} userdb { driver = passwd-file args = username_format=%n /etc/dovecot/users } File: dovecot-ldap.conf.ext hosts = sysvm-ipa.noboost.org tls = yes tls_ca_cert_dir = /etc/openldap/certs auth_bind = yes auth_bind_userdn = uid=%u,cn=users,cn=accounts,dc=noboost,dc=org base = cn=users,cn=accounts,dc=noboost,dc=org pass_attrs = uid=user pass_filter = (&(objectClass=posixAccount)(uid=%u)) File: /etc/dovecot/users craig:x:890:432:Craig:/home/craig:/bin/bash ------------------------------------------------------------------------- cya Craig

1 0

[Dovecot] Reduce logging auth-worker
by Nick Edwards 25 Mar '13

25 Mar '13

Hello Timo We would like to reduce the logging by increasing severity, we don't use syslog since we use log_path = /var/log/dovecot/pop3.log Is there a way auth-worker can be made to log warn|error instead of info? Constantly 1/5th of the log file is filled with auth-work info connecting to mysql socket, which we do not need to see unless, well, we need to see it either via debug, or if there is a problem, I know this can be done from syslog, but we prefer not to use syslog, and the wiki does not indicate it can be done? Niki

6 11

[Dovecot] SiS attachment file larger than expected
by Erik Persson 25 Mar '13

25 Mar '13

Hello! Name's Erik and I have been using Dovecot for a few months and I so far quite happy with the software. To this list I am quite new though. After a testing period I have now been running a ~300 user system running CentOS 6 and Dovecot 2.1.14 with Postfix and SiS enabled. For the large part the system is running flawlessly but I have caught a few error messages: imap(censored(a)censored.domain): Error: Attachment file /mail/attachments/70/d0/70d04b12123bfb145983f5a674ee2e65029a4018aff1c6db51993b75f10bf101-117a1a3b06f54251e96200004d877aa0 larger than expected (370113) The total number of files that I have found complaints about in the log are less than 10 accessed by 3 users in a attachment file system that by now is housing 100k + files. The only common denominator I have found so far is that all the attachments are PDF files. Most if not all of the logged files are the only referenced link of the corresponding hash. Any idea what might be causing this and how it can be prevented? I do like to be a bit paranoid when it comes to data integrity. As I am not completely familiar with the dovecot tools I also wonder if there is a way to find the offending message in the mailbox other than trying to access it via a mail client? Best regards and keep up the good work! /Erik

2 2

[Dovecot] Reporting on user info
by Alex 24 Mar '13

24 Mar '13

Hi all, I've just installed fc18 with dovecot-2.1.15 and have all the usual services set up and running properly. Of course now management is interested in who is using what service, for how long. Are there any existing reporting features available from within dovecot to provide stats on mail usage over time? Ideally, I'd like to provide a log file and find out who used each service, how long they were logged in, and from where they logged in. It would also be interesting to have a real-time view of who's connected. Does any such utility exist? Thanks, Alex

2 1