March 2013 - dovecot - dovecot.org

[Dovecot] dsync replication: assertion failed: (ibc->value_input == NULL)
by Oli Schacher 25 Mar '13

25 Mar '13

current hg (33e78edac8f5) Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Panic: file dsync-ibc-stream.c: line 527 (dsync_ibc_stream_input_next): assertion failed: (ibc->value_input == NULL) Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x5ebea) [0x7f67d85ffbea] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5ec36) [0x7f67d85ffc36] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1fcea) [0x7f67d85c0cea] -> dovecot/doveadm-server() [0x4258ec] -> dovecot/doveadm-server() [0x4268f6] -> dovecot/doveadm-server(dsync_brain_sync_mails+0x426) [0x41aa66] -> dovecot/doveadm-server(dsync_brain_run+0x162) [0x4172a2] -> dovecot/doveadm-server() [0x417940] -> dovecot/doveadm-server() [0x428410] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f67d860ed36] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f67d860fde7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f67d860ecd8] -> dovecot/doveadm-server() [0x414fda] -> dovecot/doveadm-server() [0x40c71f] -> dovecot/doveadm-server() [0x41459a] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f67d860ed36] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f67d860fde7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f67d860ecd8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f67d85c5743] -> dovecot/doveadm-server(main+0x121) [0x414ce1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x3400a1ecdd] -> dovecot/doveadm-server() [0x40c109] Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Fatal: master: service(doveadm): child 27336 killed with signal 6 (core dumped) (gdb) bt full #0 0x0000003400a328a5 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x0000003400a34085 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f67d85ffbf8 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:191 backtrace = 0x1baf510 "/usr/lib64/dovecot/libdovecot.so.0(+0x5ebea) [0x7f67d85ffbea] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5ec36) [0x7f67d85ffc36] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1fcea) [0x7f67d85c0cea] -> dovec"... #3 0x00007f67d85ffc36 in i_internal_fatal_handler (ctx=0x7ffffc4466c0, format=<value optimized out>, args=<value optimized out>) at failures.c:652 status = 0 #4 0x00007f67d85c0cea in i_panic (format=0x6ac8 <Address 0x6ac8 out of bounds>) at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffffc446790, reg_save_area = 0x7ffffc4466d0}} #5 0x00000000004258ec in dsync_ibc_stream_input_next (ibc=0x1bda990, item=ITEM_MAILBOX_ATTRIBUTE, decoder_r=0x7ffffc446808) at dsync-ibc-stream.c:527 line_item = ITEM_NONE line = <value optimized out> error = <value optimized out> i = <value optimized out> __FUNCTION__ = "dsync_ibc_stream_input_next" #6 0x00000000004268f6 in dsync_ibc_stream_recv_mailbox_attribute (_ibc=0x1bda990, attr_r=0x7ffffc446878) at dsync-ibc-stream.c:1311 ibc = 0x1bda990 pool = 0x1bdabc0 decoder = <value optimized out> attr = 0x1bdabe0 value = <value optimized out> ret = <value optimized out> __FUNCTION__ = "dsync_ibc_stream_recv_mailbox_attribute" #7 0x000000000041aa66 in dsync_brain_recv_mailbox_attribute (brain=0x1bdc890) at dsync-brain-mails.c:68 attr = <value optimized out> input = <value optimized out> ret = <value optimized out> #8 dsync_brain_sync_mails (brain=0x1bdc890) at dsync-brain-mails.c:316 changed = false __FUNCTION__ = "dsync_brain_sync_mails" #9 0x00000000004172a2 in dsync_brain_run_real (brain=0x1bdc890, changed_r=0x7ffffc44698f) at dsync-brain.c:423 changed = false ret = true #10 dsync_brain_run (brain=0x1bdc890, changed_r=0x7ffffc44698f) at dsync-brain.c:452 _data_stack_cur_id = 5 ret = true #11 0x0000000000417940 in dsync_brain_run_io (context=0x1bdc890) at dsync-brain.c:41 brain = 0x1bdc890 changed = false try_pending = true #12 0x0000000000428410 in dsync_ibc_stream_input (ibc=0x1bda990) at dsync-ibc-stream.c:194 No locals. #13 0x00007f67d860ed36 in io_loop_call_io (io=0x1bc9f30) at ioloop.c:387 ioloop = 0x1bb5720 t_id = 4 #14 0x00007f67d860fde7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:215 ctx = 0x1bb8550 events = <value optimized out> event = 0x1bb85c0 ---Type <return> to continue, or q <return> to quit--- list = 0x1bbe320 io = <value optimized out> tv = {tv_sec = 4, tv_usec = 891617} msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run" #15 0x00007f67d860ecd8 in io_loop_run (ioloop=0x1bb5720) at ioloop.c:406 No locals. #16 0x0000000000414fda in cmd_dsync_server_run (_ctx=0x1bcb560, user=0x1bd49b0) at doveadm-dsync.c:862 ctx = 0x1bcb560 ibc = 0x1bda990 brain = 0x1bdc890 temp_prefix = 0x1baf378 #17 0x000000000040c71f in doveadm_mail_next_user (ctx=0x1bcb560, input=<value optimized out>, error_r=0x7ffffc446ae0) at doveadm-mail.c:309 error = <value optimized out> ret = 0 __FUNCTION__ = "doveadm_mail_next_user" #18 0x000000000041459a in doveadm_mail_cmd_server_run (conn=0x1bbe510) at client-connection.c:115 error = 0x7f67d85a1000 "\177ELF\002\001\001" ret = <value optimized out> #19 client_handle_command (conn=0x1bbe510) at client-connection.c:217 ctx = 0x1bcb560 flags = <value optimized out> cmd_name = <value optimized out> input = {module = 0x0, service = 0x42ce7c "doveadm", username = 0x1bad569 "<munged>", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} argc = 2 #20 client_connection_input (conn=0x1bbe510) at client-connection.c:317 args = 0x1bad5b0 _data_stack_cur_id = 3 line = <value optimized out> ok = true #21 0x00007f67d860ed36 in io_loop_call_io (io=0x1bbe2d0) at ioloop.c:387 ioloop = 0x1bb5720 t_id = 2 #22 0x00007f67d860fde7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:215 ctx = 0x1bb8550 events = <value optimized out> event = 0x1bb85c0 list = 0x1bbe320 io = <value optimized out> tv = {tv_sec = 2147483, tv_usec = 0} msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run" #23 0x00007f67d860ecd8 in io_loop_run (ioloop=0x1bb5720) at ioloop.c:406 ---Type <return> to continue, or q <return> to quit--- No locals. #24 0x00007f67d85c5743 in master_service_run (service=0x1bb55c0, callback=<value optimized out>) at master-service.c:550 No locals. #25 0x0000000000414ce1 in main (argc=1, argv=0x1bb53a0) at main.c:91 set_roots = {0x42cc00, 0x0} error = 0x0

2 1

[Dovecot] nopassword not working in Dovecot 2.2rc3?
by Christian Felsing 25 Mar '13

25 Mar '13

Hello, I got some problems while set up a test system for Client Cert Auth, therefore passwords are not requred. SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM users WHERE userid = 'user(a)example.net' shows exactly what is expected, bur Dovecot does net regongnize 'Y' as nopassword: Mar 25 11:18:04 dovecot dovecot: auth: Debug: sql(user(a)example.net,192.168.200.6,<gndyHr3Y/gCwxigG>): query: SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM users WHERE userid = 'user(a)example.net' Mar 25 11:18:04 dovecot dovecot: auth: sql(user(a)example.net,192.168.200.6,<gndyHr3Y/gCwxigG>): Empty password returned without nopassword Mar 25 11:18:06 dovecot dovecot: auth: Debug: client passdb out: FAIL#0112#011user=user(a)example.net Mar 25 11:18:07 dovecot dovecot: imap-login: Disconnected (auth failed, 2 attempts in 9 secs): user=<user(a)example.net>, method=PLAIN, rip=192.168.200.6, lip=192.168.200.22, TLS As shown on http://wiki2.dovecot.org/AuthDatabase/SQL select statement above should prevent Dovecot from verifying password. any hints? best regards Christian

1 0

[Dovecot] Dovecot v2 multiple domains
by Pavel Dimow 25 Mar '13

25 Mar '13

Hello, I would like to have multiple domains on same server (with different ip's) and I want that user logs with username with domain part for every domain, but I can't find any documentation on this. To be more precise I found a post regarding dovecot v1 that suggest making separate init scripts for every domain but it also suggest that dovecot v2 will support this in code. This is the post http://dovecot.org/pipermail/dovecot/2006-April/012455.html Am I missing something or this is not still possible?

2 2

[Dovecot] Dovecot DNS queries its own host many times a second
by Dominic Malolepszy 25 Mar '13

25 Mar '13

Hi, We have observed that Dovecot appears to make a DNS lookup of its own hostname many times a second. Each Dovecot server in our cluster appears to be doing around 50 queries per second to find out its own hostname. Rsyslog was the first thing we assumed was the cause, however stopping it did not help. Also the fact that at the time Dovecot was doing around 50 logins a second, seemed to correlate with it making these queries. Is there any reason why Dovecot would need to do a lookup of its own hosts IP address every time? Seems like a strange thing to do and not cache its own hostname. Dominic

3 2

[Dovecot] Confirmation Please - Dovecot for Email Delivery
by craig.dovecot＠noboost.org 25 Mar '13

25 Mar '13

Hi All, Spec: Centos 6.3x64 Dovecot-2.0.9-5.el6.x86_64 Goal: 1) Inbound emails are delivered by Dovecot and the UID/GID is determined by a local /etc/dovecot/users file. 2) I'd like to have IMAPS clients authenticate with Dovecot via LDAP. Questions: 1) I've attempted to ensure that Dovecot will always use the local password file for mail delivery as no actual password is needed. Then the LDAP server for when the IMAPS email client connects. This appears to be working as I expect, can anyone confirm/deny the below settings are correct? 2) Is there a Dovecot architecture diagram/documentation anywhere? Settings: ------------------------------------------------------------------------- File: dovecot.conf protocols = imap lmtp listen = * File: 10-auth.conf disable_plaintext_auth = yes auth_username_format = %Ln auth_mechanisms = plain !include auth-passwdfile.conf.ext !include auth-ldap.conf.ext File: auth-passwdfile.conf.ext mail_location = maildir:/home/%n/Maildir #passdb { # driver = passwd-file # args = username_format=%n /etc/dovecot/users #} userdb { driver = passwd-file args = username_format=%n /etc/dovecot/users } File: dovecot-ldap.conf.ext hosts = sysvm-ipa.noboost.org tls = yes tls_ca_cert_dir = /etc/openldap/certs auth_bind = yes auth_bind_userdn = uid=%u,cn=users,cn=accounts,dc=noboost,dc=org base = cn=users,cn=accounts,dc=noboost,dc=org pass_attrs = uid=user pass_filter = (&(objectClass=posixAccount)(uid=%u)) File: /etc/dovecot/users craig:x:890:432:Craig:/home/craig:/bin/bash ------------------------------------------------------------------------- cya Craig

1 0

[Dovecot] Reduce logging auth-worker
by Nick Edwards 25 Mar '13

25 Mar '13

Hello Timo We would like to reduce the logging by increasing severity, we don't use syslog since we use log_path = /var/log/dovecot/pop3.log Is there a way auth-worker can be made to log warn|error instead of info? Constantly 1/5th of the log file is filled with auth-work info connecting to mysql socket, which we do not need to see unless, well, we need to see it either via debug, or if there is a problem, I know this can be done from syslog, but we prefer not to use syslog, and the wiki does not indicate it can be done? Niki

6 11

[Dovecot] SiS attachment file larger than expected
by Erik Persson 25 Mar '13

25 Mar '13

Hello! Name's Erik and I have been using Dovecot for a few months and I so far quite happy with the software. To this list I am quite new though. After a testing period I have now been running a ~300 user system running CentOS 6 and Dovecot 2.1.14 with Postfix and SiS enabled. For the large part the system is running flawlessly but I have caught a few error messages: imap(censored(a)censored.domain): Error: Attachment file /mail/attachments/70/d0/70d04b12123bfb145983f5a674ee2e65029a4018aff1c6db51993b75f10bf101-117a1a3b06f54251e96200004d877aa0 larger than expected (370113) The total number of files that I have found complaints about in the log are less than 10 accessed by 3 users in a attachment file system that by now is housing 100k + files. The only common denominator I have found so far is that all the attachments are PDF files. Most if not all of the logged files are the only referenced link of the corresponding hash. Any idea what might be causing this and how it can be prevented? I do like to be a bit paranoid when it comes to data integrity. As I am not completely familiar with the dovecot tools I also wonder if there is a way to find the offending message in the mailbox other than trying to access it via a mail client? Best regards and keep up the good work! /Erik

2 2

[Dovecot] Reporting on user info
by Alex 24 Mar '13

24 Mar '13

Hi all, I've just installed fc18 with dovecot-2.1.15 and have all the usual services set up and running properly. Of course now management is interested in who is using what service, for how long. Are there any existing reporting features available from within dovecot to provide stats on mail usage over time? Ideally, I'd like to provide a log file and find out who used each service, how long they were logged in, and from where they logged in. It would also be interesting to have a real-time view of who's connected. Does any such utility exist? Thanks, Alex

2 1

[Dovecot] Replicator updates
by Timo Sirainen 24 Mar '13

24 Mar '13

Some new features in hg: - replicator now correctly saves/restores state on exit/startup. it won't immediately start resyncing everyone now always. - if sync fails for user, retry in 5 minutes - doveadm replicator status: Give overview of replication status - doveadm replicator status <usermask>: Show users' replication status - doveadm replicator replicate [-p <priority>] <usermask>: Replicate users now. replication_full_sync_interval was also changed to 24h by default. I was thinking that with that and a nightly cronjob running "doveadm replicator replicate '*'" the full syncs could only be done during night times.

1 0

Re: [Dovecot] Migrating password scheme
by Joseph Tam 24 Mar '13

24 Mar '13

I tried the userdb prefetch / postlogin script method to do some password manipulation, but it doesn't appear to work for me. In particular, I don't think this method works with userdb { driver = passwd-file args = /path/to/passwd-file userdb_pw=%w } because it doesn't understand arbitrary var=value in the args configuration. Dvoecot seems to accept the entire string as the pathname for a password file. Is there a way to pass the plaintext password to a post-login script using passwd-file userdb? Before this, I managed password manipulation by process tracing dovecot's auth process read() syscalls and parsing out the user/password from the second buffer argument. Quite a hack but it worked. Joseph Tam <jtam.home(a)gmail.com>

3 2