- dovecot - dovecot.org

Panic: file mdbox-save.c: line 337: unreached
by Leon Kyneur 14 Jul '16

14 Jul '16

Recently updated to 2.2.25. Noticed a migration script I've been previously running fine started giving me the errors below. Remove server doesn't log any failure. doveconf -n attached. + /bin/doveadm -o mail_fsync=never backup -R -u user(a)domain.com imapc: dsync(user(a)domain.com): Panic: file mdbox-save.c: line 337: unreached dsync(user(a)domain.com): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x8d52e) [0x7f58e6da052e] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_ha ndler+0x2a) [0x7f58e6da059a] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f58e6d3f1b6] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0x5b157) [0x7f58e7080157] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbfdbf) [0x7f58e70e4dbf] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_index_transaction_commit_full+0x9d) [0x7f58e 710043d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_transaction_commit+0x107) [0x7f58e70e5337] -> /usr/lib64/dovecot/lib20_zlib_plugin.so(+0x3163) [0x7f58e5f29 163] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0xc703) [0x7f58e613d703] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x51) [0 x7f58e7069631] -> /bin/doveadm [user(a)domain.com INBOX import:650/674](dsync_mailbox_import_deinit+0xf8) [0x7f58e7a12898] -> /bin/doveadm [user(a)domain.com IN BOX import:650/674](+0x41bbf) [0x7f58e7a0cbbf] -> /bin/doveadm [user(a)domain.com INBOX import:650/674](dsync_brain_sync_mails+0x723) [0x7f58e7a0d433] -> /bin/dovea dm [user(a)domain.com INBOX import:650/674](dsync_brain_run+0x5f8) [0x7f58e7a08c78] -> /bin/doveadm [user(a)domain.com INBOX import:650/674](+0x27521) [0x7f58e7 9f2521] -> /bin/doveadm [user(a)domain.com INBOX import:650/674](+0x2929f) [0x7f58e79f429f] -> /bin/doveadm [user(a)domain.com INBOX import:650/674](+0x29d8d) [0x7f58e79f4d8d] -> /bin/doveadm [user(a)domain.com INBOX import:650/674](doveadm_mail_try_run+0x215) [0x7f58e79f56f5] -> /bin/doveadm [user(a)domain.com INBOX import:650/674](main+0x455) [0x7f58e79e57f5] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f58e6973b15] -> /bin/doveadm [user(a)domain.com INBOX import:650/674](+0x1a96d) [0x7f58e79e596d] /root/migrate_code/migrate_mailbox_eftel.sh: line 31: 48637 Aborted /bin/doveadm -o mail_fsync=never backup -R -u $USERNAME imapc: + RETCODE=134 Regards Leon

3 3

Pigeonhole vs dovecot gssapi option
by Larry Rosenman 13 Jul '16

13 Jul '16

Stephan, Is there a reason you don't pick up the dovecot-config file to set additional libraries like the Kerberos libs? I'm the FreeBSD Ports Maintainer for pigeonhole, and a user filed a PR about missing the krb5 libs. Thanks! -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

2 4

Re: [2.2.25 auth issue] auth-request.c: line 1049 (auth_request_lookup_credentials): assertion failed: (request->credentials_scheme == scheme)
by Alexey Asemov (Alex/AT) 13 Jul '16

13 Jul '16

Hello Aki. Here it is. Some sensitive data was replaced by ***. # 2.2.25 (7be1766): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.15 (97b3da0) # OS: Linux 3.10.0-***.el7.x86_64 x86_64 CentOS Linux release 7.*** (Core) ext4 auth_cache_negative_ttl = 15 secs auth_cache_size = 8 M auth_cache_ttl = 15 secs auth_default_realm = *** auth_mechanisms = plain login digest-md5 cram-md5 ntlm auth_username_chars = abcdefghijklmnopqrstuvwxyz ABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.,;=-_@ auth_username_format = %LTn@%LTd auth_verbose = yes auth_worker_max_count = 64 dict { last_login = mysql:/etc/dovecot/mailserver/last_login.dbconf sieve = mysql:/etc/dovecot/mailserver/sieve.dbconf } disable_plaintext_auth = no import_environment = TZ listen = * lock_method = dotlock log_timestamp = %F %T login_greeting = *** Mail Server ready and serving (LXmail01). mail_attachment_dir = /mailboxes/%1.16Nu/%Ld/.attachments mail_attachment_hash = %{sha256}.%{size} mail_attachment_min_size = 64 k mail_cache_min_mail_count = 32 mail_gid = mailbox mail_home = /mailboxes/%1.16Nu/%Ld/%2.256Nn/%Ln mail_location = mdbox:/mailboxes/%1.16Nu/%Ld/%2.256Nn/%Ln mail_max_keyword_length = 64 mail_plugins = quota fts fts_lucene zlib mail_uid = mailbox mailbox_idle_check_interval = 1 mins managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_interval = 90 days mdbox_rotate_size = 4 M namespace { inbox = yes location = mailbox Drafts { auto = no special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = create special_use = \Junk } mailbox Trash { auto = no special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/mailserver/mysql.dbconf driver = sql } plugin { fts = lucene fts_autoindex = yes fts_autoindex_max_recent_msgs = 65536 fts_index_timeout = 900 fts_lucene = whitespace_chars=@.,;-/ last_login_dict = proxy::last_login last_login_key = last_login/%u quota = dict:user quota::file:%h/.quota quota_rule = *:bytes=2684354560 quota_rule2 = Trash:bytes=+10%% quota_rule3 = Spam:bytes=+10%% sieve = dict:proxy::sieve;name=%Lu;bindir=/mail_local/sieve/cache sieve_dir = ~/sieve sieve_global_dir = /mail_local/sieve/global sieve_max_actions = 32 sieve_max_redirects = 4 sieve_max_script_size = 16K sieve_user_log = /mail_local/sieve/logs/%Lu.log sieve_vacation_dont_check_recipient = yes sieve_vacation_max_period = 0 sieve_vacation_min_period = 0 zlib_save = xz zlib_save_level = 1 } service anvil { client_limit = 6666 } service auth { client_limit = 6666 unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = mailbox mode = 0600 user = mailbox } user = $default_internal_user } service auth_worker { user = root } service dict { unix_listener dict { group = mailbox mode = 0600 user = mailbox } } service imap-login { chroot = login client_limit = 2048 inet_listener imaps { address = * } process_limit = 2048 process_min_avail = 1 service_count = 1 user = dovecot } service imap { drop_priv_before_exec = no process_limit = 2048 } service indexer-worker { process_limit = 2 } service ipc { unix_listener ipc { group = mode = 0600 user = } unix_listener login/ipc-proxy { group = dovecot mode = 0660 user = $default_login_user } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } unix_listener lmtp { group = mailbox mode = 0600 user = mailbox } } service pop3-login { chroot = login client_limit = 2048 inet_listener pop3s { address = * } process_limit = 2048 process_min_avail = 1 service_count = 1 user = dovecot } service pop3 { drop_priv_before_exec = no process_limit = 2048 } shutdown_clients = no ssl_cert = </etc/ssl/email.crt ssl_key = </etc/ssl/email.key syslog_facility = local2 userdb { args = /etc/dovecot/mailserver/mysql.dbconf driver = sql } verbose_proctitle = yes protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 16 mail_plugins = quota fts fts_lucene zlib imap_quota last_login } protocol pop3 { mail_max_userip_connections = 16 mail_plugins = quota fts fts_lucene zlib last_login pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_enable_last = yes pop3_save_uidl = yes pop3_uidl_duplicates = rename pop3_uidl_format = %08Xu%08Xv } protocol lda { auth_socket_path = /var/run/dovecot/auth-master lda_original_recipient_header = X-Original-To mail_debug = no mail_plugins = quota fts fts_lucene zlib sieve postmaster_address = postmaster@*** quota_full_tempfail = no recipient_delimiter = + } protocol lmtp { lda_original_recipient_header = X-Original-To lmtp_save_to_detail_mailbox = yes mail_debug = no mail_plugins = quota fts fts_lucene zlib sieve postmaster_address = postmaster@*** quota_full_tempfail = no recipient_delimiter = + } local_name LXmail.*** { ssl_cert = </etc/ssl/***.net.crt ssl_key = </etc/ssl/***.net.key } local_name LXmail01.*** { ssl_cert = </etc/ssl/***.net.crt ssl_key = </etc/ssl/***.net.key } local_name LXmail02.*** { ssl_cert = </etc/ssl/***.net.crt ssl_key = </etc/ssl/***.net.key } local_name LXmail03.*** { ssl_cert = </etc/ssl/***.net.crt ssl_key = </etc/ssl/***.net.key } local_name LXmail04.*** { ssl_cert = </etc/ssl/***.net.crt ssl_key = </etc/ssl/***.net.key } > Hi! > > Could you provide your doveconf -n so we could debug this? > > Aki >

2 3

passdb {driver = shadow args = override_username=%variable}
by UNIX admin 12 Jul '16

12 Jul '16

Hello list I want to implement override_username = %variable for the "shadow" driver, so that the following works: passdb { driver = shadow args = override_username=%Ln } by "%variable", I mean "Variables" at http://wiki.dovecot.org/Variables. I've hacked up a solution with strtok(3C), but that's a hack and a possible security hole, and I'd rather not implement it. What I really want is to be able to leverage Dovecot's var_expand() call, which, looking at the code, appears to be the function responsible for %variable expansion and formatting. The relevant piece of code seems to be this excerpt in auth/passdb-shadow.c: static enum passdb_result shadow_lookup(struct auth_request *request, struct spwd **spw_r) { auth_request_log_debug(request, AUTH_SUBSYS_DB, "lookup"); *spw_r = getspnam(request->user); if (*spw_r == NULL) { auth_request_log_unknown_user(request, AUTH_SUBSYS_DB); return PASSDB_RESULT_USER_UNKNOWN; } when request->user contains 'user(a)domain.tld', I want the code to be able to process "override_username", determine that the format is %Ln so that request->user is lowercased, and everything after the "@" sign is stripped. Therefore, if this user happens to exist in the shadow file, authentication will succeed. Currently, the "shadow" driver only appears to support "args = blocking=no". Please advise.

3 4

Re: Dovecot 2.2.25 compiling error
by Joseph Tam 12 Jul '16

12 Jul '16

>> I've reduced the problem to this: >> >> void foo(int X[static 20]); >> >> will compile but if you remove "X", it won't. > > The change was to replace "int" with "unsigned char" in the above test > program, and the test started failing then in CentOS 5's gcc. I'd > expect the same to happen for you also. No, it will fail with both "int" and "unsigned char" without the dummy argument "X", and works for both if one is inserted. I don't know why -- perhaps a bug with my version of gcc. Joseph Tam <jtam.home(a)gmail.com>

1 1

dovecot master password without "auth_master_user_separator"
by Miguel C 12 Jul '16

12 Jul '16

Looking at the doc its sugest we can either use auth_master_user_separator to login with a master user (i.e user(a)email.com*master and the master password defined in a file or db) I'm able to use this method with a password file and works just fine, however we need to sync some imap users to another destrination that does not allow us to use this format in the "email address source" (shame) But the doc also sugests if I don't use this flag I should be able to just use the same login used in the SASL mecahnisms which is not working (testing with plain text ). Is there anything more to this? I have tried to add a username to the password file with the same master password but still doens't work :| What am I missing? Melhores Cumprimentos // Best Regards ----------------------------------------------- *Miguel Clara* *IT - Sys Admin & Developer*

1 0

Feature Request
by Doug Hardie 12 Jul '16

12 Jul '16

I would like to request an additional optional argument for queue-id to dovecot-lda. The intended use for this argument is to include in the logging. From what I can tell, the queue-id size is not consistent between the various MTAs and so would need to be allocated dynamically when read during initialization. This element in the log messages would make it easier to find the trace of a received email. Generally I can easily get the queue-id generated by postfix (or sendmail - I use both). One grep would then give me the whole picture rather than having to dig out the message-id and doing a secondary grep to obtain the lda log messages. — Doug I find it interesting that every submission to this list results in a quick response that says moderation is required since I "am not a member". However, I am a member...

2 1

is it possible to run a post-login script in a dovecot proxy with local auth?
by Luca Lesinigo 12 Jul '16

12 Jul '16

We’re using dovecot v2.2.22, authenticating on a local database (passdb with sql driver), and then proxying the connections to the backend server returned by passdb (proxy=y and backend in “host” column). To support some legacy clients we should keep POP/IMAP-before-SMTP running for some time, but right know I don’t know how to hook up a successful authentication in the dovecot proxy. I did read from http://wiki2.dovecot.org/PostLoginScripting: “...it's not currently possible to run post-login scripts in proxies, because they're not actually logging in to the local Dovecot” Does that also holds true even if the proxy is authenticating users locally before proxying them? Failing that, any idea on how to get successful logins, other than parsing the log file? thank you, -- Luca Lesinigo

2 1

Re: Dovecot 2.2.25 compiling error
by Joseph Tam 12 Jul '16

12 Jul '16

Aki Tuomi wrote: >>> Well, tried with or without patches, but got still same error: >>> >>> sha1.h:80: error: static or type qualifiers in abstract declarator >> >> For what it's worth, I get the same error compiling on Solaris 10. >> It may be because I have a rather old gcc (3.4.4). Editing out >> the "static" keyword from config.h allowed it to finish the compile. > > It still happened even with > https://github.com/dovecot/core/commit/d9c865ce774aae9f2f17b89e7e94c3cfca29… > > You need to rerun autotools on this before it can do anything. I don't grok autotools, but I don't think this will solve the problem. If I understand the patch correctly, it modifies the small program used by configure to test a C99 feature. Manually compiling the small test program (with and without the changes made by the patch) will result in a successful compile, but if you compile sha1.h (line 80,81), it will fail. I've reduced the problem to this: void foo(int X[static 20]); will compile but if you remove "X", it won't. Joseph Tam <jtam.home(a)gmail.com>

2 1

a question about dovecot-sieve
by 刘莹莹 11 Jul '16

11 Jul '16

question discribe: example: > vim .dovecot.sieve require ["fileinto"]; # rule:[filter1] if anyof (header :contains "Subject" "测试邮件") { fileinto "sieve"; } when i write a mail ,give subject "这是一封测试邮件" , then server convert this subject to " SUBJECT: =?UTF-8?Q?=E8=BF=99=E6=98=AF=E4=B8=80=E5=B0=81=E6=B5=8B=E8=AF=95=E9=82=AE?= =?UTF-8?Q?=E4=BB=B6?= " the essential question is when the mail go through dovecot-sieve plugin, the sieve plugin get mail subject is "这是一封测试邮件" not "这是一封测试邮件"，there is a extra space added(which as segmentation between "=?UTF-8?Q?"). SIMPLY SAY：edit subject"这是一封测试邮件" ——>server convert "SUBJECT: =?UTF-8?Q?=E8=BF=99=E6=98=AF=E4=B8=80=E5=B0=81=E6=B5=8B=E8=AF=95=E9=82=AE?= =?UTF-8?Q?=E4=BB=B6?="——>sieve plugin get "这是一封测试邮件" The result is filter failure. is this a bug ? How can I avoid it？ thanks

2 1