- dovecot - dovecot.org

Dovecot 2.2.15, Panic: file mbox-sync.c: line 152 (mbox_sync_read_next_mail): assertion failed:
by Mark Sapiro 01 Dec '14

01 Dec '14

The log messages are attached. The core dump is at <https://www.dropbox.com/s/9i80ms7xkyxoqj7/core.26450?dl=0> The server is $ uname -a Linux sbh16.songbird.com 2.6.18-8.1.14.el5 #1 SMP Thu Sep 27 18:58:54 EDT 2007 i686 i686 i386 GNU/Linux -- Mark Sapiro <mark(a)msapiro.net> The highway is for gamblers, San Francisco Bay Area, California better use your sense - B. Dylan

2 2

Panic: from mbox-sync.c; doveadm zlib-plugin
by Timothe Litt 01 Dec '14

01 Dec '14

Upgraded to dovecot 2.2.15 (built from sources on Fedora linux), saw intermittent panics: From dovecot:imap Error: Next message unexpectedly corrupted in mbox file /home/xxxx/mail/Junk E-mail at 1202197 Panic: file mbox-sync.c: line 152 (mbox_sync_read_next_mail): assertion failed: (sync_ctx->input->v_offset != mail_ctx->mail.from_offset || sync_ctx->input->eof) Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0 [0x274ecf] -> /usr/local/lib/dovecot/libdovecot.so.0 [0x274f4d] -> /usr/local/lib/dovecot/libdovecot.so.0 [0x27446b] -> /usr/local/lib/dovecot/libdovecot-storage.so.0 [0x16633e] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mbox_sync+0x6b6) [0x168146] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mbox_storage_sync_init+0x81) [0x169391] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x40) [0x186270] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x3d) [0x18715d] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x74) [0x1b6c44] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x5f) [0x1895bf] -> dovecot/imap(imap_status_get+0x7a) [0x806396a] -> dovecot/imap(cmd_status+0x128) [0x80588a8] -> dovecot/imap(command_exec+0x33) [0x805c8e3] -> dovecot/imap [0x805b63f] -> dovecot/imap [0x805b6c3] -> dovecot/imap(client_handl Fatal: master: service(imap): child 25461 killed with signal 6 (core dumps disabled) They are on hiatus, but thought I should report this anyway. If I get a reproducer, I'll see if I can get core dumps. The user involved had several procmail processes hung waiting for the lockfile on this mbox. Killing sendmail & dovecot, the procmails & restarting sendmail & dovecot is all that I did after the errors. It is possible that the last message delivered prior to the errors was truncated ("note the input-eof" in the trace), but this shouldn't result in a panic. I'd expect a warning, then the message truncated to whatever is there, and operations proceeding... Also, it appears that make install doesn't remove the doveadm zlib plugin, which it seems was obsoleted by http://www.dovecot.org/list/dovecot-cvs/2012-October/021796.html. This results in: doveadm log find doveadm(root): Error: Module is for different ABI version 2.1.12 (we have 2.2.ABIv15(2.2.15)): /usr/local/lib/dovecot/doveadm/lib10_doveadm_zlib_plugin.so Removing /usr/local/lib/dovecot/doveadm/lib10_doveadm_zlib_plugin.* fixes this. However, it would be better if make install either removed these from an old installation in an upgrade, renamed the files, or advised the installer to do so. FWIW: # 2.2.15: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.22.14-72.fc6 i686 Fedora Core release 6 (Zod) first_valid_gid = 4000 first_valid_uid = 4000 hostname = smtp.example.net login_greeting = Dovecot ready. Unauthorized access is prohibited. mail_access_groups = mail mail_location = mbox:~/mail:INBOX=/var/mail/%n mail_privileged_group = mail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox "Train As Forgotten" { auto = subscribe } mailbox "Train As Ham" { auto = subscribe } mailbox "Train As Spam" { auto = subscribe } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { driver = pam } service imap-login { inet_listener imap { address = imap.v4.example.net imap.v6.example.net port = 143 } inet_listener imaps { address = imap.v4.example.net imap.v6.example.net port = 993 ssl = yes } } service pop3-login { inet_listener pop3 { address = pop.v4.example.net pop.v6.example.net port = 110 } inet_listener pop3s { address = pop.v4.example.net pop.v6.example.net port = 995 ssl = yes } } ssl_ca = </etc/pki/tls/certs/example_net_ca-cert-crl.pem ssl_cert = </etc/pki/tls/certs/servers-example-net.pem ssl_key = </etc/pki/tls/private/servers-example-net.pmk userdb { driver = passwd } protocol imap { imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags mail_plugins = } protocol pop3 { mail_plugins = pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } -- Timothe Litt ACM Distinguished Engineer -------------------------- This communication may not represent the ACM or my employer's views, if any, on the matters discussed.

1 0

v2.2.15 - make check - Conditional jump or move depends on uninitialised value
by AMM 01 Dec '14

01 Dec '14

Hello, I am currently using Dovecot 2.2.10 on Fedora 16 - 64 bit system I had made v2.2.10 Fedora 16 rpm file using spec file from ATrpms. http://dl.atrpms.net/all/dovecot.spec It has been working well from 6 months or so. Today I tried to make v2.2.15 rpm using same spec file. But "make check" is giving following error: fatal_printf_format_fix .............................................. : ok 0 / 190 tests failed ==8834== Conditional jump or move depends on uninitialised value(s) ==8834== at 0x4F7FE99: __strspn_sse42 (in /lib64/libc-2.14.90.so) ==8834== by 0x10FCF1: test_ds_recurse (test-data-stack.c:123) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== by 0x10FCC9: test_ds_recurse (test-data-stack.c:119) ==8834== There are more similar errors after that and then rpmbuild aborts. I already saw that someone reported same error recently: http://dovecot.org/pipermail/dovecot/2014-October/098452.html But I do not know what is the right solution / patch? Can I disable "make check" safely? Its a production server so would not take any risk. Can anyone please tell what should I do? Thanks in advance. AMM

2 4

R: Re: SORT capability
by absolutely_free＠libero.it 01 Dec '14

01 Dec '14

Here's my conf: # dovecot -n # 2.0.9: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-71.el6.x86_64 x86_64 CentOS release 6.6 (Final) auth_mechanisms = plain login digest-md5 cram-md5 disable_plaintext_auth = no first_valid_gid = 89 first_valid_uid = 89 mail_gid = 89 mail_location = maildir:/coraid-s2l2/domains mail_uid = 89 maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date imapflags notify mbox_write_locks = fcntl namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-crypt.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_max_script_size = 1M } protocols = imap pop3 lmtp sieve service imap-login { service_count = 0 } service pop3-login { service_count = 0 } ssl_cert = </etc/nginx/ssl/wildcard.crt ssl_key = </etc/nginx/ssl/wildcard.key userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = } protocol lda { mail_plugins = } protocol pop3 { pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } >----Messaggio originale---- >Da: h.reindl(a)thelounge.net >Data: 01/12/2014 12.37 >A: <dovecot(a)dovecot.org> >Ogg: Re: SORT capability > > > >Am 01.12.2014 um 12:32 schrieb absolutely_free(a)libero.it: >> # dovecot -n |grep -i sort >> >> (nothing) > >i meant post the complete output >you can't grep for something not existing >but you or some config-include may set something wrong > >> Maybe to full list is only available after authentication? > >likely > >> # telnet localhost 143 >> Trying ::1... >> Connected to localhost. >> Escape character is '^]'. >> * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE >> STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. >> a login XXXXXXXXXXX YYYYYYYYYYYYYYYY >> a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE >> SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN >> NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT >> SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in >> >>> ----Messaggio originale---- >>> Da: h.reindl(a)thelounge.net >>> Data: 01/12/2014 12.21 >>> A: <dovecot(a)dovecot.org> >>> Ogg: Re: SORT capability >>> >>> Am 01.12.2014 um 12:19 schrieb absolutely_free(a)libero.it: >>>> why I don't see SORT capability on my dovecot server? >>>> >>>> # telnet localhost 143 >>>> Trying ::1... >>>> Connected to localhost. >>>> Escape character is '^]'. >>>> * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE >> STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. >>>> 1 capability >>>> * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE >> STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5 >>>> 1 OK Capability completed. >>>> a logout >>>> * BYE Logging out >>>> a OK Logout completed. >>>> Connection closed by foreign host >>> >>> DUNNO >>> >>> mabye output of "dovecot -n" knows > >

1 0

R: Re: SORT capability
by absolutely_free＠libero.it 01 Dec '14

01 Dec '14

# dovecot -n |grep -i sort (nothing) Maybe to full list is only available after authentication? # telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login XXXXXXXXXXX YYYYYYYYYYYYYYYY a OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS] Logged in >----Messaggio originale---- >Da: h.reindl(a)thelounge.net >Data: 01/12/2014 12.21 >A: <dovecot(a)dovecot.org> >Ogg: Re: SORT capability > > > >Am 01.12.2014 um 12:19 schrieb absolutely_free(a)libero.it: >> why I don't see SORT capability on my dovecot server? >> >> # telnet localhost 143 >> Trying ::1... >> Connected to localhost. >> Escape character is '^]'. >> * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. >> 1 capability >> * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5 >> 1 OK Capability completed. >> a logout >> * BYE Logging out >> a OK Logout completed. >> Connection closed by foreign host > >DUNNO > >mabye output of "dovecot -n" knows > >

2 1

Unable to see virtual users
by Randall Gellens 01 Dec '14

01 Dec '14

I have a new Dovecot v2.2.9 installation and am having trouble getting virtual users recognized. Also, the example configuration listed on the Wiki generates config errors. Note that I haven't tried running dovecot yet, I wanted to verify that the config looked good first. First, my configuration. I'm trying to use /etc/dovecot/users as my combined userdb and passdb file, with all users having a UID/GID of vmail, and a home directory of /local/mnt/home/<user> ---------- $ sudo doveconf -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-39-generic x86_64 Ubuntu 14.04.1 LTS ext4 auth_verbose = yes log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = mdbox:/local/mnt/mail/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = username_format=%n /etc/dovecot/users driver = passwd-file } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } postmaster_address = randy(a)qti.qualcomm.com protocols = " imap sieve pop3" ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.pem userdb { args = username_format=%n /etc/dovecot/users default_fields = uid=vmail gid=vmail home=/local/mnt/home/%n driver = passwd-file } userdb { driver = passwd } ---------- Next, my /etc/dovecot/users file: $ cat /etc/dovecot/users fred:x test:{SSHA}amehbJZYxKWuIbywINVNWxKcPrWi27a+ poptest2:x poptest3:x ---------- If I ask dovecot what it knows about user 'test' it says the user doesn't exist: $ sudo doveadm user test field valueuserdb lookup: user test doesn't exist ---------- If I ask about a user in /etc/passwd, it finds it: $ sudo doveadm user nobody field value uid 65534 gid 65534 home /nonexistent mail mdbox:/local/mnt/mail/nobody system_groups_user nobody ---------- As an aside, when I copied the sample config entries from http://wiki2.dovecot.org/UserDatabase it got config errors: userdb { driver = passwd-file args = username_format=%n /etc/dovecot/users default_fields = uid=vmail gid=vmail override_fields = skip = never result_failure = continue result_internalfail = continue result_success = return-ok } The 'skip', 'result_failure', etc. entries all generated config errors as being unknown. Since these were just explicitly setting config variables to their default values, I deleted them. It does seem odd that the config sample from the Wiki generated errors though. -- Randall Gellens Opinions are personal; facts are suspect; I speak for myself only -------------- Randomly selected tag: --------------- The difference between stupidity and genius is that genius has its limits. --Albert Einstein

3 6

Working with Active Directory on Windows Server 2012 R2
by Aaron Jenkins 30 Nov '14

30 Nov '14

Hi all, I’m having issues getting Dovecot to work with AD on 2012 R2 in a test environment. Background: AD is running on dc1.ad.automaton.uk<http://dc1.ad.automaton.uk>, the domain is ad.automaton.uk<http://ad.automaton.uk>. The DNS server is running on ad.automaton.uk<http://ad.automaton.uk> and the automaton.uk<http://automaton.uk> DNS is set up correctly in the test environment in that everything resolves to the correct IP address and I can authenticate with whichever LDAP clients (ldapsearch, ApacheDS, sssd). It refuses to bind on Dovecot for some reason. aaron@mail:/var/log$ uname -a Linux mail.ad.automaton.uk 3.16.0-23-generic #31-Ubuntu SMP Tue Oct 21 17:56:17 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux aaron@mail:/var/log$ dovecot --version 2.2.9 aaron@mail:/var/log$ dpkg -l | grep dovecot ii dovecot-core 1:2.2.9-1ubuntu5 amd64 secure POP3/IMAP server - core files ii dovecot-gssapi 1:2.2.9-1ubuntu5 amd64 secure POP3/IMAP server - GSSAPI support ii dovecot-imapd 1:2.2.9-1ubuntu5 amd64 secure POP3/IMAP server - IMAP daemon ii dovecot-ldap 1:2.2.9-1ubuntu5 amd64 secure POP3/IMAP server - LDAP support aaron@mail:/var/log/$ cat dovecot-debug.log … Nov 19 09:22:23 auth: Debug: auth client connected (pid=10345) Nov 19 09:22:23 auth: Debug: client in: AUTH 1 PLAIN service=imap secured session=pkJxdDkISwAK0zcd lip=10.211.55.33 rip=10.211.55.29lport=993 rport=56395 Nov 19 09:22:23 auth: Debug: client passdb out: CONT 1 Nov 19 09:22:23 auth: Debug: client in: CONT 1 (previous base64 data may contain sensitive data) Nov 19 09:22:29 auth: Debug: client passdb out: FAIL 1 user=aaron.jenkins temp Nov 19 09:22:29 auth: Debug: client in: AUTH 2 PLAIN service=imap secured session=pkJxdDkISwAK0zcd lip=10.211.55.33 rip=10.211.55.29lport=993 rport=56395 resp= (previous base64 data may contain sensitive data) Nov 19 09:22:39 auth: Debug: client passdb out: FAIL 2 user=aaron.jenkins temp Nov 19 09:22:40 auth: Debug: client in: AUTH 3 PLAIN service=imap secured session=pkJxdDkISwAK0zcd lip=10.211.55.33 rip=10.211.55.29lport=993 rport=56395 Nov 19 09:22:44 auth: Debug: client passdb out: CONT 3 Nov 19 09:22:44 auth: Debug: client in: CONT 3 (previous base64 data may contain sensitive data) Nov 19 09:22:50 auth: Debug: client passdb out: FAIL 3 user=aaron.jenkins temp Nov 19 09:22:50 auth: Debug: client in: AUTH 4 PLAIN service=imap secured session=pkJxdDkISwAK0zcd lip=10.211.55.33 rip=10.211.55.29lport=993 rport=56395 resp= (previous base64 data may contain sensitive data) Nov 19 09:22:56 auth: Debug: client passdb out: FAIL 4 user=aaron.jenkins temp (I’ve removed the base64 as it might contain passwords I actually use, if it’s important I’ll re-run it with a different password unredacted) Do you guys have any ideas on how to get it working with 2012 R2? I know the LDAP is quite funky but I suspect that’s why it doesn’t work. Also, attached is my sssd config as it’s working fine in case it might provide any insights.

2 5

how to start a replication master-master correctly
by Eduardo Casarero 28 Nov '14

28 Nov '14

Hi all, I currently have one dovecot 2.2.15 working and I would like to add a second master server. If I configure the second server and enable the dsync in both servers, the sync will copy everything from A to B ? I mean, B server won't remove messages in A as it doesn't have anything in its users mailbox? The second master server will be a cold server just for contingency. Thanks

3 2

Re: Offtopic, spam+AV
by Reindl Harald 28 Nov '14

28 Nov '14

Am 28.11.2014 um 17:45 schrieb Jorge Bastos: > In my previous servers I have clamav+spamassassin configured in postfix, but > things as, scan only outgoing emails it's not possible. > > What's the best option for these two filtering now adays? besides that this is the wrong list why should it not be possible? * clamav-milter exists * spamass-milter exists * "-o receive_override_options=no_milters" exists normally you have submission (587) for authenticated mail and MX (25) for inbound mail and both can have their own receive_override_options our MX is a own server delivering already filtered messages to the mailstorage on a different vserver in the LAN via port 10025 the service 10025 is only reachable from one IP (the MX LAN interface) and has "receive_override_options=no_milters" while all other smtpd services in "master.cf" use their own milter setup adjusted for outgoing mail and both machines share a careful maintained bayes-database trained on one machine and deployed with rsync

1 0

Offtopic, spam+AV
by Jorge Bastos 28 Nov '14

28 Nov '14

Hi guys, In my previous servers I have clamav+spamassassin configured in postfix, but things as, scan only outgoing emails it's not possible. What's the best option for these two filtering now adays? Thanks in advanced,

1 0