- dovecot - dovecot.org

Strange indexing behavior on HTML emails ..
by Akash 16 Oct '15

16 Oct '15

Hi, In continuation to the issue I had posted about long back: http://www.dovecot.org/list/dovecot/2014-August/097362.html I did further testing today on a fresh new Debian & latest Dovecot and observed a undesired behavior. I am using fts_lucene & following sequence of commands on a empty test account me(a)myself.com: doveadm expunge -u 'my(a)myself.com' mailbox 'INBOX' all cat test.eml | /usr/lib/dovecot/dovecot-lda -e -f you(a)yourself.com -d me(a)myself.com doveadm search -u 'akash(a)mailjol.in' mailbox 'INBOX' text ABCD Search command does or doesn't find the email with slight variation in the content of test.eml. Here are the results: test.eml content: ----------------------------- From: you(a)yourself.com To: me(a)myself.com Subject: Test Message Content-Type: text/html <div id="mydiv">ABCD 1234</div> ----------------------------- RESULT: OK. The email is found. test.eml content (double quotes inside div tag replaced with single): ----------------------------- From: you(a)yourself.com To: me(a)myself.com Subject: Test Message Content-Type: text/html <div id='mydiv'>ABCD 1234</div> ----------------------------- RESULT: None. The email isn't found. test.eml content (single quotes in div but content/type header removed): ----------------------------- From: you(a)yourself.com To: me(a)myself.com Subject: Test Message <div id='mydiv'>ABCD 1234</div> ----------------------------- RESULT: OK. The email is found. What could be the reason for this? -Akash

3 7

Re: Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 16 Oct '15

16 Oct '15

> Message: 6 > Date: Wed, 14 Oct 2015 11:43:22 +0200 > From: Christian Kivalo <ml+dovecot(a)valo.at> > To: Dovecot Mailing List <dovecot(a)dovecot.org> > Subject: Re: Problems sync with mail client MAC and > dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64 > Message-ID: <33ba2eacef5dcfcb4c703615e559b094(a)valo.at> > Content-Type: text/plain; charset=US-ASCII; format=flowed > > > > Attached the doveconf -n > > Yes i have mail_debug = yes into file conf.d/10-logging.conf > > I paste the rest of log: > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Loading modules from > > directory: /usr/lib64/dovecot > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib01_acl_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib02_imap_acl_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib10_quota_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: > > /usr/lib64/dovecot/lib11_imap_quota_plugin.so > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Effective > > uid=56396, gid=55000, home=/VMAIL/xxxxxxxxxxxxxx > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > root: > > name=User quota backend=maildir args= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota > > grace: root=User quota bytes=0 (10%) > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Namespace > > inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, > > list=children, subscriptions=yes location=maildir:~/Maildir > > Your inbox namespace seems to be ok and is also defined in your doveconf > -n output. > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > maildir++: > > root=/VMAIL/xxxxxxxxxxxxxx/Maildir, index=, indexpvt=, control=, > > inbox=/VMAIL/xxxxxxxxxxxxxx/Maildir, alt= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > initializing backend with data: vfile > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > acl > > username = xxxxxxxxxxxxxx > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: > > owner > > = 1 > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl > > vfile: > > Global ACL directory: (none) > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: > > Namespace : > > type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, > > subscriptions=no location=fail::LAYOUT=none > > Somehow there seems to be an empty namespace in addition to your inbox > namespace. > > Is there a second namespace in your config somewhere? > > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: none: > > root=, index=, indexpvt=, control=, inbox=, alt= > > Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Fatal: master: > > service(imap): child 2464 killed with signal 11 (core dumps disabled) > > Just guessing: > Could it be with Thunderbird that the second namespace is ignored when > there is no subscription to it and the Apple mailprogram behaves > differently? > > regards > christian > > > > Hi, i can reproduce the error, conencting opnessl to port 993:

1 0

Problem with ldap - master user - sogo vacation
by zava.zava＠libero.it 16 Oct '15

16 Oct '15

Hi,I have a problem, i can't get the authentication for the master user using dovecot - ldap authentication, in combination with sogo.There is a script that is used by Sogo to check and disable the vacation messagge: "sogo /usr/sbin/sogo-tool expire-autoreply -p /etc/dovecot/master-users" Insidie this file there is: sogo:{SHA}gkodfgdk6yujkgdklkkdfkgjrg9ugr9p= if I run the script I get: Oct 16 09:59:12 auth: Debug: auth client connected (pid=6528)Oct 16 09:59:12 auth: Debug: client in: AUTH 1 PLAIN service=sieve secured session=aQDV64h65pAB/AAAB lip=127.0.0.1 rip=127.0.0.1 lport=4190 rport=36260 resp=Y2VkQGdyddgPQ== (previous base64 data may contain sensitive data)Oct 16 09:59:12 auth: Debug: passwd-file(sogo,127.0.0.1,master,<aQDVKzQipAB/AAAB>): Master user lookup for login: user(a)domain.comOct 16 09:59:12 auth: Debug: passwd-file(sogo,127.0.0.1,master,<aQDVKzQipAB/AAAB>): lookup: user=sogo file=/etc/dovecot/master-usersOct 16 09:59:12 auth: Info: passwd-file(sogo,127.0.0.1,master,<aQDVKzQipAB/AAAB>): Password mismatch (given password: {SHA}4sdgkfgwe22=)Oct 16 09:59:12 auth: Debug: passwd-file(sogo,127.0.0.1,master,<aQDVKzQipAB/AAAB>): SHA({SHA}kerwkekwrejkewerjrw=) != 'erwrewwweewrerewrwe='Oct 16 09:59:14 auth: Debug: client passdb out: FAIL 1 user=sogoOct 16 09:59:14 managesieve-login: Info: Disconnected (auth failed, 1 attempts in 2 secs): user=<sogo>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, TLS: Disconnected, session=<aQDVKzQipAB/AAAB> In the auth-master.conf.ext file I have: passdb { driver = passwd-file master = yes args = /etc/dovecot/master-users} Thanks in advance for help. # 2.2.13: /etc/dovecot/dovecot.conf# OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.2 ext4auth_debug = yesauth_debug_passwords = yesauth_master_user_separator = *auth_mechanisms = plain auth_verbose = yesauth_verbose_passwords = yesdefault_client_limit = 22000default_process_limit = 5000default_vsz_limit = 1 Gdisable_plaintext_auth = nofirst_valid_gid = 5000first_valid_uid = 5000last_valid_gid = 5000last_valid_uid = 5000log_path = /var/log/dovecot.logmail_debug = yesmail_location = maildir:/var/vmail/xxx/%Ln/Maildirmanagesieve_notify_capability = mailtomanagesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notifynamespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = /}passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes}passdb { driver = pam}passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf1.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf2.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf3.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf4.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf5.ext driver = ldap}passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap}plugin { sieve = /var/vmail/xxx/%n/.dovecot.sieve sieve_dir = /var/vmail/xxx/%n/ sieve_extensions = +enotify +vacation +copy +imapflags +notify}protocols = imap sieveservice auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0666 }}service imap { process_limit = 5000}service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 0 vsz_limit = 64 M}service managesieve { process_limit = 1024}ssl_cert = </etc/ssl/certs/xxx.pemssl_dh_parameters_length = 2048ssl_key = </etc/ssl/private/xxx.keyuserdb { args = uid=5000 gid=5000 home=/var/vmail/xxx/%Lu driver = passwd}userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf1.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf2.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf3.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf4.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf5.ext driver = ldap}userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap}protocol imap { mail_max_userip_connections = 100 mail_plugins =}protocol sieve { mail_max_userip_connections = 10 managesieve_max_line_length = 65536}

1 0

master user in dovecot 1.2
by Michal Žila 16 Oct '15

16 Oct '15

Hello list, i would like to use master user functionality in dovecot v1.2, but i just cant get it to work: Here’s my configuration: # dovecot -n # 1.2.9: /etc/dovecot.conf # OS: Linux 2.6.18-164.10.1.el5PAE i686 Red Hat Enterprise Linux Server release 5.4 (Tikanga) login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 200 mail_privileged_group: mail mail_location: mbox:~/mail:INBOX=/var/mail/%u mail_executable(default): /root/dovecot-master-postlogin mail_executable(imap): /root/dovecot-master-postlogin mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 lda: postmaster_address: postmaster(a)example.com auth default: master_user_separator: * debug: yes passdb: driver: passwd-file args: /etc/dovecot.passwd.masterusers pass: yes master: yes passdb: driver: pam userdb: driver: passwd # cat /root/dovecot-master-postlogin #!/bin/bash MASTER_USER=$USER export MASTER_USER exec /usr/libexec/dovecot/imap "$@“ # cat /etc/dovecot.passwd.masterusers masteruser:{PLAIN}Heslo42 Trying login as normal user: # telnet localhost imap Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. a1 login jozefkova jozefkova026 a1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH] Logged in Trying login as master user: # telnet localhost imap Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN] Dovecot ready. a1 login jozefkova*masteruser Heslo42 a1 NO [AUTHORIZATIONFAILED] Authorization failed log sequence of failed auth: Oct 15 13:04:47 linux dovecot: auth(default): client in: AUTH 1 PLAIN service=imap secured lip=127.0.0.1 rip=127.0.0.1 lport=143 rport=34618 resp=<hidden> Oct 15 13:04:47 linux dovecot: auth(default): passwd-file(masteruser,127.0.0.1,master): lookup: user=masteruser file=/etc/dovecot.passwd.masterusers Oct 15 13:04:47 linux dovecot: auth(default): passdb(masteruser,127.0.0.1,master): Master user logging in as jozefkova Oct 15 13:04:47 linux dovecot: auth-worker(default): pam(jozefkova,127.0.0.1): lookup service=dovecot Oct 15 13:04:47 linux dovecot: auth-worker(default): pam(jozefkova,127.0.0.1): #1/1 style=1 msg=Password: Oct 15 13:04:49 linux dovecot: auth-worker(default): pam(jozefkova,127.0.0.1): pam_authenticate() failed: Authentication failure (password mismatch?) Oct 15 13:04:51 linux dovecot: auth(default): client out: FAIL 1 user=jozefkova authz So i can see it’s trying to loggin in using pam mech. Is there something i can configure in dovecot userdb or is it something else? I use pam to authenticate my real users… Thank you in advance… — Michal Zila

4 9

Dovecot top stats
by Kilburn Abrahams 15 Oct '15

15 Oct '15

Hi, I have being try to track down top email users to sometime. When I do a network traffic check I can see there is about 15 times more email traffic pulled from mail server than sent. The problem I am trying to track down is which users are the culprit. I have enabled doevcot stats and I can do a doveadm stats dump user but I get a 0 for disk_input, disk_output, read_bytes and write_bytes. I do get mail_read_bytes numbers but I am not sure these numbers are correct. I there a top utility that works well so I can see email traffic from users mailboxes. The doveadm top does not work well. I also tried the perl scripts and that does not do a much better job. Thanks Kilburn

2 2

Re: iterate users with passwd-file passdb?
by Joseph Tam 15 Oct '15

15 Oct '15

Eric Abrahamsen writes: > Simply: Is it possible to iterate over users if I'm using the > passwd-file passdb driver? Do I need a SQL-based driver if I want to > iterate? What do you mean by "iterate"? If you mean whether you can look up a password entry in a multi-entry file, then yes, definitely. If you mean to sequentially go through it and do a first/last/best match, probably not. Joseph Tam <jtam.home(a)gmail.com>

4 4

Emails with sender MISSING_MAILBOX@missing_domain
by grupo correo 15 Oct '15

15 Oct '15

Hello, we are working in the migration from courier-imap to dovecot 2.2.10-4.el7_0.1.x86_64. Some emails that send a internal application show as sender "MISSING_MAILBOX@missing_domain", i use like email client Horde using dovecot like server. But if i open that email with Horde and courier-imap i can see the correct email sender. I think that the email of the sender is no correct or not accomplish some RFC. Can anyone help me to understand this? Thank you

3 2

Re: Problems sync with mail client MAC and dovecot-2.2.10-4.el7_0.1.el7_0.1.x86_64
by grupo correo 14 Oct '15

14 Oct '15

> > On 2015-10-13 09:20, grupo correo wrote: > > Hello, > > > > i have installed Centos 7.1.1503 with Dovecot 2.2.10-4.el7_0.1. With > > Thunderbird all works fine, but when i configure the email client of > > Mac > > (Yosemite) with IMAP i can see a error in the log and the client not > > see > > the emails: > > > > Oct 9 14:31:34 localhost dovecot: imap(xxxxxxx@xxxxxxx): Fatal: > > master: > > service(imap): child 18639 killed with signal 11 (core dumps disabled) > > Do you have more logs? > > Have you enabled mail_debug = yes to get more verbose logs? > > > > > I have read the instructions of http://www.dovecot.org/bugreport.html, > > but > > core file is not writing. > > > > Does anyone have this issues? I think that can be a problem in the > > configuration > > Please share your doveconf -n output. > > > Best regards > > regards > christian > Attached the doveconf -n Yes i have mail_debug = yes into file conf.d/10-logging.conf I paste the rest of log: Oct 13 21:27:17 localhost dovecot: imap: Debug: Loading modules from directory: /usr/lib64/dovecot Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib02_imap_acl_plugin.so Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 13 21:27:17 localhost dovecot: imap: Debug: Module loaded: /usr/lib64/dovecot/lib11_imap_quota_plugin.so Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Effective uid=56396, gid=55000, home=/VMAIL/xxxxxxxxxxxxxx Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota root: name=User quota backend=maildir args= Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Quota grace: root=User quota bytes=0 (10%) Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=children, subscriptions=yes location=maildir:~/Maildir Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: maildir++: root=/VMAIL/xxxxxxxxxxxxxx/Maildir, index=, indexpvt=, control=, inbox=/VMAIL/xxxxxxxxxxxxxx/Maildir, alt= Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: initializing backend with data: vfile Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: acl username = xxxxxxxxxxxxxx Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl: owner = 1 Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: acl vfile: Global ACL directory: (none) Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 13 21:27:17 localhost dovecot: imap(xxxxxxxxxxxxxx): Fatal: master: service(imap): child 2464 killed with signal 11 (core dumps disabled)

2 1

Thanks for Dovecot
by Steve Litt 14 Oct '15

14 Oct '15

Hi all, Thanks for making Dovecot. I just transitioned from Debian Wheezy to Void Linux. It was fairly easy to get Dovecot working on my Void box, and having Dovecot makes all of my email activities easier by doing one thing and doing it right. Thank you for such great software. SteveT

6 5

Indexing fails with .. FIELDS_INDEX_EXTENSION).c_str() )' failed
by Akash 14 Oct '15

14 Oct '15

Hi, Mailing list archives suggest that this problem has been fixed in the older versions itself but I am getting the error still while trying to doveadm index a large folder of emails. Sometimes it throws error after 30000, something 40000, the latest it gave up after 111000. But it just never completes. 111000/322080doveadm: /home/stephan/packages/wheezy/i386/clucene-core-2.3.3.4/src/core/CLucene/index/DocumentsWriter.cpp:210: std::string lucene::index::DocumentsWriter::closeDocStore(): Assertion `numDocsInStore*8 == directory->fileLength( (docStoreSegment + "." + IndexFileNames::FIELDS_INDEX_EXTENSION).c_str() )' failed. Aborted I am using dovecot 2:2.2.19-1~auto+7& libclucene-core1:i386 2.3.3.4-4 from debian wheezy backports. Please advice. -Akash

3 2