- dovecot - dovecot.org

mdbox + sis attachments. Error stream is larger than expected by 1 byte
by Oleg Krivonosov 20 Sep '19

20 Sep '19

Hello! I use Dovecot 2.3.4.1-5+deb10u1 (Debian 10 x64) with mdbox, sis and imap. I catch many errors with attachments "Stream is larger than expected" by 1 byte in emails from Xerox WorkCentre 3345. Examples: Sep 20 23:20:04 mailserver dovecot: imap(wasya)<606><AG1zywGTVodVrE84>: Error: Mailbox INBOX: UID=5002: read(attachments-connector(/var/mail/virtual/wasya/mdbox/storage/m.210)) failed: read(/var/mail/attachments/b3/56/b3563977baf186928d38f81480b6443cf6d6d7e4-b86d80062ab36f5d7f190000f7ccf497[base64:18 b/l]) failed: Stream is larger than expected (882801 > 882800, eof=0) (FETCH BODY[]) Sep 20 23:32:27 mailserver dovecot: imap(wasya)<4831><n0a39wGTZ8hVyu8l>: Error: Mailbox INBOX: UID=654996: read(attachments-connector(/var/mail/virtual/wasya/mdbox/storage/m.4372)) failed: read(/var/mail/virtual/wasya/mdbox/storage/m.4372 trailer) failed: Stream is larger than expected (38 > 37, eof=0) (FETCH BODY[]). This error breaks getting email in MS Outlook and breaks viewing attachment in the problem email. Please help me to debug and to fix this issue. -- Best regards Oleg

1 0

Re: Bug] Sieve vacation :addresses match only,>, case-sensitive?
by Klaus Steinberger 20 Sep '19

20 Sep '19

Hi, >> I never saw any mail system in which the local Part ist Case sensitive! > > Every Unix/Linux system (I?d say that represents the majority of mail systems) has a case sensitive local part. Most mail admins have set their systems up to normalize all users on lowercase names, but that is not and has not always been the case. at least in every large installation LDAP User Backend's (or AD or similar) are used, and they are definitly case insensitive for the CN or UID attributes. Really nobody who cares about his systems and users uses mailboxnames which just differ in case (too much danger of confusion!) At least sieve must reflect the same settings as the MDA, so if the MDA is set to downcase (which in my opionion is the only valuable setting) sieve must also downcase. Sincerly, Klaus

1 0

fts_solr: Error: fts_solr: received invalid uid '0'
by Fabian 20 Sep '19

20 Sep '19

Hi, we are trying to add full text search functionality with Solr to our Doveoct setup. Our Versions: OS: Debian 9 Tried versions: - Dovecot 2.2.7 with Solr 3.6 - Dovecot 2.3.4 with Solr 8.2 (2.2.7 from offical Debian repository, 2.3.4 from backports) Search is working mostly of the time perfrectly smooth. But sometimes following message appears in mail.err: dovecot: imap(username)<16189><UxYWLVuSYMasEQoK>: Error: fts_solr: received invalid uid '0' If this error occurs our webmail frontend delivers most of the time a timeout. Sometimes the search only takes really long. Are there any ideas why this error occurs? We are not able to reproduce the error in such a way that it would always be reproducible. However, we can reproduce the behavior in some form over and over again - but we do not know exactly what is decisive. If you need any further information please ask - thanks! :-) dovecont -n: 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.4 () # OS: Linux 4.9.0-11-amd64 x86_64 Debian 9.11 ext4 # Hostname: localhost auth_master_user_separator = * auth_username_format = %Ln default_client_limit = 5000 default_process_limit = 1000 default_vsz_limit = 256M dict { sqlquota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } disable_plaintext_auth = no first_valid_uid = 480 imap_capability = +XDOVECOT lmtp_save_to_detail_mailbox = yes mail_attribute_dict = file:/var/spool/dovecot/user/%n/Maildir/dovecot-attributes mail_gid = vmail mail_location = maildir:/var/spool/dovecot/user/%d/%n/Maildir:LAYOUT=fs mail_plugins = " listescape mail_log notify quota acl fts fts_solr virtual" mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { hidden = yes inbox = yes list = no location = prefix = separator = / subscriptions = yes } namespace { list = yes location = maildir:%%h/Maildir:INDEXPVT=~/shared/%%u:LAYOUT=fs prefix = shared/%%n/ separator = / subscriptions = no type = shared } namespace Public { list = children location = maildir:/var/spool/dovecot/public:INDEXPVT=~/public:LAYOUT=fs prefix = Public/ separator = / subscriptions = no type = public } namespace Virtual { hidden = no list = yes location = virtual:/etc/dovecot/virtual:INDEX=/var/spool/dovecot/user/%u/virtual prefix = Virtual/ separator = / subscriptions = no } namespace inbox { inbox = no location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = INBOX/ separator = / subscriptions = no type = private } passdb { args = /etc/dovecot/masteruser.%s driver = passwd-file master = yes } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { acl = vfile acl_anyone = allow acl_shared_dict = file:/var/spool/dovecot/public/shared-mailboxes.db fts = solr fts_autoindex = yes fts_solr = url=<a href="http://172.17.10.12:8983/solr/dovecot/" rel="noreferrer noopener" target="_blank">172.17.10.12:8983/solr/dovecot/</a> quota = dict:User quota::no-unset:proxy::sqlquota quota_rule = *:storage=10G sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = /var/spool/dovecot/globalsieve/duplicate.sieve sieve_duplicate_default_period = 1h sieve_duplicate_max_period = 1d } protocols = " imap lmtp sieve pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service decode2text { executable = script /usr/lib/dovecot/<a href="http://decode2text.sh" rel="noreferrer noopener" target="_blank">decode2text.sh</a> unix_listener decode2text { mode = 0666 } user = dovecot } service dict { unix_listener dict { group = vmail user = vmail } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl = no userdb { args = /etc/dovecot/mysql-userdb.conf.ext driver = sql } protocol lmtp { mail_plugins = " listescape mail_log notify quota acl fts fts_solr virtual acl quota sieve notify" quota_full_tempfail = yes } protocol imap { imap_capability = +XDOVECOT mail_max_userip_connections = 100 mail_plugins = " listescape mail_log notify quota acl fts fts_solr virtual imap_acl imap_quota" } remote <a href="http://172.17.10.10" rel="noreferrer noopener" target="_blank">172.17.10.10</a> { protocol imap { imap_metadata = yes } }

2 3

Second private namespace
by André Rodier 19 Sep '19

19 Sep '19

Hello, I have Dovecot working, with a private namespace only. I would like to know if the following is feasible. - Add a second private namespace, in another directory scheme, for instance /mnt/backup/homebox/<user>/Mails/... - This namespace would be read-only. Perhaps the index and flags should be stored in a different folder with r/w access (e.g. /var, or even /tmp, it's not important) Now, as a matter of fact, this folder would be mounted on demand, via systemd-automount and fuse and is likely to be remote. This might implies some flags or caching on Dovecot performance. Thanks for your insights, André

1 0

Recent Dovecot on old operating system
by geho781＠justmail.de 19 Sep '19

19 Sep '19

Hi, sorry for the dumb question and please ignore this post if you think it's far beyond; i know it's not the way to go, but for reasons ... Has anyone running a self compiled recent dovecot (2.2.36.4) on Debian-7 and does it work? Or thinks it should work. Surprisingly it actually compiles flawlessly on Debian-7, but i wonder wether it will become a complete mess replacingthe existing dovecot (2.1.7) with the new one, serving a few dozens users and any kind of mail clients. Libraries of the compiled Dovecot: $ ldd ./src/master/.libs/dovecot linux-vdso.so.1 => (0x00007ffeacfb1000) libdovecot.so.0 => /usr/local/00-DBAI/dovecot/lib/dovecot/libdovecot.so.0 (0x00007f557b2a9000) libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f557af1c000) libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007f557ad18000) librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007f557ab10000) /lib64/ld-linux-x86-64.so.2 (0x00007f557b5dc000) libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f557a8f4000) libc6 versions: Debian-7: 2.13-38 Debian-9: 2.24-11 thanks so far, gerald

2 1

Dovecot 2.3.7.2 lucene segfault and coredump
by Domenico Pastore 19 Sep '19

19 Sep '19

Hi, i have a problem with libclucene-core.so.2.3.3.4. I See segfault error to messages log, when dovecot store mail to INBOX. set 12 13:41:21 box02.par-tec.it kernel: doveadm-server[20285]: segfault at 38 ip 00007f575b68fc42 sp 00007ffc0272e750 error 4 in libclucene-core.so.2.3.3.4[7f575b569000+188000] set 12 13:41:22 box02.par-tec.it kernel: doveadm-server[18871]: segfault at 38 ip 00007f9bea6d2c42 sp 00007fff47bceae0 error 4 in libclucene-core.so.2.3.3.4[7f9bea5ac000+188000] In the dovecot logs: 2019-09-12 13:45:09 auth: Debug: ldap(test4444client(a)newsvilXXXX,10.0.8.128<mailto:test4444client@newsvilXXXX,10.0.8.128>): Finished userdb lookup 2019-09-12 13:45:09 auth: Debug: userdb out: USER 1 test4444client@newsvilXXXX home=/pec_store/pec_mailbox/pec_mailbox_devel01/4/5/6/7/1/45671_18231 quota_rule=*:bytes=1048576000 mail_plugins+= 2019-09-12 13:45:10 SKENO8Uvel0gbAAA5ZKy4w doveadm(test4444client@newsvilXXXX): Fatal: master: service(doveadm): child 27680 killed with signal 11 (core dumped) 2019-09-12 13:45:10 auth: Debug: master in: USER 1 test4444client@newsvilXXXX service=doveadm lip=192.160.10.3 lport=924 rip=10.0.8.128 rport=36760 2019-09-12 13:45:10 auth: Debug: ldap(test4444client@newsvilXXXX 10.0.8.128): Performing userdb lookup I have attach the coredump of error and dovecot.conf Thanks for support. Br, Domenico ------------------- info: ------------------- # 2.3.7.2 (3c910f64b): /pec/config/dovecot/dovecot-devel01/dovecot.conf # Pigeonhole version 0.5.7.2 (7372921a) # OS: Linux 3.10.0-957.27.2.el7.x86_64 x86_64 CentOS Linux release 7.6.1810 (Core) # Hostname: box02

2 5

fts-elastic plugin
by Filip Hanes 19 Sep '19

19 Sep '19

Hi all, I have recently worked on fts plugin for ElasticSearch. https://github.com/filiphanes/fts-elastic It is forked from fts-elasticsearch as you can see in PR https://github.com/atkinsj/fts-elasticsearch/pull/21 with following changes (maybe some more) - no duplicate json keys in indexed documents, so compatible with ES 7.x - 1 elastic index for all users with routing by username - _id field similar to fts-solr (uid/box_guid/user) - better json response parsing - no need to use _source - added rawlog_dir to config and some more - renamed all elasticsearch to elastic for shorter names - fixed http_client leaks - fixed some compile warnings I would appreciate if someone with better experience in c and dovecot code would review my code and suggest/push changes. In my opinion fts-elastic is now functionally on level as currently recommended FTS plugin: fts-solr. I would like to implement proper rescan inspired by fts-lucene so it would become the most complete fts plugin for dovecot. -- Filip Hanes

3 2

Imaptest stall
by Marc Roos 18 Sep '19

18 Sep '19

I have been testing with imaptest and getting 'stalls', I tried even building from source and static. Even running it on the same host. Anyone knows what I could doing wrong? [@~]# ./imaptest - append=100,0 logout=0 host=192.168.10.44 port=143 user=test2 pass=xxxxxxxx seed=100 secs=240 clients=1 mbox=64kb.mbox box=INBOX/test Logi Sele Appe 100% 100% 100% 1 1 5 1/ 1 0 0 9 1/ 1 0 0 13 1/ 1 0 0 5 1/ 1

3 7

Namespace overlap
by Daniel Miller 17 Sep '19

17 Sep '19

Given an existing default namespace: namespace inbox { type = private separator = / prefix = location = sdbox:/var/mail/%d/%n/sdbox inbox = yes hidden = no list = yes subscriptions = yes } And mailboxes like: INBOX INBOX/Archives INBOX/Archives/2018 if I then define a new namespace: namespace archives { type = private separator = / prefix = Archives/ location = mdbox:/var/mail/%d/%n/Archives/mdbox subscriptions = no list = children } What will happen to the previous existing mailboxes & mails? Will they simply be "masked" by the new namespace and remain pending other operations? Or would they be moved/deleted? If they remain - is it possible to refer to the old mailboxes via either IMAP or doveadm? -- Daniel

1 0

CVE-2019-11500 and LMTP error
by Gabriele Nencioni 16 Sep '19

16 Sep '19

Hi all, does the dovecot fixed version: 2.3.7.2, 2.2.36.4 (as the CVE-2019-11500 says) fix the LMTP error "Got unexpected reply" as well? The LMTP error "Got unexpected reply" is described here: https://dovecot.org/pipermail/dovecot/2018-August/112562.html https://dovecot.org/pipermail/dovecot/2018-August/112666.html Thanks in advance Regards, -- Gabriele Nencioni

2 1