- dovecot - dovecot.org

[Dovecot] IDLE dropping EXISTS events on mass message arrival
by Eric Wong 22 Jan '14

22 Jan '14

Hi, I'm not sure if this is some throttling/DoS protection or a bug. I didn't see notice anything like it mentioned looking at the NEWS file from hg, this is on 2.1.7 on Debian stable. I have a client doing IDLE on INBOX.vomiteer. When individual messages arrive with some time interval in between them, I get EXISTS events for each message as expected. However, when I store a bunch of messages at once (via tag + mass copy in mutt on a fast-ish connection), I get a few EXISTS events (sometimes one, sometimes two) even though I copied a lot of new messages over. I expected to get an EXISTS event for each message which arrived, but perhaps there's some sort of DoS/throttling mechanism. strace -t -s4096 output of the dovecot process below: fd=13 is inotify, you'll see large read(13, ... indicating multiple filenames from inotify. However, only one EXISTS message got written to the socket. I've filtered out the gettimeofday syscalls for brevity. 07:30:02 epoll_wait(9, {}, 6, 3937) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/cur", {st_mode=S_IFDIR|0700, st_size=12288, ...}) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/cur", {st_mode=S_IFDIR|0700, st_size=12288, ...}) = 0 07:30:06 stat64("/home/ew/.maildir/.INBOX.vomiteer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=25920, ...}) = 0 07:30:06 fstat64(10, {st_mode=S_IFREG|0600, st_size=25920, ...}) = 0 07:30:06 epoll_wait(9, {}, 6, 7865) = 0 07:30:14 setsockopt(11, SOL_TCP, TCP_CORK, [1], 4) = 0 07:30:14 write(11, "* OK Still here\r\n", 17) = 17 07:30:14 setsockopt(11, SOL_TCP, TCP_CORK, [0], 4) = 0 07:30:14 time(NULL) = 1390289414 07:30:14 epoll_wait(9, {{EPOLLIN, {u32=4159555408, u64=4159555408}}}, 6, 22124) = 1 07:30:17 read(13, "\2\0\0\0\200\0\0\0\t\365\r\0000\0\0\0001390289417.M94623P14841.dcvr,S=1580,W=1619:2,S\0\0\2\0\0\0\200\0\0\0\n\365\r\0000\0\0\0001390289417.M94624P14841.dcvr,S=1580,W=1619:2,S\0\0\2\0\0\0\200\0\0\0\v\365\r\0000\0\0\0001390289417.M94625P14841.dcvr,S=1422,W=1460:2,S\0\0\2\0\0\0\200\0\0\0\f\365\r\0000\0\0\0001390289417.M94626P14841.dcvr,S=1422,W=1460:2,S\0\0\2\0\0\0\200\0\0\0\r\365\r\0000\0\0\0001390289417.M94627P14841.dcvr,S=1861,W=1907:2,S\0\0\2\0\0\0\200\0\0\0\16\365\r\0000\0\0\0001390289417.M94628P14841.dcvr,S=1861,W=1907:2,S\0\0\2\0\0\0\200\0\0\0\17\365\r\0000\0\0\0001390289417.M94629P14841.dcvr,S=4732,W=4854:2,S\0\0\2\0\0\0\200\0\0\0\20\365\r\0000\0\0\0001390289417.M94630P14841.dcvr,S=4732,W=4854:2,S\0\0\2\0\0\0\200\0\0\0\21\365\r\0000\0\0\0001390289417.M94631P14841.dcvr,S=4028,W=4128:2,S\0\0\2\0\0\0\200\0\0\0\22\365\r\0000\0\0\0001390289417.M94632P14841.dcvr,S=4028,W=4128:2,S\0\0\2\0\0\0\200\0\0\0\23\365\r\0000\0\0\0001390289417.M94633P14841.dcvr,S=3865,W=3968:2,S\0\0\2\0\0\0\200\0\0\0\24\365\r\0000\0\0\0001390289417.M94634P14841.dcvr,S=3865,W=3968:2,S\0\0", 32768) = 768 07:30:17 epoll_wait(9, {{EPOLLIN, {u32=4159555408, u64=4159555408}}}, 6, 499) = 1 07:30:17 read(13, "\2\0\0\0\200\0\0\0\25\365\r\0000\0\0\0001390289417.M94635P14841.dcvr,S=4092,W=4189:2,S\0\0\2\0\0\0\200\0\0\0\26\365\r\0000\0\0\0001390289417.M94636P14841.dcvr,S=4092,W=4189:2,S\0\0\2\0\0\0\200\0\0\0\27\365\r\0000\0\0\0001390289417.M94637P14841.dcvr,S=1517,W=1552:2,S\0\0\2\0\0\0\200\0\0\0\30\365\r\0000\0\0\0001390289417.M94638P14841.dcvr,S=1517,W=1552:2,S\0\0", 32768) = 256 07:30:17 epoll_wait(9, {}, 6, 498) = 0 07:30:17 stat64("/home/ew/.maildir/.INBOX.vomiteer/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 07:30:17 stat64("/home/ew/.maildir/.INBOX.vomiteer/cur", {st_mode=S_IFDIR|0700, st_size=12288, ...}) = 0 07:30:17 stat64("/home/ew/.maildir/.INBOX.vomiteer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=26328, ...}) = 0 07:30:17 fstat64(10, {st_mode=S_IFREG|0600, st_size=26328, ...}) = 0 07:30:17 pread64(10, "\200\200\200\207@\0\0\20\0\0\0\0\0\0\0\0$\0\0\0\0\0\0\0\1\0\0\0\200\200\200\214\0\1\0\20\0\0$\0\337!\336R\344\231\2L\0\0\0\0\t\"\336R\t\"\336R\0\0\0\0\t\"\336R\0\0\0\0007\n\0\0\200\200\200\204 \0\0\20@\0\4\0\234e\0\0\200\200\200\242\2\0\0\20\317\0\0\0\10\0\0\0\320\0\0\0\10\0\0\0\321\0\0\0\10\0\0\0\322\0\0\0\10\0\0\0\323\0\0\0\10\0\0\0\324\0\0\0\10\0\0\0\325\0\0\0\10\0\0\0\326\0\0\0\10\0\0\0\327\0\0\0\10\0\0\0\330\0\0\0\10\0\0\0\331\0\0\0\10\0\0\0\332\0\0\0\10\0\0\0\333\0\0\0\10\0\0\0\334\0\0\0\10\0\0\0\335\0\0\0\10\0\0\0\336\0\0\0\10\0\0\0\200\200\200\207@\0\0\20\1\0\0\0\0\260\2L\0\0\0\0\4\0\4\0\1\0\0\0\200\200\200\242\0\2\0\20\317\0\0\0\250\275\0\0\320\0\0\0\234\277\0\0\321\0\0\0|\301\0\0\322\0\0\0|\304\0\0\323\0\0\0\200\307\0\0\324\0\0\0|\312\0\0\325\0\0\0h\315\0\0\326\0\0\0\\\320\0\0\327\0\0\0\224\323\0\0\330\0\0\0\210\325\0\0\331\0\0\0h\327\0\0\332\0\0\0h\332\0\0\333\0\0\0l\335\0\0\334\0\0\0h\340\0\0\335\0\0\0T\343\0\0\336\0\0\0H\346\0\0\200\200\200\204 \0\0\0200\0\4\0\337\0\0\0", 8192, 25920) = 408 07:30:17 pread64(10, "", 8192, 26328) = 0 07:30:17 stat64("/home/ew/.maildir/.INBOX.vomiteer/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=26328, ...}) = 0 07:30:17 fstat64(10, {st_mode=S_IFREG|0600, st_size=26328, ...}) = 0 07:30:17 time(NULL) = 1390289417 07:30:17 setsockopt(11, SOL_TCP, TCP_CORK, [1], 4) = 0 07:30:17 write(11, "* 32 EXISTS\r\n", 13) = 13 07:30:17 setsockopt(11, SOL_TCP, TCP_CORK, [0], 4) = 0 07:30:17 epoll_wait(9, <unfinished ...> (Nothing happened after this) # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 3.9.2-x86_64-xxxxxx x86_64 Debian 7.3 auth_mechanisms = plain login log_timestamp = "%Y-%m-%d %H:%M:%S " mail_fsync = never mail_location = maildir:~/.maildir mail_max_userip_connections = 666 mail_privileged_group = mail passdb { driver = shadow } protocols = imap service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } user = root } service imap-login { inet_listener imap { address = 127.0.0.1 port = 1434 } process_limit = 10 process_min_avail = 1 } service imap { process_limit = 32 } service pop3-login { process_limit = 10 process_min_avail = 1 } service pop3 { process_limit = 32 } ssl = no userdb { driver = passwd } protocol lda { postmaster_address = postmaster(a)dcvr.yhbt.net } -- Eric Wong

2 1

[Dovecot] AD Kerberos and Dovecot
by Christian Felsing 22 Jan '14

22 Jan '14

Hello, I got stucked on Kerberos auth with Dovecot: Jan 22 17:48:36 test dovecot: auth: Error: LDAP: binding failed (dn cn=AUTH\_ldap): Local error, SASL(-1): generic failure: GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (Credentials cache file '/tmp/krb5cc_1003' not found) kinit and and ldapsearch with gssapi auth are working. Are there instructions how to set up Kerberos auth with Dovecot and Active Directory? How does Dovecot handle Kerberos tickets? best regards Christian

1 0

[Dovecot] master password
by Marc Perkel 21 Jan '14

21 Jan '14

This is probably easy but how would a set a secret static master password so that if I typed it in for any login it would be happy? I can't use the * separator method in this case because it screws up squirrelmail.

2 1

[Dovecot] Shared mailboxes / IMAP folder performance
by Sebastian Schlatow 21 Jan '14

21 Jan '14

Hello, how performant is an IMAP shared folder / mailbox if it contains 2 million mails? Is it possible two have such a quantity of mails in a shared folder? Is it possible to search that shared folder for mails in a fast way? Regards Sebastian

2 3

[Dovecot] Failure in doveconf
by Andrew Ray 21 Jan '14

21 Jan '14

I ran into a problem while configuring dovecot. Quickly reading the paragraph below, I saw "yes" as one of the options, and put that into the config, as below: # In case of password mismatches, log the attempted password. Valid values are # no, plain and sha1. sha1 can be useful for detecting brute force password # attempts vs. user simply trying the same password over and over again. # You can also truncate the value to n chars by appending ":n" (e.g. sha1:6). auth_verbose_passwords = yes The result from doveconf -n was: doveconf: Error: x�η doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf: 0pη (where the error message was always a changing, apparently random set of characters.) So I managed, by going back through the config file and commenting out options, to find this was the problem and then finally read what are the acceptable values. Any other place that I have tried to give a non acceptable value I get a reasonable error message with line number and problem. Well, now I fixed my original problem, but something needs to be adjusted in the error handling code. Sincerely, Andrew Ray -- Andrew Ray +1 404-418-5443 +421 (0) 917 832 253 http://guns.freedomlives.net/

1 0

[Dovecot] forwarded message is broken in 2.2.10 with pigeonhole-0.4.2
by Burckhard Schmidt 21 Jan '14

21 Jan '14

Hi, forwarding a message with sieve like redirect:copy "me(a)other.domain"; was working without any problem until dovecot-2.1.17, dovecots lmtp and dovecot-2.1-pigeonhole-0.3.5. Using dovecot-2.2.10 , dovecots lmtp and dovecot-2.2-pigeonhole-0.4.2 the structure of a forwarded message is broken. Content of a message is not displayed or an attachment (for instance pdf) can not be opened by (different) clients. Writing a html mail or plain one makes no different. I have compared two messages and the main different is a missing Content-Type: multipart/alternative; boundary="...." to encapsulate the body of the forwarded message. Was it lost in sieve? Here parts of a "well" forwarded message: Return-Path: ... ... Received: by mails.cms.hu-berlin.de (Postfix, from userid 29) id A78C738734; Tue, 14 Jan 2014 17:10:54 +0100 (CET) X-Sieve: Pigeonhole Sieve 0.3.5 X-Sieve-Redirected-From: schmidt(a)mails.cms.hu-berlin.de Delivered-To: <schmidt(a)mails.cms.hu-berlin.de> Received: from mails.cms.hu-berlin.de by suncom1 (Dovecot) with LMTP id p8HoIn9h1VKnTwAA9XuJ/g for <schmidt(a)mails.cms.hu-berlin.de>; Tue, 14 Jan 2014 17:10:54 +0100 ... Message-ID: <52D5618D.6050905(a)gmail.com> Date: Tue, 14 Jan 2014 17:10:53 +0100 From: xy <xy(a)gmail.com> User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: schmidt(a)hu-berlin.de Subject: from gmail with attachment Content-Type: multipart/mixed; boundary="------------070108020005050001040207" X-ENVELOPE-TO: <me(a)other.domain> This is a multi-part message in MIME format. --------------070108020005050001040207 Content-Type: multipart/alternative; boundary="------------090806050202050708030507" --------------090806050202050708030507 Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 8bit Hallo. text --------------090806050202050708030507 Content-Type: text/html; charset=ISO-8859-15 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=ISO-8859-15"> </head> <body text="#000000" bgcolor="#FFFFFF"> Hallo. text P. </body> </html> --------------090806050202050708030507-- --------------070108020005050001040207 Content-Type: application/pdf; name="auftrag-2014-eng-Hinweise.pdf" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="auftrag-2014-eng-Hinweise.pdf" JVBERi0xLjYNJeLjz9MNCjcyIDAgb2JqDTw ... ... c3RyZWFtDWVuZG9iag1zdGFydHhyZWYNCjExNg0KJSVFT0YNCg== --------------070108020005050001040207-- message end Now a broken message without "Content-Type: multipart/alternative;": Return-Path: ... ... Received: by mail5.cms.hu-berlin.de (Postfix, from userid 29) id 47C4C6D46E; Tue, 14 Jan 2014 17:43:54 +0100 (CET) X-Sieve: Pigeonhole Sieve 0.4.2 X-Sieve-Redirected-From: testuser(a)mail5.cms.hu-berlin.de Delivered-To: <testuser(a)mail5.cms.hu-berlin.de> Received: from mail5.cms.hu-berlin.de by suncom5 (Dovecot) with LMTP id mnY0AEpp1VLsaQAA0tuC1A for <testuser(a)mail4.cms.hu-berlin.de>; Tue, 14 Jan 2014 17:43:54 +0100 ... Message-ID: <52D56948.1090704(a)gmail.com> Date: Tue, 14 Jan 2014 17:43:52 +0100 From: xy <xy(a)gmail.com> User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: testuser(a)hu-berlin.de Subject: from gmail with attachment Content-Type: multipart/mixed; boundary="------------030506080302040201020604" X-ENVELOPE-TO: <me(a)other.domain> This is a multi-part message in MIME format. --------------030506080302040201020604 Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit text. --------------030506080302040201020604 Content-Type: application/pdf; name="auftrag-2014-eng-Hinweise.pdf" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="auftrag-2014-eng-Hinweise.pdf" JVBERi0xLjYNJeLjz... ... c3RyZWFtDWVuZG9iag1zdGFydHhyZWYNCjExNg0KJSVFT0YNCg== --------------030506080302040201020604-- message end -- Mit freundlichen Grüßen --- Burckhard Schmidt Abteilung Systemsoftware und Kommunikation ZE Computer- und Medienservice der Humboldt-Universität zu Berlin Postanschrift: Unter den Linden 6, 10099 Berlin Standort: Rudower Chaussee 26; 12489 Berlin Tel.: +49-30-2093-70058 Fax: +49-30-2093-2959 Mail: bschmidt(a)cms.hu-berlin.de

3 12

[Dovecot] Dovecot doesn't seem to report all subfolders to Thunderbird
by dovecot＠voidptr.de 21 Jan '14

21 Jan '14

Hi, I've recently migrated my emails from a Yahoo account to my own mailserver on a VPS. Ever since then, Thunderbird seems to have issues with the mailbox's directory structure: When I start Thunderbird, it immediately deletes the local copies of all 3rd-level folders (i.e. subfolders of a subfolder of a folder in the mailbox root). Since that didn't happen with the Yahoo account, I assume it's some kind of error or misconfiguration of Dovecot. Here's an example of the mailbox structure: voidptr.de '-> University '-> IEEE '-> Conference "University" and "IEEE" work without problems, but "Conference" gets deleted locally every time I start Thunderbird. When I collapse and re-expand "University" in the folder panel, all subfolders (including "Conference") reappear, but Thunderbird has to re-download the contents of "Conference", since it deleted the local copies earlier. It looks as if Dovecot only reported the topmost two folder levels when Thunderbird requests a folder list... Is there any way I can change that behavior? Nils $ doveconf -n # 2.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-042stab078.22 x86_64 Debian 7.3 auth_verbose = yes mail_location = maildir:~/Maildir:LAYOUT=fs namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = subscriptions = yes } passdb { args = scheme=SHA512-CRYPT username_format=%n /etc/dovecot/users driver = passwd-file } protocols = " imap" service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service imap-login { inet_listener imaps { port = 0 } } ssl = required ssl_cert = </etc/ssl/certs/own/voidptr.de.pem ssl_key = </etc/ssl/certs/own/voidptr.de.key userdb { args = username_format=%n /etc/dovecot/users default_fields = home=/home/%n driver = passwd-file }

3 4

[Dovecot] Sieve Filter based on Email Body
by Roman Gelfand 21 Jan '14

21 Jan '14

Is it possible to file emails based on the contents of email body? If yes, can you point me to an example. Thanks in advance

2 1

[Dovecot] A variable for the unix user or home path would be useful in some cases
by interfaSys sàrl 20 Jan '14

20 Jan '14

Hello, In our hosting environment, we let users share mailboxes across all their domains and think it's best if the shared mailbox listing (in a file) stays in their unix home path. That would be: /home/USER/imap/shared-mailboxes.db Unfortunately, it seems there is no way to generate that path using a variable. Something like this would be convenient: acl_shared_dict = file:%v/imap/shared-mailboxes.db Instead, we have to use something like this: acl_shared_dict = file:~/../../../shared-mailboxes.db which only works for virtual users. Did somebody solve this another way? Could we have the unix user or home path as a variable? Or could we have a modifier giving us the path or the unix user based on the unix UID? Cheers, Olivier

1 0

Re: [Dovecot] imap abort after upgrade from 2.2.4 to 2.2.7
by morrison 20 Jan '14

20 Jan '14

When I did upgrade, 2.2.7 was the latest release. When I ran into the problem, I checked back and found 2.2.8 and 2.2.9 were released shortly one after another. It seemed these releases were sort of buggy. I would like to know if what I described in my previous email was an known issue and was addressed before upgrade to 2.2.10. We are using dovecot as our internal mail service. So stable is most important to us. Regards,

1 0