- dovecot - dovecot.org

[Dovecot] quota-related crash for doveadm dsync operation
by Emmanuel Dreyfus 15 May '13

15 May '13

Hi I understand the crash below is caused by filesystem quota. I just report it because perhaps it could have a more graceful failure. Apr 29 09:39:17 danceny dovecot: dsync-local(jdoe): Error: Mailbox Sent: Saving failed: Not enough disk space Apr 29 09:39:17 danceny syslogd[165]: last message repeated 4 times Apr 29 09:39:17 danceny dovecot: doveadm: Error: dsync-remote(jdoe): Error: Cached message size smaller than expected (35111 < 40830) Apr 29 09:39:17 danceny dovecot: doveadm: Error: dsync-remote(jdoe): Error: Corrupted index cache file /mail/indexes/jdoe/.imap/Sent/dovecot.index.cache: Broken physical size for mail UID 976 Apr 29 09:39:17 danceny dovecot: doveadm: Error: dsync-remote(jdoe): Error: dsync(local): read(/home/pct/jdoe/mail/Sent) failed: Invalid argument Apr 29 09:39:17 danceny dovecot: dsync-local(jdoe): Error: dsync(root(a)volanges.net.espci.fr): read() failed: Broken pipe Apr 29 09:39:17 danceny dovecot: dsync-local(jdoe): Panic: file mail-storage.c: line 1830 (mailbox_transaction_commit_get_changes): assertion failed: (ret < 0 || seq_range_count(&changes_r->saved_uids) == save_count || array_count(&changes_r->saved_uids) == 0) Apr 29 09:39:17 danceny dovecot: dsync-local(jdoe): Fatal: master: service(doveadm): child 23443 killed with signal 6 (core not dumped - set service doveadm { drop_priv_before_exec=yes }) -- Emmanuel Dreyfus manu(a)netbsd.org

2 1

[Dovecot] Lucene and Zlib with 2.2.1
by Kyle Wheeler 15 May '13

15 May '13

Hello, I have an "archive" folder in my inbox, where I manually stick old mails into a compressed mbox format. Since upgrading to Dovecot 2.2.1, I've started seeing messages like the following in my log files: imap(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable indexer-worker(...): Error: lucene: Failed to sync mailbox INBOX: Mailbox isn't selectable imap(...): Error: indexer failed to index mailbox INBOX/Archive/2007/Sent.gz These errors *appear* to be mostly benign; I still get results from searching the mailbox. But for whatever reason, the indexer appears to not be working for those folders. As you can probably tell, I'm using the fts_lucene plugin, which used to work just fine (with Dovecot 2.1.x). Is this expected behavior? Are these errors truly ignorable? Why are these compressed mailboxes not selectable? ~Kyle -- Where justice is denied, where poverty is enforced, where ignorance prevails, and where any one class is made to feel that society is an organized conspiracy to oppress, rob and degrade them, neither persons nor property will be safe. -- Frederick Douglas

3 5

[Dovecot] Xlist in userdb, Foldernames with whitespace?
by Hajo Locke 15 May '13

15 May '13

Hello, i use dovecot 2.1.7 and exported all my XLIST FolderSettings to userdb Whole Story is here: http://dovecot.org/list/dovecot/2013-March/089209.html This is all successful, but there is one problem left. I use lines like this to realize individual XLIST Foldernames in usedb: namespace/inbox/mailbox=Sent namespace/inbox/mailbox/Sent/name=Sent namespace/inbox/mailbox/Sent/auto=subscribe namespace/inbox/mailbox/Sent/special_use=\sent My problem is to allow Foldernames with whitespace in it f.e. Sent Messages I tried to put these names in quotes in this line or mask the blank with backslash but nothing was working. Dovecot ist not accepting these settings: dovecot: imap: Debug: Added userdb setting: namespace/inbox/mailbox="Sent Messages" dovecot: imap: Debug: Unknown userdb setting: plugin/namespace/inbox/mailbox/"Sent Messages"/auto=subscribe dovecot: imap: Debug: Unknown userdb setting: plugin/namespace/inbox/mailbox/"Sent Messages"/name="Sent Messages" dovecot: imap: Debug: Unknown userdb setting: plugin/namespace/inbox/mailbox/"Sent Messages"/special_use=\sent How to code folders with whitespace etc. in my userdb settings? I tried a lot but nothing was correct. Thanks, Hajo

2 3

[Dovecot] protocols and privileges
by andreas graeper 15 May '13

15 May '13

hi, 1) protocols = pop3 but when starting the service, output tells about imap. when mua fetches mails ~/mail/.imap/INDEX is created. 2) i have some users uid=500 .. 505. src in /var/mail/%u, owner is <user>.mail and home-directories /home/<user> - owner is <user>.users when dovecot tries to create directory /home/<user>/mail then it tells for user xyz (uid = 502) euid=502(xyz) egid=100(users) missing +w permission /home/xyz , euid is not dir owner. but /home/xyz is owned by xyz.users and mod = 0700 ( drwx------ ) same environment for uid = 501 works great ! thanks in advance andreas ? permission lookup from /home/xyz/mail failed do i have to create that mail directory manually ?

2 1

[Dovecot] dovecot 2.2.1: lmtp running in base_dir
by Andy R 15 May '13

15 May '13

Evening all, I'm running into an issue with lmtp trying to store user mail in 'base_dir' ( same as this ( http://www.dovecot.org/list/dovecot/2011-January/056736.html )) however I'm just using PAM for auth. I've tried with chroot, without chroot and 'chroot'ing lmtp directly in ' service lmtp { } ' which just lead to lots more errors. I've not included anything of the current config so far, as I don't know what is needed here yet. I'm sure I'm missing something obvious, but I can't spot it for the life of me. Can anyone offer any new ideas? Many thanks Andy R.

2 1

[Dovecot] Dovecot 2.2.1 subscribtion status in LIST
by Nikolay S. 15 May '13

15 May '13

Hi there, I am using Evolution to connect to dovecot imap server. Today the server was upgraded to 2.2.1 from 2.1.9, and there is problem with evolution being unable to subscribe to INBOX. This is from dovecot 2.1.9: a002 list "" "*" return (subscribed) * LIST (\Subscribed) "." "Sent Items" * LIST (\Subscribed) "." "Junk E-mail" * LIST (\Subscribed) "." "Trash" * LIST (\Subscribed) "." "Archive" * LIST (\Subscribed) "." "Drafts" * LIST (\Subscribed) "." "INBOX" <--- And this is from 2.2.1: a002 list "" "*" return (subscribed) * LIST (\Subscribed) "." "Sent Items" * LIST (\Subscribed) "." "Junk E-mail" * LIST (\Subscribed) "." Trash * LIST (\Subscribed) "." Archive * LIST (\Subscribed) "." Drafts * LIST () "." INBOX <--- a002 OK List completed. a002 lsub "" "*" * LSUB () "." Drafts * LSUB () "." "Sent Items" * LSUB () "." Archive * LSUB () "." Trash * LSUB () "." INBOX <--- * LSUB () "." "Junk E-mail" a002 OK Lsub completed. In 2.2.1 LIST does not show INBOX as subscribed, which looks to confuse evolution. INBOX is actually subscribed: cat <path-to-maildir>/subscriptions Drafts Sent Items Archive Trash INBOX Junk E-mail

2 1

[Dovecot] IMAP SSL proxy (questions)
by Trever L. Adams 15 May '13

15 May '13

Hello everyone, I have seen: http://wiki.dovecot.org/HowTo/ImapProxy. It doesn't seem to fit what I need. Unfortunately, I cannot use TLS. I have to use SSL. Also, I would rather not duplicate the certificates for the IMAP servers. Hence nginx doesn't seem to be a good choice either. I am hoping that since SSL has "Client Hello" which specifies the site requested the the following could be done: Client - > Proxy [SYN] Proxy -> Client [SYN, ACK] Client -> Proxy [ACK] Client -> Proxy [SSL With "Client Hello", having server_name in Extension: server_name and sub-fields] Proxy sees intended host Proxy <-> Intended Server [SYN/SYN+ACK/ACK sequence] Proxy -> Intended Server [Replay SSL/Client Hello] Client <-> Proxy <-> Intended Server (Proxy is non decrypting Man-in-the-Middle, just acting as a pseudo-invisible relay) I know that something somewhat like this works because this is how Apache can do virtual hosts with SSL. Of course, it acts as the end point intended server, not a proxy. I believe it is also somewhat how Squid does SSL proxying, although I could be entirely wrong. Is this possible? Can this be implemented in dovecot? If not, does anyone know of such a project. Proxy needs to not have any exploitable holes and really only needs to understand enough SSL to get the server_name, pass through the connection, replaying Client Hello, and then knowing when to shut the connection. Just as a breif example, the use I have for this now is that I have several imap servers which all have IPv6 addresses, but have to share an IPv4 address. for SMTP side of things, this works well for all incoming email. (As an aside, does anyone know of a similar setup for SSL traffic on port 465 SSL for SMTP?) Thank you for any help, Trever

5 5

[Dovecot] Keyword limit?
by Michael M Slusarz 15 May '13

15 May '13

Running into a weird issue in a mailbox that has 26+ keywords. In one session, I do this: S: 2 SELECT "INBOX" (QRESYNC (1255685337 78608 [...uids...])) S: [...] S: * OK [HIGHESTMODSEQ 78608] Highest S: * OK [UIDVALIDITY 1255685337] UIDs valid S: 2 OK [READ-WRITE] Select completed. C: 3 UID STORE 48386 (UNCHANGEDSINCE 78608) +FLAGS AAAAAAAA S: * 8 FETCH (UID 48386 MODSEQ (78609) FLAGS (\Seen AAAAAAAA)) S: 3 OK Store completed. C: 4 LOGOUT S: * OK [CLOSED] Previous mailbox closed. S: * BYE LOGOUT received S: 4 OK Completed The next time I access that mailbox, I see this: C: 2 SELECT "INBOX" (QRESYNC (1255685337 78609 [...uids...])) S: [...] S: * OK [UIDVALIDITY 1255685337] UIDs valid S: * OK [HIGHESTMODSEQ 78609] Highest S: * 8 FETCH (MODSEQ (78610) UID 48386 FLAGS (\Seen)) S: 2 OK [READ-WRITE] Select completed. MODSEQ 78610 is entirely server-initiated. It *appears* that the mailbox doesn't handle more than 26 keywords. My dovecot-keywords looks like: 0 $Forwarded [Entries 1-24] 25 Test "Test" is a keyword I created immediately before "AAAAAAAA". If I remove Test and then add "AAAAAAAA", the keyword sticks. Is this a built-in limit? Can't find anything in the config/wiki docs (Dovecot 2.1.16). Or are my dovecot index/cache files hosed in some way? michael

3 4

[Dovecot] Mail deduplication
by Tim Groeneveld 15 May '13

15 May '13

Hi Guys, I am wondering about mail deduplication. I am looking into the possibility of seperating out all of the message bodies with multiple parts inside mail that is recived from `dovecot` and hashing them all. The idea is that by hashing all of the parts inside the email, I will be able to ensure that each part of the email will only be saved once. This means that attachments & common parts of the body will only be saved once inside the storage. How achievable would this be with the current state of dovecot? Would it even be worth doing? Thanks, Tim

7 19

[Dovecot] quota and dict
by Jeff Gustafson 15 May '13

15 May '13

I have a question about using dict and quotas. I want dovecot to send quota queries to a custom dict server over a socket. I'm doing this because I can't do group quotas based on domain since a customer can have each of their users associated with different domains under a single account. I need to lookup the account ID and group based on that. I'm worried putting everything in mysql will cause way too many writes and lower the performance of our mysql cluster. I have having a little trouble connecting all the dots in the config file. In the userdb example, there is an 'args' parameter that allows a file to specify a uri. I don't see how to do that for dict. I only see file, mysql, and postgresql. Shouldn't I be able to use a dictionary proxy to attach any custom program to a quota dict socket? Tell the quota plug to proxy quota which then points to a socket: plugin { quota = dict:User quota::proxy::quota } dict { quota = proxy:/tmp/test-socket } or should it be: plugin { quota = dict:User quota::proxy:/tmp/test-socket } Neither one create a socket in /tmp. It seems like this should be possible, but I don't see an obvious way to do it. ...Jeff

2 1