- dovecot - dovecot.org

[Dovecot] New full text search indexer
by Timo Sirainen 14 Nov '07

14 Nov '07

As described earlier (http://dovecot.org/list/dovecot/2006-December/018055.html) Dovecot nowadays has full text search indexing support in CVS HEAD. Currently there are two backends: Lucene and Squat. Lucene's problem is that standard IMAP SEARCH command can't be used with it without breaking IMAP RFC. So Lucene can be used only with non-standard X-BODY-FAST and X-TEXT-FAST search commands. Squat's code then is quite complex and it's pretty slow. It works with 4 character blocks, so it can answer: - Search string < 4 characters: Can't answer anything - Search string = 4 characters: Definite yes/no - Search string > 4 characters: Probable yes / definite no Since search strings are usually more than 4 characters, Dovecot uses the index only to filter out messages which definitely won't match and then does regular searching for the non-filtered messages. It works ok, but it could work better. The Squat indexes take maybe 30-50% of the mailbox's size. Most of the space goes to UID lists (list of messages matching each 4 character block). For example one UID list could be "2,4-10,20-30". This is already stored in a compressed format by storing the UID numbers relative to previous UID, which allows storing them usually with a single byte per UID, even if the UIDs are large. So, this morning I had an idea how this could maybe be improved with two changes: 1. Don't use 4 character blocks. Instead allow variable sized paths, and keep track of the UIDs for each node in the path. So for example adding "abc" to UID 1 will place the UID 1 to node "a", "ab" and "abc". 2. Use UIDs relative to parent's UIDs. For example if node "a" has UIDs 1,3,5 and "ab" is added for UID 5, the UID is changed to 2 (3th in 1,3,5 list - 1). This can help the compression a lot. The best case scenario for the above example is if "ab" contains also 1,3,5 UIDs. Then it can be written with a single 0-2 range. With these changes, the indexer can be configured to perform in different ways. Text can be indexed in two ways: full words, and substrings within those words (as required by IMAP). I think a useful combination of these would be to index all 4 character substrings and all full words up to 10 characters or so. This kind of an index can answer: - Search string <= 4 characters: Definite yes/no - For X-BODY-FAST / X-TEXT-FAST: - Search string 5-10 characters: Definite yes/no - Search string 11+ characters: Probable yes / definite no - For standard IMAP SEARCH: - Search string 5-10 characters: Definite yes if message contains the key as non-substring, otherwise same as below. This helps only if user does a search that matches a lot of messages. - Search string 11+ characters: Probable yes / definite no UTF-8 text is indexed as bytes, but the path depth can be counted as characters instead of as bytes. I've a test program finished, and unless there are some bugs left I think it shows that this can work pretty well: Squat-like 4 byte substrings (but can answer 1-3 char queries also): Message count: 7495 Index time: 4.19 CPU seconds (7.39MB/CPUs) Node memory: 3014072 bytes (2943 kB) in 90550 nodes UID memory: 8277212 bytes (8083 kB) in 352778 lists Total: 11291284 / 32474899 bytes = 34.77% Indexing the same mailbox file with squat-test gives: - Index time: 9.55 CPU seconds, 9.63 real seconds (3.24MB/CPUs) - 4145192 bytes in 102208 nodes (12.76%) - 7286058 bytes in 305501 uid_lists (22.44%) - 11431250 bytes total of 32474899 (35.20%) So the new indexer is over twice as fast and uses slightly less space. Indexing 4 char substrings and words up to 10 chars: Index time: 5.13 CPU seconds (6.04MB/CPUs) Node memory: 6002804 bytes (5862 kB) in 615501 nodes UID memory: 9044610 bytes (8832 kB) in 519488 lists Total: 15047414 / 32474899 bytes = 46.34% So it takes somewhat more space, but definitely less than having both Squat + Lucene. No substring indexing, words up to 10 chars (Lucene replacement): Index time: 1.39 CPU seconds (22.28MB/CPUs) Node memory: 3297663 bytes (3220 kB) in 548540 nodes UID memory: 1803735 bytes (1761 kB) in 213554 lists Total: 5101398 / 32474899 bytes = 15.71% Is there a need for Lucene anymore with this kind of a speed and disk space usage? :) The above tests are run with everything being indexed except space and control chars (ie. practically space + tab). If only alphanumeric characters are indexed, the total lines are (in same order as above): Total: 7048664 / 32474899 bytes = 21.70% (-13.07%) Total: 9610543 / 32474899 bytes = 29.59% (-16.75%) Total: 3963335 / 32474899 bytes = 12.20% (-3.51%) There are probably still a few optimizations that can be done to get the disk space usage even lower. I did spent quite a lot of time making it use less CPU though. Even tried a bit different coding style variations in the critical functions to get gcc to create faster code.. One interesting thing I noticed was that binary searching a character from a char array was slower than just sequentially going through the characters. I tried adding checks to do it only if the array was big, but it was always slower. Maybe something to do with CPU cache. If you want to try yourself, the test program is in http://dovecot.org/tmp/new-indexer.c

7 10

Re: [Dovecot] SSL/TLS with Outlook client
by Nikolay Shopik 14 Nov '07

14 Nov '07

Agree with Hugo most root CA have intermidate certificates which should supplied with your server certificate. Otherwise chain won't work and any client don't trust it. - original message - Subject: Re: [Dovecot] SSL/TLS with Outlook client From: Hugo Monteiro <hugo.monteiro(a)fct.unl.pt> Date: 14/11/2007 00:14 Eli Sand wrote: > Hugo Monteiro wrote: > >> Ah ... wildcard certs .. from what i recall, certs issued like >> *.example.com were not very well accepted by M$ clients. You should >> test against non wildcard certs and see how it behaves. >> > > Already have and no luck :( My domain is elisand.com and I have tried > *.elisand.com, mx1.elisand.com (I believe that's what my MX record is... if > not, whatever it is is what I tried) and mail.elisand.com which is the > smtp/imap server name I use in Outlook. All three yield the same result :( > > Eli. > > > I have taken the liberty to connect to your server, using openssl, i've seen the following: $ openssl s_client -CApath /usr/share/ca-certificates/cacert.org/ -connect mail.elisand.com:993 CONNECTED(00000003) depth=1 /O=Root CA/OU=http://www.cacert.org/CN=CA Cert Signing Authority/emailAddress=support(a)cacert.org verify return:1 depth=0 /CN=*.elisand.com verify return:1 --- Certificate chain 0 s:/CN=*.elisand.com i:/O=Root CA/OU=http://www.cacert.org/CN=CA Cert Signing Authority/emailAddress=support(a)cacert.org --- i believe you should change two things. If the name you wish to use on your clients is mail.alisand.com, then the certificate should read CN=mail.elisand.com. Furthermore, it's always a good idea to provide the chaining certificate path on dovecots side. Try using the ssl_ca_file directive on dovecot's configuration. Regards, Hugo Monteiro. -- ci.fct.unl.pt:~# cat .signature Hugo Monteiro Email : hugo.monteiro(a)fct.unl.pt Telefone : +351 212948300 Ext.15307 Centro de Informática Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa Quinta da Torre 2829-516 Caparica Portugal Telefone: +351 212948596 Fax: +351 212948548 www.ci.fct.unl.pt apoio(a)fct.unl.pt ci.fct.unl.pt:~# _

1 0

[Dovecot] Using Dovecot as Asterisk PBX voicemail server
by Kenneth Porter 14 Nov '07

14 Nov '07

I'm reading the Asterisk book, 2nd edition, and it describes how one can set up voicemail to be delivered by IMAP to a voicemail folder. Asterisk can monitor flags on the folder so that the "message available" light on one's phone tracks the state of the "read" flag in the folder. One can either dial in for one's voicemail or listen to it from one's favorite IMAP client. (Dovecot is mentioned in the book.) I'm wondering how one would set up auth for this? Asterisk needs to log in to the account to deliver the voicemail and to check its state, but I wouldn't want to put everyone's mail password in plaintext in Asterisk's voicemail.conf file. Would I set up a separate IMAP account for each user to hold their voicemail, and use simple passwords (such as the PIN they use for phone access to voicemail) in the Asterisk config? Or is there a way to set up Dovecot to allow a second user to login to a specific IMAP folder in all accounts, in the same way the local delivery agent has write access to all users' mailbox? Google's page for the book: <http://books.google.com/books?id=vtQxJ3oSm64C&dq=asterisk+book> Dovecot mentions: <http://books.google.com/books?id=vtQxJ3oSm64C&dq=asterisk+book&q=dovecot#se…>

3 3

[Dovecot] namespace public folders
by Nikolay Shopik 13 Nov '07

13 Nov '07

Hi list, Here is thing im trying to accomplish. I would like to setup public folders which resposible for delivering mails for some speical addresses like info(a)example.com. And it will be perfect if "seen" status for this folder will be saved per user. I mean if one user read message and set it as read other user should see it still as unread. As I far i know there some limitation in 1.0 tree but not in lates 1.1. My question is can I do such setup with dovecot+postfix. Im really appreciate for simple examples how can i accomplish this kind setup if it possible :)

3 3

[Dovecot] Caching?
by Bjørn T Johansen 13 Nov '07

13 Nov '07

Any way to minimize the number of sql statements that dovecot do? (and I tried adding userdb prefetch { } but number of sql calls are still the same) Am I doing something wrong or? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

2 2

[Dovecot] v1.1.beta8 released
by Timo Sirainen 13 Nov '07

13 Nov '07

http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta8.tar.gz http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta8.tar.gz.sig Changes since beta7: - Added a new "raw" mail storage backend which allows opening files/streams as single mail mailboxes. deliver uses this now instead of opening the incoming mail as a mbox. So deliver should be now faster and it doesn't anymore remove Dovecot's private mbox headers if you're not using mbox. - Cache file tracks message expunges again - All kinds of other fixes - Some optimizations I think we're getting closer to v1.1 RCs.

9 17

[Dovecot] Dovecot does not fetch mails from Maildir
by Aras Koktas 13 Nov '07

13 Nov '07

Hello I have the following configuration. I am trying to login through pop3 and fetch e-mails but it does not fetch anything. I see that there is a mail there. Here is what i have List from my homedir. Set correct on MySQL as (home) -- [root@axis info]# ls -al new total 12 drwx------ 2 exim exim 4096 Nov 12 21:11 . drwxrwx--- 6 exim exim 4096 Nov 12 21:11 .. -rw------- 1 exim exim 1996 Nov 12 21:11 1194919868.H288251P7967.axis.phidot.com -- -- FROM sql File-- password_query = SELECT userid as user, password FROM mailacct WHERE userid = '%u' user_query = SELECT home, uid, gid FROM mailacct WHERE userid = '%' -- DOVECOT CONFIG -- # 1.0.7: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /usr/share/ssl/certs/dovecot.pem ssl_key_file: /usr/share/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login first_valid_uid: 93 mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: PLAIN passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-sql.conf

2 4

[Dovecot] Missing deliver
by Sean Smitz 13 Nov '07

13 Nov '07

I've installed Red Hat Enterprise Linux 5 on a new server. I'm configuring sendmail and dovecot; however, /usr/local/libexec/dovecot was not created when I installed the dovecot rpm (rpm -Uvh dovecot-1.0-1.2.rc15.el5.x86_64.rpm). The problem is I can't find the deliver executable which is supposed to be in this directory. Any help would be appreciated.

2 1

[Dovecot] login_process_size too small on x86_64 Fedora/RHEL
by Tomas Janousek 12 Nov '07

12 Nov '07

Hello, as described in [253363], login_process_size of 32M is not enough on 64-bit versions of Fedora and RHEL (and possibly other distributions as well). [253363] https://bugzilla.redhat.com/show_bug.cgi?id=253363 As I understand it, there's an intersegment gap between read-only/executable and writable segments of shared libs. That's probably a security feature or something. I found a similar issue here[1], if anyone wants a comment from someone who understands it. [1] http://gcc.gnu.org/ml/libstdc++/2006-12/msg00033.html Shall we just increase login_process_size or make it arch-dependent or something? Regards, -- Tomas Janousek, SW Engineer, Red Hat, Inc.

2 2

[Dovecot] Secure authentication?
by Bjørn T Johansen 12 Nov '07

12 Nov '07

I have enabled SSL support for my dovecot installation but if I enable secure authentication in my MUA, I get an error from dovecot telling me that this is not supported.. Is this because dovecot does not support this or am I missing some config? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

7 9

[Dovecot] dovecot 1.1b7: mail-cache-lookup.c: line 68: unreached
by Adam McDougall 12 Nov '07

12 Nov '07

I have since upgraded to 1.1b8 but this morning my attention was called to this error from 1.1b7: Nov 11 06:35:17 hill dovecot: IMAP(voice): file mail-cache-lookup.c: line 68: unreached Nov 11 06:35:17 hill dovecot: child 70673 (imap) killed with signal 6 Nov 11 06:35:17 hill dovecot: IMAP(voice): Connection closed bytes=262/25869 I can't say for sure but it was probably a squirrelmail connection. It wasn't me, and I wasn't even awake at the time so I don't know how to reproduce it.

1 0

[Dovecot] dovecot: pipe() failed: Too many open files
by Ralf Hildebrandt 12 Nov '07

12 Nov '07

I'm encountering lots of Oct 31 11:14:25 postamt dovecot: pipe() failed: Too many open files errors around midday ever since the latest upgrade to 1.0.7. The errors appear in pairs like this one: Oct 31 11:20:01 postamt dovecot: pipe() failed: Too many open files Oct 31 11:20:01 postamt dovecot: imap-login: Internal login failure: user=<username>, method=PLAIN, rip=193.175.174.239, lip=141.42.4.250, TLS What gives? -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de We're using Postfix - it generally seems to take the approach that the message that arrives is the message that gets delivered, without any extra bits being added. -- Chris Stratford

2 3

[Dovecot] v2.0 / Master/config rewrite
by Timo Sirainen 12 Nov '07

12 Nov '07

If anyone's interested, I updated my master/config rewrite to latest Dovecot v1.1 tree and added it to hg: http://hg.dovecot.org/dovecot-master-rewrite/ It probably doesn't work, but with the exception of plugins it compiles anyway. :) I'm thinking that maybe after v1.1.0 I could continue with the rewrite and create v2.0 after all instead of v1.2. Just look at how much cleaner deliver.c is :) http://hg.dovecot.org/dovecot-master-rewrite/file/59ebbfcf21cb/src/deliver/… vs http://hg.dovecot.org/dovecot/file/eb4f1fbeecda/src/deliver/deliver.c Another thing with v2.0 I was thinking about was to change index file formats to be more efficient.

2 1

[Dovecot] some mail accesses in dovecot 1.1 stall for a bit (in progress)
by Adam McDougall 11 Nov '07

11 Nov '07

I noticed this in an earlier beta and took a note, and I still see it sometimes in 1.1b4, but it is only occasional so I have not tracked down yet what dovecot is doing. Just a FYI for the list incase others see it and to say that its an issue I tend to track down that I did not see in 1.0, and its been low on my list until now. Sometimes when I login to dovecot and read a message from an imap maildir folder, the message contents do not load for at least 10 seconds, sometimes closer to a minute, but after that first message loads, the rest seem fine in that mailbox. The time seems to vary some, usually longer rather than shorter.

2 9

[Dovecot] imap search/content-transfer-encoding assertion failed
by Andrew Garner 11 Nov '07

11 Nov '07

When performing an imap search, I hit the following assertion failure: imap(vmail): Panic: file unichar.c: line 128 (uni_ucs4_to_utf8_c): assertion failed: (chr <= 0x40000000) imap(vmail): Error: Raw backtrace: /usr/lib/dovecot/imap [0x80c7f7f] -> /usr/lib/dovecot/imap [0x80c7d6a] -> /usr/lib/dovecot/imap [0x80d8616] -> /usr/lib/dovecot/imap(uni_utf8_to_decomposed_titlecase+0x9f) [0x80d892f] -> /usr/lib/dovecot/imap(message_decoder_decode_next_block+0x679) [0x80c46e9] -> /usr/lib/dovecot/imap(message_search_more+0x3e) [0x80c2e8e] -> /usr/lib/dovecot/imap(message_search_msg+0x72) [0x80c3012] -> /usr/lib/dovecot/imap [0x8093f47] -> /usr/lib/dovecot/imap [0x80b7719] -> /usr/lib/dovecot/imap(mail_search_args_foreach+0x32) [0x80b77c2] -> /usr/lib/dovecot/imap(index_storage_search_next_nonblock+0x243) [0x8093af3] -> /usr/lib/dovecot/imap [0x805cdc7] -> /usr/lib/dovecot/imap [0x805d138] -> /usr/lib/dovecot/imap(io_loop_handle_timeouts+0x112) [0x80ce892] -> /usr/lib/dovecot/imap(io_loop_handler_run+0x66) [0x80cf316] -> /usr/lib/dovecot/imap(io_loop_run+0x28) [0x80ce768] -> /usr/lib/dovecot/imap(main+0x4ab) [0x806675b] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7e68ea8] -> /usr/lib/dovecot/imap [0x8059141] My quick analysis: This seemed to be caused by a single message in this mailbox. I think dovecot is expanding base64 encoded binary data and then inevitably failing on the utf8 conversion of the decoded random binary data. The mime headers for this message are: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="------------080305000603070709090808" ... This is a multi-part message in MIME format. --------------080305000603070709090808 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit <text content> ... --------------080305000603070709090808 Content-Type: application/x-zip-compressed; name="xxxxxxxx.zip" Content-Transfer-Encoding: base64 Content-Disposition: inline; filename="xxxxxxxxxxxx.zip" <base64 encoded zip file> ... --------------080305000603070709090808-- # dovecot -n # 1.1.beta6: /etc/dovecot/dovecot.conf protocols: imap pop3 listen: 127.0.0.1 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no first_valid_uid: 89 mail_location: maildir:~/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/rawlog /usr/lib/dovecot/pop3 mail_plugins(default): fts fts_lucene mail_plugins(imap): fts fts_lucene mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_log_prefix: %Us(%u[%r]): mail_log_max_lines_per_sec: 100 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f auth default: mechanisms: plain cram-md5 verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: fts: lucene

2 1

[Dovecot] assertion failed: (mailbox_list_is_valid_existing_name(_list, name))
by Adam McDougall 11 Nov '07

11 Nov '07

Do you need a gdb backtrace for this one? I'm not sure why all of a sudden this started happening, its probably due to me adding a folder somewhere? not sure. It happened when I went to open my folder subscriptions in thunderbird. It was taking longer than usual (call this phase 1) and I noticed this in the logs: (cant remember if this was phase 1 or 2 but the error is probably the same) Nov 11 00:38:38 boomhauer dovecot: imap-login: Login: user=<mcdouga9>, method=PLAIN, rip=208.53.102.126, lip=35.9.37.190, TLS Nov 11 00:38:39 boomhauer dovecot: IMAP(mcdouga9): fchown(/egr/mail/shared/decs/temp.boomhauer.3050.af3db3ac545170a7) failed: Operation not permitted Nov 11 00:38:44 boomhauer dovecot: IMAP(mcdouga9): file mailbox-list-maildir.c: line 186 (maildir_list_get_path): assertion failed: (mailbox_list_is_valid_existing_name(_list, name)) Nov 11 00:38:44 boomhauer dovecot: child 3050 (imap) killed with signal 6 Nov 11 00:38:45 boomhauer dovecot: imap-login: Login: user=<mcdouga9>, method=PLAIN, rip=208.53.102.126, lip=35.9.37.190, TLS Nov 11 00:38:45 boomhauer dovecot: IMAP(mcdouga9): fchown(/egr/mail/shared/decs/temp.boomhauer.3052.5538be060c2f9c7d) failed: Operation not permitted Nov 11 00:38:46 boomhauer dovecot: IMAP(mcdouga9): file mailbox-list-maildir.c: line 186 (maildir_list_get_path): assertion failed: (mailbox_list_is_valid_existing_name(_list, name)) Nov 11 00:38:46 boomhauer dovecot: child 3052 (imap) killed with signal 6 When I cancelled the subscription window, "phase 2" is the same thing but happening more rapidly. I traced what tbird is doing and can reproduce it with: ? OK Logged in. a list "" "#shared/decs/%/%" Connection closed by foreign host. Doing a list on #shared/decs/% works though.

2 2

[Dovecot] Outlook can't see namespace folders
by James 10 Nov '07

10 Nov '07

Hi guys i understand that you can't subscribe to the Prefix names of namespace folders right now with dovecot. But for instance if i user outlook express and it can't see the prefix name then it can't see the subfolders of that "prefix folder" either. So even though it can detect and see the subfolders it won't display them cause it can't see the "parent" Is there any fix for this? it's also kind of annoying in thunderbird but at least you can still see the subfolders. TIA James Here's my config # /etc/dovecot/dovecot.conf protocols = imap imaps pop3 pop3s log_timestamp = "%Y-%m-%d %H:%M:%S " first_valid_uid = 100 login_user=vmail mail_extra_groups = mail mail_debug = yes pop3_uidl_format = %08Xu%08Xv mail_location = maildir:/home/vmail/domains/%n/Maildir #default_mail_env = maildir:/home/vmail/domains/%n/Maildir auth default { mechanisms = plain passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb ldap { args = /etc/dovecot/dovecot-ldap.conf } } # maildir namespace private { separator = / prefix = location = maildir:/home/vmail/domains/%n/Maildir inbox = yes hidden = no } # mbox namespace private { separator = / prefix = "Mbox/" location = mbox:/home/vmail/domains/%n/Mbox inbox = no hidden = no } #public spam folder namespace public { separator = / prefix = /Spam/ location = maildir:/home/vmail/domains/Spam/Maildir/ hidden = no } ssl_disable = no ssl_cert_file = /etc/ssl/certs/dovecot.pem ssl_key_file = /etc/ssl/private/dovecot.pem ssl_verify_client_cert = no ssl_cipher_list = ALL:!LOW:HIGH:MEDIUM:+SSLv2:RSA

3 10

[Dovecot] Request for variable unique to each server?
by Adam McDougall 10 Nov '07

10 Nov '07

I've been looking for a variable I can use in my dovecot.conf within the INDEX= setting so I can have one index dir per imap server on NFS. I've been looking at http://wiki.dovecot.org/Variables but no variable seems to contain something like server hostname, and I've been hunting for the variable expansion code in dovecot but haven't been able to find it. %l (local IP) won't help me because when using our load balancer, %l is the same IP on all of my servers. %r is close to useful but having a local webmail server on each server means I'd end up with 127.0.0.1 being shared (also I would end up with one directory per unique user/clientIP combo). Is there a variable that holds the server hostname or something else unique per server, or could one be added, or could someone point me at the code? Thanks.

2 2

[Dovecot] UTF-8 in dovecot-sieve ?
by Arthur Pétry 10 Nov '07

10 Nov '07

Hi, Reading http://tools.ietf.org/html/rfc3028#section-2.7.2 I thought that out-of-the-box dovecot can filter messages by matching header in UTF-8. But when I tested it, it failed : (I'm using 1.0.5 with sieve plugin) Here is my .dovecot.sieve file : ---------- require ["fileinto", "imapflags"]; if allof(header :contains "subject" "filtre") { addflag "test_1"; } if allof(header :contains "subject" "là") { addflag "test_2"; } if allof(header :comparator "i;ascii-casemap" :contains "subject" "hé") { addflag "test_3"; } ---------- Only the first of the three rules do work. When I try to match a subject string with accent encoded in ISO-8859 like "hélà" : "=?ISO-8859-1?Q?h=E9l=E0?=" there is no match Am I doing something wrong ?

2 1

[Dovecot] 1.0beta7 still has SEARCH TEXT not search the FROM
by Asheesh Laroia 10 Nov '07

10 Nov '07

I just tried out 1.0beta7 and erased all my indexes and with fts and fts_squat enabled, and when I SEARCH TEXT in Dovecot, it does *not* find messages where the thing I SEARCH for appear only in the From: header. Timo, can you confirm or deny that you still see this behavior? I did clear my indexes before doing it. -- Asheesh. -- Man is the measure of all things. -- Protagoras

2 2

[Dovecot] Index corruption ?
by Geoffroy Desvernay 09 Nov '07

09 Nov '07

Hi, We are using dovecot for some times (a little before 1.0), for IMAP and (a little for the moment) deliver. We have ~20000 logins/day, Maildirs are over NFS (with indexes too, for the moment...) Up to 1.0.5, we sometime have this error in maillog: ________________________________________________________________________ Nov 1 13:55:41 tic dovecot: IMAP(login): file mail-index-view-sync.c: line 666 (mail_index_view_sync_end): assertion failed: (view->log_file_offset >= view->map->hdr.log_file_int_offset) ________________________________________________________________________ I didn't find any bits on google, nor on this list's archive... # gdb (without debug, I may do it if required) ________________________________________________________________________ Program terminated with signal 6, Aborted. Reading symbols from /usr/local/lib/libiconv.so.3...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/libiconv.so.3 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols found)...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x182ad51f in kill () from /lib/libc.so.6 (gdb) bt #0 0x182ad51f in kill () from /lib/libc.so.6 #1 0x182ad4be in raise () from /lib/libc.so.6 #2 0x182ac0e8 in abort () from /lib/libc.so.6 #3 0x080a85da in i_set_failure_syslog () #4 0x080a80e1 in data_stack_deinit () #5 0x08092c97 in mail_index_view_sync_end () #6 0x0808229e in index_mailbox_sync_next () #7 0x0000001c in ?? () #8 0xbfbfe7e8 in ?? () #9 0x080d3140 in ?? () #10 0x080d8044 in ?? () #11 0x0000001c in ?? () #12 0xbfbfe828 in ?? () #13 0x08060761 in imap_sync_deinit () Previous frame inner to this frame (corrupt stack?) ____________________________________________________________________ dovecot -n # 1.0.5: /usr/local/etc/dovecot.conf ssl_ca_file: /etc/ssl/cacert.pem ssl_cert_file: /etc/ssl/private/imaps.ec-marseille.fr.pem ssl_key_file: /etc/ssl/private/imaps.ec-marseille.fr.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_greeting: IMAP Centrale ready. login_greeting_capability: yes login_process_size: 64 login_processes_count: 20 login_max_processes_count: 512 valid_chroot_dirs: /users:/home max_mail_processes: 2048 verbose_proctitle: yes first_valid_uid: 1000 last_valid_uid: 55000 first_valid_gid: 999 last_valid_gid: 55000 mail_extra_groups: mail mail_location: maildir:%h/Maildir/ mmap_disable: yes lock_method: flock maildir_stat_dirs: yes maildir_copy_with_hardlinks: yes mail_drop_priv_before_exec: yes mail_executable: /usr/local/libexec/dovecot/imap_convert imap_client_workarounds: delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep auth default: verbose: yes worker_max_count: 60 passdb: driver: pam args: imap passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: passwd userdb: driver: ldap args: /usr/local/etc/dovecot-uldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs ___________________________________________________________________ # dovecot-ldap.conf (dovecot-uldap.conf is a symlink) ___________________________________________________________________ hosts = ldapr.serv.int:389 ldap:389 dn = <our binddn> dnpass = <our pass> auth_bind = yes ldap_version = 3 base = ou=People,<our_basedn> deref = never scope = onelevel user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,uid=system_user user_filter = (&(objectClass=inetLocalMailRecipient)(|(uid=%u)(mail=%u)(mail=%n@<our_primary_domain>))) pass_attrs = uid=user pass_filter = (&(objectClass=inetLocalMailRecipient)(|(uid=%u)(mail=%u)(mail=%n@<our_primary_domain>))) ____________________________________________________________________ -- ___________________________________________________________ / Geoffroy DESVERNAY | \ /\ `Service info` | Tel: (+33|0)4 91 05 45 24 /\ \/ Ecole Centrale de Marseille | Fax: (+33|0)4 91 05 45 98 \/ \ (ex-EGIM) | Mail: dgeo(a)ec-marseille.fr / -----------------------------------------------------------

3 2

[Dovecot] IMAP outlook express error
by Hannibal Ndlovu 09 Nov '07

09 Nov '07

Hi Am running debian etch + exim4 + dovecot 1.0.rc15-2etch with both an IMAP and a POP3 server The issue is when i try and get my mail using the IMAP protocol outlook gives and error "cannot find Inbox on 192.0.0.1" its happens with thunderbird and with Kmail - I assume i have misconfigured it some how and my mail is set to "mail_spool" in Exim4 I have pasted the output of "dovecot -n" # /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: pop3 imap listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting: The Chisipite Mail Server is ready. login_processes_count: 5 max_mail_processes: 100 verbose_proctitle: yes mail_extra_groups: mail Debian-exim mailbox_idle_check_interval: 5 mail_debug: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: verbose: yes passdb: driver: pam passdb: driver: passwd args: /etc/passwd passdb: driver: shadow args: /etc/shadow userdb: driver: passwd

2 2

[Dovecot] Dovecot I/O scheduling (all versions)
by mikkel＠euro123.dk 08 Nov '07

08 Nov '07

I have experienced this on all versions of Dovecot that Ive used (1.0 - 1.1b6) using IMAP (its difficult to test if its also there with POP3). What I see is that if there is a peak in disk usage at the time of a specific request that requests stalls. The saturation of disk I/O is momentary but when its done (maybe after one or two seconds) Dovecot still waits for its I/O operation instead of continuing as soon as resources are available. Now, I would expect Dovecot to only wait until there are resources available and not stall for at long time (sometimes it stalls for like 10 seconds, and sometimes completely). This could be OS specific (Im using ZFS and Solaris 10 on Sparc) but it may also be due to the way dovecot is programmed. Theres always plenty of RAM and CPU available so thats not whats causing troubles. Is anyone else familiar with this issue? Regards, Mikkel

2 1

[Dovecot] IDLE with Leopard Mail
by Scott Murman 08 Nov '07

08 Nov '07

imap IDLE is now built into the apple mail client in Leopard (finally!!). anyone looked at compatibility issues with dovecot? -SM-

2 1

[Dovecot] v1.1.beta7 released
by Timo Sirainen 08 Nov '07

08 Nov '07

http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta7.tar.gz http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta7.tar.gz.sig Changes since beta6: - Beginnings of unit tests, as I mentioned in a previous mail - Message parsing fixes - Cache file handling fixes Known bugs: - Cache file doesn't keep track of how much it contains deleted data, which means it could grow infinitely. This worked at some point, so I'm not sure what I did to break it. I'll figure it out later. - Apparently for some use cases v1.1 is still slower (about 2x) than v1.0. Probably more or less specific to NFS + mmap_disable=yes.

1 0

Re: [Dovecot] Unit testing
by Alan Ferrency 07 Nov '07

07 Nov '07

Timo Sirainen <tss(a)iki.fi> wrote: > I finally added beginnings of unit tests to Dovecot v1.1 code tree: > http://hg.dovecot.org/dovecot/rev/4e4a5d6bb2cb Great! Unit testing is good, even though it's boring and not very glamorous. I wonder if you have seen or considered libtap, possibly as an optional dependency for those who care about running the tests? http://jc.ngo.org.uk/trac-bin/trac.cgi/wiki/LibTap It looks like it could almost drop in, in place of some of your existing test helpers. It is also compatible with a variety of end user test tools. However, I could see hesitation in adding external dependencies where they aren't really necessary. If you had TAP compatibility through libtap or other means, I could easily drop dovecot into our existing suite of nightly smoke tests on FreeBSD. > I'm probably going to be pretty lazy at adding more of those tests, so > if you've ever wanted to get your own code to Dovecot, now would be a > great time to do it! :) With a 5 month old and a 4 year old on hand, "copious free time" isn't my strong point, but I'll at least attempt to provide tests with any future bug reports. Thanks! Alan Ferrency

1 0

[Dovecot] How to set multi backends (with same type)
by maximatt 07 Nov '07

07 Nov '07

hi..... i don't know if its posible. i have two ldap directories, and i want use them to use as my dovecot users backend... so i have two configurations files... "dovecot-ldap1.conf" and " dovecot-ldap2.conf" and i try setting like: Test 1: (simil postfix ) :D This dont work auth default { : : passdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf, /etc/dovecot/etc/ldap/dovecot-ldap2.conf } userdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf, /etc/dovecot/etc/ldap/dovecot-ldap2.conf } } Test 2: This dont work auth default { : : passdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf/etc/dovecot/etc/ldap/dovecot- ldap2.conf } userdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf/etc/dovecot/etc/ldap/dovecot- ldap2.conf } } Test 3: (looking "passbd ldap" as a set) :) this work, but dovecot-ldap2.conf override dovecot-ldap1.conf (the set vision, none) auth default { : : passdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf args= /etc/dovecot/etc/ldap/dovecot-ldap2.conf } userdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf args= /etc/dovecot/etc/ldap/dovecot-ldap2.conf } } ¿How could i do this? :( Thanks in advance :) -- Salu2 ;)

1 1

[Dovecot] imaptest update
by Timo Sirainen 07 Nov '07

07 Nov '07

http://dovecot.org/tools/imaptest.c now keeps track of messages' metadata and complains if they change. It relies on Message-ID: header being unique in the source mailbox, otherwise it'll give bogus errors. I might fix that some day. I changed the code from using simple line-based parsing to Dovecot's imap-parser code. Unfortunately it looks like it's pretty slow. At least I'm pretty sure imaptest didn't take more than a few % of CPU before, while now it's showing 35% CPU usage.. I guess I'll have to profile it a bit to see what's eating the CPU. And yes, looks like it found a couple of bugs from Dovecot 1.1's MIME parsing (BODY/BODYSTRUCTURE replies change). That was actually why I wrote this code in the first place, I was trying to figure out how to reproduce a bug. I'm getting closer to my stress testing dream tool. :) http://mailman1.u.washington.edu/pipermail/imap-protocol/2007-March/000413.…

1 0

[Dovecot] Unit testing
by Timo Sirainen 07 Nov '07

07 Nov '07

I finally added beginnings of unit tests to Dovecot v1.1 code tree: http://hg.dovecot.org/dovecot/rev/4e4a5d6bb2cb There are currently just a couple of tests implemented in test-lib (lib/ functions) and test-mail (lib-mail/ functions). I'm probably going to be pretty lazy at adding more of those tests, so if you've ever wanted to get your own code to Dovecot, now would be a great time to do it! :)

1 0

[Dovecot] index corruption
by rosenfield＠users.sourceforge.net 07 Nov '07

07 Nov '07

Hi people Just switched to Dovecot yesterday, and I've already got about five reports of users with duplicate mail in their inbox :-/. Not as bad as lost email, mind you, but pretty annoying still. Checking the server log, it says: postfix/smtpd: disconnect from unknown deliver: msync() failed with index file maildir/dovecot.index: Input/output error unionfs: new lower inode mtime (bindex=0, name=maildir) dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error IMAP: Disconnected: Internal error occurred. Refer to server log for more information. This is dovecot version 1.0.3, the log presented here relates to only one user; user name snipped for anonymity purposes. Afterwards things just get worse and worse with the affected user: dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: Corrupted transaction log file maildir/.SPAM/dovecot.index.log: invalid new transaction log sequence (1 >= 1) dovecot: IMAP: fscking index file maildir/.SPAM/dovecot.index dovecot: IMAP: Transaction log file maildir/.SPAM/dovecot.index.log: marked corrupted dovecot: IMAP: Corrupted transaction log file maildir/.SPAM/dovecot.index.log: invalid new transaction log sequence (2 >= 2) dovecot: IMAP: fscking index file maildir/.SPAM/dovecot.index dovecot: IMAP: Corrupted transaction log file maildir/.Junk/dovecot.index.log: invalid new transaction log sequence (1 >= 1) dovecot: IMAP: fscking index file maildir/.Junk/dovecot.index dovecot: IMAP: Transaction log file maildir/.Junk/dovecot.index.log: marked corrupted dovecot: IMAP: Corrupted transaction log file maildir/.Junk/dovecot.index.log: invalid new transaction log sequence (2 >= 2) dovecot: IMAP: fscking index file maildir/.Junk/dovecot.index deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error What could be the problem? How do I go about debugging an issue such as this?

2 2

[Dovecot] IMAP - Empty attachments error
by Tomáš Klandra 06 Nov '07

06 Nov '07

Hallo, I have one problem with the following configuration: - server: debian, dovecot used as an IMAP server, version 0.99.14. - stations: windows 2k/XP, mailer seamonky 1.1.4 Sometimes (let's say once in 20 attemptes) when saving attachments, they are empty (zero size files). Simple re-saving them helps. I was looking on mozilla forums if it's not a bug in SeaMonkey, which looked more likely to me, but didn't find anything, so I got the idea it could be a bug in dovecot. If someone saw this as well or have any ideas, I would really appreciate any help about it, as the error is really annoying. Thank you, Tom

2 1

[Dovecot] assertion failed with hg current
by Jakob Hirsch 06 Nov '07

06 Nov '07

Hi, I get a lot of these after updating to the current 1.1 hg version: > Nov 6 16:05:35 seba deliver(jh): file mail-cache-transaction.c: line 736 (mail_cache_header_add_field): assertion failed: (cache->field_file_map[field_idx] != (uint32_t)-1) > Nov 6 16:05:35 seba deliver(jh): Raw backtrace: /usr/local/libexec/dovecot/deliver(i_syslog_fatal_handler+0x2b) [0x80bbeab] -> /usr/local/libexec/dovecot/deliver [0x80bbd4c] -> /usr/local/libexec/dovecot/deliver(mail_cache_add+0x2d2) [0x8091da2] -> /usr/local/libexec/dovecot/deliver(index_mail_cache_add_idx+0x69) [0x8085629] -> /usr/local/libexec/dovecot/deliver [0x806f776] -> /usr/local/libexec/dovecot/deliver(mail_storage_copy+0x53) [0x80ab3b3] -> /usr/local/libexec/dovecot/deliver(maildir_copy+0x52) [0x8067802] -> /usr/local/libexec/dovecot/deliver(deliver_save+0xcf) [0x80592df] -> /usr/local/libexec/dovecot/deliver(main+0x1317) [0x805a7e7] -> /lib/libc.so.6(__libc_start_main+0xe0) [0x948f70] -> /usr/local/libexec/dovecot/deliver [0x8058541] Besides that, it seems to run fine.

2 1

[Dovecot] User keywords limit to 26
by Arthur Pétry 06 Nov '07

06 Nov '07

Hi, I'm planning to use dovecot 1.0.5 for a webmail using a lot of user- defined tags. Recently, I just saw the limit of 26 of them when messages are stored in maildir format. This is an important issue for me, since I didn't find how to remove a flag from the dovecot-keywords database. Is there any plan to get rid of the keywords limit ? Or perhaps the new dbox storage format can fix that ? By the way, the comportement of Dovecot when we try to add a new flag while the limit is exceeded is strange : (C: is client and S: Dovecot) The store of the flags is ok : C: RUBY0094 UID STORE 89 +FLAGS (test_0 test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26) S: * 81 FETCH (UID 89 FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26 test_0)) S: RUBY0094 OK Store completed. And then when we fetch them, dovecot reply 2 times. The first time with all the flags, and the second time with only the 26 flags stored in maildir. (I suppose Dovecot try to sync the flags when we fetch it) : C: RUBY0095 UID FETCH 89 FLAGS S: * 81 FETCH (FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26 test_0) UID 89) S: * 81 FETCH (FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_0)) S: RUBY0095 OK Fetch completed.

2 1

[Dovecot] Sent vs Sent Items
by Ed W 06 Nov '07

06 Nov '07

Religious wars about which is "best" aside - some mail clients seem to default to using "Sent Items" folder for saving sent mail, and others (many) default to "Sent". Seems that in the interests of compatibility and "doing the right thing" (tm) that a symlink from one folder to the other name would ensure that either default would give the same result (in a mixed client setup)? However, I wonder if someone has already written a plugin to do something simple like this? More generally I guess it's folder aliasing, so that Sent == Sent Items and perhaps there are also synonyms for Drafts/Templates? Anyone got any thoughts on this simple idea? (The prob with sym links is a) creating them at mailbox setup time and b) what happens when someone tries to delete the folder...) Cheers Ed W

6 6

[Dovecot] MySQL-SSL
by xyon 06 Nov '07

06 Nov '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello all, I've been running dovecot authenticating against a local MySQL database, but it has come time to implement it with a remote database. Instead of using stunnel, I'd rather take advantage of MySQL's native SSL support. I didn't know if this was possible with dovecot, and if it was, what config changes I might need to get it going. I found the below page/patch from some time ago and tried to use the ssl_key and ssl_cert directives in /etc/dovecot-sql.conf, but it didn't seem to recognize them (perhaps I need to compile mysql-ssl support into dovecot manually?): http://www.dovecot.org/list/dovecot-cvs/2004-July/003003.html Also, I noticed a need for ssl_ca and ssl_ca_path but am unfamiliar with how to generate what's needed if these options are required. FYI, dovecot 1.0.7 is running on CentOS 4.5, using rpm from ATrpms: http://dl.atrpms.net/el4-i386/atrpms/stable/dovecot-1.0.7-0_63.el4.i386.rpm Thanks for any advice or documentation pointers you can provide. Have a great evening everyone! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.7 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHL85sJ6p9X8nw/2oRAr9JAJ9u5XTOXqqUvVFE5HqEAr4HzC2juwCgob5o 7usezyZdBjP44wEYQKUg/fQ= =tv5y -----END PGP SIGNATURE-----

1 0

[Dovecot] deliver to subfolder?
by Ralf Hildebrandt 06 Nov '07

06 Nov '07

Can dovecot's deliver deliver a mail to a certain subfolder within a user's mailbox? I was thinking of something along the lines of: deliver -m subfolder But what is the correct syntax to deliver to "spam", subfolder of INBOX? deliver -m spam < message.txt deliver -m INBOX.spam < message.txt -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de

2 1

[Dovecot] truncated messages / attachments
by Markus Stumpf 05 Nov '07

05 Nov '07

I am currently running dovecot-1.1.beta6 (at least beta5 also had the problem) Retrieving some messages via IMAP gets them truncated and it also happens with retrieving attachments (message is HTML part of multipart-alternative, attachments are at least some PDF files). A user reported she is rather sure one of the messages was ok, before moving it to some other folder. In the filesystem the messages are there in full length. It happens with Outlook as well as with Thunderbird. We're using Maildir. After upgrading from beta5 to beta6 I have removed all dovecot.index* files of a folder with a defect message. This didn't make a difference. (Thought it could be related to some indexing problem). Any one else seeing this? \Maex -- Markus Stumpf

2 2

[Dovecot] Couldn't init INBOX: Can't sync mailbox: Messages keep getting expunged
by Tom Sommer 05 Nov '07

05 Nov '07

After updating Dovecot, one of my servers keep spamming these errors in the log: dovecot: Nov 03 14:14:18 Error: POP3(foo(a)bar.com): Getting size of message UID=4402 failed dovecot: Nov 03 14:14:18 Error: POP3(foo(a)bar.com): Getting size of message UID=4402 failed dovecot: Nov 03 14:14:18 Error: POP3(foo(a)bar.com): Couldn't init INBOX: Can't sync mailbox: Messages keep getting expunged The funny thing is the mailbox is empty, there are no mails in the folder that should be needed to be parsed It was perfectly fine before I updated, and the permissions on the folder is correct. It only affects some mailboxes as well. Any ideas? // Tom

3 5

Re: [Dovecot] Dovecot write activity (mostly 1.1.x)
by mikkel＠euro123.dk 05 Nov '07

05 Nov '07

On Sun, November 4, 2007 4:32 pm, Timo Sirainen wrote: >> >> I didn't know that mail_nfs_index=yes resulted in a forced chown. >> How come that's necessary with NFS but not on local disks? >> > > It's used to flush NFS attribute cache. Enabling it allows you to use > multiple servers to access the same maildir at the same time while still > having attribute cache enabled (v1.0 required actime=0). If you don't need > this (and it's better if you don't), then just set the mail_nfs_* to "no" > and it works faster. > >> By the way I misinformed you about fsync_disable=yes. >> It was like that before i upgraded to v1.1, but v1.1 requires >> fsync_disable=no when mail_nfs_index=true so I had to disable it. > > So you use ZFS on the NFS server, but Dovecot is using NFS on client > side? The fsyncs then just mean that the data is sent to NFS server, not a > real fsync on ZFS. > Thanks a lot for the help - this changed a lot! Dist writes fell to about 1/3 of before. I guess the reason is that ZFS can now make use if it's caching capabilities. Delivers activity is completely random since it's impossible to load balance a connection based on the e-mail recipient, since only the ip is known at the load balancing point. Therefore I have fsync_disable=no for deliver. It's easy to force the clients using imap/pop3 to the same server since it can be based on the ip only. Therefore I have fsync_disable=yes for imap/pop3. This changed everything. Now there's a real performance gain upgrading from 1.0.x to 1.1.x. About two or three times less disk activity overall (reads were already improved) for both reads and writes. Thats pretty neat!

1 0

[Dovecot] Version 1.1beta 6 and OS X Leopard (10.5)
by Jerry Yeager 05 Nov '07

05 Nov '07

Just a quick note: The new 1.1-b6 is working fine on OS X 10.5.

1 0

Re: [Dovecot] Testing with some Unstable
by Jeff Grossman 05 Nov '07

05 Nov '07

Andrew Sackville-West wrote: > [SNIPPED] > > actually, assuming you now have unstable in your sources.list, those > are packages currently installed for which there are updates available > (probably unstable updates...). Be careful or you'll end up farther > than you want. > > I can't answer to the specifics of sendmail and libmilter, but so long > as you have unstable in your sources.list, those kept-back packages > will appear (unless you upgrade them, of course). Probably, on the > assumption that sendmail and libmilter is sufficient for your needs, > you should change you sources.list back once those two upgrades are > done. > > A > I have "APT::Default-Release "testing";" in my apt.conf file. Is it still advised to remove the unstable lines from my sources.list file even though I have the above in my apt.conf file? Thanks for you help. Jeff

1 1

[Dovecot] Dovecot write activity (mostly 1.1.x)
by mikkel＠euro123.dk 04 Nov '07

04 Nov '07

Im experiencing write activity thats somewhat different from my previous qmail/courier-imap/Maildir setup. This more outspoken in v.1.1.x than v1.0.x (Im using Maildir). Write activity is about half that of read activity when measuring throughput. But when measuring operations its about 5-7 times as high (measured with zpool iostat on ZFS). I think this might be due to the many small updates to index and cache files. Anyway since writing is much more demanding to the disk than reads dovecots ends up being slower (only a little though) than my old qmail/courier-imap/Maildir was. And the old setup didnt even benefit from indexes like Dovecot does. (What I mean saying slower is that it can service fewer users before it hits the wall). Of course theres also lots of benefits using Dovecot. Im just wondering whether this was a thing that should be focused on for later versions (maybe writes could be grouped together or something like that). Dovecot is very cheap on the CPU side so the only real limit in terms of scalability is the storage. Regards, Mikkel

2 6

[Dovecot] Sieve error messages (sieve 1.1.2, dovecot 1.1b6)
by mikkel＠euro123.dk 04 Nov '07

04 Nov '07

Sorry for spamming the list today:) Im getting a lot of these errors in the deliver log: deliver([recipient]): [date] Info: sieve runtime error: Fileinto: Generic Error deliver([recipient]): [date]:18 Error: sieve_execute_bytecode([path-to-sieve]) failed deliver([recipient]): [date] Info: msgid=<[msgid] >: save failed to [foldername]: Quota exceeded In this case the account is over the defined Dovecot quota limit. Dovecot knows what to do but sieve seems to throw its standard error message. Is there something wrong with Sieve or is it just that the error is misleading? This has been present in all v1.1.x I think (some changes was made to the error messages in b3 or b4 but believe this didnt change). Regards, Mikkel

1 0

[Dovecot] *notify config for 1.0.x doesn't enable inotify
by Paolo 04 Nov '07

04 Nov '07

hi, the current code has changed include linux/inotify.h to sys/inotify.h since 2006-01-17, but that won't work with inotify*.h as documented in the wiki. One has to either revert back to linux/inotify.h, or add #include <sys/inotify-syscalls.h> to both configure.in and src/lib/ioloop-notify-inotify.c Or, just symlink sys/inotify.h -> linux/inotify.h. That's on Debian 3.1 (Sarge). -- paolo GPG/PGP id:0x1D5A11A4 - 04FC 8EB9 51A1 5158 1425 BC12 EA57 3382 1D5A 11A4

3 6

[Dovecot] IMAP vs system username logging with checkpassword auth
by dale gallagher 03 Nov '07

03 Nov '07

Hi After upgrading to dovecot 1.0.7 I noticed that the actual username is no longer logged, but rather the system user (in my case 'vmail') under which my virtual set-up runs. Now I'm unable to see which virtual users log in. Any pointers on how to configure dovecot to log the actual username given during the IMAP dialogue would be appreciated. My dovecot.conf includes the following: auth default { mechanisms = plain passdb checkpassword { args = /var/qmail/bin/qmail-vauth } userdb prefetch { } user = auth } An example logfile entry: 2007-11-03 15:41:56.027191500 dovecot: Info: imap-login: Login: user=<vmail>, method=PLAIN, rip=192.168.0.141, lip=192.168.0.10, TLS

2 1

[Dovecot] MANAGESIEVE patch v8 for dovecot 1.0.7
by Stephan Bosch 03 Nov '07

03 Nov '07

Hello dovecot users, I have updated the MANAGESIEVE patch to the latest stable version of dovecot (1.0.7). This new version also adds extra configuration settings to explicitly specify the location of the sieve storage and the active sieve script. Additionally, the README now more clearly explains the configuration of the daemon. It currently won't compile with 1.1 due to significant changes in the master code. However, because 1.1 now approaches a stable release, the next version is going to be updated to version 1.1. Change Log V8 ------------- + Fixed a few incompatibilities with 1.0.7 version. For instance, the "Logged in" message is now sent by the -login process and not by the managesieve daemon anymore. This caused a segfault every once in a while. + Probably fixed the settings problem reported by Steffen Kaiser regarding login_dir. 'dovecot -n' now reports correct results, but testing will show whether the whole problem is solved. + The managesieve daemon now accepts the sieve_storage and sieve configuration settings, so it is now possible to explicitly configure the location of the sieve storage and the active script respectively. The daemon still falls back to using the mail_location (MAIL) settings if nothing else is specified. + The cyrus timsieved does not use the + character in string literals and many clients have adopted to this behaviour. The latest managesieve (08) advises to accept a missing + from clients. The server should not send any + characters as well. This behavior is now implemented on the server. + Cleaned up sieve-storage.c: split up the sieve_storage_create function in various sub-functions for obtaining the various paths and directories. + Forced manual intervention if rescueing a non-symlink file at the active script path fails somehow. Previously, this presented the admin with a log message that it had just eaten the script, which is not very nice. + Restructured the README.managesieve file and added some more explanation with regard to the configuration of the daemon. This patch still includes (yet another) instance of the CMU Sieve source, as explained in one of my previous e-mails (http://dovecot.org/list/dovecot/2006-July/015016.html) The patch can be downloaded at: http://sinas.rename-it.nl/~sirius/dovecot-1.0.7-MANAGESIEVE-v8.diff.gz The README.managesieve is located in the root of the dovecot source tree after applying the patch. Have fun testing the patch. Don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl IRC: Freenode, #dovecot, S[r]us

4 6

[Dovecot] v1.1.beta6 released
by Timo Sirainen 02 Nov '07

02 Nov '07

http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta6.tar.gz http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta6.tar.gz.sig Fixes since beta5: - dovecot.index.cache file wasn't actually being created/updated (or something like that) - SORT assert-crashed sometimes when sorting by string fields - etc.

1 0

[Dovecot] Listening only on localhost
by tobias-mail＠gmx.net 02 Nov '07

02 Nov '07

Hi! I've got dovecot 1.0.rc15. I want dovecot to listen only on localhost for imap, and on any interfaces for imaps. So I put the following into my config: protocol imap { listen = 127.0.0.1:143 ssl_listen = *:10993 .. } dovecot -n correctly reports: listen: 127.0.0.1:143 ssl_listen: *:10993 But I can still do a 'telnet MY_HOST 143' from the outside, and 'netstat -pltn | grep dovecot' reports: [ip changed ;)] tcp 0 0 77.my.ip.253:10993 0.0.0.0:* LISTEN 4847/dovecot tcp 0 0 77.my.ip.253:143 0.0.0.0:* LISTEN 4847/dovecot Am I doing something wrong? Or is there a bug? -- GMX FreeMail: 1 GB Postfach, 5 E-Mail-Adressen, 10 Free SMS. Alle Infos und kostenlose Anmeldung: http://www.gmx.net/de/go/freemail

3 2

[Dovecot] Postfix and Dovecot Deliver LDA
by spammy 02 Nov '07

02 Nov '07

Hi all, Having problems moving from postfix/dovecot/mysq/maildrop existing intall to dovecot LDA dovecot -n # 1.0.5: /etc/dovecot/dovecot.conf log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap pop3 login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_location: maildir:/vmail/%d/%u mail_debug: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth-client mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail master.cf (maildrop line commented. -f ${recipient} in maildrop was working ok) dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -d ${recipient} main.cf dovecot_destination_recipient_limit = 1 # I haven't found any docs about the following must work, but apparently working. virtual_mailbox_domains = proxy:mysql:/etc/postfix/mysql_virtual_domains_maps.cf virtual_transport = dovecot dovecot.log dovecot: 2007-11-02 12:32:40 Info: auth(default): master out: USER 1 vaina(a)neenux.com uid=5000 gid=5000 deliver(vaina(a)neenux.com): 2007-11-02 12:32:40 Info: auth input: vaina(a)neenux.com deliver(vaina(a)neenux.com): 2007-11-02 12:32:40 Info: auth input: uid=5000 deliver(vaina(a)neenux.com): 2007-11-02 12:32:40 Info: auth input: gid=5000 deliver(vaina(a)neenux.com): 2007-11-02 12:32:40 Fatal: setuid(5000) failed: Operation not permitted I'm using vmail:vmail (5000:5000) for all my virtual users and postfix chrooted. I have read the wiki but I'm not using diferrent uids and gids for every user so, I don't understand why deliver is trying to setuid. sorry for my newbie question but my english is not the best and I'm totally lost. any ideas? roger

2 2

[Dovecot] caching custom headers (via plugins)
by Paolo 02 Nov '07

02 Nov '07

hi, currently dovecot caches on disk some most common headers. Is it possible to tweak such headers list via plugins, eg to cache custom X-* headers, or do I need to hack the actual index/cache src? if so, which are the .c/.h files to touch? thanks -- paolo GPG/PGP id:0x1D5A11A4 - 04FC 8EB9 51A1 5158 1425 BC12 EA57 3382 1D5A 11A4

3 4