- dovecot - dovecot.org

[Dovecot] SEARCH TEXT does not seem to search headers
by Asheesh Laroia 23 Oct '07

23 Oct '07

The RFC says <http://www.isi.edu/in-notes/rfc3501.txt> this: TEXT <string> Messages that contain the specified string in the header or body of the message. But with the current hg tip (see linked rawlogs), SEARCH TEXT provides results disjoint from SEARCH FROM. I guess that's a bug? http://paulproteus.acm.jhu.edu/bug-report/2007-10-22/20071022-125604-622.out and http://paulproteus.acm.jhu.edu/bug-report/2007-10-22/20071022-125604-622.in -- Asheesh. P.S. Sorry to be so noisy lately.... -- And that's the way it is... -- Walter Cronkite

2 2

Re: [Dovecot] pam_ldap.so memory leaks?
by Flannery, Andrew 22 Oct '07

22 Oct '07

Thank you for the speedy response! >> The dovecot-auth process' VmRSS size grows by 4k per request and has a >> limit of 256megs. > The main dovecot-auth or dovecot-auth -w processes'? dovecot-auth -w is the culprit. >> Okay the question: In dovecot 1.1.0 beta3 I see that blocking=yes is >> now on, no matter what. Has something been done to address potential >> memory leaks in pam modules? > # Number of auth requests to handle before destroying the process. > This may > # be useful if PAM plugins leak memory. > #auth_worker_max_request_count = 0 This looks promising, thanks!

1 0

[Dovecot] Courier to Dovecot: problems with folders
by Claudio Strizzolo 22 Oct '07

22 Oct '07

Hi all, I am migrating a maildir Courier-IMAP installation to Dovecot. Almost everything seems to work well, but I still have problems accessing subfolders. First let's see what I have done. I used the courier-dovecot-migrate.pl script suggested in http://wiki.dovecot.org/Migration/Courier to convert mailboxes from Courier to Dovecot. No problems here. My dovecot.conf contains this: (...) mail_location = maildir:/mail/vmail/domains/%h namespace private { prefix = INBOX. inbox = yes } (...) The subscriptions file in the mailboxes looks correct to me. It includes all the folders and subfolders, i.e.: Sent Trash Drafts mail.dovecot mail.misc mail.postmaster tools web.apache web.css Folders separated by "." are actually subfolders: mail ---- dovecot | --- misc | --- postmaster I let the configuration of my IMAP clients unchanged from Courier to Dovecot. That is, they specify the "INBOX." prefix, as before. For instance, with Pine: folder-collections=mymail {mymail.example.com/user=John.Smith}INBOX.[] Now the problem: I get different behaviours depending on the client I use to access to Dovecot: - Thunderbird: All the folders are seen correctly. But the whole folders tree is under "Inbox", while with Courier the first-level folders (i.e. Drafts, mail, web) were at the same level of Inbox - Webmail (Squirrelmail 1.4.8): The same as above. - Pine: The folders are apparently correct, and are not under Inbox, but I can access only the first-level folders: the folders containing sub-folders are empty, therefore the subfolders cannot be accessed. Any hints? Thanks in advance Claudio

2 1

[Dovecot] Squirrelmail: "ERROR: Connection dropped by IMAP server."
by Jakob Hirsch 22 Oct '07

22 Oct '07

Hi, running the current version from http://hg.dovecot.org/dovecot/ (but the same happens with 1.1.beta3) After yesterday's patches, squirrelmail (tested with 1.4.11 and 1.4.10a) complains when appending to the Sent folder (after sending a message): ERROR: Connection dropped by IMAP server. Query: SELECT "INBOX" dovecot's log says dovecot: IMAP(jh): Disconnected: EOF while appending bytes=12780/37798 I have captured the conversation with tcpdump (http://plonk.de/imap.cap) and it looks like dovecot is closing the connection. With Thunderbird it works just fine. Regards, Jakob

2 1

[Dovecot] pam_ldap.so memory leaks?
by Flannery, Andrew 22 Oct '07

22 Oct '07

Hello List, I have a question about dovecot-1.1.0-beta3 but first I'll ramble a little bit: Recently I upgraded a 0.99 installation of dovecot to 1.0.5. All went relatively smoothly until the dovecot-auth process began returning "out of memory" after a day. There is a rather large user base here. The current setup is using passdb pam with blocking=yes, with pam_ldap.so handling most authentication (although in special cases I am using a custom written pam module which I have disabled to eliminate as the source of the leak). The dovecot-auth process' VmRSS size grows by 4k per request and has a limit of 256megs. Unfortunately turning blocking=yes off isn't an option. The reason I must have it turned on is that the custom pam module is changing the username on specific requests. I am trying to pinpoint the memory leak (pam_ldap is my biggest suspect right now though I'm going to try running valgrind on a test system). For now I have set shutdown_clients=no and am restarting dovecot at regular intervals. Okay the question: In dovecot 1.1.0 beta3 I see that blocking=yes is now on, no matter what. Has something been done to address potential memory leaks in pam modules? Thanks, -Andrew

2 1

[Dovecot] Assertion failed: (pos < input->size)
by Asheesh Laroia 22 Oct '07

22 Oct '07

Oct 21 10:04:05 alchemy dovecot: imap-login: Login: user=<paulproteus>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, TLS Oct 21 10:05:44 alchemy dovecot: IMAP(paulproteus): file message-decoder.c: line 289 (message_decode_body): assertion failed: (pos < input->size) Oct 21 10:05:44 alchemy dovecot: IMAP(paulproteus): Raw backtrace: imap [0x80c8e10] -> imap [0x80c8d1c] -> imap(message_decoder_decode_next_block+0x868) [0x80c58a8] -> /usr/local/lib/dovecot/imap/lib20_fts_plugin.so [0xb7f7f2f5] -> imap [0x805f526] -> imap [0x805f8a8] -> imap(io_loop_handle_timeouts+0x10b) [0x80cf71b] -> imap(io_loop_handler_run+0x69) [0x80d0169] -> imap(io_loop_run+0x28) [0x80cf5f8] -> imap(main+0x4ac) [0x8068dec] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe0) [0xb7e29050] -> imap [0x805b941] Oct 21 10:05:44 alchemy dovecot: child 14390 (imap) killed with signal 6 Assertion failed. This happened when doing a "SEARCH TEXT delicious". I have to run out and buy ingredients for a birthday cake, so I thought I'd email this very terse message to the list in case it was some help, and if you need more info just reply saying "more info" and I'll go through the usual debugging steps. -- Asheesh. -- It is much easier to be critical than to be correct. -- Benjamin Disraeli

2 9

[Dovecot] Best version for production systems?
by Mitch Pirtle 22 Oct '07

22 Oct '07

Hi dovecotters, I have a system running 1.0rc1 right now and am having problems (more on that later). I know that 1.0.5 is "current" but I'm running Debian Stable (Etch) and have reservations of upgrading until nothing works anymore ;-) Do I really need to make the upgrade to 1.0.5, and if so can anyone here point out how to do so using the standard Debian apt-get process? -- Mitch

2 1

[Dovecot] Suggested IMAP Directory Size..
by Ilo Lorusso 22 Oct '07

22 Oct '07

Hi, ive walked into a enviroment where the previous admin has being using pop and making the email clients leaving a copy of the mail on the workstation.. Now overtime these mailboxes (mbox format) have grown between 1,5 to 1,8 Gigs large I want to convert all these mailbox to IMAP (only 15) and want to know whats the largested suggest folder size per user dovecot IMAP runs smoothly with good responce times.. I know the users also have large OUT LOOK pst files 4.5GIGs and wondering if I could also intergrate that into IMAP? Please any feedback would be great on this topic..??

7 9

[Dovecot] Migrating from UW IMAP - pine - Thunderbird - squirrelmail
by Israel Bravo 22 Oct '07

22 Oct '07

Hello! I saw your post to the mailing list (http://www.dovecot.org/list/dovecot/2006-January/010968.html) where you write "A description for pine with imap acces without entering any password is also discussed.", but I didn't find such description in this post. Would you be so kind to point me to some source where it is explained - currently users have to insert the password twice - when they open the shell window and when they start Pine. Another question - may be you can help me: Currently we use Pine with IMAP (dovecot); both INBOX and folder collection are saved on the Linux server. But how to save the "saved-messages" and "sent-mail" folders in the user's home directory on the server? Thank you for help, -- _________________________________________________________ | Israel Bravo Unix system administrator | The faculty of Industrial Engineering & Management, | Technion, 32000 Haifa, Israel | Phone: 972-4-829-4428 http://ie.technion.ac.il/~bravo/ |________________________________________________________

2 1

[Dovecot] more problems with dovecot-1.1 beta3
by Sergey 22 Oct '07

22 Oct '07

Hi, Thank you for pointing me about -xc99 flag, I have compiled and installed dovecot inplace of version 1.0.5 without any special actions on the upgrade. And after starting it immediately got in it's log file messages like: --- dovecot: Oct 16 23:10:18 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.git-altlinux-ru/dovecot.index.cache: Invalid argument --- I have tried to delete dovecot.index.cache files from imap directories, but this did not helped: --- dovecot: Oct 16 23:52:24 Error: IMAP(seriv): Corrupted transaction log file /var/spool/imap/seriv/.imap/dovecot.index.log: indexid changed 1189182277 -> 1192593117 dovecot: Oct 16 23:52:24 Error: IMAP(seriv): Index file /var/spool/imap/seriv/.imap/dovecot.index: indexid changed: 1189182277 -> 1192593117 dovecot: Oct 16 23:52:24 Error: IMAP(seriv): Corrupted transaction log file /var/spool/imap/seriv/.imap/dovecot.index.log: indexid changed: 1189182277 -> 1192593117 dovecot: Oct 16 23:52:28 Error: IMAP(seriv): /var/spool/imap/seriv/.imap/dovecot.index view is inconsistent dovecot: Oct 16 23:52:28 Panic: IMAP(seriv): file client.c: line 105: assertion failed: (!client->destroyed) dovecot: Oct 16 23:52:28 Error: IMAP(seriv): Raw backtrace: /opt/dovecot/libexec/dovecot/imap'i_internal_fatal_handler+0x48 [0x8135118] -> /opt/dovecot/libexec/dovecot/imap'i _panic+0x23 [0x8134b03] -> /opt/dovecot/libexec/dovecot/imap'client_destroy+0x33 [0x808ee43] -> /opt/dovecot/libexec/dovecot/imap'client_continue_pending_input+0x5d [0x808fac d] -> /opt/dovecot/libexec/dovecot/imap'idle_finish+0xfa [0x808348a] -> /opt/dovecot/libexec/dovecot/imap'cmd_idle_continue+0x46 [0x8083776] -> /opt/dovecot/libexec/dovecot/i map'client_command_cancel+0x4a [0x808ec6a] -> /opt/dovecot/libexec/dovecot/imap'client_destroy+0x10b [0x808ef1b] -> /opt/dovecot/libexec/dovecot/imap'client_continue_pending_ input+0x5d [0x808facd] -> /opt/dovecot/libexec/dovecot/imap'idle_finish+0xfa [0x808348a] -> /opt/dovecot/libexec/dovecot/imap'cmd_idle_continue+0x202 [0x8083932] -> /opt/dove cot/libexec/dovecot/imap'idle_sync_now+0x84 [0x80836b4] -> /opt/dovecot/libexec/dovecot/imap'idle_callback+0x5b [0x808371b] -> /opt/dovecot/libexec/dovecot/imap'check_timeout +0x14c [0x80e323c] -> / dovecot: Oct 16 23:52:28 Error: IMAP(seriv): opt/dovecot/libexec/dovecot/imap'io_loop_handle_timeouts+0x217 [0x813d057] -> /opt/dovecot/libexec/dovecot/imap'io_loop_handler_r un+0x8d [0x813d9dd] -> /opt/dovecot/libexec/dovecot/imap'io_loop_run+0x4b [0x813d14b] -> /opt/dovecot/libexec/dovecot/imap'main+0x9a [0x809f18a] -> /opt/dovecot/libexec/dovec ot/imap'_start+0x7d [0x807c95d] dovecot: Oct 16 23:52:28 Error: child 7529 (imap) killed with signal 6 --- Then I have tried to delete all dovecot.index* files from there, but the messages in dovecot.log are almost the same: --- deliver(seriv): Oct 18 14:59:49 Error: file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:01:35 Error: IMAP(seriv): Sending log messages too fast, throttling.. dovecot: Oct 18 15:01:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Drafts/dovecot.index.cache: Invalid argument deliver(seriv): Oct 18 15:01:38 Error: file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.sisyphus-cybertalk-lists-altlinux-org/dovecot.index.cache: In valid argument dovecot: Oct 18 15:02:57 Warning: SIGHUP received - reloading configuration dovecot: Oct 18 15:02:58 Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 384). Either grow the limit or change login_max_processes_count a nd max_mail_processes settings dovecot: Oct 18 15:03:13 Warning: Killed with signal 15 deliver(seriv): Oct 18 15:04:07 Error: file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.community-lists-altlinux-org/dovecot.index.cache: Invalid arg ument deliver(seriv): Oct 18 15:04:23 Error: file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.Trash/dovecot.index.cache: Invalid argument deliver(seriv): Oct 18 15:04:50 Error: file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/.community-lists-altlinux-org/dovecot.index.cache: Invalid arg ument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument dovecot: Oct 18 15:06:36 Error: IMAP(seriv): Sending log messages too fast, throttling.. dovecot: Oct 18 15:06:37 Error: IMAP(seriv): file_set_size() failed with index cache file /var/spool/imap/seriv/.imap/dovecot.index.cache: Invalid argument --- One more problem is with fd limit: I have a small dovecot installation, so don't want to increase fd limit. I tried to decreasee max_mail_processes, login_max_processes_count and login_max_connections, but still I have --- # /opt/dovecot/sbin/dovecot -n # 1.1.beta3: /opt/dovecot/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 384). Either grow the limit or change login_max_processes_count and max_mail_processes settings log_path: /tmp/dovecot.log info_log_path: /tmp/dovecot.debug protocols: pop3 pop3s imap imaps ssl_cert_file: /etc/ssl/parkheights.cert ssl_key_file: /etc/ssl/parkheights.key login_dir: /opt/dovecot/var/run/dovecot/login login_executable(default): /opt/dovecot/libexec/dovecot/imap-login login_executable(imap): /opt/dovecot/libexec/dovecot/imap-login login_executable(pop3): /opt/dovecot/libexec/dovecot/pop3-login login_max_connections: 120 max_mail_processes: 128 mail_extra_groups: mail mail_location: maildir:/var/spool/imap/%n/.imap mail_executable(default): /opt/dovecot/libexec/dovecot/imap mail_executable(imap): /opt/dovecot/libexec/dovecot/imap mail_executable(pop3): /opt/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /opt/dovecot/lib/dovecot/pop3 auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: ldap args: /opt/dovecot/etc/dovecot-ldap.conf userdb: driver: ldap args: /opt/dovecot/etc/dovecot-ldap.conf userdb: driver: prefetch socket: type: listen master: path: /opt/dovecot/var/run/dovecot/auth-master mode: 384 user: vmail group: vmail bash-3.00# grep login_max /opt/dovecot/etc/dovecot.conf login_max_processes_count = 128 # 16 + login_max_connections * 2 available file descriptors. login_max_connections = 120 bash-3.00# grep max_mail /opt/dovecot/etc/dovecot.conf max_mail_processes = 128 --- So I reverted to 1.0.5 which works fine for me. -- WBR, Sergey Ivanov.

3 6