- dovecot - dovecot.org

[Dovecot] Handling ENFILE
by Mike Abbott 14 Apr '09

14 Apr '09

My mail server consumed all of its configured file table slots and started returning ENFILE ("Too many open files in system") for many operations. This wreaked havoc with dovecot-1.1.13. Here are some areas where dovecot should detect and more gracefully handle ENFILE error returns: 1. Deliver should report an error more helpful than "Unknown internal error" when fdatasync_path fails: deliver(user): Apr 10 14:53:20 Error: fdatasync_path(/Volumes/MailData/ user/new) failed: Too many open files in system deliver(user): Apr 10 14:53:20 Info: msgid=<...>: save failed to INBOX: BUG: Unknown internal error 2. Index files should not be fscked when they could not be opened due to ENFILE: Error: IMAP(user): open() failed with index file /Volumes/MailData/ user/.Deleted Messages/dovecot.index: Too many open files in system Warning: IMAP(user): fscking index file /Volumes/MailData/ user/.Deleted Messages/dovecot.index 3. Dovecot should not crash when mail transaction logs become corrupt, or appear to have become corrupt due to ENFILE. Here is a sequence of error messages from the log but I can't tell whether the IMAP ones up through the panic in the middle are all from the same process, or from different processes. deliver(user): Apr 10 14:55:32 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:55:54 Error: open() failed with index file / Volumes/MailData/user/dovecot.index: Too many open files in system deliver(user): Apr 10 14:55:54 Error: open() failed with file /Volumes/ MailData/user/dovecot.index.log.2: Too many open files in system deliver(user): Apr 10 14:55:57 Error: open() failed with index cache file /Volumes/MailData/user/dovecot.index.cache: Too many open files in system dovecot: Apr 10 14:56:08 Warning: IMAP(user): fscking index file / Volumes/MailData/user/dovecot.index dovecot: Apr 10 14:56:16 Error: IMAP(user): Fixed index file /Volumes/ MailData/user/dovecot.index: log_file_seq 15 -> 2 deliver(user): Apr 10 14:56:19 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:56:20 Error: Corrupted transaction log file / Volumes/MailData/user/dovecot.index.log seq 2: record size too small (type=0x0, offset=23088, size=0) (sync_offset=36848) deliver(user): Apr 10 14:56:20 Warning: fscking index file (in-memory index) deliver(user): Apr 10 14:56:21 Info: msgid=<...>: save failed to INBOX: Internal error occurred. Refer to server log for more information. [2009-04-10 14:56:20] dovecot: Apr 10 14:56:40 Panic: IMAP(user): file mail-transaction-log- view.c: line 103 (mail_transaction_log_view_set): assertion failed: (min_file_seq <= max_file_seq) dovecot: Apr 10 14:56:40 Error: IMAP(user): Raw backtrace: [see below for better backtrace] deliver(user): Apr 10 14:56:45 Error: Transaction log file /Volumes/ MailData/user/dovecot.index.log: marked corrupted deliver(user): Apr 10 14:57:04 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:57:23 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:57:49 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:58:21 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:58:41 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:59:09 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:59:28 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 14:59:43 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 15:00:57 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 15:03:01 Info: msgid=<...>: saved mail to INBOX deliver(user): Apr 10 15:03:27 Info: msgid=<...>: saved mail to INBOX dovecot: Apr 10 15:21:41 Error: IMAP(user): Corrupted transaction log file /Volumes/MailData/user/dovecot.index.log seq 2: Invalid transaction log size (36848 vs 23088): /Volumes/MailData/user/ dovecot.index.log (sync_offset=36848) dovecot: Apr 10 15:21:42 Info: imap-login: Login: user=<user>, method=CRAM-MD5, rip=..., lip=..., TLS The backtrace for the assertion failure was: 0 libSystem.B.dylib 0x00007fff8007c102 __kill + 10 1 libSystem.B.dylib 0x00007fff800f7ffc abort + 83 2 imap 0x000000010006a22e default_fatal_finish + 70 3 imap 0x000000010006a27c i_syslog_fatal_handler + 0 4 imap 0x00000001000699db i_info + 0 5 imap 0x0000000100058542 mail_transaction_log_view_set + 104 6 imap 0x0000000100053b4c view_sync_set_log_view_range + 125 7 imap 0x0000000100053fc5 mail_index_view_sync_begin + 378 8 imap 0x000000010003c26e index_mailbox_sync_init + 129 9 imap 0x0000000100018457 maildir_storage_sync_init + 229 10 imap 0x000000010000c6bb imap_sync_init + 132 11 imap 0x000000010000c90d cmd_sync_delayed + 477 12 imap 0x000000010000716a client_handle_input + 409 13 imap 0x0000000100007244 client_input + 148 14 imap 0x0000000100071228 io_loop_handler_run + 272 15 imap 0x00000001000705ed io_loop_run + 55 16 imap 0x000000010000e219 main + 1635 17 imap 0x00000001000016c0 start + 52 I have since configured more open files, and enabled core dumps and added the pid to the mail_log_prefix for better tracking, but this is all I have to work with for now. Too bad the values of min_file_seq and max_file_seq are not logged in the panic.

2 1

[Dovecot] Dovecot+Sieve
by Andrey Garkin 13 Apr '09

13 Apr '09

Hi All!!! I'm configure mail server with Postix+Mysql+Dovecot. How can I'm using to work sieve plugins? My dovecot.conf /protocol lda { mail_plugin_dir = /usr/lib/dovecot/lda #sendmail_path = /usr/sbin/postfix #auth_socket_path = /var/run/dovecot/auth-master mail_plugins = cmusieve #global_script_path = /etc/sieve.conf } plugin { sieve = /etc/sieve.conf sieve = /home/vmail/domain.ru/user(a)domain.ru/.dovecot.sieve/ My sieve.conf cat sieve.conf /require "fileinto"; if header :contains "Subject" "***SPAM***" { fileinto ".Spam"; stop; My .dovecot.sieve require "fileinto"; if header :contains "Subject" "***SPAM***" { fileinto ".Spam"; stop; }/ The mail server is already installed and work, but the sieve plugins is not work((( /ls /usr/lib/dovecot/lda lib01_acl_plugin.so lib11_trash_plugin.so lib20_expire_plugin.so lib20_mail_log_plugin.so lib90_cmusieve_plugin.la lib10_quota_plugin.so lib20_convert_plugin.so lib20_fts_plugin.so lib21_fts_squat_plugin.so lib90_cmusieve_plugin.so/ All messages marked as ***SPAM*** , get to a folder the .INBOX... _Sieve plugins is not working._ In what there can be a problem? Thanks for All!!! Best Regards Andrey...

4 5

[Dovecot] How can I skip EOH in headers?
by Konstantin Lepa 13 Apr '09

13 Apr '09

Hello. My callback for get_stream is called from mail_get_stream in mail_storage_copy. Further, mbox_save_init is called and it called mbox_save_get_input_stream. backtrace (A) for my callback: #0 i_stream_header_filter_read (stream=0x8147e00) at istream-header- filter.c:314 #1 0x080cdbaa in parse_header (mstream=0x8147e00) at istream-header- filter.c:356 #2 0x080cdc0c in i_stream_header_filter_seek (stream=0x8147e00, v_offset=0, mark=false) at istream-header-filter.c:370 #3 0x080dea5b in i_stream_seek (stream=0x8147e28, v_offset=0) at istream.c:155 #4 0x080dfeae in i_stream_create_concat (input=0x8115528) at istream- concat.c:260 #5 0x2831e03d in rarules_get_stream (mail=0x8141860, hdr_size=0x0, body_size=0x0, stream_r=0xbfbfe920) at /home/pitman/work/rarules/src/rarules-plugin.c:181 #6 0x0809d830 in mail_get_stream (mail=0x8141860, hdr_size=0x0, body_size=0x0, stream_r=0xbfbfe920) at mail.c:149 #7 0x0809d936 in mail_storage_copy (t=0x811b980, mail=0x8141860, flags=0, keywords=0x0, dest_mail=0x0) at mail-copy.c:17 #8 0x080a0632 in mailbox_copy (t=0x811b980, mail=0x8141860, flags=0, keywords=0x0, dest_mail=0x0) at mail-storage.c:763 #9 0x0805960d in deliver_save (namespaces=0x8121c68, storage_r=0xbfbfeb94, mailbox=0x811a360 "Draft", mail=0x8141860, flags=0, keywords=0x0) at deliver.c:234 ... backtrace (B) for mbox_save_init: #0 mbox_save_get_input_stream (ctx=0x811bb00, input=0x814c728) at mbox-save.c:384 #1 0x08078165 in mbox_save_init (_t=0x811b980, flags=0, keywords=0x0, received_date=1239634649, timezone_offset=0, from_envelope=0x80f292b "MAILER-DAEMON", input=0x814c728, dest_mail=0x8150060, ctx_r=0xbfbfe924) at mbox-save.c:512 #2 0x080a0560 in mailbox_save_init (t=0x811b980, flags=0, keywords=0x0, received_date=-1, timezone_offset=0, from_envelope=0x80f292b "MAILER-DAEMON", input=0x814c728, dest_mail=0x0, ctx_r=0xbfbfe924) at mail-storage.c:728 #3 0x0809d9c4 in mail_storage_copy (t=0x811b980, mail=0x8141860, flags=0, keywords=0x0, dest_mail=0x0) at mail-copy.c:28 #4 0x080a0632 in mailbox_copy (t=0x811b980, mail=0x8141860, flags=0, keywords=0x0, dest_mail=0x0) at mail-storage.c:763 #5 0x0805960d in deliver_save (namespaces=0x8121c68, storage_r=0xbfbfeb94, mailbox=0x80f2af9 "INBOX", mail=0x8141860, flags=0, keywords=0x0) at deliver.c:234 ... The function mbox_save_get_input_stream calls i_stream_create_header_filter and i_stream_create_concat. The function read_header (istream-header-filter.c) finds EOH for call of i_stream_seek (backtrace B), but my calls of i_stream_create_header_filter and i_stream_create_concat doesn't find EOH (backtrace A). Why? I don't understand. I want to call rarules_header_callback for disable eoh so as to add my headers. Thanks P.S. Sorry for my bad english :-( It's mbox_save_get_input_stream: -------------------------------------------- mbox_save_get_input_stream(struct mbox_save_context *ctx, struct istream *input) { struct istream *filter, *ret, *cache_input, *streams[3]; /* filter out unwanted headers and keep track of headers' MD5 sum */ filter = i_stream_create_header_filter(input, HEADER_FILTER_EXCLUDE | HEADER_FILTER_NO_CR | HEADER_FILTER_ADD_MISSING_EOH, mbox_save_drop_headers, mbox_save_drop_headers_count, save_header_callback, ctx); if ((ctx->mbox->storage->storage.flags & MAIL_STORAGE_FLAG_KEEP_HEADER_MD5) != 0) { /* we're using MD5 sums to generate POP3 UIDLs. clients don't like it much if there are duplicates, so make sure that there can't be any by appending our own X-Delivery-ID header. */ const char *hdr; T_BEGIN { mbox_save_x_delivery_id(ctx); } T_END; hdr = ctx->x_delivery_id_header; streams[0] = i_stream_create_from_data(hdr, strlen(hdr)); streams[1] = filter; streams[2] = NULL; ret = i_stream_create_concat(streams); i_stream_unref(&filter); filter = ret; } It's my callback for get_stream: --------------------------------------- static int rarules_get_stream(struct mail *mail, struct message_size *hdr_size, struct message_size *body_size, struct istream **stream_r) { struct rarules_mail *m = RA_MAIL_CONTEXT(mail); struct istream *stream = NULL; unsigned int deleted = 0; unsigned int added = 0; int ret = 0; DPRINT("func is called"); /* standard get_stream for mail storage format */ ret = m->module_ctx.super.get_stream(mail, hdr_size, body_size, &stream); added = array_count(&m->add_hdr_arr); deleted = array_count(&m->del_hdr_arr); if (m->enabled && (deleted || added)) { struct istream * tmp = NULL; struct istream **chunks = NULL; const unsigned int max_chunks = 4; unsigned int i = 0; unsigned int cnt = 0; DPRINT("modifing message headers"); /* create message from chunks with new hdrs and skip excluded hdrs */ chunks = t_new(struct istream *, max_chunks); chunks[cnt++] = make_header_filter(stream, &m->del_hdr_arr, deleted); if (added) { chunks[cnt++] = create_header_stream(&m->add_hdr_arr, added); } chunks[cnt++] = create_stream_for_msgbody(stream); chunks[cnt++] = NULL; tmp = i_stream_create_concat(chunks); for (i = 0; chunks[i] != NULL; ++i) { i_stream_unref(&chunks[i]); } i_stream_unref(&stream); stream = tmp; } *stream_r = stream; DPRINT("func is executed"); return ret; }

1 0

[Dovecot] Issue with converting users from cyrus user.domain.com
by Preston Lord 13 Apr '09

13 Apr '09

I have been using cyrus for the past 6 years, but it is a pain to config. So ... I just installed dovecot 1.0.15 on a new debian 4r7 box. In cyrus we were using usernames as "user.domain.tld". In dovecot I realize I can: auth_username_translation = .@ But this converts user.domain.tld to user@domain@tld which of course fails. Is there a regex or something I can apply to pull this off? I also tried auth_username_format = %n.%d But I think this does the opposite of what I need. Any help is GREATLY appreciated. Thanks in advance P.

4 7

[Dovecot] deliver vs lda
by Timo Sirainen 12 Apr '09

12 Apr '09

deliver is the binary name. but it's configured inside protocol lda {} section. This is getting annoying, any thoughts on what would be a good unifying name? a) deliver binary, protocol deliver {} b) lda binary, protocol lda {} c) dovecot-lda binary, protocol lda {} d) mda binary, protocol mda {} e) dovecot-mda binary, protocol mda {} f) something else? In any case protocol lda {} would work for a while longer for backwards compatibility. c) and e) choices also makes me think if e.g. imap and imap-login should be called dovecot-imap and dovecot-imap-login instead. People have had trouble finding them since ps|grep dovecot doesn't find them..

14 39

[Dovecot] Dovecot crash
by Wolfgang.Friebel＠desy.de 12 Apr '09

12 Apr '09

tonight dovecot 1.2beta4 crashed for the first time with an assertion failed. See attached log file. Around that time nobody was logged in into dovecot and there were no other mail deliveries going on. The mail in question should have been delivered to three recipients, one got the mail, the two others not. There is unfortunately no core dump file. I have attached the dovecot -n output as well. -- Wolfgang Friebel Deutsches Elektronen-Synchrotron DESY Phone/Fax: +49 33762 77372/216 Platanenallee 6 Mail: Wolfgang.Friebel AT desy.de D-15738 Zeuthen Germany

3 2

[Dovecot] allow_nets and deliver + userdb lookup
by Pavel Volkovitskiy 12 Apr '09

12 Apr '09

Hello! I'm trying to restrict imap logins to our internal network for several users, but this breaks dovecot delivery too Even if i set allow_nets to NULL or 0.0.0.0/0 deliver exits with "Error: Auth lookup returned failure" i'm running it as 'command = /usr/lib/dovecot/deliver -e -d "$local_part@$domain" -s' in exim.conf i guess delivery lookups should be independent of allow_nets i'm using dovecot 1.1.13 + managesieve patch -- Pavel

2 1

[Dovecot] SSL
by Mohsen Pahlevanzadeh 11 Apr '09

11 Apr '09

Dear all, I have installed qmail+dovecot+vpopmail. It work, Now i wanna enable ssl on dovecot.i have pop3 & imap on my dovocet.When i was reading SSL on wiki, i saw config of that i define 4 CA file(2cert+2key), But i see 2 ca file in mkcert.(1cert+1key) It seem wiki or mkcert.sh is incomplete. Please help me..... Yours, Mohsen

2 2

[Dovecot] outlook problem if TLS mailsettings are off
by Georg Käfer 10 Apr '09

10 Apr '09

Dear List, I dont know if its a dovecot config problem or whatever else issue. Behaviour: If I set /etc/dovecot/dovecot.conf: Following is valid with IMAP mailboxes only: disable_plaintext_auth = yes # outlook 2007 with TLS in/out enabled can show index of mails and klick on mail does preview / doubleklick opens mail PERFECT AS INTENDED disable_plaintext_auth = no # outlook 2007 with TLS/SSL OFF can show index of mails, but (double)-/klick on mail gives me "sandwatch"-mouspointer and I've to restart outlook again (and enable TLS again to get it work again) with POP3 mailbox both variants are working smoothly. Other ssl/tls settings: ssl_disable = no login_process_per_connection = yes using or not using following makes no difference... imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh I'm sad - but I can't force SSL/TLS for my users - so I can't "solve" this by using "disable_plaintext_auth = yes" Is there any way out of the dark? my data: gentoo linux dovecot 1.1.7 postfix 2.5.5 postfixadmin-2.2.1.1 mysql 5.0.70-r1 php 5.2.8-pl12 dovecot -n # 1.1.7: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-gentoo-r3 i686 Gentoo Base System release 1.12.11.1 ext3 protocols: pop3 pop3s imap imaps ssl_cert_file: /etc/ssl/dovecot/server.pem ssl_key_file: /etc/ssl/dovecot/server.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login mail_max_userip_connections(default): 10 mail_max_userip_connections(imap): 10 mail_max_userip_connections(pop3): 30 first_valid_uid: 8 last_valid_uid: 8 first_valid_gid: 12 last_valid_gid: 12 mail_privileged_group: mail mail_uid: mail mail_gid: mail mail_location: maildir:/var/mail/%d/%n/Maildir/:INDEX=/var/mail/%d/%n/indexes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: mail group: mail regards, Georg Kaefer

2 2

[Dovecot] Postfix + Dovecot + Sieve + SpamAssassin
by Sascha Scandella 10 Apr '09

10 Apr '09

Hello Until now I used Postfix in combination with Procmail and Dovecot. I am convinced that the Dovecot Sieve plugin is a much more elegant solution. So I changed to Postfix + Dovcecot Deliver + Dovecot + Sieve. If I understood correctly I cannot call other applications within a Sieve script. Until now I used Procmail to filter Spam Messages with SpamAssassin. Is there a possibility to filter spam messages before/after Dovecot deliver. I want to use the users .spammassassin user_prefs located in their home folder. I suppose if I use a content filter in Postfix this is to early, since the user is not known at that moment. Or am I wrong? Any help is highly appreciated. Best regards, Sascha

3 2

[Dovecot] About "Status" to the header
by ogu_yo＠yahoo.co.jp 10 Apr '09

10 Apr '09

hi list, I'd like to know about "Status" to the header on dovecot. I can see the "Status" to the header in /var/spool/mail/user if I check mail by using mutt, but I cannot see "Status" to the header if I check mail by using evolution, thunderbird etc. - /var/spool/mail/user -------------------------------------- To: test(a)test.example.com Subject: test Status: RO Content-Length: 0 Lines: 0 -------------------------------------- Then, there is a question. Which one is the reason of that cannot see "Status" to the header with evolution and thunderbird? - there isn't "Status" to the header - there is "Status" to the header, but just cannot see Thanks in advance. Regards, Yoko -------------------------------------- Power up the Internet with Yahoo! Toolbar. http://pr.mail.yahoo.co.jp/toolbar/

3 6

[Dovecot] sieve rules in MySQL?
by David Reid 10 Apr '09

10 Apr '09

Has anyone looked at modifying the sieve implementation to allow the use of MySQl to store the rules? david

4 3

[Dovecot] Panic: file mempool-system.c: line 104
by Martins Lazdans 09 Apr '09

09 Apr '09

Hello! I have used Dovecot for more than a year without problems, but today it just crashed with this message: dovecot: Apr 09 21:23:38 Panic: file mempool-system.c: line 104 (pool_system_realloc): assertion failed: (old_size == (size_t)-1 || mem == NULL || old_size <= malloc_usable_size(mem)) dovecot: Apr 09 21:23:38 Error: Raw backtrace: /usr/local/sbin/dovecot [0x805757c] -> /usr/local/sbin/dovecot [0x8057664] -> /usr/local/sbin/dovecot [0x80514e9] -> /usr/local/sbin/dovecot [0x8056edb] -> /usr/local/sbin/dovecot [0x805bcc1] -> /usr/local/sbin/dovecot [0x8055bbf] -> /usr/local/sbin/dovecot [0x8055d3b] -> /usr/local/sbin/dovecot [0x8055d87] -> /usr/local/sbin/dovecot [0x8062448] -> /usr/local/sbin/dovecot [0x805aadf] -> /usr/local/sbin/dovecot [0x805a5a7] -> /usr/local/sbin/dovecot [0x804d63a] -> /usr/local/sbin/dovecot [0x804da67] -> /usr/local/sbin/dovecot [0x804e4ce] -> /usr/local/sbin/dovecot [0x805a17a] -> /usr/local/sbin/dovecot [0x805adac] -> /usr/local/sbin/dovecot [0x8059f89] -> /usr/local/sbin/dovecot [0x8051b43] -> /lib/libc.so.6(__libc_start_main+0xd8) [0xb7e49df8] -> /usr/local/sbin/dovecot [0x804a451] dovecot --version 1.1.7 It seems, than some brute force attack caused this, here some more log: > dovecot: Apr 09 21:23:36 Info: auth(default): client out: FAIL 1 user=jennie > dovecot: Apr 09 21:23:36 Info: auth(default): client out: FAIL 1 user=jeffrey > dovecot: Apr 09 21:23:36 Info: auth(default): client out: FAIL 1 user=job > dovecot: Apr 09 21:23:36 Info: auth-worker(default): sql(jimmy,81.149.214.201): query: SELECT password FROM mailbox WHERE username = 'jimmy' AND active = '1' > dovecot: Apr 09 21:23:36 Info: auth(default): client in: AUTH 1 PLAIN service=pop3 lip=195.3.144.29 rip=81.149.214.201 lport=110 rport=34646 resp=<hidden> > dovecot: Apr 09 21:23:36 Info: auth-worker(default): sql(jimmy,81.149.214.201): unknown user For now I blocked this one IP (81.149.214.201), but wondering if this could happen again in the future? Don`t really understand what`s the problem. I have ~2Gb of memory free, so it can not be a out of memory issue. Any ideas? Thank you! -- Martins Lazdans

2 5

[Dovecot] dbox problem
by Xueron Nee 09 Apr '09

09 Apr '09

Hi, I have just tested the dbox format mailbox, it works fine. But when I create dir through imap with `create` command, it only creates the dir onder ~/dbox/mailboxes, such as ~/dbox/mailboxes/newfolder. There was no `dbox-Mails` dir created. So the newfolder was 'noselect'. But the new folders created by `autocreate` plugin was correct. -- Xueron Nee http://www.xueron.com

2 7

[Dovecot] Indexing of mails to speed up the IMAP SEARCH command
by Tassilo Horn 09 Apr '09

09 Apr '09

Hi all, I use a local dovecot server which is synchronized with my two imap accounts using OfflineIMAP. This works very nice and is highly usable. But one thing I'd like to improve is the slow IMAP search. When I search for a string in the subjects of all messages in a mailbox using some mail client, dovecot seems to grep all the messages in there. Is there a way to let dovecot index more informations which are then used to speed up the SEARCH command? Bye, Tassilo

5 9

[Dovecot] Moving IMAP folders to NFS volume.
by Frank Bonnet 09 Apr '09

09 Apr '09

Hello Due to lack of disk space on local disks I need to move all our imap folders to a NFS volume ( NetAPP filer ) I have a question about Dovecot indexes , is it better to remove all of them before copying folders to the NFS volume and let Dovecot rebuild all indexes when users restart to access to their imap folders ? Thanks a lot.

2 1

[Dovecot] Strange behavior of header_filter_callback
by Konstantin Lepa 09 Apr '09

09 Apr '09

Hello. I asked about the problem in http://markmail.org/message/zsry62fcig5hqka3 . And I created simple example plug-in for deliver. It is attached (I don't want to paste so much code) For compile in command-line run: # DOVECOT=<path to dovecot> gmake ...send mail... ...view dovecot lda log... # gmake clean # WITH_ONLY_HEADERS=1 DOVECOT=<path to dovecot> gmake ...send mail... ...view dovecot lda log... My log (notice strings start with #): deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: Loading modules from directory: /usr/local/lib/dovecot/lda deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: Module loaded: /usr/local/lib/dovecot/lda/lib90_example_plugin.so deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: auth input: uid=1002 deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: auth input: gid=1002 deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: auth input: home=/var/spool/mail/pitman(a)virtualworld.com deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_plugin_init is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: mbox: data=/var/spool/mail/pitman(a)virtualworld.com :INDEX=/var/indexes/pitman@virtualworld.com deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: mbox: INBOX defaulted to /var/spool/mail/pitman(a)virtualworld.com/inbox deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: fs: root=/var/spool/mail/pitman(a)virtualworld.com , index=/var/indexes/pitman(a)virtualworld.com, control=, inbox=/var/spool/mail/pitman(a)virtualworld.com /inbox deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_deliver_mail is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_get_stream is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func make_header_filter is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func create_header_stream is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func create_stream_for_msgbody is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: #Message 1: deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_get_stream is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func make_header_filter is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func create_header_stream is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func create_stream_for_msgbody is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: #Message 1: deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: msgid=: saved mail to INBOX deliver(pitman(a)virtualworld.com): Apr 08 13:52:39 Info: example: func example_plugin_deinit is called My log (WITH_ONLY_HEADERS=1): deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: Loading modules from directory: /usr/local/lib/dovecot/lda deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: Module loaded: /usr/local/lib/dovecot/lda/lib90_example_plugin.so deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: auth input: uid=1002 deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: auth input: gid=1002 deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: auth input: home=/var/spool/mail/pitman(a)virtualworld.com deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_plugin_init is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: mbox: data=/var/spool/mail/pitman(a)virtualworld.com :INDEX=/var/indexes/pitman@virtualworld.com deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: mbox: INBOX defaulted to /var/spool/mail/pitman(a)virtualworld.com/inbox deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: fs: root=/var/spool/mail/pitman(a)virtualworld.com , index=/var/indexes/pitman(a)virtualworld.com, control=, inbox=/var/spool/mail/pitman(a)virtualworld.com /inbox deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_deliver_mail is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_get_stream is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func make_header_filter is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Return-Path: <pupkin(a)virtualworld.com > deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Delivered-To: pitman(a)virtualworld.comm > deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Received: from localhost.virtualworld.com (localhost [127.0.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Received: by bsdman.virtualworld.com (Postfix) with ESMTP id 3B3E11FE for <pitman(a)virtualworld.com>; Wed, 8 Apr 2009 13:53:51 +0400 (MSD) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: 2009-04-08T13:53:51.199182+1 From: pupkin(a)virtualworld.com Reply-to: Konstantin(a)bsdman.virtualworld.com, Lepa(a)bsdman.virtualworld.com To: pitman(a)virtualworld.com Message-Id: <20090408095351.3B3E11FE(a)bsdman.virtualworld.com> Date: Wed, 8 Apr 2009 13:53:51 +0400 (MSD) Message 1 deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Received: for <pitman(a)virtualworld.com>; Wed, 8 Apr 2009 13:53:51 +0400 (MSD) Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: 2009-04-08T13:53:51.199182+1 From: pupkin(a)virtualworld.com Reply-to: Konstantin(a)bsdman.virtualworld.com, Lepa(a)bsdman.virtualworld.com To: pitman(a)virtualworld.com Message-Id: <20090408095351.3B3E11FE(a)bsdman.virtualworld.com> Date: Wed, 8 Apr 2009 13:53:51 +0400 (MSD) Message 1 deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Content-Type: text/plain; charset="us-ascii"m (localhost [127.0.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #MIME-Version: 1.0t/plain; charset="us-ascii"m (localhost [127.0.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Content- Transfer-Encoding: 7bit/plain; charset="us-ascii"m (localhost [127.0.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Subject: 2009-04-08T13:53:51.199182+1i"m (localhost [127.0.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #From: pupkin(a)virtualworld.com182+1i "m (localhost [127.0.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Reply-to: Konstantin(a)bsdman.virtualworld.com ,calhost [127.0.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Reply- to: Lepa(a)bsdman.virtualworld.com To: pitman(a)virtualworld.com Message-Id: <20090408095351.3B3E11FE(a)bsdman.virtualworld.com> Date: Wed, 8 Apr 2009 13:53:51 +0400 (MSD) Message 1 deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #To: pitman(a)virtualworld.comalworld.com ,calhost [127.0.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Message-Id: <20090408095351.3B3E11FE(a)bsdman.virtualworld.com >.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #Date: Wed, 8 Apr 2009 13:53:51 +0400 (MSD)alworld.com>.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: #: Wed, 8 Apr 2009 13:53:51 +0400 (MSD)alworld.com>.0.1]) deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_header_filter_callback is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_get_stream is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func make_header_filter is called deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: msgid=<20090408095351.3B3E11FE(a)bsdman.virtualworld.com >: saved mail to INBOX deliver(pitman(a)virtualworld.com): Apr 08 13:53:51 Info: example: func example_plugin_deinit is called

2 3

[Dovecot] dovecot 1.2-rc2 doesn't build on Solaris 10
by Laurent Blume 09 Apr '09

09 Apr '09

Hi all, Timo, When trying to build 1.2 rc2 on Solaris 10, with the same options and compiler as what works for 1.1.13, I get the following error: libtool: compile: cc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -O -m64 -I/usr/sfw/include -c quota-fs.c -KPIC -DPIC -o .libs/quota-fs.o "quota-fs.c", line 436: undefined symbol: GRPQUOTA cc: acomp failed for quota-fs.c *** Error code 1 make: Fatal error: Command failed for target `quota-fs.lo' Current working directory /export/espace/apps/src/network/dovecot-1.2.rc2/src/plugins/quota *** Error code 1 The compiler is Studio 12 patched, and the options used were: CFLAGS='-O -m64' \ SSL_LIBS="-R/usr/sfw/lib/64 -L/usr/sfw/lib/64 -lssl -lcrypto" \ ./configure --prefix=/opt/dovecot-1.2-rc2 \ --sysconfdir=/etc/opt/dovecot-rc \ --localstatedir=/var/dovecot-rc \ --with-rundir=/var/run/dovecot-rc \ --with-statedir=/var/dovecot-rc/lib \ --with-ioloop=best \ --with-zlib \ --with-bzlib \ --with-ssl=openssl \ --with-ssldir=/etc/certs \ --with-shadow \ --with-pam \ --with-ldap \ --enable-header-install Thanks, Laurent -- / Leader de Projet & Communauté | I'm working, but not speaking for \ G11N http://fr.opensolaris.org | Bull Services http://www.bull.com / FOSUG http://guses.org |

2 2

[Dovecot] Upgrade from 0.99.x to 1.1.x
by Wolfram Schlich 09 Apr '09

09 Apr '09

Hi! I want to upgrade a Dovecot installation from 0.99.14 to 1.1.15, so I had a look at the following wiki article: http://wiki.dovecot.org/Upgrading?action=show&redirect=UpgradingDovecot The article http://wiki.dovecot.org/Upgrading/1.0 says something about .customflags -> dovecot-keywords and .subscriptions -> subscriptions change/conversion: http://wiki.dovecot.org/Upgrading/1.0#Subscriptions http://wiki.dovecot.org/Upgrading/1.0#Keywords Do I understand it correctly that when directly upgrading from 0.99 to 1.1, Dovecot does the subscriptions renaming but not the keywords renaming and conversion, but that when I manually rename all .customflags files to dovecot-keywords, it does the format conversion of that file automatically? Is there anything else what's important to note for such an upgrade? The system is using Maildir as the mailbox format and only local storage (no NFS etc.). -- Regards, Wolfram Schlich <wschlich(a)gentoo.org> Gentoo Linux * http://dev.gentoo.org/~wschlich/

4 5

[Dovecot] crashed with shared namespace
by Xueron Nee 09 Apr '09

09 Apr '09

Hi, I have a shared namespace, which works fine yesterday. Today I have just updated my dovecot to the newest from hg.dovecot.org, and it crashed when list the shared namespace. namespace shared { separator = / prefix = shared/%%u/ location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u list = children subscriptions = no } cmd: # telnet localhost 143 Trying 127.0.0.1... Connected to localhost.localdomain (127.0.0.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN] AMOS READY a1 login test1(a)xueron.com ****** a1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH ACL RIGHTS=texk] Logged in a1 list "" "*" * LIST (\HasNoChildren) "/" "Sent" * LIST (\HasNoChildren) "/" "Spam" * LIST (\HasChildren) "/" "virtual" * LIST (\HasChildren) "/" "aaaaa" * LIST (\HasNoChildren) "/" "aaaaa/aaa" * LIST (\HasNoChildren) "/" "Junk" * LIST (\HasNoChildren) "/" "Draft" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "INBOX" * LIST (\Noselect \HasChildren) "/" "shared/xueron(a)xueron.com" * LIST (\HasNoChildren) "/" "public/test2" * LIST (\HasNoChildren) "/" "public/test4" * LIST (\HasNoChildren) "/" "public/test1" * LIST (\HasNoChildren) "/" "public/test3" * LIST (\HasChildren) "/" "shared/xueron(a)xueron.com/mydir" * LIST (\HasNoChildren) "/" "shared/xueron(a)xueron.com/mydir/subdir" * LIST (\HasNoChildren) "/" "shared/xueron(a)xueron.com/newdir" a1 OK List completed. a1 list "shared/" "*" Connection closed by foreign host. maillog: Apr 9 12:31:27 mail dovecot: Panic: IMAP(test1(a)xueron.com): file mail-user.c: line 30 (mail_user_init): assertion failed: (*username != '\0') Apr 9 12:31:27 mail dovecot: IMAP(test1(a)xueron.com): Raw backtrace: imap [0x80e7800] -> imap [0x80e785a] -> imap [0x80e711c] -> imap [0x80af7ab] -> imap(shared_storage_get_namespace+0x298) [0x8072708] -> imap [0x8071eef] -> imap [0x80601ec] -> imap(cmd_list_full+0x4ad) [0x8060bcd] -> imap(cmd_list+0x19) [0x8060ec9] -> imap [0x8063f9c] -> imap [0x806404b] -> imap(client_handle_input+0x2f) [0x8064aff] -> imap(client_input+0x63) [0x8064d33] -> imap(io_loop_handler_run+0x107) [0x80effc7] -> imap(io_loop_run+0x28) [0x80ef0d8] -> imap(main+0x754) [0x806d044] -> /lib/libc.so.6(__libc_start_main+0xdc) [0x901dec] -> imap [0x805cf11] Apr 9 12:31:27 mail dovecot: child 14971 (imap) killed with signal 6 (core dumps disabled btw: yesterday, there was such logs when 'list "shared/" "*"': Apr 8 17:03:37 mail dovecot: IMAP(test1(a)xueron.com): Invalid namespace prefix %u/ vs but no crash. Thanks :) -- Xueron Nee http://www.xueron.com

1 0

[Dovecot] Multiple use of the same LDAP attribute
by Bernhard Schmidt 09 Apr '09

09 Apr '09

Hi, we've found a weird bug (?) in Dovecot 1.1.11. Since day and age we've been running dovecot for our student mailserver, getting the location of the mailbox from a LDAP directory. We allow login and LDA with both full mail address and an internal username, so the mailbox directory is based on a LDAP attribute user_attrs = xxxMailbox=mail=maildir:/home/mailstore/%U$/Maildir:INDEX=/home/mailstore/indexes/%1U$/%U$, uidNumber=vmail, gidNumber=vmail, xxxMailQuota=quota_rule2=*:storage=%$B this worked just fine until we introduced sieve, which made us realize we did not have the home directory set at all. The obvious and easy fix (we thought) was to set the home directory based on the xxxMailbox variable as well: user_attrs = xxxMailbox=mail=maildir:/home/mailstore/%U$/Maildir:INDEX=/home/mailstore/indexes/%1U$/%U$, uidNumber=vmail, gidNumber=vmail, xxxMailQuota=quota_rule2=*:storage=%$B, xxxMailbox=home=/home/mailstore/%U$ unfortunately, after this trivial change hell froze over, because suddenly the mail variable was not set at all anymore, and since we had set mail_location = maildir:/home/mailstore/%Uu/Maildir:INDEX=/home/mailstore/indexes/%1Un/%Un (based on username) it was suddenly delivered into the wrong folder (based on the supplied username, not on the LDAP attribute). Debug from after the change: Apr 8 13:53:39 lxmhs23 dovecot: auth(default): ldap(username(a)xxx.de): user search: base=<deleted> scope=onelevel filter=<deleted> fields=xxxMailbox,uidNumber,gidNumber,xxxMailQuota,xxxMailbox Apr 8 13:53:39 lxmhs23 dovecot: auth(default): ldap(username(a)xxx.de): result: xxxMailQuota(quota_rule2=*:storage=%$B)=*:storage=1073741824B xxxMailbox(home=/home/mailstore/%U$)=/home/mailstore/1636D8B1D7916DEA/ [...] Apr 8 13:53:39 lxmhs23 deliver(username(a)xxx.de): maildir: data=/home/mailstore/USERNAME@XXX.DE/Maildir:INDEX=/home/mailstore/indexes/U/USERNAME As you can see the mail variable wasn't set by LDAP at all. We did some more tests and found a workaround, when using another LDAP (mwnid) attribute that contains the same information it works just fine user_attrs = xxxMailbox=mail=maildir:/home/mailstore/%U$/Maildir:INDEX=/home/mailstore/indexes/%1U$/%U$, uidNumber=vmail, gidNumber=vmail, xxxMailQuota=quota_rule2=*:storage=%$B, mwnid=home=/home/mailstore/%U$ Apr 8 14:18:06 lxmhs23 dovecot: auth(default): ldap(username(a)xxx.de): user search: base=<deleted> scope=onelevel filter=<deleted> fields=xxxMailbox,uidNumber,gidNumber,xxxMailQuota,mwnid Apr 8 14:18:06 lxmhs23 dovecot: auth(default): ldap(username(a)xxx.de): result: xxxMailQuota(quota_rule2=*:storage=%$B)=*:storage=1073741824B xxxMailbox(mail=maildir:/home/mailstore/%U$/Maildir:INDEX=/home/mailstore/indexes/%1U$/%U$)=maildir:/home/mailstore/1636D8B1D7916DEA//Maildir:INDEX=/home/mailstore/indexes/1/1636D8B1D7916DEA/ mwnid(home=/home/mailstore/%U$)=/home/mailstore/1636D8B1D7916DEA Apr 8 14:18:06 lxmhs23 deliver(username(a)xxx.de): maildir: data=/home/mailstore/1636D8B1D7916DEA//Maildir:INDEX=/home/mailstore/indexes/1/1636D8B1D7916DEA/ So, it looks like there is an issue using the same LDAP attribute (xxxMailbox in this case) twice in variable expansion. Is this a known issue? Of course there are several viable workarounds (base mail location on home directory, use the second attribute), but this problem was pretty surprising. Bernhard

4 6

[Dovecot] Trying nonplaintext mech with LDAP password-hash
by dovecotlist＠encambio.com 09 Apr '09

09 Apr '09

Hello List, The only passdb block in /pfx/etc/dovecot/dovecot.conf is: passdb ldap { args = /pfx/etc/dovecot/dovecot-ldap.conf } In /pfx/etc/dovecot/dovecot-ldap.conf: auth_bind = no dn = cn=mymgr,dc=host,dc=tld dnpass = ******** default_pass_scheme = LDAP-MD5 In /pfx/etc/openldap/slapd.conf: password-hash {MD5} If I try: $ /pfx/bin/ldapsearch <...> \ | grep '^userPassword' \ | sed -e 's;.*:: $.*$$;\1;' \ | mimencode -u ...I get the correct password (MD5 hashed.) According to wiki.dovecot.org/AuthDatabase/LDAP/PasswordLookups this should work, and indeed when starting dovecot it does not complain about: 'CRAM-MD5 mechanism can't be supported with given passdbs' Instead it starts right up, but when a thunderbird client connects and tries authenticating with CRAM-MD5 it fails. In the wiki page 'PasswordLookups' it mentions: Supports non-plaintext authentication mechanisms (if returning plaintext/properly hashed passwords). I've already verified that this works correctly with plaintext (CLEARTEXT in slapd.conf), but I really want to store the passwords in LDAP using some hash. Why doesn't LDAP-MD5 work as advertised? What did the author mean by 'properly hashed passwords'? Thanks. -- Eduard

2 2

[Dovecot] Dovecot 1.1.11 failing to accept SSL/TLS connections
by Mike Brudenell 08 Apr '09

08 Apr '09

Greetings - We are running Dovecot 1.1.11 on our servers and have been gradually migrating people off our old (UW-based) systems onto the new (Dovecot-based) ones. As a result the new systems are seeing more connections from more people. We have started seeing problems reported by users of our webmail service that they are getting an error indicating the webmail software (Prayer) has failed to establish an IMAP connection using TLS to Dovecot. Investigations show it is not just the webmail service that is affected but all mail clients: it's just other clients retry the connection, whereas Prayer fails the login and shows the error message: TLS/SSL failure for username.imap.york.ac.uk: SSL negotiation failed It seems to be related to one of Dovecot's imap-login processes getting a lot of file descriptors in use. We initially spawn off 10 imap-login processes and have each handling 256 connections. Full "dovecot -n" at the end of the message, but the relevant settings here are: login_process_size = 64 login_process_per_connection = no login_processes_count = 10 login_max_processes_count = 128 login_max_connections = 256 We have grown to suspect it is to do with one of the imap-login processes having a large number of files open. Killing the process seems to get rid of the problem. For example currently we have 11 imap-login processes running, one of which has 518 open files -- process 12436 in the list below. I suspect that, as in previous times we've encountered the problem, killing this process will alleviate the problem. (I'll be doing this later on this evening.) It is slightly odd that the imap-login processes have a very skewed distribution of open files, almost as if the algorithm for allocating connections to a process favours some over others. For example the current counts of open files are: Pid = Open files count 12430 = 42 26818 = 237 12431 = 90 12433 = 12 12438 = 304 12437 = 106 12435 = 190 12432 = 14 12436 = 518 12434 = 32 12429 = 12 Process 12436 was one of the 10 imap-login processes initially created back on March 3rd. (Process 26818 was the additional imap-login process spawned a little later on March 4th.) I don't believe the problem lies with the available file descriptors on the system: in the script which starts Dovecot I do date >/var/run/dovecot-limits ulimit -Sa >>/var/run/dovecot-limits echo "----------" >>/var/run/dovecot-limits ulimit -Ha >>/var/run/dovecot-limits ulimit -Sn 10128 echo "==========" >>/var/run/dovecot-limits ulimit -Sa >>/var/run/dovecot-limits echo "----------" >>/var/run/dovecot-limits ulimit -Ha >>/var/run/dovecot-limits $DOVECOT >>/var/run/dovecot-limits 2>&1 (The magic 10128 number came from Dovecot 1.1.11 itself, complaining that the number I had originally was too low.) Likewise the output of the pfiles command on process 12436 (which is the one I believe to be problematic) indicates its limit still has some available -- I'm guessing Dovecot has reduced the limit down to 533 from the 10128 set in the startup script: Current rlimit: 533 file descriptors We originally saw this problem with Dovecot 1.0.3 which we were running up until a couple of weeks ago. From there I upgraded first to 1.0.15 and then to 1.1.11. I'd hoped that upgrading would fix the problem: I see it has been mentioned before on the list, but not for a year or two. Can anyone give any help, please? Cheers, Mike Brudenell Configuration info Platform: Solaris 10 dovecot -n output is : # 1.1.11: /usr/local/dovecot-1.1.11/etc/dovecot.conf # OS: SunOS 5.10 i86pc ufs base_dir: /var/run/dovecot/ log_path: /logfiles/mail/live/dovecot listen: *:143 ssl_listen: *:993 ssl_cert_file: /usr/local/dovecot/ssl/certs/imapservice-bundle-2007.pem ssl_key_file: /usr/local/dovecot/ssl/private/imapservice-key-2007.pem disable_plaintext_auth: no shutdown_clients: no login_dir: /var/run/dovecot/login login_executable: /usr/local/dovecot-1.1.11/libexec/dovecot/imap-login login_log_format_elements: user=<%Lu> method=%m rip=%r lip=%l %c login_process_per_connection: no login_greeting_capability: yes login_processes_count: 10 max_mail_processes: 10000 mail_max_userip_connections: 20 mail_location: maildir:/mailstore/messages/%1Ln/%Ln/Maildir:INDEX=/mailstore/index/%1Ln/%Ln:CONTROL=/mailstore/control/%1Ln/%Ln mail_plugins: quota imap_quota fts fts_squat mail_log_prefix: [%p]%Us(%Lu): imap_client_workarounds: delay-newmail namespace: type: private separator: / inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login cache_size: 1024 cache_ttl: 600 username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890 username_format: %Ln passdb: driver: shadow userdb: driver: passwd plugin: fts: squat fts_squat: partial=4 full=4 quota: fs:user

3 8

[Dovecot] Prohibit removing INBOX
by floss＠pbartels.info 08 Apr '09

08 Apr '09

Hello list, I'm using dovecot 1.1.11 and I'm going to prohibit users to remove their INBOX and some other directories in the mailbox root. I used Access Control Lists (http://wiki.dovecot.org/ACL) to do this: protocol imap { mail_plugins = acl } plugin { # With global ACLs in /etc/dovecot/acls/ directory: acl = vfile:/etc/dovecot/acls } /etc/dovecot/acls/.DEFAULT: owner lrwstie /etc/dovecot/acls/INBOX/.DEFAULT owner lrwstiekxa Actually - its not possible to create/remove directories under the mailbox root - its possible to create directories under INBOX - its NOT possible to remove directories under INBOX (This is my problem.) I tried symlinks like: /var/mail/.../INBOX/dovecot-acl -> /etc/dovecot/acls/INBOX/.DEFAULT /var/mail/.../dovecot-acl -> /etc/dovecot/acls/.DEFAULT But I think the symlink won't help because they doesn't change anything. And even with the symlinks its not possible to remove directories under IBOX. The documentation says: > If a mailbox has both global and per-mailbox ACL file, both of them > are read and the ACLs are merged. If there are any conflicts: > * v1.0 and v1.1: The per-mailbox ACL file overrides global ACL file. As far I can see it the documentation says nothing about merging ACLs of subdirs. But it seems the given behavior is not wanted by the dovecot design, because it seems it should be possible to override ACLs for subdirs, also give more permissions than the upper dirs. Is this a dovecot failure, do I miss something or is it really wanted by dovecot this way? My MUA (Evolution) says: > Cannot delete folder "INBOX/test". > Because "IMAP command failed: Permission denied". It unsubscribes the folder but it not able to remove it. Logs: dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /etc/dovecot/acls//.DEFAULT dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /var/mail/domain1.tld/address1/mail/dovecot-acl dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /etc/dovecot/acls/INBOX/.DEFAULT dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /var/mail/domain1.tld/address1/mail/INBOX/dovecot-acl dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /etc/dovecot/acls/INBOX/.DEFAULT dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /var/mail/domain1.tld/address1/mail/INBOX/dovecot-acl dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /etc/dovecot/acls/INBOX/.DEFAULT dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /var/mail/domain1.tld/address1/mail/INBOX/dovecot-acl dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /etc/dovecot/acls/INBOX/.DEFAULT dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /var/mail/domain1.tld/address1/mail/INBOX/dovecot-acl dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /etc/dovecot/acls/INBOX/.DEFAULT dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /var/mail/domain1.tld/address1/mail/INBOX/dovecot-acl dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /etc/dovecot/acls//.DEFAULT dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /var/mail/domain1.tld/address1/mail/dovecot-acl dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /etc/dovecot/acls//.DEFAULT dovecot: 2009-04-05 13:21:22 Info: IMAP(address1(a)domain1.tld): acl vfile: reading file /var/mail/domain1.tld/address1/mail/dovecot-acl Thanks in advance Philipp Bartels

3 2

[Dovecot] Dovecot, LVS and the issues I have with it.
by neil 08 Apr '09

08 Apr '09

We run around 5 dovecot (debian etch 1.0.rc15) POP/IMAP 'nodes' using the LVS load balancer and an NFS based SAN. it works pretty well. I love the robustness of load balancing POP/IMAP. We do a reasonable amount of throughput through these especially at peak times pushing our SAN to around 1.5k IOP/s We currently have two issues with this setup. One of which is NFS index corruption issues we get due to NFS/dovecot locking. Basically the UUID list or a .index gets corrupt. This causes a full re-indexing of the mailbox / broken mailbox until i delete the indexes. In the UUID lists case the symptom tends to effect use who use POP rather than IMAP and insist on keeping messages on the server. Because it's corrupt it gets rebuilt one way or the other and the users email client proceeds to redownload the entire mailbox again until he remarks them to be saved. This tends to annoy the user a lot. After a bit of testing we do however expect this to be fixed by version 1.1. However if anyone has any comments on this I would certainly be interested. The other issue is a little tricky to describe or even log effectively. Occasionally a node basically receives more connections than it is able to handle. The connection count goes through the roof for that node. It will go up way beyond 150 dovecot authentication threads and 100 or so active POP/IMAP dovecot threads. The IO_wait/cpu and memory usage also tends to be spiking at this point. The server gets to the tipping point where it can no longer serve it's POP/IMAP requests fast enough compared to the number of connections it's getting. I'd be fine with this but this creates some less than desirable symptoms: 1. We obviously reach the auth thread cap eventually so any new auth requests basically get refused by the server. To the user this is a seen as an outlook/mail client re-auth pop-up request. This annoys them. Ideally if the server stops accepting auth requests it should fall off our load balancer until it can consistently accept them again. Since the LVS detects a node fail by whether the tcp port is still open this doesn't happen, since dovecot keeps the port open. This is obviously more an LVS issue and not for this mailing list I expect unless anyone has any config tweaking tips here? 2. Now here's my real gripe. Dovecot does not handle running out resources very gracefully at all in our setup. It does start killing threads after a while. I get multiple *"dovecot: child 17989 (login) killed with signal 9". *I'm not exactly sure what's going on here because after this all I can see is the machine totally out of memory and the kernel starts killing absolutely everything. All services are killed (including ssh etc..) and I plug a monitor into the server and find the last few lines of the console listing init and other rather important things having just been killed. At this point it is a case of power cycling the server and all is back to normal again. I imagine there's not a huge amount of people using dovecot in this way. But anyone got any recommendations here? I really like using dovecot in this setup it handles it pretty well and the redundancy and functionality options it provides have been invaluable. Neil

4 3

[Dovecot] Global Sieve File
by James Butler 08 Apr '09

08 Apr '09

Is anyone here using a global Sieve file that handles messages for an entire server with many users? I understand and use local Sieve files, but I would like to learn more about how to set up Sieve to filter ALL incoming messages using a single file. I would love to read about how you managed to get it working. I'm running Fedora 10 with Postfix 2.5.5 and Dovecot 1.2.rc2. Thanks for any insight! James

4 6

[Dovecot] dovecot doesnt see any emails
by alexus 08 Apr '09

08 Apr '09

$ dovecot --version 1.1.13 $ grep ^mail_location /usr/local/etc/dovecot.conf mail_location = maildir:~vpopmail/domains/%d/%u/Maildir/ $ i use SquirrelMail as a client to IMAP in, but when I login, I dont see any emails in my INBOX I even tried pop3 same story $ telnet localhost pop3 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. USER XXXXXX(a)XXX.XXX +OK PASS XXXXXX +OK Logged in. UIDL +OK . QUIT +OK Logging out. Connection closed by foreign host. $ -- http://alexus.org/

4 8

[Dovecot] Compiling v1.3 on different OSes
by Timo Sirainen 08 Apr '09

08 Apr '09

I was hoping to finally get shared libdovecot.so and libdovecot-storage.so libraries for v1.3, so Sieve (and maybe others) could link against them. But I'm running into trouble getting it to compile in Solaris 10. Could you non-Linux users test if this compiles with you? http://dovecot.org/tmp/dovecot-1.3.UNSTABLE.tar.gz Or if anyone has ideas why this happens, I'd like to know: libtool: link: gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -I/home/cras/include -o .libs/rawlog rawlog.o ../lib-dovecot/.libs/libdovecot.so -lrt -lsocket -lsendfile -Wl,-rpath -Wl,/usr/local/lib/dovecot ../lib-dovecot/.libs/libdovecot.so: undefined reference to `dlerror(a)SUNW_1.22' ../lib-dovecot/.libs/libdovecot.so: undefined reference to `dlopen(a)SUNW_1.22' ../lib-dovecot/.libs/libdovecot.so: undefined reference to `dlsym(a)SUNW_1.22' ../lib-dovecot/.libs/libdovecot.so: undefined reference to `dlclose(a)SUNW_1.22' If I disable plugins (so dl*() functions aren't used) it compiles, so it's only those functions that are problematic. pvs -s /lib/libc.so lists the dl* functions under SUNW_1.22 so I'd think that should have worked..

9 20

[Dovecot] Segfault in dovecot 1.2rc2 with quota + public namespace enabled
by Markus Werner 07 Apr '09

07 Apr '09

Hi, I have configured a public namespace ("#Shared"). Since dovecot 1.2rc2 (1.1.11 worked fine) I get a segfault, if I try to access a folder under this namespace when quota plugin is enabled. When the quota plugin is disabled, accessing those folders works. $ dovecot -n # 1.2.rc2: /opt/dovecot/etc/dovecot.conf # OS: Linux 2.6.26-1-686 i686 Debian 5.0 base_dir: /var/run/dovecot protocols: imap pop3 listen: 127.0.0.1,192.168.128.151 ssl_listen: 192.168.128.151 ssl_ca_file: /opt/dovecot/etc/certs/cacert.pem ssl_cert_file: /opt/dovecot/etc/certs/asterixCert.pem ssl_key_file: /opt/dovecot/etc/certs/asterixKey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: ALL:!LOW:!SSLv2 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /opt/dovecot/libexec/dovecot/imap-login login_executable(imap): /opt/dovecot/libexec/dovecot/imap-login login_executable(pop3): /opt/dovecot/libexec/dovecot/pop3-login login_user: dovecotl login_process_per_connection: no login_processes_count: 1 login_max_processes_count: 3 max_mail_processes: 100 mail_max_userip_connections: 8 first_valid_uid: 2000 last_valid_uid: 2000 first_valid_gid: 2000 last_valid_gid: 2000 mail_access_groups: dovecot mail_uid: 2000 mail_gid: 2000 mail_location: maildir:~/Maildir mail_debug(default): yes mail_debug(imap): yes mail_debug(pop3): no mail_executable(default): /opt/dovecot/libexec/dovecot/imap mail_executable(imap): /opt/dovecot/libexec/dovecot/imap mail_executable(pop3): /opt/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota acl imap_acl fts fts_squat mail_plugins(imap): quota imap_quota acl imap_acl fts fts_squat mail_plugins(pop3): mail_plugin_dir(default): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /opt/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /opt/dovecot/lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes namespace: type: private separator: / prefix: INBOX/ inbox: yes list: yes subscriptions: yes namespace: type: public separator: / prefix: #Shared/ location: maildir:/var/spool/dovecot/sharedfolders:INDEX=~/Maildir/index/public:CONTROL=~/Maildir/control/public list: yes subscriptions: yes namespace: type: shared separator: / prefix: #User/%%u/ location: maildir:%%h/Maildir:INDEX=~/Maildir/index/shared/%%u list: yes auth default: mechanisms: plain login user: dovecota worker_max_count: 3 passdb: driver: passwd-file args: /opt/dovecot/etc/passwd userdb: driver: passwd-file args: /opt/dovecot/etc/passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 432 user: dovecota group: dovecot plugin: sieve: ~/.dovecot/.dovecot.sieve acl: vfile:/opt/dovecot/etc/dovecot-acls acl_shared_dict: file:/var/lib/dovecot/shared-mailboxes.db acl_anyone: allow quota: dict:user::file:%h/Maildir/dovecot-quota quota_rule: *:storage=10G:messages=500000 fts: squat fts_squat: partial=4 full=10 $ gdb /opt/dovecot/libexec/dovecot/imap /var/spool/dovecot/users/markus/core GNU gdb 6.8-debian Copyright (C) 2008 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "i486-linux-gnu"... warning: Can't read pathname for load map: Input/output error. Reading symbols from /lib/i686/cmov/libdl.so.2...done. Loaded symbols for /lib/i686/cmov/libdl.so.2 Reading symbols from /lib/i686/cmov/libc.so.6...done. Loaded symbols for /lib/i686/cmov/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 Reading symbols from /opt/dovecot/lib/dovecot/imap/lib01_acl_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib01_acl_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib02_imap_acl_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib02_imap_acl_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib10_quota_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib10_quota_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib20_fts_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib20_fts_plugin.so Reading symbols from /opt/dovecot/lib/dovecot/imap/lib21_fts_squat_plugin.so...done. Loaded symbols for /opt/dovecot/lib/dovecot/imap/lib21_fts_squat_plugin.so Reading symbols from /lib/i686/cmov/libnss_compat.so.2...done. Loaded symbols for /lib/i686/cmov/libnss_compat.so.2 Reading symbols from /lib/i686/cmov/libnsl.so.1...done. Loaded symbols for /lib/i686/cmov/libnsl.so.1 Reading symbols from /lib/i686/cmov/libnss_nis.so.2...done. Loaded symbols for /lib/i686/cmov/libnss_nis.so.2 Reading symbols from /lib/i686/cmov/libnss_files.so.2...done. Loaded symbols for /lib/i686/cmov/libnss_files.so.2 Core was generated by `imap'. Program terminated with signal 11, Segmentation fault. [New process 31957] #0 0x080ec1e2 in array_idx_modifiable_i (array=0x18, idx=0) at array.c:10 10 pos = idx * array->element_size; (gdb) bt full #0 0x080ec1e2 in array_idx_modifiable_i (array=0x18, idx=0) at array.c:10 pos = 0 #1 0xb7dbf88a in quota_get_mail_user_quota (user=0x0) at quota-storage.c:482 No locals. #2 0xb7db98d8 in quota_transaction_begin (box=0x9771440) at quota.c:739 user = (struct mail_user *) 0x0 #3 0xb7dbfdee in quota_mailbox_transaction_begin (box=0x9771440, flags=MAILBOX_TRANSACTION_FLAG_HIDE) at quota-storage.c:87 t = (struct mailbox_transaction_context *) 0x977bac0 qt = <value optimized out> #4 0xb7daf55e in fts_transaction_begin (box=0x9771440, flags=MAILBOX_TRANSACTION_FLAG_HIDE) at fts-storage.c:937 fbox = (struct fts_mailbox *) 0x978ac80 t = <value optimized out> #5 0x080b38ae in mailbox_transaction_begin (box=0x9771440, flags=MAILBOX_TRANSACTION_FLAG_HIDE) at mail-storage.c:787 trans = (struct mailbox_transaction_context *) 0x18 #6 0x08069f2b in imap_fetch_begin (ctx=0x9769d18) at imap-fetch.c:349 No locals. #7 0x08061bb0 in cmd_fetch (cmd=0x9769bd8) at cmd-fetch.c:226 client = <value optimized out> ctx = (struct imap_fetch_context *) 0x9769d18 args = (const struct imap_arg *) 0x976ec58 next_arg = (const struct imap_arg *) 0x18 search_args = (struct mail_search_args *) 0x9773ba8 messageset = <value optimized out> ret = <value optimized out> #8 0x0806700c in client_command_input (cmd=0x9769bd8) at client.c:603 client = (struct client *) 0x9769948 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #9 0x080670a9 in client_command_input (cmd=0x9769bd8) at client.c:652 client = (struct client *) 0x9769948 command = <value optimized out> __PRETTY_FUNCTION__ = "client_command_input" #10 0x080676ed in client_handle_input (client=0x9769948) at client.c:693 _data_stack_cur_id = 3 ret = <value optimized out> remove_io = <value optimized out> handled_commands = false #11 0x08067ba3 in client_input (client=0x9769948) at client.c:748 cmd = <value optimized out> output = (struct ostream *) 0x9769afc bytes = <value optimized out> __PRETTY_FUNCTION__ = "client_input" #12 0x080f73f0 in io_loop_handler_run (ioloop=0x9762ae8) at ioloop-epoll.c:208 ctx = (struct ioloop_handler_context *) 0x9762bf0 event = (const struct epoll_event *) 0x9762c30 list = (struct io_list *) 0x9769b80 io = (struct io_file *) 0x9769b58 tv = {tv_sec = 1, tv_usec = 729686} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #13 0x080f6880 in io_loop_run (ioloop=0x9762ae8) at ioloop.c:338 No locals. #14 0x080704c5 in main (argc=Cannot access memory at address 0x0 ) at main.c:320 No locals. -- Markus

2 4

Re: [Dovecot] Compiling v1.3 on different OSes
by Alan Ferrency 07 Apr '09

07 Apr '09

> On Mon, 2009-04-06 at 14:08 -0400, Timo Sirainen wrote: > > http://dovecot.org/tmp/dovecot-1.3.UNSTABLE.tar.gz > > OK, updated the URL once more. Now iconv problems should be gone? And > everyone else is happy with it too? :) It worked fine in FreeBSD 6.2. Thanks, Alan Ferrency pair Networks, Inc.

1 0

[Dovecot] v1.3 plugin locations
by Timo Sirainen 07 Apr '09

07 Apr '09

It's getting more and more annoying to have separate plugin directories for lda, pop3 and imap. Currently all the plugins are installed into $lib/dovecot/ and then symlinked to the lda, pop3, imap directories. The original reason was that v0.99 just loaded everything in those directories since there was no mail_plugins setting. But then there are things like expire-tool and convert-tool (and the upcoming doveadm) that don't load plugins at all, even though they probably should. Adding just more directories to them seems to be pointless. Also SQL plugins are shared by dovecot-auth and dict and those would need symlinking.. And in future you might want to load SQL plugins to e.g. imap process. So, I was planning on just putting everything into $lib/dovecot/. expire-tool etc. would use mail_plugins setting that wasn't inside protocol {}. So for example: mail_plugins = quota protocol lda { mail_plugins = quota sieve } protocol imap { mail_plugins = quota imap_quota } protocol pop3 { # defaults to mail_plugins=quota above, no need to set it explicitly } That leaves auth and dict.. I was considering adding new auth_plugins and dict_plugins settings, but that might make it more difficult to start using distro-compiled Dovecot where sql, ldap, etc. are in plugins. So perhaps the auth/ and dict/ directories can stay and contain symlinks. But the $lib/dovecot/sql/ directory could go away and the sql plugins be stored just in $lib/dovecot/ among everything else. Any thoughts?

2 1

[Dovecot] Getting Error 24 device timeout
by Jones, Keven 07 Apr '09

07 Apr '09

Hello, Does anyone know what causes this error and how to fix this Begin 'Pop52-Bounceback'. Connect: 172.20.23.52 110 +OK USER bounceback +OK PASS *#*#*#*#*#* +OK Logged in. STAT ERROR! FUNCTION: MainLoop:Pop3Stat POP Account: Pop52-Bounceback Error: 24 Device Time-Out

2 5

[Dovecot] Compile and configure Solr plugin
by Rui Carneiro 07 Apr '09

07 Apr '09

Hi all, I'm having some kind of troubles on Solr's integration. I configured Dovecot with the Solr argument (--with-solr) and everything proceeded just fine. But, when I started Dovecot I got this error: Plugin fts_solr not found from directory /usr/lib64/dovecot/modules/imap Error: imap dump-capability process returned 89 Fatal: Invalid configuration in /etc/dovecot/dovecot.conf In fact, there is no Solr plugin in that directory. So I tried to make a symbolic link from where the compiled Solr plugin was to this directory: ln -s /usr/local/lib/dovecot/lib21_fts_solr_plugin.so And now I have the following error: dlopen(/usr/lib64/dovecot/modules/imap/lib21_fts_solr_plugin.so) failed: /usr/lib64/dovecot/modules/imap/lib21_fts_solr_plugin.so: undefined symbol: mailbox_get_virtual_box_patterns Couldn't load required plugins Error: imap dump-capability process returned 89 Fatal: Invalid configuration in /etc/dovecot/dovecot.conf I'm missing some steps in this installation for sure, do anyone have any clue? Thanks, Rui Carneiro

1 1

[Dovecot] Modified websieve for use with dovecot
by Wolfgang.Friebel＠desy.de 07 Apr '09

07 Apr '09

In order to let users construct a sieve filter using a GUI I have taken websieve.pl from Alain Turbide (for use with Cyrus) and modified it to work with dovecot. In order to get it working quickly I have removed all the code I did not need (e.g. ldap support, password authentication) and coded Kerberos5 auth (via GSSAPI or SASL) in. I understand that this makes the work mostly useless to others. As however the dovecot adaptations were done by removing internally used perl packages by ones on CPAN such as Mail::IMAPClient and Net::Managesieve that part of the code should be of a broader interest. If someone is interested to have a look or even wants to help make it again a more universal tool I have put the code on ftp://ftp-zeuthen.desy.de/pub/unix/mail/websieve.pl Current status: I have tested the creation and modification of sieve rules, inspecting and setting ACL's (dovecot 1.2), displaying quota and creating folders. All the other code (e.g. the part that deals with an administrative user) is untested and probably not compatible yet with the new perl modules used. -- Wolfgang Friebel Deutsches Elektronen-Synchrotron DESY Phone/Fax: +49 33762 77372/216 Platanenallee 6 Mail: Wolfgang.Friebel AT desy.de D-15738 Zeuthen Germany

1 0

[Dovecot] big picture
by Mohsen Pahlevanzadeh 07 Apr '09

07 Apr '09

Dear all, You & every mail-man saw Big Picture of qmail. I assumed qmail is black box.I want to extend big picture, i use qmail admin ,Devocot & vpopmail. I draw a few relation.Can you tell me whether i draw correct?Also i need to if i didn't draw relation tell me that i will draw that. Yours, Mohsen

2 2

[Dovecot] Script to install dovecot 1.2 plus Managerootsieve to CentOS5.2
by Bruce A. Mallett 07 Apr '09

07 Apr '09

I have no idea if this is of interest to anyone but it might save you some work .. I created a script that will install Dovecot 1.2-rc2 (currently) to a CentOS5.2 installation complete with Stephan Bosch's Managesieve, postfix, virtual users, LDAP, and LDAP personal address books. Oh right! .. and Squirrelmail plus various plugins (change LDAP password, LDIF import, Avelsieve). Also self-signed certificates are created from data supplied in a configuration file. I've stuck the required files here: http://www.nightstorm.com/~bam/CentOS5.2/ I did an install to a 32 bit CentOS so it has worked at least once on that architecture. It *should* work on a 64 bit as well (I provide the RPM) but I've not personally tested it. I am by no means an expert on any of this stuff (particularly the security aspects), so I'd certainly welcome any suggestions for ways to improve on the installation, the script, life, the universe, ... ;-) - Bruce

1 0

[Dovecot] Quota calculation problem with 1.2 beta 4
by Ralf Hildebrandt 07 Apr '09

07 Apr '09

Two of my users are reporting that their quota is not being recalculated ALTHOUGH they deleted lots and lots of mails. I'm using today's hg checkout of 1.2 beta 4 -- Ralf Hildebrandt Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.computerbeschimpfung.de Wen du nicht mit Können beeindrucken kannst, den verwirre mit Schwachsinn!

4 12

Re: [Dovecot] Compiling v1.3 on different OSes
by Alan Ferrency 07 Apr '09

07 Apr '09

Timo Sirainen <tss(a)iki.fi> wrote: > Could you non-Linux users test if this compiles with you? > > http://dovecot.org/tmp/dovecot-1.3.UNSTABLE.tar.gz During 'make' on FreeBSD 6, I get: /usr/local/bin/bash ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -I/usr/local/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT lib-signals.lo -MD -MP -MF .deps/lib-signals.Tpo -c -o lib-signals.lo lib-signals.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I/usr/local/include -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT lib-signals.lo -MD -MP -MF .deps/lib-signals.Tpo -c lib-signals.c -fPIC -DPIC -o .libs/lib-signals.o lib-signals.c: In function `lib_signal_code_to_str': lib-signals.c:47: error: `SEGV_MAPERR' undeclared (first use in this function) lib-signals.c:47: error: (Each undeclared identifier is reported only once lib-signals.c:47: error: for each function it appears in.) lib-signals.c:49: error: `SEGV_ACCERR' undeclared (first use in this function) lib-signals.c:55: error: `BUS_ADRALN' undeclared (first use in this function) lib-signals.c:57: error: `BUS_ADRERR' undeclared (first use in this function) lib-signals.c:59: error: `BUS_OBJERR' undeclared (first use in this function) % libtool --version ltmain.sh (GNU libtool) 1.5.22 (1.1220.2.365 2005/12/18 22:14:06) % gcc --version gcc (GCC) 3.4.4 [FreeBSD] 20050518 I hope this helps, and I'd be happy to perform further compilation tests. Alan Ferrency pair Networks, Inc.

2 4

[Dovecot] Adding Sieve Extensions
by James Butler 06 Apr '09

06 Apr '09

How can I add an extension to Dovecot's Sieve implementation? I would like to use 'editheader' and 'redirect'. Thank you! James

4 13

[Dovecot] v1.2: can't access other users shared INBOX
by Sascha Wilde 06 Apr '09

06 Apr '09

Hi *, when a user A shares his INBOX with another user B, the user B can't access its content: User A: g getacl INBOX * ACL INBOX A(a)example.com lrswipkxtecda B(a)example.com lrswipkxtecd g OK Completed User B: l list "" "*" * LIST (\Noselect \HasChildren) "/" "user" * LIST (\Noselect \HasChildren) "/" "user/A(a)example.com" * LIST (\HasChildren) "/" "INBOX" * LIST (\HasNoChildren) "/" "INBOX/Gesendet" * LIST (\HasChildren) "/" "user/A(a)example.com/foobar" * LIST (\HasNoChildren) "/" "user/A(a)example.com/INBOX" l OK List completed. s1 select "user/A(a)example.com" s1 NO [CANNOT] Invalid mailbox name s2 select "user/A(a)example.com/INBOX" s2 NO [NONEXISTENT] Mailbox doesn't exist: INBOX Actually there are two bugs to observe here: 1) "user/A(a)example.com" really should be accessible to user B. Why is it listed with "\Noselect"? 2) "user/A(a)example.com/INBOX" does not exist, so the error message is correct, but why does it appear in the listing in the first place? cheers sascha -- Sascha Wilde OpenPGP key: 4BB86568 http://www.intevation.de/~wilde/ http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

4 12

[Dovecot] big picture
by Mohsen Pahlevanzadeh 06 Apr '09

06 Apr '09

Dear all, You & every mail-man saw Big Picture of qmail. I assumed qmail is black box.I want to extend big picture, i use qmail admin ,Devocot & vpopmail. I draw a few relation.Can you tell me whether i draw correct?Also i need to if i didn't draw relation tell me that i will draw that. Yours, Mohsen

1 0

[Dovecot] Implementation of editheaders in dovecot
by Konstantin Lepa 06 Apr '09

06 Apr '09

Hello. I wrote the hook function for deliver. I want to add support of editheaders in the plug-in for dovecot. For this purpose I wrote the function rarules_get_stream. Remover of headrs works properly, but adding does not work. I took Timo Sirainen's advice from http://markmail.org/message/skb6arnll5gaopdr . Do I use a correct way of creation of a message? I give backtrace and a part of my code. Thanks, Konstantin uname -a: FreeBSD bsdman.virtualworld.com 6.4-RELEASE FreeBSD 6.4-RELEASE #0: Wed Nov 26 11:43:51 UTC 2008 root@dessler.cse.buffalo.edu:/usr/obj/ usr/src/sys/GENERIC i386 dovecot --version: 1.1.11 build: $ ./configure --localstatedir=/var --with-statedir=/var/db/dovecot -- without-shadow --enable-debug --with-ioloop=kqueue --disable-ipv6 -- with-gssapi --without-vpopmail --without-ldap --without-pgsql --with- mysql --without-sqlite --prefix=/usr/local --mandir=/usr/local/man -- infodir=/usr/local/info/ --build=i386-portbld-freebsd6.4 patches: in freebsd ports (gdb) bt #0 0x282f3a01 in memcpy () from /lib/libc.so.6 #1 0x080df555 in i_stream_concat_read_next (cstream=0x814aa00) at istream-concat.c:79 #2 0x080df784 in i_stream_concat_read (stream=0x814aa00) at istream- concat.c:136 #3 0x080de659 in i_stream_read (stream=0x814aa28) at istream.c:78 #4 0x080cd99a in i_stream_header_filter_read (stream=0x814e400) at istream-header-filter.c:322 #5 0x080de659 in i_stream_read (stream=0x814e428) at istream.c:78 #6 0x080dff26 in i_stream_crlf_read_common (cstream=0x814ad00) at istream-crlf.c:41 #7 0x080e01b3 in i_stream_crlf_read_lf (stream=0x814ad00) at istream- crlf.c:103 #8 0x080de659 in i_stream_read (stream=0x814ad28) at istream.c:78 #9 0x080e2611 in i_stream_tee_read (stream=0x814ae00) at istream- tee.c:122 #10 0x080de659 in i_stream_read (stream=0x814ae28) at istream.c:78 #11 0x080deea3 in i_stream_read_data (stream=0x814ae28, data_r=0xbfbfea88, size_r=0xbfbfea8c, threshold=1) at istream.c:322 #12 0x080d1744 in message_parser_read_more (ctx=0x8156468, block_r=0xbfbfea80, full_r=0xbfbfea27) at message-parser.c:117 #13 0x080d20ac in parse_next_body_to_eof (ctx=0x8156468, block_r=0xbfbfea80) at message-parser.c:411 #14 0x080d2ccf in message_parser_parse_next_block (ctx=0x8156468, block_r=0xbfbfea80) at message-parser.c:765 #15 0x080931d9 in index_mail_cache_parse_continue (_mail=0x8150060) at index-mail.c:1316 #16 0x0807838d in mbox_save_continue (_ctx=0x811bb00) at mbox-save.c:582 #17 0x080a05a8 in mailbox_save_continue (ctx=0x811bb00) at mail- storage.c:740 #18 0x0809d9df in mail_storage_copy (t=0x811b980, mail=0x8141860, flags=0, keywords=0x0, dest_mail=0x0) at mail-copy.c:33 #19 0x080a0632 in mailbox_copy (t=0x811b980, mail=0x8141860, flags=0, keywords=0x0, dest_mail=0x0) at mail-storage.c:763 #20 0x0805960d in deliver_save (namespaces=0x8121c68, storage_r=0xbfbfee14, mailbox=0x811a370 "Draft", mail=0x8141860, flags=0, keywords=0x0) at deliver.c:234 #21 0x2831fe8f in store_in (arg=0x811a370 "Draft", md=0xbfbfed00) at / home/pitman/work/rarules/src/actions.c:220 #22 0x2831f759 in rarules_execute_action (type=RARULES_ACTION_STORE_IN, arg=0x811a370 "Draft", md=0xbfbfed00) at /home/pitman/work/rarules/src/actions.c:57 #23 0x2831e70d in execute_actions (action=0x811a360, md=0xbfbfed00) at /home/pitman/work/rarules/src/rarules.c:98 #24 0x2831e692 in apply_rules (rule=0x811a320, md=0xbfbfed00) at /home/ pitman/work/rarules/src/rarules.c:80 #25 0x2831e56a in rarules_main (namespaces=0x8121c68, storage_r=0xbfbfee14, mail=0x8141860, db=0x8121000, destaddr=0xbfbfef62 "pitman(a)virtualworld.com", username=0x8113525 "pitman(a)virtualworld.com", mailbox=0x80f2a19 "INBOX") at /home/pitman/work/rarules/src/rarules.c:52 #26 0x2831da37 in rarules_deliver_mail (namespaces=0x8121c68, storage_r=0xbfbfee14, mail=0x8141860, destaddr=0xbfbfef62 "pitman(a)virtualworld.com", mailbox=0x80f2a19 "INBOX") at /home/pitman/work/rarules/src/rarules_plugin.c:126 #27 0x0805b69a in main (argc=3, argv=0xbfbfeeac) at deliver.c:1084 (gdb) f 1 #1 0x080df555 in i_stream_concat_read_next (cstream=0x814aa00) at istream-concat.c:79 79 memcpy(cstream->istream.w_buffer, data, data_size); (gdb) p data $4 = (const unsigned char *) 0x15 <Address 0x15 out of bounds> (gdb) p data_size $5 = 1 /////////////////////////////////////////My code///////////////////////////////////////////////////////// static int rarules_get_stream(struct mail * mail, struct message_size * hdr_size, struct message_size * body_size, struct istream ** stream_r) { struct rarules_mail * ra_mail = RARULES_MAIL_CONTEXT(mail); struct istream * stream = NULL; struct istream ** chunks = NULL; const unsigned int max_chunks = 4; unsigned int i = 0; unsigned int cnt = 0; unsigned int exclude_cnt = 0; unsigned int include_cnt = 0; int ret = 0; #if 1 {/* Test code */ const char * str = "Subject"; const char * str2 = "X-DSPAM: test value\n\n"; array_append(&ra_mail->exclude_headers, &str, 1); array_append(&ra_mail->include_headers, &str2, 1); } #endif DPRINT("Standard get_stream for mail storage format"); ret = ra_mail->module_ctx.super.get_stream(mail, hdr_size, body_size, &stream); include_cnt = array_count(&ra_mail->include_headers); exclude_cnt = array_count(&ra_mail->exclude_headers); if ((!exclude_cnt && !include_cnt) || ret < 0) { *stream_r = stream; return ret; } DPRINT("Create message from chunks with new headers and skip excluded headers"); chunks = t_new(struct istream *, max_chunks); chunks[cnt++] = header_filter(stream, &ra_mail->exclude_headers, exclude_cnt); if (include_cnt) { chunks[cnt++] = create_header_stream(&ra_mail->include_headers, include_cnt); } chunks[cnt++] = create_stream_for_msgbody(stream); chunks[cnt++] = NULL; *stream_r = i_stream_create_concat(chunks); DPRINT("Cleanup"); array_clear(&ra_mail->include_headers); array_clear(&ra_mail->exclude_headers); for (i = 0; chunks[i] != NULL; ++i) { i_stream_unref(&chunks[i]); } i_stream_unref(&stream); DPRINTF("Func `%s' executed", __FUNCTION__); return ret; } inline static struct istream * create_stream_for_msgbody(struct istream * stream) { struct istream * tmp = stream; struct message_size hdr_size; struct message_size body_size; DPRINTF("Func `%s' called", __FUNCTION__); message_get_body_size(stream, &body_size, NULL); message_get_header_size(stream, &hdr_size, NULL); i_stream_seek(stream, hdr_size.physical_size); stream = i_stream_create_limit(stream, body_size.physical_size); i_stream_unref(&tmp); return stream; } inline static struct istream * header_filter(struct istream * stream, ARRAY_TYPE(const_string) * headers_arr, unsigned int count) { const char * const * headers = NULL; DPRINTF("Func `%s' called", __FUNCTION__); if (count) { headers = (const char **)array_idx(headers_arr, 0); } return i_stream_create_header_filter(stream, HEADER_FILTER_EXCLUDE | HEADER_FILTER_NO_CR | HEADER_FILTER_HIDE_BODY, headers, count, null_header_filter_callback, NULL); } inline static struct istream * create_header_stream(ARRAY_TYPE(const_string) * headers_arr, unsigned int count) { unsigned int i = 0; struct istream * result = NULL; struct istream ** chunks = NULL; const char * const * headers = NULL; DPRINTF("Func `%s' called", __FUNCTION__); i_assert(count != 0); headers = (const char **)array_idx(headers_arr, 0); DPRINT("Create streams for new included headers from headers"); chunks = t_new(struct istream *, count + 1); for (i = 0; i < count; ++i) { struct istream * tmp = NULL; tmp = i_stream_create_from_data(headers[i], strlen(headers[i])); chunks[i] = i_stream_create_lf(tmp); i_stream_unref(&tmp); } chunks[count] = NULL; result = i_stream_create_concat(chunks); for (i = 0; chunks[i] != NULL; ++i) { i_stream_unref(&chunks[i]); } return result; }

3 9

[Dovecot] dovecot-1.1.13 auth-worker killed
by Jiri Novosad 06 Apr '09

06 Apr '09

Hi, I get these errors with dovecot 1.1.13 in my logs: dovecot: Mar 27 12:00:34 Error: auth-worker(default): *** glibc detected *** dovecot-auth: double free or corruption (!prev): 0x00002b30d5a7dd90 *** dovecot: Mar 27 12:00:34 Error: auth(default): worker-server(jan,147.251.48.141): Aborted: Worker process died unexpectedly dovecot: Mar 27 12:00:34 Error: child 21838 (auth-worker) killed with signal 6 (core not dumped) dovecot: Mar 27 12:10:23 Error: child 22711 (auth-worker) killed with signal 11 (core not dumped) dovecot: Mar 27 12:10:23 Error: auth(default): worker-server(thomas,209.85.146.140): Aborted: Worker process died unexpectedly Haven't seen this with previous versions. But somehow I fail to get the core dump. I do 'ulimit -c unlimited' before starting dovecot, I set * soft core 8192 * hard core 8192 in limits.conf, /proc/sys/kernel/core_pattern is set to /tmp/core. Regards, Jiri Novosad My dovecont -n: # 1.1.13: /packages/run.64/dovecot-1.1.13//etc/dovecot.conf # OS: Linux 2.6.18-92.1.22.el5 x86_64 Red Hat Enterprise Linux Server release 5.3 (Tikanga) ext3 base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/log info_log_path: /var/log/dovecot/info_log protocols: pop3s imaps pop3 imap listen(default): * listen(imap): * listen(pop3): *:110 ssl_listen(default): ssl_listen(imap): ssl_listen(pop3): *:995 ssl_cert_file: /etc/ssl/cert-anxur.fi.muni.cz.pem ssl_key_file: /etc/ssl/serverkey-anxur.fi.muni.cz.pem ssl_parameters_regenerate: 24 login_dir: /var/run/dovecot/login login_executable(default): /packages/run.64/dovecot-1.1.13/libexec/dovecot/imap-login login_executable(imap): /packages/run.64/dovecot-1.1.13/libexec/dovecot/imap-login login_executable(pop3): /packages/run.64/dovecot-1.1.13/libexec/dovecot/pop3-login login_greeting: HI! login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:/home/%u/mail/:INBOX=/var/mail/%u:INDEX=/home/%u/mail/.imap mail_debug: yes mail_full_filesystem_access: yes maildir_copy_with_hardlinks: no mbox_write_locks: fcntl mbox_dirty_syncs: no mbox_lazy_writes: no dbox_rotate_days: 0 mail_drop_priv_before_exec: yes mail_executable(default): /packages/run.64/dovecot-1.1.13/libexec/dovecot/imap mail_executable(imap): /packages/run.64/dovecot-1.1.13/libexec/dovecot/imap mail_executable(pop3): /packages/run.64/dovecot-1.1.13/libexec/dovecot/pop3 mail_plugin_dir(default): /packages/run.64/dovecot-1.1.13/lib/dovecot/imap mail_plugin_dir(imap): /packages/run.64/dovecot-1.1.13/lib/dovecot/imap mail_plugin_dir(pop3): /packages/run.64/dovecot-1.1.13//lib/dovecot/pop3 mail_log_max_lines_per_sec: 20 imap_max_line_length(default): 131072 imap_max_line_length(imap): 131072 imap_max_line_length(pop3): 65536 imap_client_workarounds(default): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %08Xv%08Xu pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: executable: /packages/run.64/dovecot-1.1.13/libexec/dovecot/dovecot-auth verbose: yes debug: yes passdb: driver: pam args: dovecot userdb: driver: passwd

3 7

[Dovecot] conflict name of si_code on NetBSD
by Tatsuyoshi 06 Apr '09

06 Apr '09

Hi. I compiled 1.2.rc2 on NetBSD. [toyota@sernpidal]% uname -rsm NetBSD 3.1 i386 [toyota@sernpidal]% ./configure; make --- snip --- gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT child-wait.o -MD -MP -MF .deps/child-wait.Tpo -c -o child-wait.o child-wait.c In file included from child-wait.c:4: lib-signals.h:9: error: parse error before '.' token *** Error code 1 Stop. Error occurred. I changed some code, and find out the source of the trouble. [toyota@sernpidal]% grep -w si_code /usr/include/sys/siginfo.h #define si_code _info._code /** si_code */ /** si_code */ The 'si_code' name is conflicted, and I need change the name of 'si_code'. The following is quick patch for NetBSD, just change si_code to sicode. [toyota@sernpidal]% diff -crN dovecot-1.2.rc2_bak dovecot-1.2.rc2 diff -crN dovecot-1.2.rc2_bak/src/lib/lib-signals.c dovecot-1.2.rc2/src/lib/lib-signals.c *** dovecot-1.2.rc2_bak/src/lib/lib-signals.c Thu Apr 2 02:08:21 2009 --- dovecot-1.2.rc2/src/lib/lib-signals.c Mon Apr 6 12:45:42 2009 *************** *** 27,36 **** static bool signals_initialized = FALSE; static struct io *io_sig = NULL; ! const char *lib_signal_code_to_str(int signo, int si_code) { /* common */ ! switch (si_code) { case SI_USER: return "kill"; #ifdef SI_KERNEL --- 27,36 ---- static bool signals_initialized = FALSE; static struct io *io_sig = NULL; ! const char *lib_signal_code_to_str(int signo, int sicode) { /* common */ ! switch (sicode) { case SI_USER: return "kill"; #ifdef SI_KERNEL *************** *** 43,49 **** switch (signo) { case SIGSEGV: ! switch (si_code) { case SEGV_MAPERR: return "address not mapped"; case SEGV_ACCERR: --- 43,49 ---- switch (signo) { case SIGSEGV: ! switch (sicode) { case SEGV_MAPERR: return "address not mapped"; case SEGV_ACCERR: *************** *** 51,57 **** } break; case SIGBUS: ! switch (si_code) { case BUS_ADRALN: return "invalid address alignment"; case BUS_ADRERR: --- 51,57 ---- } break; case SIGBUS: ! switch (sicode) { case BUS_ADRALN: return "invalid address alignment"; case BUS_ADRERR: *************** *** 60,66 **** return "object-specific hardware error"; } } ! return t_strdup_printf("unknown %d", si_code); } static void sig_handler(int signo, siginfo_t *si, void *context ATTR_UNUSED) --- 60,66 ---- return "object-specific hardware error"; } } ! return t_strdup_printf("unknown %d", sicode); } static void sig_handler(int signo, siginfo_t *si, void *context ATTR_UNUSED) diff -crN dovecot-1.2.rc2_bak/src/lib/lib-signals.h dovecot-1.2.rc2/src/lib/lib-signals.h *** dovecot-1.2.rc2_bak/src/lib/lib-signals.h Thu Apr 2 01:59:55 2009 --- dovecot-1.2.rc2/src/lib/lib-signals.h Mon Apr 6 12:46:00 2009 *************** *** 5,12 **** typedef void signal_handler_t(const siginfo_t *si, void *context); ! /* Convert si_code to string */ ! const char *lib_signal_code_to_str(int signo, int si_code); /* Set signal handler for specific signal. If delayed is TRUE, the handler will be called later, ie. not as a real signal handler. */ --- 5,12 ---- typedef void signal_handler_t(const siginfo_t *si, void *context); ! /* Convert sicode to string */ ! const char *lib_signal_code_to_str(int signo, int sicode); /* Set signal handler for specific signal. If delayed is TRUE, the handler will be called later, ie. not as a real signal handler. */ -- Tatsuyoshi Toyota rs27(a)tatsuyoshi.net

1 0

[Dovecot] is it possible to recover files from a dovecot.inboxe.cache file?
by Alfred Nutile 06 Apr '09

06 Apr '09

I found this file in the mail boz and noticed it had 20 emails in it (though you can only read really the header the body is cryptic cause it is a bin file?) Just not sure if I can and how to use this to restore the lost emails in that inbox. Thanks

2 1

[Dovecot] Segfault in Sieve 1.2
by Bernhard Schmidt 06 Apr '09

06 Apr '09

Hello, two days ago I've upgraded to 1.2rc2 and the new sieve implementation (version 0.1.4). Today I got the first mail that got stuck in the postfix queue because deliver was dying with a segfault. The mail is spam, thus I don't have any issues sharing it: http://users.birkenwald.de/~berni/temp/deliver-segfault.mail It happens with this small sieve script (my normal one is larger, but this is the part that triggers the segfault): http://users.birkenwald.de/~berni/temp/deliver-segfault.sieve Note that I've been running this script unaltered for months, first with Dovecot 1.1 and CMUSieve and now with various versions of Dovecot 1.2 and the new sieve implementation for about three weeks, this is the first mail that got stuck. I got a coredump, but without debugging symbols it doesn't tell that much. If you can't reproduce it I'll compile it with debugging symbols and try again. (gdb) bt full #0 0x00007fa0f87ecbd7 in strstr () from /lib/libc.so.6 No symbol table info available. #1 0x00007fa0f8341933 in ?? () from /usr/lib/dovecot/lda/lib90_sieve_plugin.so No symbol table info available. #2 0x00007fa0f83377a3 in sieve_address_match () from /usr/lib/dovecot/lda/lib90_sieve_plugin.so No symbol table info available. #3 0x00007fa0f833ba7b in ?? () from /usr/lib/dovecot/lda/lib90_sieve_plugin.so No symbol table info available. #4 0x00007fa0f8332537 in sieve_interpreter_continue () from /usr/lib/dovecot/lda/lib90_sieve_plugin.so No symbol table info available. #5 0x00007fa0f8332728 in sieve_interpreter_run () from /usr/lib/dovecot/lda/lib90_sieve_plugin.so No symbol table info available. #6 0x00007fa0f833f8ca in ?? () from /usr/lib/dovecot/lda/lib90_sieve_plugin.so No symbol table info available. #7 0x00007fa0f833fb3d in sieve_execute () from /usr/lib/dovecot/lda/lib90_sieve_plugin.so No symbol table info available. #8 0x00007fa0f8326f9d in ?? () from /usr/lib/dovecot/lda/lib90_sieve_plugin.so No symbol table info available. #9 0x000000000041a5ad in main () No symbol table info available. Platform is Debian Lenny amd64. Regards, Bernhard

2 1

[Dovecot] v1.2.rc2 released
by Timo Sirainen 04 Apr '09

04 Apr '09

http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc2.tar.gz http://dovecot.org/releases/1.2/rc/dovecot-1.2.rc2.tar.gz.sig Somehow I forgot to check that "make distcheck" finished successfully in rc1, so rc1 didn't actually even fully compile. No other changes since rc1 than the compile fix.

3 5

[Dovecot] THREAD X-REFERENCES2 index bug?
by Nathan Kinkade 04 Apr '09

04 Apr '09

Hi all, $ sudo dovecot --version 1.2.beta3 I just started using Dovecot a few weeks ago, and my client is also using the X-REFERENCES2 thread algorithm. The client is misbehaving when trying to list messages in my INBOX, but only when a threaded message exists. I have tracked it down to the thread index that Dovecot is returning, but the problem is only extant when using the X-REFERENCES2 thread algorithm. Here is a snippet of transcript from imap client that comes with Dovecot: $ export MAIL=maildir:~/Maildir:INBOX=~/Maildir/INBOX $ /usr/lib/dovecot/imap <snip> 1 SELECT "INBOX" <snip> 2 THREAD X-REFERENCES2 UTF-8 ALL * THREAD (0)(2)(1 3)(4) 2 OK Thread completed. There are, in fact, only 4 messages in my INBOX, and the reference to (0) seems spurious. When I do the same test, but passing REFERENCES instead of X-REFERENCES2 Dovecot returns an index which I believe to be correct: <snip> 2 THREAD REFERENCES UTF-8 ALL * THREAD (1 3)(2)(4) 2 OK Thread completed. <snip> Is this the normal and expected behavior of X-REFERENCES2 that the client just needs to take into account, or is the reference to thread index (0) an error? Thanks! Nathan

2 6

[Dovecot] decreasing log messages
by Louis-David Mitterrand 04 Apr '09

04 Apr '09

Hi, Since I use "/usr/sbin/dovecot --exec-mail imap" from mutt I get a lot of these in my syslog: Apr 3 11:09:33 zenon IMAP(ldm): : Connection closed bytes=36/256 Is it possible to suppress them while keeping the "remote users" messages: Apr 3 10:52:05 zenon dovecot: IMAP(xxxxx): Connection closed bytes=9420/5976987 Apr 3 10:52:08 zenon dovecot: imap-login: Login: user=<xxxxx>, method=PLAIN, ri p=xx.xx.xx.xx, lip=xx.xx.xx.xx, TLS Thanks,

2 2

[Dovecot] 1.2rc2: setacl crash
by Oli Schacher 04 Apr '09

04 Apr '09

Hi By playing around with imap acl I managed to get another crash. Setup is the same as in my last crash report ("1.2 beta4, crash with ACL"), except updated from beta4 to rc2 and added the slash to the prefix, as suggested by Timo: prefix: shared/%%d/%%n/ What I did: logged in as sales 2 setacl INBOX oli@<domain>.ch -lrs Connection closed by foreign host. Server Log: Apr 4 08:05:06 box dovecot: Panic: IMAP(sales@<domain>.ch): file ../../../src/lib/array.h: line 162 (array_idx_i): assertion failed: (idx * array->element_size < array->buffer->used) Apr 4 08:05:06 box dovecot: IMAP(sales@<domain>.ch): Raw backtrace: imap [0x80e7110] -> imap [0x80e716a] -> imap [0x80e6a2c] -> /usr/lib/dovecot/imap/lib01_acl_plugin.so [0x4cd872] -> /usr/lib/dovecot/imap/lib01_acl_plugin.so [0x4cd8d0] -> /usr/lib/dovecot/imap/lib01_acl_plugin.so [0x4cf780] -> /usr/lib/dovecot/imap/lib01_acl_plugin.so(acl_object_update+0x18) [0x4cc998] -> /usr/lib/dovecot/imap/lib02_imap_acl_plugin.so [0x111fda] -> imap [0x8063d6c] -> imap [0x8063e1b] -> imap(client_handle_input+0x2f) [0x80648cf] -> imap(client_input+0x63) [0x8064b03] -> imap(io_loop_handler_run+0x100) [0x80ef870] -> imap(io_loop_run+0x28) [0x80ee9a8] -> imap(main+0x754) [0x806cdb4] -> /lib/libc.so.6(__libc_start_main+0xdc) [0x2f1dec] -> imap [0x805ce41] Apr 4 08:05:06 box dovecot: child 2330 (imap) killed with signal 6 (core dumped) Backtrace: #0 0x00503402 in __kernel_vsyscall () No symbol table info available. #1 0x00304d10 in raise () from /lib/libc.so.6 No symbol table info available. #2 0x00306621 in abort () from /lib/libc.so.6 No symbol table info available. #3 0x080e711d in default_fatal_finish () No symbol table info available. #4 0x080e716a in i_internal_fatal_handler () No symbol table info available. #5 0x080e6a2c in i_panic () No symbol table info available. #6 0x004cd872 in modify_right_list (pool=0x923b3a0, rightsp=0x923b4b4, modify_rights=0x920a358, modify_mode=ACL_MODIFY_MODE_REMOVE) at ../../../src/lib/array.h:162 old_rights = (const char * const *) 0x923b3f4 new_rights = (const char * const *) 0xbfbbae94 null = 0x0 #7 0x004cd8d0 in vfile_object_modify_right (aclobj=0x923b278, idx=1, update=0xbfbbb02c) at acl-backend-vfile.c:941 c1 = 73 c2 = <value optimized out> #8 0x004cf780 in acl_backend_vfile_object_update (_aclobj=0x923b278, update=0xbfbbb02c) at acl-backend-vfile.c:1100 aclobj = (struct acl_object_vfile *) 0x0 dotlock = <value optimized out> path = <value optimized out> i = 1 fd = 6 changed = <value optimized out> __PRETTY_FUNCTION__ = "acl_backend_vfile_object_update" #9 0x004cc998 in acl_object_update (aclobj=0x923b278, update=0xbfbbb02c) at acl-api.c:137 No locals. #10 0x00111fda in cmd_setacl (cmd=0x9219210) at imap-acl-plugin.c:576 ns = (struct mail_namespace *) 0x9216b38 storage = <value optimized out> box = (struct mailbox *) 0x9220a78 backend = (struct acl_backend *) 0x92172b8 update = {rights = {id_type = ACL_ID_USER, identifier = 0x921e318 "oli@<domain>.ch", rights = 0x920a358, neg_rights = 0x0, global = 0}, modify_mode = ACL_MODIFY_MODE_REMOVE, neg_modify_mode = ACL_MODIFY_MODE_REMOVE} mailbox = 0x921e310 "INBOX" identifier = 0x921e318 "oli@<domain>.ch" rights = 0x921e339 "lrs" error = <value optimized out> negative = false #11 0x08063d6c in client_command_input () No symbol table info available. #12 0x08063e1b in client_command_input () No symbol table info available. #13 0x080648cf in client_handle_input () No symbol table info available. #14 0x08064b03 in client_input () No symbol table info available. #15 0x080ef870 in io_loop_handler_run () No symbol table info available. #16 0x080ee9a8 in io_loop_run () No symbol table info available. #17 0x0806cdb4 in main () No symbol table info available.

1 0