- dovecot - dovecot.org

[Dovecot] dovecot 1.2: dict no longer really support DICT_ITERATE_FLAG_RECURSE
by Bernhard Herzog 16 Oct '08

16 Oct '08

Hi, In dovecot 1.1, I could use DICT_ITERATE_FLAG_RECURSE when iterating over a dict to retrieve all entries that start with a given prefix. This doesn't seem to work anymore in the new dict implementation in dovecot 1.2. Looking at the SQL queries actually generated, it seems as if dovecot 1.1 used to generate queries that use pattern matching (key LIKE "my/prefix/%") whereas dovecot 1.2 does not, so it's no wonder that it doesn't work in 1.2. This probably has to do with the pattern matching for dict keys in the config file. It would be enough for my purposes at the moment -- i.e. getting the metadata plugin to work with dovecot 1.2 -- if recursion were only possible for the last of fields in the pattern. Regards, Bernhard -- Bernhard Herzog | ++49-541-335 08 30 | http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück | AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

2 5

[Dovecot] dovecot 1.1.4 maildir imap segfault in message_parse_header_next
by Diego Liziero 16 Oct '08

16 Oct '08

I've tried to stress test dovecot 1.1.4 with imaptest for days without any assertion failure or crash. Just some "got too little data" messages. So far it's the most stable 1.1.x version. Today a user got this imap segfault with vanilla 1.1.4 (I don't know if it's something you have already fixed in current tree). The user didn't complain of anything, I've just found the error in the logs and the core file. Regards, Diego. ---- Core was generated by `/usr/libexec/dovecot/imap'. Program terminated with signal 11, Segmentation fault. #0 0x080c8d41 in message_parse_header_next (ctx=0x8774fa0, hdr_r=0xbfa438e0) at message-header-parser.c:114 114 if (msg[0] == '\n' || (gdb) bt full #0 0x080c8d41 in message_parse_header_next (ctx=0x8774fa0, hdr_r=0xbfa438e0) at message-header-parser.c:114 msg = (const unsigned char *) 0x0 i = <value optimized out> size = 0 startpos = <value optimized out> colon_pos = 4294967295 parse_size = 0 value_pos = <value optimized out> ret = -2 continued = false continues = <value optimized out> crlf_newline = false #1 0x080c62f5 in read_header (mstream=0x877d6d0) at istream-header-filter.c:163 hdr = (struct message_header_line *) 0x0 highwater_offset = <value optimized out> pos = <value optimized out> ret = <value optimized out> matched = false hdr_ret = <value optimized out> __PRETTY_FUNCTION__ = '\0' <repeats 11 times> #2 0x080c6a17 in i_stream_header_filter_read (stream=0x877d6d0) at istream-header-filter.c:293 mstream = (struct header_filter_istream *) 0xfffffffe ret = <value optimized out> pos = <value optimized out> #3 0x080d4fa8 in i_stream_read (stream=0x877d6f8) at istream.c:73 _stream = (struct istream_private *) 0xfffffffe ret = <value optimized out> __PRETTY_FUNCTION__ = '\0' <repeats 13 times> #4 0x080d505d in i_stream_read_data (stream=0x877d6f8, data_r=0xbfa439a8, size_r=0xbfa439a4, threshold=0) at istream.c:299 ret = 0 read_more = false __PRETTY_FUNCTION__ = '\0' <repeats 18 times> #5 0x080cb8ec in message_get_body_size (input=0x877d6f8, body=0xbfa439d8, has_nuls=0x0) at message-size.c:76 msg = <value optimized out> i = <value optimized out> size = <value optimized out> missing_cr_count = <value optimized out> __PRETTY_FUNCTION__ = '\0' <repeats 21 times> #6 0x08064178 in fetch_body_header_fields (ctx=0x875e668, mail=0x8776138, body=0x875e958) at imap-fetch-body.c:458 size = {physical_size = 0, virtual_size = 0, lines = 0} old_offset = 0 #7 0x08062218 in imap_fetch (ctx=0x875e668) at imap-fetch.c:309 _data_stack_cur_id = 4 ret = <value optimized out> __PRETTY_FUNCTION__ = "\000\000\000\000\000\000\000\000\000\000" #8 0x0805bd9e in cmd_fetch (cmd=0x875e5c0) at cmd-fetch.c:152 ctx = (struct imap_fetch_context *) 0x875e668 args = (const struct imap_arg *) 0x8762638 search_arg = (struct mail_search_arg *) 0x875e610 messageset = <value optimized out> ret = <value optimized out> #9 0x0805fe8c in client_command_input (cmd=0x875e5c0) at client.c:580 client = (struct client *) 0x875e368 command = <value optimized out> __PRETTY_FUNCTION__ = '\0' <repeats 20 times> #10 0x0805ff35 in client_command_input (cmd=0x875e5c0) at client.c:629 client = (struct client *) 0x875e368 command = (struct command *) 0x0 __PRETTY_FUNCTION__ = '\0' <repeats 20 times> #11 0x080606f5 in client_handle_input (client=0x875e368) at client.c:670 _data_stack_cur_id = 3 ret = <value optimized out> remove_io = <value optimized out> handled_commands = false #12 0x0806090e in client_input (client=0x875e368) at client.c:725 cmd = <value optimized out> output = (struct ostream *) 0x875e4ec bytes = 197 __PRETTY_FUNCTION__ = '\0' <repeats 12 times> #13 0x080d8710 in io_loop_handler_run (ioloop=0x875c9b0) at ioloop-epoll.c:203 ctx = <value optimized out> event = (const struct epoll_event *) 0x875cae8 list = (struct io_list *) 0x875e568 io = (struct io_file *) 0x875e548 tv = {tv_sec = 4, tv_usec = 926334} t_id = 2 msecs = <value optimized out> ret = 1 i = 0 j = 0 call = <value optimized out> #14 0x080d77f8 in io_loop_run (ioloop=0x875c9b0) at ioloop.c:320 No locals. #15 0x0806848c in main (argc=Cannot access memory at address 0x0 ) at main.c:293 No locals.

2 3

[Dovecot] imap-quota not working
by arvids 16 Oct '08

16 Oct '08

Hello, imap-quota plugin always returns empty quota: a1 GETQUOTA "" * QUOTA "" () a1 OK Getquota completed. a2 GETQUOTAROOT INBOX * QUOTAROOT "INBOX" a2 OK Getquotaroot completed. quota_rule and quota_rule2 for this user are defined in db as following: '*:storage=5000000' '*:messages=50000' Quota for LDA is working OK. I am using dovecot-1.1.3 with quotadict. Here is my dovecot -n output: # 1.1.3: /usr/local/dovecot/etc/dovecot.conf base_dir: /var/run/dovecot/ syslog_facility: local7 protocols: pop3 imap ssl_cert_file: /etc/postfix/host-cert.pem ssl_key_file: /etc/postfix/host-key.pem disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable(default): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3-login login_greeting: Server. login_process_per_connection: no login_processes_count: 5 login_max_processes_count: 32 verbose_proctitle: yes first_valid_uid: 95 first_valid_gid: 95 mail_uid: 95 mail_gid: 95 mail_location: maildir:~/Maildir fsync_disable: yes mail_executable(default): /usr/local/dovecot/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail imap_client_workarounds(imap): delay-newmail imap_client_workarounds(pop3): pop3_enable_last(default): no pop3_enable_last(imap): no pop3_enable_last(pop3): yes pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: . inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login digest-md5 cram-md5 apop cache_size: 1024 cache_ttl: 600 cache_negative_ttl: 60 user: doveauth verbose: yes passdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf userdb: driver: prefetch userdb: driver: sql args: /usr/local/dovecot/etc/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: quota: dict:::proxy:/var/run/dovecot/dict-server:quotadict dict: quotadict: mysql:/usr/local/dovecot/etc/dovecot-sql-dict-quota.conf Regards, Arvids

2 8

[Dovecot] deliver does not work with new shared namespaces in dovecot 1.2
by Sascha Wilde 16 Oct '08

16 Oct '08

Hi Timo, checking my new userdb-checkpassword back end is stumbled across the fact, that the new shared namespace definitions possible in dovecot stop deliver from working. The log says: Oct 15 14:37:43 burlywood3 <info> deliver(2(a)burlywood3.rgb)[24502]: Namespace: type=shared, prefix=users/%%u/, sep=/, inbox=no, hidden=no, list=no, subscriptions=no Oct 15 14:37:43 burlywood3 <error> deliver(2(a)burlywood3.rgb)[24502]: Namespace 'users/': shared: Shared namespace prefix contains unknown variables Oct 15 14:37:43 burlywood3 <critical> deliver(2(a)burlywood3.rgb)[24502]: Fatal: Namespace initialization failed I guess the primary (only?) case where these shared namespaces are needed for delivery is the use of sieve. cheers sascha -- Sascha Wilde OpenPGP key: 4BB86568 http://www.intevation.de/~wilde/ http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

2 2

[Dovecot] Multiple users in password like file
by Rajiv Gore 16 Oct '08

16 Oct '08

Hi Can I provide login in name and password of multiple users in password like file and will dovecot allow multiple users to login from different ip address? I have set up 2 users. Both are system users. Dovecot allows login in for the first user but doesn't allow login for the second user. Any help will be appreciated. Thanks -- Rajiv Gore Sai Links (India) Pvt. ltd L-213 MIDC Ahmednagar -414 111 MS, India Tele 091-241-2778935 Fax 091-241-2423284

2 1

[Dovecot] assertion failure in current hg, file istream.c: line 303 (i_stream_read_data): assertion failed: (stream->stream_errno != 0) (1.1.3 was working fine)
by Diego Liziero 16 Oct '08

16 Oct '08

Today I updated to current dovecot-1.1 hg tree and I got many of these assertion failures: file istream.c: line 303 (i_stream_read_data): assertion failed: (stream->stream_errno != 0) (gdb) bt full #0 0x00352402 in __kernel_vsyscall () No symbol table info available. #1 0x0043ed20 in raise () from /lib/libc.so.6 No symbol table info available. #2 0x00440631 in abort () from /lib/libc.so.6 No symbol table info available. #3 0x080f6968 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:150 backtrace = 0x906d950 "/usr/libexec/dovecot/imap [0x80f6946] -> /usr/libexec/dovecot/imap [0x80f7207] -> /usr/libexec/dovecot/imap(i_fatal+0) [0x80f6ac0] -> /usr/libexec/dovecot/imap(i_stream_read_data+0. #4 0x080f7207 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, fmt=0x8124778 "file %s: line %d (%s): assertion failed: (%s)", args=0xbfe643a4 "mG\022\b/\001") at failures.c:430 No locals. #5 0x080f6ac0 in i_panic (format=0x8124778 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:197 args = 0xbfe643a4 "mG\022\b/\001" #6 0x080fcb64 in i_stream_read_data (stream=0x9094a08, data_r=0xbfe64444, size_r=0xbfe64440, threshold=0) at istream.c:303 ret = -1 read_more = false __PRETTY_FUNCTION__ = "i_stream_read_data" #7 0x08065ba1 in imap_fetch_send (ctx=0x90716e0, output=0x90714ec, input=0x9094a08, cr_skipped=false, virtual_size=169, add_missing_eoh=false, last_cr=0x9071734) at imap-fetch-body.c:132 msg = (const unsigned char *) 0x0 i = 3219539032 size = 0 vsize_left = 169 sent = 0 ret = 581237648214344776 add = 16 '\020' blocks = false #8 0x08065d7f in fetch_stream_send (ctx=0x90716e0) at imap-fetch-body.c:217 ret = 151603720 #9 0x080660e8 in fetch_stream (ctx=0x90716e0, size=0x908efc4) at imap-fetch-body.c:293 input = (struct istream *) 0x10b8df #10 0x08066225 in fetch_data (ctx=0x90716e0, body=0x9071cd8, size=0x908efc4) at imap-fetch-body.c:318 str = (string_t *) 0x906cc18 #11 0x08066ac7 in fetch_body_mime (ctx=0x90716e0, mail=0x908e9e8, body=0x9071cd8) at imap-fetch-body.c:555 part = (const struct message_part *) 0x908efb0 section = 0x9071d12 "MIME" __PRETTY_FUNCTION__ = "fetch_body_mime" #12 0x08064bad in imap_fetch_more (ctx=0x90716e0) at imap-fetch.c:309 h = (const struct imap_fetch_context_handler *) 0x90718c8 _data_stack_cur_id = 4 client = (struct client *) 0x9071368 handlers = (const struct imap_fetch_context_handler *) 0x9071850 count = 7 ret = 1 __PRETTY_FUNCTION__ = "imap_fetch_more" #13 0x08064dd4 in imap_fetch (ctx=0x90716e0) at imap-fetch.c:361 ret = 0 __PRETTY_FUNCTION__ = "imap_fetch" #14 0x0805c792 in cmd_fetch (cmd=0x9071600) at cmd-fetch.c:152 ctx = (struct imap_fetch_context *) 0x90716e0 args = (const struct imap_arg *) 0x9075688 search_arg = (struct mail_search_arg *) 0x9071678 messageset = 0x9075750 "4068" ret = 151455048 #15 0x08061173 in cmd_uid (cmd=0x9071600) at cmd-uid.c:26 command = (struct command *) 0x907068c cmd_name = 0x9075738 "fetch" #16 0x08062534 in client_command_input (cmd=0x9071600) at client.c:580 client = (struct client *) 0x9071368 command = (struct command *) 0x23 __PRETTY_FUNCTION__ = "client_command_input" #17 0x08062769 in client_command_input (cmd=0x9071600) at client.c:629 client = (struct client *) 0x9071368 command = (struct command *) 0x9070668 __PRETTY_FUNCTION__ = "client_command_input" #18 0x08062867 in client_handle_next_command (client=0x9071368, remove_io_r=0xbfe64765) at client.c:670 size = 132 #19 0x080628a3 in client_handle_input (client=0x9071368) at client.c:680 _data_stack_cur_id = 3 ret = 7 remove_io = false handled_commands = false #20 0x08062a31 in client_input (client=0x9071368) at client.c:725 cmd = (struct client_command_context *) 0x4e7408 output = (struct ostream *) 0x90714ec bytes = 132 __PRETTY_FUNCTION__ = "client_input" #21 0x08101115 in io_loop_handler_run (ioloop=0x906f9b0) at ioloop-epoll.c:203 ctx = (struct ioloop_handler_context *) 0x906faa8 events = (struct epoll_event *) 0x906fae8 event = (const struct epoll_event *) 0x906fae8 list = (struct io_list *) 0x9071568 io = (struct io_file *) 0x9071548 tv = {tv_sec = 1799, tv_usec = 999874} events_count = 3 t_id = 2 msecs = 1800000 ret = 1 i = 0 j = 0 call = true #22 0x081003ac in io_loop_run (ioloop=0x906f9b0) at ioloop.c:320 No locals. #23 0x0806debd in main (argc=1, argv=0xbfe648c4, envp=0xbfe648cc) at main.c:293 No locals.

2 9

[Dovecot] Ignore prefix given by client?
by Tim Bishop 15 Oct '08

15 Oct '08

Hi all, I'm new to Dovecot, but so far I've been really impressed with what I've seen. I hope someone can help with the following question. We're migrating from a setup where some of our users use mbox with UW imap. The problem is we've never enforced a folder prefix, so some have their folders in ~/, others in ~/mail and others in ~/Mail. We've also got some users using maildir with Courier imap. I decided the easiest way to get this working transparently for the users was to use the post-login scripting approach. My script manages to locate the user's mail and sets MAIL accordingly. This all works a treat. The problem is when a user specifies their own prefix in their mail client (if it's blank there are no problems). If they have ~/Mail none of the folders show up. I've had a play with namespaces in an attempt to fix that, but it doesn't seem to be doing what I want. So my question is: is it possible for Dovecot to simply ignore the folder prefix given by the client? Thanks, Tim. -- Tim Bishop http://www.bishnet.net/tim/ PGP Key: 0x5AE7D984

2 2

[Dovecot] Something weird happening...
by Claudio Prono 15 Oct '08

15 Oct '08

Hi to all, I use Dovecot dovecot11-1.1.3-5.1 from OpenSuSE 11, when i send a mail from the logs i read: Oct 8 10:36:31 mail postfix/pipe[17934]: A360A851: to=<mediatest(a)atpss.net>, relay=dovecot, delay=0.22, delays=0.18/0/0/0.04, dsn=4.3.0, status=deferred (temporary failure. Command output: Can't open log file /var/log/dovecot-err.log: Permission denied ) But, log files seems ok: -rw------- 1 777 root 56 Oct 8 10:35 dovecot-err.log -rw------- 1 777 root 302 Oct 8 10:35 dovecot-inf.log Also processess seems right: root 17965 0.0 0.0 2052 584 ? Ss 10:35 0:00 /usr/sbin/dovecot root 17966 0.0 0.2 8564 2172 ? S 10:35 0:00 dovecot-auth root 17967 0.0 0.2 8564 2356 ? S 10:35 0:00 dovecot-auth -w dovecot 17969 0.0 0.1 3476 1572 ? S 10:36 0:00 pop3-login dovecot 17970 0.0 0.1 3476 1572 ? S 10:36 0:00 pop3-login dovecot 17971 0.0 0.1 3476 1572 ? S 10:36 0:00 pop3-login dovecot 17972 0.0 0.1 3484 1584 ? S 10:36 0:00 imap-login dovecot 17973 0.0 0.1 3484 1584 ? S 10:36 0:00 imap-login dovecot 17974 0.0 0.1 3484 1584 ? S 10:36 0:00 imap-login Here is my config: log_path: /var/log/dovecot-err.log info_log_path: /var/log/dovecot-inf.log protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login first_valid_uid: 51 last_valid_uid: 51 mail_location: maildir:/var/mail/virtual/%n@%d mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib64/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib64/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %Mf auth default: passdb: driver: pam passdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf userdb: driver: passwd userdb: driver: sql args: /etc/dovecot/dovecot-mysql.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: maildir quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80 So, what can be the problem? Thanks, Claudio Prono. -- ------------ Claudio Prono Systems Development @ Atpss.net Srl, Divisione Implementazione Sistemi Via San Bernardino, 17 - 10137 Torino (TO) - IT Tel +39-011.32.72.100 Fax +39-011.32.46.497 PGP Fingerprint: 75C2 4049 E23D 2FBF A65F 40DB EA5C 11AC C2B0 3647 Disclaimer: http://atpss.net/disclaimer ------------

6 10

[Dovecot] Multiple IMAP connections.
by Roderick A. Anderson 15 Oct '08

15 Oct '08

There is a project (catmail) to build a webmail front end using the Catalyst Framework and the question came up about multiple connections per user. Specifically the question was: "The IMAP server can support multiple connections, but do you think the backend should support multiple connections for separate folders or one IMAP connection for one session?" Since my servers are too low volume to have hit any kind of resource limits, and I believe Thunderbird mostly does the "Right Thing", I'm asking how you, that have higher volume systems, would prefer connections handled. Also I believe there was a thread, or two :-), on the way some of the other webmail programs handle connections. Not good? Thanks for all insights and suggestions. Rod --

1 0

[Dovecot] Bug: MODSEQ FETCH return (?)
by Michael M. Slusarz 15 Oct '08

15 Oct '08

Hi Timo - hope things are well :) Playing around with the CONDSTORE (RFC 4551) stuff while testing the IMAP lib I am writing and I think I have found a bug in Dovecot 1.2. RFC 4551 [4] identifies the FETCH response to a MODSEQ request as follows: fetch-mod-resp = "MODSEQ" SP "(" permsg-modsequence ")" with 'permsg-modsequence' defined as: permsg-modsequence = mod-sequence-value ;; per message mod-sequence Unfortunately, Dovecot 1.2 is returning as follows: S: * 1 FETCH (UID 1 MODSEQ 3 FLAGS (\Flagged \Deleted \Recent)) Where, under the RFC, I believe it should be: S: * 1 FETCH (UID 1 MODSEQ (3) FLAGS (\Flagged \Deleted \Recent)) Here is a proposed patch (WARNING: my C skills = zero): # HG changeset patch # User root(a)bigworm.curecanti.org # Date 1224040830 21600 # Branch HEAD # Node ID 0c0615bc6bf74ccf109049e251a30b8ab5f8ea67 # Parent 40df4d4cced09fa72d37581d0c526416d2c6e3de per RFC 4551, MODSEQ FETCH responses need to be wrapped in (). diff -r 40df4d4cced0 -r 0c0615bc6bf7 src/imap/imap-fetch.c --- a/src/imap/imap-fetch.c Tue Oct 14 14:52:44 2008 +0300 +++ b/src/imap/imap-fetch.c Tue Oct 14 21:20:30 2008 -0600 @@ -749,7 +749,7 @@ modseq = mail_get_modseq(mail); if (ctx->client->highest_fetch_modseq < modseq) ctx->client->highest_fetch_modseq = modseq; - str_printfa(ctx->cur_str, "MODSEQ %llu ", + str_printfa(ctx->cur_str, "MODSEQ (%llu) ", (unsigned long long)modseq); return 1; } Hope this helps/is correct. michael

2 1