- dovecot - dovecot.org

[Dovecot] Segfault in deliver server
by Sascha Wilde 19 May '09

19 May '09

Hi Timo, Hi list, I finally got along to test the current dovecot 1.2 with our Kolab Server. And I'm very excited to see all the cool ACL and shared name spaces stuff upstream, thanks a lot Timo! Anyway I just stumbled across a new bug using our metadata-plugin (which in turn uses the dict back end): Making a few annotations requests after another it stops working. dovecot.log sais something like: Feb 03 11:58:21 burlywood3 <info> dovecot[10486]: IMAP(4(a)burlywood3.rgb): metadata_get_metadata_entry: dict key=shared//kolab/var/dovecot/spool/4@burlywood3. rgb/home/maildir/.Calendar//vendor/kolab/folder-type Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: child 10503 (dict) killed with signal 11 Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: IMAP(4(a)burlywood3.rgb): read(/kolab/var/dovecot/run/dict-server) failed: Connection reset by peer Feb 03 11:58:21 burlywood3 <critical> dovecot[10520]: Fatal: dup2(3) failed: Bad file descriptor Feb 03 11:58:21 burlywood3 <error> dovecot[10486]: child 10520 (dict) returned error 89 (Fatal failure) Feb 03 11:58:21 burlywood3 <critical> dovecot[10486]: Panic: file ioloop.c: line 38 (io_add): assertion failed: (fd >= 0) (END) I attached gdb to dict and got this: Program received signal SIGSEGV, Segmentation fault. array_idx_modifiable_i (array=0x38, idx=0) at array.c:10 10 pos = idx * array->element_size; (gdb) bt #0 array_idx_modifiable_i (array=0x38, idx=0) at array.c:10 #1 0x0805e9a2 in sql_pool_unlink (ctx=0x80fb670) at sql-pool.c:64 #2 0x0805ea24 in sql_pool_new (pool=0x80f9470, db_driver=0x80dd498 "sqlite", connect_string=0x810ad78 "/kolab/var/dovecot/lib/metadata-dict.sqlite") at sql-pool.c:97 #3 0x0805bb3c in sql_dict_init (driver=0x80f9ae0, uri=0xbfce9f76 "/kolab/etc/dovecot/metadata-dict.conf", value_type=DICT_DATA_TYPE_STRING, username=0x80fb910 "4(a)burlywood3.rgb") at dict-sql.c:86 #4 0x0805c9ca in dict_init (uri=0xbfce9f6f "sqlite:/kolab/etc/dovecot/metadata-dict.conf", value_type=DICT_DATA_TYPE_STRING, username=0x80fb910 "4(a)burlywood3.rgb") at dict.c:87 #5 0x0805a1b1 in dict_client_connection_input (conn=0x80fb8d0) at dict-server.c:407 #6 0x0806637c in io_loop_handler_run (ioloop=0x80f8a80) at ioloop-epoll.c:202 #7 0x080652fd in io_loop_run (ioloop=0x80f8a80) at ioloop.c:338 #8 0x0805a42d in main () at main.c:122 (gdb) li 5 6 void *array_idx_modifiable_i(struct array *array, unsigned int idx) 7 { 8 size_t pos; 9 10 pos = idx * array->element_size; 11 if (pos >= array->buffer->used) { 12 /* index doesn't exist yet, initialize with zero */ 13 buffer_append_zero(array->buffer, pos + array->element_size - 14 array->buffer->used); (gdb) p array $1 = (struct array *) 0x38 (gdb) p *array Cannot access memory at address 0x38 (gdb) up #1 0x0805e9a2 in sql_pool_unlink (ctx=0x80fb670) at sql-pool.c:64 64 next_ctx = SQL_POOL_CONTEXT(ctx->prev); (gdb) p *ctx $2 = {module_ctx = {reg = 0x0}, prev = 0x0, next = 0x810d2b0, pool = 0x80f9470, refcount = 0, key = 0x80fb638 "sqlite\t/kolab/var/dovecot/lib/metadata-dict.sqlite", orig_deinit = 0x805f229 <driver_sqlite_deinit_v>} (gdb) li 59 prev_ctx->next = ctx->next; 60 } 61 if (ctx->next == NULL) 62 ctx->pool->unused_head = ctx->prev; 63 else { 64 next_ctx = SQL_POOL_CONTEXT(ctx->prev); 65 next_ctx->prev = ctx->prev; 66 } 67 ctx->pool->unused_count--; 68 } (gdb) c Continuing. Program terminated with signal SIGSEGV, Segmentation fault. The program no longer exists It's quite possible, that we got any details in the usage of the dict back end wrong, but I guess that in any case the dict server shouldn't segfault... cheers sascha -- Sascha Wilde OpenPGP key: 4BB86568 http://www.intevation.de/~wilde/ http://www.intevation.de/ Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998 Geschäftsführer: Frank Koormann, Bernhard Reiter, Dr. Jan-Oliver Wagner

2 2

[Dovecot] Multiple dovecot versions side-by-side
by Max Ivanov 19 May '09

19 May '09

I'm current maintainer of dovecot packages in ALTLinux distro and I plan to make possible to install multiple dovecot versions side-by-side (1.0, 1.1, 1.2) to make upgrade process easier and more robust. Is there any consequences of doing that? I worry about locking maildirs and mboxes, does dovecot handle it correctly if another dovecot process tries to work on same mail location?

2 1

[Dovecot] LDA and postfix with recipient delimiter: documentation
by John Fawcett 18 May '09

18 May '09

Just a comment about the documentation for postfix integration when using receipient delimiter and delivery of user+foo(a)domain.ext to user@domain: http://wiki.dovecot.org/LDA/Postfix I had some issues to get this working, so thought I'd share my experience. Dovecot version 1.2.rc3. Postfix version postfix-2.7-20090511. I have no local (unix) mailboxes, everything is delivered to dovecot, so in postfix I have set mailbox_transport = dovecot. In this case the following syntax taken from the docs does not work: dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${nexthop} whereas the following does work: dovecot unix - n n - - pipe flags=DRhu user=vmail:mail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${domain} I think that ${domain} is always what is wanted and only when ${nexthop} happens to have the same value as ${domain} - for example when using a transport table entry like this: /etc/postfix/transport domain.ext dovecot: will the ${user}@${nexthop} form be deliverable. Can anyone see a reason for not using always ${user}@${domain} instead of ${user}@${nexthop}? John

5 6

[Dovecot] dovecot 2.0 (revision 9271:d467712aee77) compile problems on AIX 5.3
by Jonathan Siegle 18 May '09

18 May '09

Having some problems compiling on AIX 5.3 with IBM vac version 8. Programs that I had problems building: test-mail test-imap test-index To fix the undefined symbols problem: ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_end ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_begin ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_is_utf8 ld: 0711-317 ERROR: Undefined symbol: .charset_to_utf8_str ld: 0711-317 ERROR: Undefined symbol: .message_header_decode_utf8 ld: 0711-317 ERROR: Undefined symbol: .rfc822_parser_init ld: 0711-317 ERROR: Undefined symbol: .rfc822_skip_lwsp ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_content_type ld: 0711-317 ERROR: Undefined symbol: .rfc2231_parse ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_mime_token ld: 0711-317 ERROR: Undefined symbol: .rfc822_parse_atom ld: 0711-317 ERROR: Undefined symbol: .message_address_parse ld: 0711-317 ERROR: Undefined symbol: .iconv ld: 0711-317 ERROR: Undefined symbol: .iconv_open ld: 0711-317 ERROR: Undefined symbol: .iconv_close I add this ../lib-charset/.libs/libcharset.a -liconv to the Makefiles (./src/lib-imap/Makefile;./src/lib-index/Makefile;./src/lib-mail/ Makefile) below: $ find . -name Makefile -exec egrep -p libcharset.a {} \; -print clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-imap$(EXEEXT): $(test_imap_OBJECTS) $(test_imap_DEPENDENCIES) @rm -f test-imap$(EXEEXT) $(LINK) $(test_imap_LDFLAGS) $(test_imap_OBJECTS) $ (test_imap_LDADD) $(LIBS) \ ../lib-mail/.libs/libmail.a ../lib-charset/.libs/libcharset.a -liconv ./src/lib-imap/Makefile clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-index$(EXEEXT): $(test_index_OBJECTS) $(test_index_DEPENDENCIES) @rm -f test-index$(EXEEXT) $(LINK) $(test_index_LDFLAGS) $(test_index_OBJECTS) $ (test_index_LDADD) $(LIBS) ../lib-charset/.libs/libcharset.a -liconv ./src/lib-index/Makefile clean-noinstPROGRAMS: @list='$(noinst_PROGRAMS)'; for p in $$list; do \ f=`echo $$p|sed 's/$(EXEEXT)$$//'`; \ echo " rm -f $$p $$f"; \ rm -f $$p $$f ; \ done test-mail$(EXEEXT): $(test_mail_OBJECTS) $(test_mail_DEPENDENCIES) @rm -f test-mail$(EXEEXT) $(LINK) $(test_mail_LDFLAGS) $(test_mail_OBJECTS) $ (test_mail_LDADD) $(LIBS) ../lib-charset/.libs/libcharset.a -liconv ./src/lib-mail/Makefile Then compilation occurs fine. Thanks! Jonathan

2 4

[Dovecot] How to manage Seen flags via sieve?
by Max Ivanov 18 May '09

18 May '09

I use public namespace for group mailboxes. If someone sends email from this mailbox , MTA detects it and delivers copy of that message to mailbox/Sent folder, to keep history of all messages available for every group member. I'd like to set Seen flag on all messages that dovecots deliver puts into "Sent" folder. Is it posible somehow?

2 1

[Dovecot] 1.1.13 squat core dump
by David Halik 18 May '09

18 May '09

While using 1.1.13 and squat with local pine imap on Solaris 9 I had a random core dump today. I was doing a search in a maildir folder with about 2000 emails. Unfortunately, I haven't been able to reproduce it yet, but I wanted to send along the info anyways. Environment: # uname -a SunOS 5.9 Generic_122300-39 sun4u sparc SUNW,Sun-Blade-100 Backtrace: http://pastebin.com/f7aa8bb5 ~# dovecot -n # 1.1.13: /usr/local/etc/dovecot.conf # OS: SunOS 5.9 sun4u protocols: imap imaps pop3 pop3s ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no mail_location: maildir:~/Maildir:INDEX=/heroes/u1/dovecot-index/sparc/index/%u:CONTROL=/heroes/u1/dovecot-index/control/%u mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota fts fts_squat mail_plugins(imap): quota imap_quota fts fts_squat mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): UID%u-%v namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: passdb: driver: pam args: * userdb: driver: passwd plugin: quota: fs fts: squat fts_squat: partial=4 full=4 -- ================================ David Halik System Administrator OIT-CSS Rutgers University dhalik(a)jla.rutgers.edu ================================

5 14

Re: [Dovecot] LDA and postfix with recipient delimiter: documentation
by john.ml＠erba.tv 18 May '09

18 May '09

> Hi John, > no i didnt wrote that, i only have user(a)domain.ext > layout in use currently in my test servers > > -- > Best Regards > > MfG Robert Schetterer > > Germany/Munich/Bavaria > Hi Robert I probably didn't make it clear. The problem with the published syntax is that it does not work for receipient delimiter and delivery to mailbox, except as far as I can see when next_hop is the same as domain, which is not always the case. I think that the documentation should report the syntax with ${domain} instead of ${next_hop}, unless there's something I'm missing, since this should always work. thanks again John

2 1

[Dovecot] migration and conversion from courier
by Giuliano Gavazzi 18 May '09

18 May '09

Dear all, back in January I posted about migration from courier and in particular on the script courier-dovecot-migrate.pl. That script had a bug on BSD (or should I say not-Linux?) type systems*. On FreeBSD (6.1) and MacOSX (10.5) it appended a lot of binary garbage at the end of dovecot-keywords files. On a couple of systems I had not actually run the script with the -- convert option, as I had misunderstood the procedure, so those systems, ironically, are the ones that I migrated better... Now to the issue. My final question at the time was (http://dovecot.org/pipermail/dovecot/2009-January/036292.html) can one delete the dovecot-keywords and rerun the script (leaving alone the dovecot-uidlist)? There is a problem if this cannot be done, as those files have the following structure: 0 flag0 1 flag1 ... m binary garbage [optionally followed by more lines like the last] and if a new keyword is added, the file ends up like (this is copy and paste example): 0 JunkRecorded 1 $NotJunk 2 $Junk 3 Redirected 4 ^A<F0># 5 <B0><96># 6 $Forwarded It does not look like a nice thing to me. I doubt though that the script will cope with flags correctly, as in principle will get the flags from an out of date courierimapkeywords, thus missing any new ones. Perhaps the only solution is to have a new script that deletes the garbage lines and renumbers the following ones, so that the above example would become: 0 JunkRecorded 1 $NotJunk 2 $Junk 3 Redirected 4 $Forwarded and then renames all *g files to *e. Thoughts? Giuliano * This bug was fixed back then by Timo who replaced the script on the site http://www.dovecot.org/tools/courier-dovecot-migrate.pl. But there's no note of the change on the site nor was an announcement made to the list, AFAIK.

2 4

[Dovecot] Quota over NFS
by Flavio Costa 18 May '09

18 May '09

I have accidentaly reply only to Timo, so I'm forwarding to discussion back to the list. Sorry! ---------- Forwarded message ---------- From: Timo Sirainen <tss(a)iki.fi> Date: Mon, May 11, 2009 at 3:12 PM Subject: Re: [Dovecot] Quota over NFS To: Flavio Costa <flavio.cdc(a)gmail.com> On Mon, 2009-05-11 at 15:03 -0300, Flavio Costa wrote: > I get that the server doesn't reply correctly to Dovecot, but the > thing is: why does the LDA works properly? > > May 6 13:15:35 SERVER_NAME deliver(USER_TO): > msgid=<eb4d7eac0905060915y130b9af6i93567e198659d5f7(a)mail.gmail.com>: rejected: Not enough disk space Because it's the NFS server that enforces the quota here. You'd get this error even if you didn't load quota plugin at all. Also note that it's saying "Not enough disk space", not "Quota exceeded" which is the error message from Dovecot v1.0's quota plugin. > And yet, why does 'quota <user>' replies correctly and Dovecot > doesn't? Looking at quota-tools sources, it seemed to ignore the active-check entirely. So I don't know if Dovecot should ignore it too.. > They all obtain the info from the rpc.rquotad running on the > fileserver, right? Yeah. -- Flávio Coutinho da Costa

2 8

[Dovecot] expire plugin error
by Michael Lechtermann 18 May '09

18 May '09

Hi, I am using the db backend for the expire plugin and found the following error message in the logfile: dovecot: Jan 22 10:10:55 Error: dict: secondary db: unable to allocate space from the buffer cache dovecot: Jan 22 10:10:55 Error: dict: Failed to initialize dictionary 'expire' dovecot: Jan 22 10:10:55 Error: IMAP(xxxxxxxxxx): read(/var/dovecot/dict-server) failed: Remote disconnected Anyone know how to fix this? I do not want to use SQL as backend, that would be overkill. # ls -alFh /var/dovecot/dict-server srwxrwxrwx 1 root wheel - 0B Jan 22 10:08 /var/dovecot/dict-server= # dovecot -n # 1.1.8: /etc/dovecot.conf # OS: OpenBSD 4.4 sparc64 ffs base_dir: /var/dovecot/ log_path: /var/log/dovecot.log protocols: imaps pop3s listen: xxxxxxxxxxxx ssl_ca_file: /etc/ssl/xxxxxxxxxxxx.ca ssl_cert_file: /etc/ssl/xxxxxxxxxxxx.crt ssl_key_file: /etc/ssl/private/xxxxxxxxxxxx.key login_dir: /var/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_user: _dovecot mail_max_userip_connections(default): 25 mail_max_userip_connections(imap): 25 mail_max_userip_connections(pop3): 5 first_valid_uid: 10000 last_valid_uid: 19999 first_valid_gid: 100 last_valid_gid: 100 mail_gid: 100 mail_location: mbox:/var/data/mail/%u/mbox:INBOX=/var/data/mail/%u/mbox/inbox:INDEX=/var/dovecot/index/%u mbox_write_locks: fcntl mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): expire imap_quota quota trash zlib mail_plugins(imap): expire imap_quota quota trash zlib mail_plugins(pop3): expire quota zlib mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: bsdauth userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs:user:noenforcing:mount=/var/data trash: /etc/dovecot-trash.conf expire: Trash 14 expire_dict: proxy:/var/dovecot/dict-server:expire dict: expire: db:/var/lib/dovecot/expire.db

3 5