October 2006 - dovecot

[Dovecot] errors on copying messages to sent-mail
by Herr Nagengast 03 Nov '06

03 Nov '06

Howdy, In rc10 I'm still experiencing the occasional error copying mail to my sent messages folder. This is on Thunderbird 1.5.0.7 on a Mac. My configure command: ./configure --without-shadow --localstatedir=/var -with-cyrus-sasl2 --without-gssapi --without-vpopmail --prefix=/usr/local --build=i386-portbld-freebsd5.3 FYI, Todd

2 2

[Dovecot] compiling dovecot-sieve
by Fintec 02 Nov '06

02 Nov '06

Our server is an CentOS4.4 box and we use the atrpms built RPMs for installing dovecot. I am wanting to use the sieve plug-in so I've followed the dovecot wiki instructions, downloaded the files from CVS, but I'm not sure what configure options to use. When I try without any options I get: dovecot-config not found from /usr/src/dovecot-sieve, use --with-dovecot=PATH to give path to compiled Dovecot sources I tried using "./configure --with-dovecot=/usr/libexec/dovecot" but get the same problem. Any help would be greatly appreciated. Gavin -- ATRPMS RPM file listing -- /etc/dovecot.conf /etc/pam.d/dovecot /etc/pki/dovecot/dovecot-openssl.cnf /etc/rc.d/init.d/dovecot /usr/lib64/dovecot/imap /usr/lib64/dovecot/imap/lib01_acl_plugin.so /usr/lib64/dovecot/imap/lib01_convert_plugin.so /usr/lib64/dovecot/imap/lib01_quota_plugin.so /usr/lib64/dovecot/imap/lib01_zlib_plugin.a /usr/lib64/dovecot/imap/lib01_zlib_plugin.la /usr/lib64/dovecot/imap/lib01_zlib_plugin.so /usr/lib64/dovecot/imap/lib02_imap_quota_plugin.a /usr/lib64/dovecot/imap/lib02_imap_quota_plugin.la /usr/lib64/dovecot/imap/lib02_imap_quota_plugin.so /usr/lib64/dovecot/imap/lib02_trash_plugin.so /usr/lib64/dovecot/lda /usr/lib64/dovecot/lda/lib01_acl_plugin.so /usr/lib64/dovecot/lda/lib01_convert_plugin.so /usr/lib64/dovecot/lda/lib01_quota_plugin.so /usr/lib64/dovecot/lda/lib02_trash_plugin.so /usr/lib64/dovecot/lib01_acl_plugin.a /usr/lib64/dovecot/lib01_acl_plugin.la /usr/lib64/dovecot/lib01_acl_plugin.so /usr/lib64/dovecot/lib01_convert_plugin.a /usr/lib64/dovecot/lib01_convert_plugin.la /usr/lib64/dovecot/lib01_convert_plugin.so /usr/lib64/dovecot/lib01_quota_plugin.a /usr/lib64/dovecot/lib01_quota_plugin.la /usr/lib64/dovecot/lib01_quota_plugin.so /usr/lib64/dovecot/lib02_trash_plugin.a /usr/lib64/dovecot/lib02_trash_plugin.la /usr/lib64/dovecot/lib02_trash_plugin.so /usr/lib64/dovecot/pop3 /usr/lib64/dovecot/pop3/lib01_convert_plugin.so /usr/lib64/dovecot/pop3/lib01_quota_plugin.so /usr/libexec/dovecot /usr/libexec/dovecot/checkpassword-reply /usr/libexec/dovecot/deliver /usr/libexec/dovecot/dict /usr/libexec/dovecot/dovecot-auth /usr/libexec/dovecot/gdbhelper /usr/libexec/dovecot/imap /usr/libexec/dovecot/imap-login /usr/libexec/dovecot/pop3 /usr/libexec/dovecot/pop3-login /usr/libexec/dovecot/rawlog /usr/libexec/dovecot/ssl-build-param /usr/sbin/dovecot /usr/sbin/dovecotpw /usr/share/doc/dovecot-1.0 /usr/share/doc/dovecot-1.0/REDHAT-FAQ.txt /usr/share/doc/dovecot-1.0/USE-WIKI-INSTEAD /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration/maildir-migration.txt /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration/migrate-folders /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration/migrate-users /usr/share/doc/dovecot-1.0/UW-to-Dovecot-Migration/perfect_maildir.pl /usr/share/doc/dovecot-1.0/auth-protocol.txt /usr/share/doc/dovecot-1.0/auth.txt /usr/share/doc/dovecot-1.0/configuration.txt /usr/share/doc/dovecot-1.0/design.txt /usr/share/doc/dovecot-1.0/examples /usr/share/doc/dovecot-1.0/examples/dovecot-ldap.conf /usr/share/doc/dovecot-1.0/examples/dovecot-sql.conf /usr/share/doc/dovecot-1.0/examples/mkcert.sh /usr/share/doc/dovecot-1.0/index.txt /usr/share/doc/dovecot-1.0/mail-storages.txt /usr/share/doc/dovecot-1.0/multiaccess.txt /usr/share/doc/dovecot-1.0/nfs.txt /usr/share/doc/dovecot-1.0/securecoding.txt /usr/share/doc/dovecot-1.0/variables.txt /var/cache/dovecot /var/cache/dovecot/indexes /var/run/dovecot /var/run/dovecot/login

3 15

[Dovecot] making dovecot and exim write to one log
by Zbigniew Szalbot 02 Nov '06

02 Nov '06

Hello, I am looking for some advice. I am trying to force dovecot to run to the same log as exim does. In dovecot.conf I put the exim log path /var/log/exim/mainlog. I restarted dovecot and the process worked fine. However at midnight exim log file is rotated and since then dovecot stops logging to this log. In syslog.conf I put: mail.* /var/log/exim/mainlog And in newsyslog.conf I have: /var/log/exim/mainlog mailnull:mail 640 60 * @T00 Z I used to have an N flag next to Z but after reading the man I realized that its job is not to inform other processes about log creation. My qeustion is how do I set up things that dovecot and exim happily write to one log without having to restart dovecot at midnight? I am fairly new to FreeBSD which I use so I beg your patience with me. Thanks! -- Zbigniew Szalbot

2 1

Re: [Dovecot] deliver + quota failure
by Mark Ruijs 02 Nov '06

02 Nov '06

I investigated the deliver with quota's bug a little more (rc10, mysql, virtual domains, maildir). My log files reads: deliver(test(a)ruijs.cc): Info: msgid=<000f01c6fac1$bd4e8670$8801a8c0@Moskou>: save failed to INBOX deliver(test(a)ruijs.cc): Info: sieve runtime error: Keep: Generic Error deliver(test(a)ruijs.cc): Info: msgid=<000f01c6fac1$bd4e8670$8801a8c0@Moskou>: save failed to INBOX deliver(test(a)ruijs.cc): Error: open(ruijs.cc/test//.temp.in2sports2.vianetworks.nl.13210.72d247ac698d0019) failed: No such file or directory deliver(mark(a)ruijs.cc): Info: msgid=<dovecot-1162066721-407295-0(a)in2sports2.vianetworks.nl>: saved mail to Junk Dovecot tries to deliver, but notices quota exceeded. I don't think Sieve is playing a role here - I added Sieve before I encountered the problem. Two problems: 1) The .dovecot.lda-dupes can't be written (that's what the open...failed notice is about). 2) The Quota Exceed mail seem to contain mal-formed headers (that's why it the notice-mail ends in my junk-folder). Digging into deliver.c, I noticed that auth_client_put_user_env() changes the HOME environment from /var/mail (which is ok), to ruijs.cc/test/ (which is the maildir, relative to /var/mail). And then fopen fails (see the trace below). So I think that the code auth_socket = getenv("AUTH_SOCKET_PATH"); if (auth_socket == NULL) auth_socket = DEFAULT_AUTH_SOCKET_PATH; ret = auth_client_put_user_env(ioloop, auth_socket, destination, process_euid); if (ret != 0) return ret; home = getenv("HOME"); if (home != NULL) { /* If possible chdir to home directory so core file could be written. If it fails, don't worry. */ (void)chdir(home); is the key. Should the chdir be done *before* the call to auth_client_put_user_env()? I'm not familiar with the internal workings of the Dovecot LDA, so I won't suggest a proper fix. Who will. As for the mal-formed headers, I'll take a look at it later. Mark #0 i_error (format=0x80ac5f7 "open(%s) failed: %m") at failures.c:203 #1 0x0809f900 in dotlock_create (path=0x9ece2c0 "ruijs.cc/test//.dovecot.lda-dupes", dotlock=0x9edfc48, flags=Variable "flags" is not available. ) at file-dotlock.c:265 #2 0x0809fb71 in file_dotlock_open (set=0x80b9c90, path=0x9ece2c0 "ruijs.cc/test//.dovecot.lda-dupes", flags=0, dotlock_r=0x9ee7920) at file-dotlock.c:614 #3 0x08056ec5 in duplicate_new (path=0x9ece2c0 "ruijs.cc/test//.dovecot.lda-dupes") at duplicate.c:157 #4 0x080571c6 in duplicate_mark (id=0x9ece270, id_size=55, user=0xbf9edb45 "test(a)ruijs.cc", time=1162163205) at duplicate.c:195 #5 0x080573c9 in mail_send_rejection (mail=0x9ede7e0, recipient=0xbf9edb45 "test(a)ruijs.cc", reason=0x9edc218 "Quota exceeded") at mail-send.c:51 #6 0x08056c51 in main (argc=5, argv=0xbf9ec5d4) at deliver.c:595

3 4

[Dovecot] another suggestion
by Hans Morten Kind 02 Nov '06

02 Nov '06

On our solaris systems we quite often sees dovecot coredump on exit when trying to free a null buffer. After including if (array->buffer == NULL) return; in array_free() in array.h these coredums have been avoided. hmk

2 1

[Dovecot] BUG in RC10 deliver using mbox format
by Steven F Siirila 02 Nov '06

02 Nov '06

After recently adding the -f parameter to the call to the deliver command which is called by Postfix, I found that e-mail with a null return path (MAIL FROM:<>) was causing Dovecot deliver to SEGFAULT. I verified this by making this patch to deliver.c (notice I fixed a typo here, too): *** deliver.c.orig Fri Oct 13 07:32:28 2006 --- deliver.c Fri Oct 27 21:26:08 2006 *************** *** 446,454 **** i++; if (i == argc) { i_fatal_status(EX_USAGE, ! "Missing envleope argument"); } ! envelope_sender = argv[i]; } else { print_help(); i_fatal_status(EX_USAGE, --- 446,455 ---- i++; if (i == argc) { i_fatal_status(EX_USAGE, ! "Missing envelope argument"); } ! if (*argv[i]) ! envelope_sender = argv[i]; } else { print_help(); i_fatal_status(EX_USAGE, While this fixed my SEGFAULT, it still leaves the "From_" line with the default "dovecot.deliver" as the return path, something I don't want. It should be "MAILER-DAEMON" or some-such just like all the other LDAs in the case of a NULL return path. Perhaps there needs to be a new parameter so one can specify what a NULL return path should be converted to when it is encountered... Also, note that the "Usage" message in deliver.c does not include the relatively new -f option either, so that should have been part of my above patch as well. -- Steven F. Siirila Office: Lind Hall, Room 130B Internet Services E-mail: sfs(a)umn.edu Office of Information Technology Voice: (612) 626-0244 University of Minnesota Fax: (612) 626-7593

3 2

[Dovecot] quota with sendmail and dovecot
by Antonio Casado Rodríguez 02 Nov '06

02 Nov '06

I have a problem with dovecot and quotas I don't want quota in INBOX with sendmail (mbox), it's work ok. Sendmail can put the new messages in INBOX although exceed the quota limit. I have two namespace in dovecot: namespace private { separator = / inbox = yes prefix = "#mbox/" location = mbox:/Public/Maildir/%n_mbox_indexes:INBOX=/var/mail/%n } namespace private { separator = / prefix = "" location = maildir:/Public/Maildir/%n } I have this quota: plugin { quota = maildir:storage=10240 } It's work ok, i have 10 MB in INBOX and i have 10 MB in maildir. My clients are Mozilla Thunderbird My problem: when Sendmail put one new message in INBOX, Thunderbird see it, but the quota don't change. I think that when dovecot do a full sync it must update the quota.

2 1

[Dovecot] Dovecot-auth stand alone
by Jorgen Lundman 02 Nov '06

02 Nov '06

Since you have to have a SASL implementation with Postfix, either Cyrus or Dovecot, would it be feasable to have autoconf options to build only those parts required? Currently I attempt to disable most things, except for LDAP which we want to use: ./configure --with-ldap --without-pop3d --without-passwd --without-passwd-file --without-shadow --without-pam --without-checkpassword --without-bsdauth --without-vpopmail --without-ssl --without-deliver --without-sql-drivers --with-storages= That still compiles, and installs, imap. No way to stop that. However, master process "dovecot" does not want to start with "protocols=" set to empty. This is somewhat understandable, but I really do not want any listening ports, just the Unix auth socket and dovecot-auth process. Bind localhost for now? I take it I should run dovecot-auth as stand-alone, setting the AUTH_1 environment variable as well as a few others. Lund -- Jorgen Lundman | <lundman(a)lundman.net> Unix Administrator | +81 (0)3 -5456-2687 ext 1017 (work) Shibuya-ku, Tokyo | +81 (0)90-5578-8500 (cell) Japan | +81 (0)3 -3375-1767 (home)

3 5

[Dovecot] 1.0.rc10 status report
by David Lee 02 Nov '06

02 Nov '06

(Background: Relatively new to dovecot; looking to do transparent replacement of long-established UW-IMAP on cluster of Linux boxes which NFS-mount a shared "/var/spool/mail".) With rc8, where I had already increased "login_max_processes_count" from default 128 to 1024, we had still hit the issue of too many logins crashing dovecot, so that trial had only lasted a couple of hours. With rc10, I doubled this to try to avoid the problem (I didn't want to risk testing the new code that addressed the problem... sorry!). We ran for almost a full working day. Good! Because of a few issues (below) I then backed off. 1. "User unknown": We use NIS for our passwd information. On the earlier rc8 test we had had several occurences of "User unknown" (from "deliver") giving "dsn=5..." for perfectly valid users. So for this rc10 test I applied a local patch so these were reduced to "EX_TEMPFAIL" (dsn=4...). (This was triggered, as epected, a few times and subsequent delivery attemtps succeeded.) I strongly suspect that this is some sort of issue with FC5, probably "nscd" and nothing to do with dovecot. Hints would be nice, but from the dovecot perspective you may probably ignore this item. 2. For one particular user, the "deliver" consistently gave: Failed to create storage for '...' with mail 'mbox:/HOME_DIRECTORY_USED_BUT_NOT_GIVEN_BY_USERDB:INBOX=... I think this is ultimately due to something strange in the user ".forward" file. I'd be delighted to follow this up with anyone else who might have seen it. Although in one sense we may be drifting off-topic, in another sense I suspect that there is scope for adjusting "deliver" to handle this more gracefully. 3. There were several occurences of: IMAP(...): file ../../../../../src/lib-storage/index/mbox/mbox-sync-rewrite.c: line 405 (mbox_sync_read_and_move): assertion failed: (need_space == (uoff_t)-mails[idx].space) child 30842 (imap) killed with signal 6 This looks particularly awkward. Any thoughts? 4. There were two occurences of: IMAP(...): file ../../../src/lib-index/mail-index.c: line 1801 (mail_index_move_to_memory): assertion failed: (index->fd == -1) child 20493 (imap) killed with signal 6 Again, this looks particularly awkward. Any thoughts? For these last two items, note that the indexes are currently NFS-shared alongside the INBOX area. I'm still not clear on how to regard the concept of indexes, as applied to a small cluster of machines, and handling simultaneous updates to INBOXes (analogous to the vital importance of INBOX locking for such updates). If one imagines the IMAP daemon (and pop and deliver) as file-clients of the (NFS-shared) INBOXes on a fileserver, do the indexes belong very close to the INBOXes (fileserver) or the dovecot software (file client)? So should I have the indexes on the fileserver (one instance), or should they be on each cluster machine's private storage (possibly several instances; one per cluster machine)? I've got them on the server; would they be better on the cluster clients? (Might that be the cause and fix of these two problems?) -- : David Lee I.T. Service : : Senior Systems Programmer Computer Centre : : Durham University : : http://www.dur.ac.uk/t.d.lee/ South Road : : Durham DH1 3LE : : Phone: +44 191 334 2752 U.K. :

3 2

[Dovecot] deliver + quota failure
by Mark Ruijs 02 Nov '06

02 Nov '06

I use Dovecot's deliver as the LDA for Postfix in a virtual user setting. My maillog reads: Oct 22 00:17:51 mail dovecot: auth(default): master in: USER 1 mark.ruys(a)in2sports.net service=deliver Oct 22 00:17:51 mail dovecot: auth-worker(default): sql(mark.ruys(a)in2sports.net): SELECT maildir AS home, 5000 AS uid, 5000 AS gid, CONCAT('dirsize:storage=', round(quota/1000)) AS quota FROM mailbox WHERE username = 'mark.ruys(a)in2sports.net' AND active = 1 Oct 22 00:17:51 mail dovecot: auth(default): master out: USER 1 mark.ruys(a)in2sports.net home=in2sports.net/mark.ruys/ uid=5000 gid=5000 quota=dirsize:storage=10240 Oct 22 00:17:51 mail deliver(mark.ruys(a)in2sports.net): msgid=<00c801c6f55e$af416fb0$8801a8c0@Moskou>: save failed to INBOX Oct 22 00:17:51 mail deliver(mark.ruys(a)in2sports.net): open(in2sports.net/mark.ruys//.temp.mail.in2sports.net.12777.5c70c02bb158bd1 a) failed: No such file or directory The reason is, I'm out of quota. I expected some kind of bounce, but the message is killed by Amavis because of a bad header: Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit Your message was automatically rejected by Dovecot Mail Delivery Agent. The following reason was given: Quota exceeded --12684/mail.in2sports.net Content-Type: message/disposition-notification Reporting-UA: mail.in2sports.net; Dovecot Mail Delivery Agent Final-Recipient: rfc822; mark.ruys(a)in2sports.net The problem is, there is no recipient (header is missing). Anyone a clue how to fix it? Thanks for some directions. Mark Ruys Config: - Dovecot rc 10 - postfix-2.3.3-2.mysql.sasl2.vda.fc4 dovecot.conf: protocol imap { mail_plugins = quota imap_quota } protocol lda { postmaster_address = postmaster(a)in2sports.net mail_plugins = quota auth_socket_path = /var/run/dovecot/auth-master } postfix/main.cf: dovecot_destination_recipient_limit = 1 virtual_transport = dovecot virtual_create_maildirsize = yes virtual_mailbox_limit_maps = mysql:/etc/postfix/mysql/limits.cfg virtual_mailbox_limit_override = yes virtual_overquota_bounce = yes

2 1