March 2007 - dovecot - dovecot.org

[Dovecot] Multiple delivery with LDA+sieve
by Vincent Bernat 07 Apr '07

07 Apr '07

Hi ! I am still a bit annoyed with the way that Sieve plugin handles multiple delivery into the same folder. For reference : http://www.dovecot.org/list/dovecot/2007-January/019029.html Summary : When a same message (same message-id) is to be delivered twice into the same mailbox, it is delivered twice while I think that the second one should be discarded. Here are a few test cases : - you subscribe to a few mailing lists on topic "X" and deliver all mails from those mailing lists in the same folder. You get twice the mails that are crossposted. - you subscribe to one mailing list and read it regulary so you don't care of receiving messages from this mailing list (you are in Cc when someone answers) in your INBOX. You match on To or Cc to put everything in the same folder. You get messages twice when you are put personally in Cc. - you place a forward from one account to two of your accounts (one is keeping backup, the other don't but delivers faster). You receive all messages twice. With procmail, I handle those (real) cases with formail. I can't with Sieve. I don't see any interest in receiving the same message twice into the same mailbox. Is it possible to maintain a list of recent message-id and mailbox couples to avoid to deliver again a message to the same mailbox ? -- Terminate input by end-of-file or marker, not by count. - The Elements of Programming Style (Kernighan & Plauger)

3 3

[Dovecot] [ rc28 ] dict{} seems to be ignored
by Emiliano Gabrielli (aka AlberT) 06 Apr '07

06 Apr '07

Hi all, I'm new to the list, so ... hello everybody :-) Let's go to the point... I'm implementing quota over imap support in my mail server, so since a number of days I'm tring to upgrade to the new 1.x version (debian sarge) ... After having a number of troubles using the debian backport packege I am now using the -rc28 package that I have built by myself... I installed libmysqlclient14 and compiled dovecot with the following configure options: ./configure --with-ssl=openssl \ --with-mysql \ --disable-ipv6 \ --with-cyrus-sasl2 \ --with-gssapi \ --with-deliver \ --host=$(DEB_HOST_GNU_TYPE) \ --build=$(DEB_BUILD_GNU_TYPE) \ --prefix=/usr \ --sysconfdir=/etc/dovecot \ --libexecdir=\$${prefix}/lib \ --localstatedir=/var \ --mandir=\$${prefix}/share/man \ --infodir=\$${prefix}/share/info \ --with-moduledir=\$${prefix}/lib/dovecot/modules as taken from the sarge-backports debian package and after having removed pgsql, ldap and ipv6 support, as I don't need them... The imap over quota seem to work perfectly, since I can see quota info in IMAP clients (and via telnet) the only thing I can't make work is the dict: storage for quota info!! It seems the dict{ .. } section in the dovecot.conf file is *totally* ignored: dict { quotadict = mysq:/etc/dovecot/dovecot-dict-quota.conf } As you can see I have a typo in the driver name, but no error nor error message is given ... I followed the wiki instruction about Quota/Dict and I have created the necessary table ... that is not filled of course .. Anybody can tell me if may be a compilation problem, a configuration one or a bug in the current dovecot release ?? Thanks in advance -- <?php echo ' Emiliano Gabrielli (aka AlberT) ',"\n", ' GrUSP founder - ZCE ',"\n", ' AlberT_at_SuperAlberT_it - www.SuperAlberT.it ',"\n", ' IRC: #php,#AES azzurra.com ',"\n",'ICQ: 158591185'; ?>

2 18

[Dovecot] Mailbox isn't a valid mbox file
by Jay Chandler 06 Apr '07

06 Apr '07

Keep getting this error within Squirrelmail (and other clients) on one particular user's mailbox file: ERROR: Could not complete request. Query: SELECT "INBOX.Backup" Reason Given: Mailbox isn't a valid mbox file I've snipped the first and last message off of it, still no love. mailserver# cat FILE | od -c | less 0000000 F r o m p r o m o t i o n s @ 0000020 e m e s s a g e . c i s c o . c So apparently there isn't a control character in the first message that'd be causing this either. Anyone have any ideas? Only one user out of many is having this issue, but he's whiny... -- Jay Chandler Network Administrator Chapman University

3 4

Re: [Dovecot] compiling dovecot on aix gcc 3.3.2
by Ralf Becker 05 Apr '07

05 Apr '07

Hello funkypunky drunky, on AIX dovecot plugins (which are shared objects = .so) are a little bit problematic. It is not enough to activate run time linking by using -brtl and make the main program (dovecot) to be able to use shared objects. When a share object does function calls back into the main program, all these functions (=symbols) in dovecot have to be explicitly exported. Otherwise you see "signal 11" or so. Because this is very fiddly, there is a linker flag -bexpall to export all symbols of the main program (dovecot)... but this does seemingly not work with symbols defined in static libraries (.a). While dovecot build creates static libraries to keep the linker command line small, but does *not* generate export files (.exp) containing the libraries globals symbols, the compile time linker does not known anything about them. I think, if dovecot build would use libtool to create the libraries, libtool would export the libraries symbols to fix this. And this is, what my script does. It looks on the compiler command line for library file (.a) and exports all global symbols to an .exp file. The paths of these .exp files are appended to the original compiler command line and so -bexpall knows about the globale symbols defined in the libraries and is able to export them. I don't know if this information is useful for you, because you're using gcc. But if you are using AIX ld (instead of gnu ld) you have to deal with this problem, I think. Regards, Ralf funkypunky drunky schrieb: > Hi Ralf > I check your script. But i cannot udnerstand what you do. R u trying to > export the library of the dovecot? I cannot go deeper. Anyway would you > like to tell what did you do with XLC compiler. Maybe i can setup the > analogy of it when using gcc instead of XLC. > Best regards. > > > 2007/3/27, Ralf Becker <beckerr(a)fh-trier.de <mailto:beckerr@fh-trier.de>>: > > Hello! > > Have you tried to export all symbols defined in lib archives generated > while dovecot is build? I've had this problem on aix with xlC and > solved > it by writing an compiler script for doing that. > > See > http://www.dovecot.org/list/dovecot/2007-February/019226.html > and > http://wiki.dovecot.org/AixPluginsSupport > > Regards, Ralf > > Timo Sirainen schrieb am 26.03.2007 21:08: > > On Mon, 2007-03-26 at 09:24 +0300, funkypunky drunky wrote: > >> I pasted the output of gdb. I hope it is usefull. Thanx > >> > >> This GDB was configured as "powerpc-ibm-aix5.1.0.0"... > >> Core was generated by `imap'. > >> Program terminated with signal 11, Segmentation fault. > >> #0 0xd1a468cc in i_malloc () > >> from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so > >> (gdb) bt full > >> #0 0xd1a468cc in i_malloc () > >> from /usr/local/lib/dovecot/imap/lib10_quota_plugin.so > >> No symbol table info available. > >> #1 0xd1a47cc8 in quota_init () at quota.c:32 > > > > So it crashes at the first Dovecot function it tries to call. Perhaps > > the imap binary isn't exporting the symbols, or something like that. > > I've no idea. Anyway it is most likely related to some linking or > > compiling flags (or the linker/compiler itself). > > > > -- > ______________________________________________________________________ > > Dipl.-Inform. (FH) Ralf Becker Rechenzentrum (r/ft) der FH Trier > (Network|Mail|Web|Firewall) University of applied sciences > Administrator Schneidershof, D-54293 Trier > > Mail: beckerr(a)fh-trier.de > <mailto:beckerr@fh-trier.de> Fon: +49 651 8103 499 > WWW: http://www.fh-trier.de/~beckerr Fax: +49 651 8103 214 > PGP: http://www.fh-trier.de/~beckerr/pgp ICQ: <available> > ______________________________________________________________________ > > Wenn Gott gewollt haette, dass E-Mail in HTML geschrieben wuerden, > endeten Gebete traditionell mit </amen>. (Tom Listen) > > -- ______________________________________________________________________ Dipl.-Inform. (FH) Ralf Becker Rechenzentrum (r/ft) der FH Trier (Network|Mail|Web|Firewall) University of applied sciences Administrator Schneidershof, D-54293 Trier Mail: beckerr(a)fh-trier.de Fon: +49 651 8103 499 WWW: http://www.fh-trier.de/~beckerr Fax: +49 651 8103 214 PGP: http://www.fh-trier.de/~beckerr/pgp ICQ: <available> ______________________________________________________________________ Wenn Gott gewollt haette, dass E-Mail in HTML geschrieben wuerden, endeten Gebete traditionell mit </amen>. (Tom Listen)

2 4

[Dovecot] 1.0.rc29 released
by Timo Sirainen 05 Apr '07

05 Apr '07

http://dovecot.org/releases/dovecot-1.0.rc29.tar.gz http://dovecot.org/releases/dovecot-1.0.rc29.tar.gz.sig Probably one more RC after this. * Security fix: If zlib plugin was loaded, it was possible to open gzipped mbox files outside the user's mail directory. + Added auth_gssapi_hostname setting. - IMAP: LIST "" "" didn't return anything if there didn't exist a namespace with empty prefix. This broke some clients. - If Dovecot is tried to be started when it's already running, don't delete existing auth sockets and break the running Dovecot - If deliver failed too early it still returned exit code 89 instead of EX_TEMPFAIL. - deliver: INBOX fallbacking with -n parameter wasn't working. - passdb passwd and shadow couldn't be used as master or deny databases - IDLE: inotify didn't notice changes in mbox file - If index file directory couldn't be created, disable indexes instead of failing to open the mailbox. - Several other minor fixes

22 41

[Dovecot] --with-vpopmail compile errors
by Oliver Schulze L. 05 Apr '07

05 Apr '07

Hi, I'm building dovecot.src.rpm with vpopmail support and I get this error: if gcc -DHAVE_CONFIG_H -I. -I. -I../.. -I../../src/lib -I../../src/lib-sql -I../../src/lib-settings -I../../src/lib-ntlm -DAUTH_MODULE_DIR=\""/usr/lib/dovecot/auth"\" -DPKG_LIBEXECDIR=\""/usr/libexec/dovecot"\" -I/home/vpopmail/include -std=gnu99 -O2 -g -march=i686 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -I/usr/kerberos/include -std=gnu99 -O2 -g -march=i686 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -I/usr/kerberos/include -MT userdb-vpopmail.o -MD -MP -MF ".deps/userdb-vpopmail.Tpo" -c -o userdb-vpopmail.o userdb-vpopmail.c; \ then mv -f ".deps/userdb-vpopmail.Tpo" ".deps/userdb-vpopmail.Po"; else rm -f ".deps/userdb-vpopmail.Tpo"; exit 1; fi userdb-vpopmail.c: In function `vpopmail_lookup_vqp': userdb-vpopmail.c:30: error: `auth_request' undeclared (first use in this function) userdb-vpopmail.c:30: error: (Each undeclared identifier is reported only once userdb-vpopmail.c:30: error: for each function it appears in.) make[3]: *** [userdb-vpopmail.o] Error 1 make[3]: Leaving directory `/usr/src/redhat/BUILD/dovecot-1.0.rc27/src/auth' make[2]: *** [all-recursive] Error 1 make[2]: Leaving directory `/usr/src/redhat/BUILD/dovecot-1.0.rc27/src' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/usr/src/redhat/BUILD/dovecot-1.0.rc27' make: *** [all] Error 2 error: Bad exit status from /var/tmp/rpm-tmp.73126 (%build) I'm using: - vpopmail from: http://www.qmailtoaster.com/download/stable/vpopmail-toaster-5.4.13-1.3.3.s… - centos 4.4 - dovecot rpm from: http://dl.atrpms.net/all/dovecot-1.0-3_50.rc27.at.src.rpm - rpmbuild command: rpmbuild --rebuild --without inotify --with pam_stack --with forcequota2 --with vpopmail --target=i686 dovecot-1.0-3_50.rc27.at.src.rpm Also, I don't if vpopmail support is official, in that case, this info should go to the devel version of dovecot HTH Oliver -- Oliver Schulze L. | Get my e-mail after a captcha in: Asuncion - Paraguay | http://tinymailto.com/oliver

2 3

[Dovecot] vpopmail "last auth" question
by B. Cook 03 Apr '07

03 Apr '07

Hello, I run the domain for the school here with qmail and vpopmail on FreeBSD with dovecot from the ports. I'm running dovecot 1.0.r26 and everything is working great. I been noticing that dovecot isn't updating when the user last logged in.. and I can't seem to figure out why. I also can't seem to find anything in the archives about it.. so am I the only one? name: bcook passwd: $1$ clear passwd: comment/gecos: B. Cook uid: 0 gid: 0 flags: 0 gecos: B. Cook limits: No user limits set. dir: /usr/local/vpopmail/domains/poughkeepsieschools.org/bcook quota: 41943040S usage: 72% account created: Wed Oct 18 21:09:03 2006 last auth: Never logged in I'm wondering how I could get the 'last auth' to populate like it used to w/ courier. below is my config if it will help: protocols = imap imaps pop3 listen = * disable_plaintext_auth = no ssl_disable = no ssl_cert_file = /long/path/to/file.pem ssl_key_file = /long/path/to/file.pem verbose_ssl = yes login_user = dovecot login_process_size = 64 first_valid_uid = 89 last_valid_uid = 89 first_valid_gid = 89 protocol imap { mail_plugins = quota imap_quota imap_client_workarounds = delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep } protocol pop3 { pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } auth default { mechanisms = plain passdb vpopmail { args = } userdb vpopmail { } user = root } plugin { quota = maildir } Thanks in advance. -- B. Cook Network Analyst Poughkeepsie City School District Mobile: 845.264.5827 | Desk: 845.451.4791

4 4

[Dovecot] prefetch + static + deliver
by Tom Bombadil 02 Apr '07

02 Apr '07

Hi all... The prefetch entry in the wiki says: "If you're using Dovecot's local delivery agent, you'll still need a valid userdb which it can use to locate the users. You can do this by adding a normal sql/ldap userdb after userdb prefetch." (http://wiki.dovecot.org/UserDatabase/Prefetch) My question is: Does it need to be a SQL/LDAP userdb? How about static or passwd? Thanks in advance :)

3 3

[Dovecot] Using Dovecot LDA with Sendmail
by Scott Peron 02 Apr '07

02 Apr '07

Hi all, After looking at the LDA/Sendmail page in the dovecot wiki, I wanted to contribute another method to easily configure Sendmail to use deliver. Instead of adding a new mailer definition, as already suggested, one can simply use the following line in their sendmail.mc file instead: FEATURE(`local_procmail', `/usr/libexec/dovecot/deliver', `deliver -d $u', `SPhnu9')dnl And further on, still use: MAILER(procmail)dnl The location of deliver will of course vary for each OS and distro, etc, but this redefines the "procmail" mailer in the resulting sendmail.cf to use deliver instead, with the correct flags. For most setups, I believe this is the simplest configuration path. Scott -- Scott Peron, Webmaster, Infolytica Corp. webmaster(a)infolytica.com Tel: (514) 849-8752 x269 Fax: (514) 849-4239 http://www.infolytica.com Place du Parc, 300 Leo-Pariseau, Suite 2222, Montreal, QC, Canada, H2X 4B3

4 3

[Dovecot] Unexpected behaviour when deleteing a big mailbox
by Steffen Kaiser 02 Apr '07

02 Apr '07

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, my last tests left me with a mailbox with > 80'000 messages in Maildir. Dovecot served them fine. No problem. I usually use IMAP's "Mark messages a deleted" function and expunge later. Because the "Move to Trash" is default in many MUAs, I decided to try it on this mailbox. I do think that it is hard to detect and prevent such problem, but could it be implemented that when the client connection times out, the COPY process is terminated and rolled back? I mean, as long as the messages are copied/linked to */tmp nothing is done, yet, hence, a simple cleanup of */tmp would result in a rollback. Due to the timeout, the EXPUNGE wasn't issued so far and the source mailbox is unchanged. Or, is it possible to prevent two COPYs of an overlapping message range into the same destination folder simultaneously? Or, can I prevent to COPY such a huge range of messages at once? I know 80'000 messages are much, but I have users with an INBOX of at least 40'000, eventually moving all files into an archive mailbox. I'm also surprised to find that I didn't get two full copies of the source mailbox. ============== Start situation: 4.8G .box1 (I didn't recorded the individual subdirs, unfortunately.) # find .box1 -type f | wc -l 84273 Newly created .Trash. === I started Thunderbird, let sync the mailbox, selected them all, and pressed "Delete". Some time later: Connection timed out. I, wondered, and hit "Delete" a second time. Again, connection timed out. === I was surprised, however, to see that the Dovecot log with still active telling me that mails are copied to Trash. I ended up with two processes copying all messages to .Trash/tmp on the server. The process I traced a bit later linked any file after the other. What I wondered right from the beginning was, that du -hs .??* displayed about 3.5GB in .Trash, but still 4.8GB in .box1. So, why are there 3.5GB additional files in .Trash, when I configured Dovecot to use hardlinks? The end situation is that .box1 contains all messages still, but any Unseen messages are moved to .box1/cur, and .Trash contains: 7.4G .Trash/cur 791M .Trash/new 76K .Trash/tmp # find .Trash/ -type f | wc -l 121713 The size nearly doubled. # du -hs .box1 ; du -sh .Trash/ 4.8G .box1 8.2G .Trash/ ==== Last lines in Dovecot log: dovecot: Mar 21 11:46:15 Info: IMAP(dvtest) [11535]: copy -> Trash: uid=83964, msgid=<xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx(a)xx-xxxx-xxxxx-xxxx.xx>, box=box1 dovecot: Mar 21 11:46:15 Info: IMAP(dvtest) [11535]: copy -> Trash: uid=83965, msgid=<xxxxxxxx.xxxxxxx(a)xx-xxxx-xxxxx-xxxx.xx>, box=box1 dovecot: Mar 21 11:46:29 Info: IMAP(dvtest) [11535]: Disconnected: Mailbox is in inconsistent state, please relogin. Last lines of strace: fstat64(13, {st_mode=S_IFREG|0600, st_size=1341104, ...}) = 0 stat64("/var/cache/dovecot/31045/index/.box1/dovecot.index", {st_mode=S_IFREG|0600, st_size=1341104, ...}) = 0 alarm(120) = 0 fcntl64(13, F_SETLKW64, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}, 0xbfe562d4) = 0 alarm(0) = 120 fstat64(13, {st_mode=S_IFREG|0600, st_size=1341104, ...}) = 0 mmap2(NULL, 1341104, PROT_READ|PROT_WRITE, MAP_SHARED, 13, 0) = 0xb3ffc000 munmap(0xb4285000, 1341104) = 0 write(1, "* 7998 FETCH (FLAGS ($Label2 $La"..., 2067) = 2067 write(1, "* 8091 FETCH (FLAGS (\\Answered \\"..., 2056) = -1 EPIPE (Broken pipe) - --- SIGPIPE (Broken pipe) @ 0 (0) --- munmap(0xb7cbc000, 1341104) = 0 fcntl64(13, F_SETLK64, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}, 0xbfe56394) = 0 write(2, "\1IDisconnected: Mailbox is in in"..., 66) = 66 # /usr/local/dovecot.rc27/sbin/dovecot -n # /usr/local/dovecot.rc27/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot/dovecot.log protocols: imap imaps pop3 pop3s ssl_ca_file: /etc/ssl/certs/ca.crt ssl_cert_file(default): /etc/ssl/certs/imap.pem ssl_cert_file(imap): /etc/ssl/certs/imap.pem ssl_cert_file(pop3): /etc/ssl/certs/pop3.pem ssl_key_file(default): /etc/ssl/private/imap.key ssl_key_file(imap): /etc/ssl/private/imap.key ssl_key_file(pop3): /etc/ssl/private/pop3.key disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot//login login_executable(default): /usr/local/dovecot.rc27/libexec/dovecot/imap-login login_executable(imap): /usr/local/dovecot.rc27/libexec/dovecot/imap-login login_executable(pop3): /usr/local/dovecot.rc27/libexec/dovecot/pop3-login login_log_format_elements: %p: user=<%u> method=%m rip=%r lip=%l %c verbose_proctitle: yes first_valid_uid: 1000 mail_location: maildir:%h/MailDir:CONTROL=/var/cache/dovecot/%i/control:INDEX=/var/cache/dovecot/%i/index mail_debug: yes dotlock_use_excl: yes maildir_copy_with_hardlinks: yes maildir_copy_preserve_filename: yes mail_drop_priv_before_exec: yes mail_executable(default): /usr/local/dovecot.rc27/libexec/dovecot/imap mail_executable(imap): /usr/local/dovecot.rc27/libexec/dovecot/imap mail_executable(pop3): /usr/local/dovecot.rc27/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_log zlib mail_plugins(imap): quota imap_quota mail_log zlib mail_plugins(pop3): quota mail_log mail_plugin_dir(default): /usr/local/dovecot.rc27/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/dovecot.rc27/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/dovecot.rc27/lib/dovecot/pop3 mail_log_prefix: %Us(%u) [%p]: mail_log_max_lines_per_sec: 30 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %u pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): oe-ns-eoh namespace: type: private separator: . inbox: yes hidden: yes auth default: mechanisms: plain login cache_size: 10 username_chars: abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890 verbose: yes debug: yes passdb: driver: ldap args: /usr/local/dovecot.rc26/etc/dovecot-ldap.conf passdb: driver: shadow userdb: driver: prefetch userdb: driver: ldap args: /usr/local/dovecot.rc26/etc/dovecot-ldap.conf userdb: driver: passwd-file args: /etc/passwd socket: type: listen client: path: /var/run/dovecot/auth-client mode: 432 master: path: /var/run/dovecot/auth-master mode: 432 group: mail plugin: quota: fs Bye, - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBRgFBGy9SORjhbDpvAQLBcQf+OAqiufFlyPqJTyM3Ylkmiae2afXPe2wl bNWg6AyDrdvFw+rtdc5vnYukQUSk2a8zQBggt3Rfb1zZQb0pszrzLdR+fOwnW2uE kDyHRhyy88aVpM848oQKYnlWdNHFrdwbyp2myU4JxJhu0bXsAhyMgf9txshwe5cd 23O1x+gkWUp+1wuz84uTep3Kcs1wVXWANEN5RT4YMI3MOqMrcyB+P0lj0luy0HTH HE9T6mLqzGt0Cw6yfm+1W8bU3Wnt3C5je15gT++OPd5YmDvpQs+fOjavDIITsuOf jBck4N+KjwOM+FzP8Ea1WNWCvObJKdeiISkoFWFO9bafw5Yue9hFNA== =yyP5 -----END PGP SIGNATURE-----

6 17