- dovecot - dovecot.org

[Dovecot] 1.0alpha1: new assert/core
by Jeff A. Earickson 07 Sep '05

07 Sep '05

Hi, I saw a new assert and core dump today in 1.0alpha1. Setup is Solaris 9, dovecot built with gcc 4.0.1, running as imap server for mbox format. The syslog said: IMAP(user): file message-body-search.c: line 393 (message_body_search_ctx): assertion failed: (input->v_offset <= part->physical_pos) A gdb analysis of the core dump is attached. BTW, I save core dumps in case you need further debugging done for an assert. On another note, I have also had issues with dovecot locking up with "Too many open files" syslog error messages. Last night, after several hours of "too many open files" complaints, the master dovecot process just died -- no core dump and no complaint to syslog. Per advice of the list, I have doubled the rlim_fd_cur and rlim_fd_max kernel parameters and rebooted my imap server. I also saw in my syslog: Sep 6 16:48:53 emerald dovecot: [ID 956436 mail.error] pipe() failed: Too many open files Sep 6 16:48:53 emerald dovecot: [ID 257797 mail.crit] dup2(stderr) failed: Bad file number With students back, they have been giving dovecot a real hard workout. Jeff Earickson Colby College

1 0

Re: [Dovecot] dovecot/pop-before-smtp
by Lorens 07 Sep '05

07 Sep '05

On Tue, Sep 06, 2005 at 04:50:12PM -0700, Micah Stevens wrote: > Okay, just tried this. Doesn't work. I'm using 0.99 as packaged for RHEL 3. > Would that make a difference? Yes. The syntax changed. > login_executable = /usr/libexec/dovecot/popbsmtp.sh > /usr/libexec/dovecot/imap-login I'm fairly certain that login_executable is not the same thing as the mail_executable. > Starting IMAP daemon (dovecot): Fatal: Can't use login executable > /usr/libexec/dovecot/popbsmtp.sh /usr/libexec/dovecot/pop3-login: No such > file or directory Especially as the popbsmtp script should be launched for each login, and not at daemon start. In 1.0 there are two executables, mail_executable launched for logins, and (from memory) auth_executable launched at daemon start, so I suppose login_executable is the wrong one :-) I diagnose the error you get as meaning that the space is not ed separat out, and that dovecot tries to fork the executable named /usr/libexec/dovecot/popbsmtp.sh /usr/libexec/dovecot/pop3-login which obviously won't work. > Permissions are 777 on the popbsmtp.sh script. I double checked this. > > I tried to just copy the config as stated, but dovecot didn't parse it, > that's why I'm assuming it's for 1.x versions: Correct. Not good enough at 0.99 to say what the equivalent would be (I found that I needed 1.0 before I tried to do pbsmtp). > So I'm stuck, I also tried putting an insert statement on the user_query, > but that fails as Lorens mentioned. Problem with direct SQL is that I can't manage to make dovecot execute two SQL statements. If you're using a db with stored procedures you could maybe squeeze through that loophole, but your best bet is to find out what user_executable should be (maybe the same thing?) > Back to pop-before-smtp which doesn't work either, but it works better. :) :-) HTH

1 0

[Dovecot] 1.0-test75 and roadmap for v1.0
by Timo Sirainen 07 Sep '05

07 Sep '05

http://dovecot.org/test/ Keywords are finally stored in maildir filenames and listed in "dovecot-keywords" file. It should be possible to just rename 0.99.x's .customflags file to dovecot-keywords (but it can't be renamed back after modification). Also fixed another uid/sequence mixup bug with setting keywords in general (in mbox too). Fixed SHA1 checksum generation with big-endian machines (used only in passwords). I think I'll forget about the master/config rewrite for a while and leave it for Dovecot v2.0. That would mean the next release will be called 1.0-alpha1. After that there should be only bugfixes and some smaller features and optimizations left. I looked through my TODO and found the following missing features / optimizations that pretty much have to be done before v1.0. Anything important missing? - keywords: - add some limits to how many there can be - send FLAGS/PERMANENTFLAGS untagged replies when they change (required by IMAP RFC) - remove unused keywords from keyword list? (only when adding new ones) - mail cache file - cache _all_ headers that are marked to be cached when headers are being parsed, not just the ones client is requesting at that time. - compression should drop fields with last_used < (latest_mail_index_date - month) - when parsing mbox or saving message, parse the mail through index-mail so things gets saved into cache immediately - mbox - when we're updating flags with lazy writing, we're still parsing the mbox, just not writing to it! - always add empty line after mail. - make the parser require it too? syncing should make sure there always exists two LFs at end of file. raw-mbox-stream should make sure the last message ends with LF even if it doesn't exist in the file - COPY doesn't work to same mailbox (lock assert crash) - keep mbox lock for two extra seconds after sync to make sure we notice changes made by other mbox writer software - maildir - hardlink copying doesn't update indexes (does it even work?) - deliver needs quota integration somehow so it returns out-of-quota failure as fatal instead of temporary Probably after v1.0: - Full NFS support - Try to handle out-of-quota/disk space situations well

8 18

[Dovecot] 1.0.alpha1: Namespaces
by Wolfram Schlich 06 Sep '05

06 Sep '05

Hi, I'm currently using 1.0.alpha1 without luck regarding a namespace issue. Maybe it's a general understanding problem on my side, but let's see :-) I would like to have my mail stored in Maildir format below ~/.maildir/, which works fine so far. I want any (sub)folders to be created like this: ~/.maildir/ /cur /new /tmp /.Folder/ /cur /new /tmp /.Subfolder/ /cur /new /tmp BUT ;) Dovecot seems to disregard my namespace settings: --8<--[ /etc/dovecot.conf ]--8<-- default_mail_env = maildir:~/.maildir:INDEX=MEMORY namespace private { separator = / # prefix = # location = maildir:~/.maildir inbox = yes hidden = no } --8<-- Every new (sub)folder I create is stored as ~/.maildir/.Folder resp. ~/.maildir/.Folder.Subfolder in the filesystem. Are namespaces the right way? Is it possible at all? Thanks in advance. -- Wolfram Schlich

5 7

Re: [Dovecot] An alternate "dovecot-auth" daemon using cyrus-sasl
by Andrey Panin 06 Sep '05

06 Sep '05

On 249, 09 06, 2005 at 01:35:58PM +0400, Dmitry Butskoy wrote: > Andrey Panin wrote: > > >On 248, 09 05, 2005 at 03:48:19PM +0400, buc wrote: > > > > > >>We use dovecot in a heterogeneous environment (Windows/Linux desktops > >>and Linux servers). For unified authentication we use a sheaf > >>"Samba/Openldap" (i.e., Samba NT domain with openldap backend and > >>pam/nss_ldap for Linux). > >> > >> > >So why you can't use dovecot with openldap as passdb ? > > > Yes, now we use dovecot with pam, which uses openldap by pam_ldap etc... > But PAM can handle plain passwords only, therefore it is not suitable > for NTLM. > I have not found it in examples, but may be dovecot`s ntlm can take > appropriate password hashes from openldap directly? > (sambaLMPassword/sambaNTPassword) Yes, dovecot can handle LM/NTLM password hashes and it can fetch them from OpenLDAP directly (look at doc/dovecot-ldap.conf) In general you can store passwords in any supported form, just add proper password scheme prefix. For example: {NTLM}69943C5E63B4D2C104DBBCC15138B72B For more information read here: http://wiki.dovecot.org/Authentication > >>Windows users are authenticated well everywhere, but there is one old > >>issue. As "SPA" (NTLM) against NT domain is not supported by dovecot, it > >>is necessary to use default "plain" method. In addition to security > >>problems, it does also a problem of password unification. Each time a > >>user changes the password, he should do it one more time for the mail > >>program. > >> > >>I know that dovecot supports NTLM, however against local database only > >>(not for NT domain controller). In early versions support of cyrus-sasl > >>(which supports NTLM now) had been incorporated, however it like not > >>work and now is removed. > >>Fortunately, there is a possibility to substitute dovecot-auth > >>executable. Therefore I have tried to make an alternate variant of > >>dovecot-auth, which supports all that we need. > >> > >>For us, it seems to be more useful to create an auth daemon using > >>cyrus-sasl, rather than to add domain support to existing ntlm code. > >>First of all, it is easier for implementation. Besides it enables use of > >>all mechanisms supported by cyrus-sasl (present and future), including > >>GSSAPI. Anyway, it will be the useful additive to dovecot. > >> > >> > > > >Dovecot doesn't support cyrus-sasl for a good reason - it's a mess. > > > > > Certainly, I do not suggest to switch to use cyrus-sasl in upstream dovecot. > > But can give this patch the right to a life? Somewhere in "unofficial > patches"... > > >>I have made appropriate patches for both dovecot-1.0-stable and > >>dovecot-1.0.alpha1. > >>The idea is to copy "src/auth" to "src/auth-cyrus", strip all unneeded > >>from newly created directory and add cyrus-sasl support. The resulting > >>code probably looks not so elegantly as if it has been written > >>separately, however this way allows to not make a lot of things from the > >>scratch. > >> > >> > >>The patch against 1.0.alpha1 is > >>here: http://dmitry.butskoy.name/dovecot/dovecot-1.0.alpha1-cyrus.tar.gz . > >>To be more readable, it is not a flat patch (due to a lot of whole > >>files add/remove). It is a tarball with 3 files: a list of files to > >>initial copy from auth/ to auth-cyrus/, a patch for resulting tree, and > >>a script which automates this steps (:-)). (The script should be run in > >>the root of the main source, i.e. a dir with src/ and doc/ subdirs). > >> > >>I already have successfully tested this patch with PLAIN method. > >>However before testing of other methods, it would be desirable that > >>somebody have looked at it. > >> > >>Whether someone could check up my patch (just fluently having read), > >>at least for obvious bugs and typos? > >> > >> > > Dmitry Butskoy <Dmitry(a)Butskoy.name> > Saint-Petersburg, Russia > Red Hat Certified Engineer 809003662809495 > > -- Andrey Panin | Linux and UNIX system administrator pazke(a)donpac.ru | PGP key: wwwkeys.pgp.net

2 1

[Dovecot] upgrading: should I and what will change?
by Joshua Paine 06 Sep '05

06 Sep '05

I've been running dovecot 0.99.11 with postfix and postgresql in a production environment with about 25 real users and a couple hundred aliases split over a few domains for nearly a year now. No problems of any kind that I have noticed. Should I upgrade to the latest dovecot? What changes, if any, will I have to make? I've looked through the archives for a couple months without seeing much, and I don't see anything specific in the docs about upgrading. -Joshua <><

2 1

[Dovecot] Dovecot-LDA & OpenBSD
by Björn Ketelaars 06 Sep '05

06 Sep '05

Im having a bit of a problem with compiling dovecot-lda on OpenBSD. I used information from wiki.dovecot.org but this, unfortunately, resulted in some errors. Am I missing something? make all-recursive Making all in src Making all in libsieve if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I/mnt/files/dovecot-1.0-test80/src/lib -I/mnt/files/dovecot-1.0-test80/src/lib-mail -I/mnt/files/dovecot-1.0-test80/src/lib-storage -I/mnt/files/dovecot-1.0-test80/src/lib-storage/index/mbox -DSYSCONFDIR=\""/usr/local/etc"\" -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -MT deliver.o -MD -MP -MF ".deps/deliver.Tpo" -c -o deliver.o deliver.c; then mv -f ".deps/deliver.Tpo" ".deps/deliver.Po"; else rm -f ".deps/deliver.Tpo"; exit 1; fi In file included from common.h:4, from deliver.c:5: /mnt/files/dovecot-1.0-test80/src/lib/lib.h:6:22: config.h: No such file or directory In file included from /mnt/files/dovecot-1.0-test80/src/lib/lib.h:23, from common.h:4, from deliver.c:5: /mnt/files/dovecot-1.0-test80/src/lib/compat.h:17:4: #error uoff_t size not set In file included from /mnt/files/dovecot-1.0-test80/src/lib/lib.h:23, from common.h:4, from deliver.c:5: /mnt/files/dovecot-1.0-test80/src/lib/compat.h:37: error: conflicting types for `socklen_t' /usr/include/sys/types.h:95: error: previous declaration of `socklen_t' In file included from common.h:5, from deliver.c:5: /mnt/files/dovecot-1.0-test80/src/lib-storage/mail-storage.h:428: error: syntax error before "mail_get_virtual_size" /mnt/files/dovecot-1.0-test80/src/lib-storage/mail-storage.h:428: warning: type defaults to `int' in declaration of `mail_get_virtual_size' /mnt/files/dovecot-1.0-test80/src/lib-storage/mail-storage.h:428: warning: data definition has no type or storage class /mnt/files/dovecot-1.0-test80/src/lib-storage/mail-storage.h:431: error: syntax error before "mail_get_physical_size" /mnt/files/dovecot-1.0-test80/src/lib-storage/mail-storage.h:431: warning: type defaults to `int' in declaration of `mail_get_physical_size' /mnt/files/dovecot-1.0-test80/src/lib-storage/mail-storage.h:431: warning: data definition has no type or storage class In file included from deliver.c:13: /mnt/files/dovecot-1.0-test80/src/lib/istream.h:5: error: syntax error before "uoff_t" /mnt/files/dovecot-1.0-test80/src/lib/istream.h:20: error: syntax error before "uoff_t" /mnt/files/dovecot-1.0-test80/src/lib/istream.h:25: error: syntax error before "uoff_t" /mnt/files/dovecot-1.0-test80/src/lib/istream.h:51: error: syntax error before "uoff_t" /mnt/files/dovecot-1.0-test80/src/lib/istream.h:54: error: syntax error before "uoff_t" In file included from deliver.c:15: /mnt/files/dovecot-1.0-test80/src/lib/ostream.h:7: error: syntax error before "uoff_t" /mnt/files/dovecot-1.0-test80/src/lib/ostream.h:57: error: syntax error before "uoff_t" *** Error code 1 Stop in /mnt/files/dovecot-lda-0.1/src. *** Error code 1 Stop in /mnt/files/dovecot-lda-0.1/src (line 384 of Makefile). *** Error code 1 Stop in /mnt/files/dovecot-lda-0.1 (line 283 of Makefile). *** Error code 1 Stop in /mnt/files/dovecot-lda-0.1 (line 188 of Makefile). -- Insanity in individuals is something rare - but in groups, parties, nations and epochs, it is the rule.

1 0

[Dovecot] how to migrate from one server to another?
by Bram Mertens 06 Sep '05

06 Sep '05

Hi I have purchased and installed a new PC and would like to transfer my mail (in Maildir format) to it. Are there any precautions I must take before copying the mail over? I will disable mail delivery temporarily so no new mail gets written to disk but I don't know if dovecot has to be stopped before copying/editing mail for backup or migrating purposes. Anything else I must pay attention to? TIA Bram

2 2

[Dovecot] dovecot + openwebmail
by Peter McEvoy 05 Sep '05

05 Sep '05

Hi, I'm trying to add some sanity to a badly thought out mail system that, for various reasons, cant be fixed from the bottom up at this moment in time. The system is debian sarge, exim 4.5, doing virtual domains and delivering into mboxes in /var/spool/virtual/$domain/$user , there is webmail access and this allows user to create folders in (dont shoot me!) /etc/openwebmail/users/$domain/$username/mail/ , the files in this directory appear to be mboxes in that each mail begins with a From: line, the naming of these files is completely arbitrary. Im trying to add imap access that would ideally give users access to the mail in /var , and also in the openwebmail dirs, though the latter is not essential, just desirable. All mails are owned by user mail. I've installed dovecot-imapd version 0.99.14-1, but if this doesnt have the namespace additions from version 1.0-test, I can easily install that. Reading the wiki, it seems I can achieve this with namespaces, something like namespace private { separator = / inbox = yes prefix = location = mbox:/etc/openwebmail/users/%d/%u/mail:INBOX=/var/spool/virtual/%d/%u } But, Im not quite sure where this would go in the config file, going by the example config you can just shoehorn them into the middle of the file, but I'm not 100% sure... I had been trying to use things like.. default_mail_env = mbox:/var/folders/%d/%u:INBOX=/var/spool/virtual/%d/%u:INDEX=/var/indexes/%d/%n Having created the necessary folders in /var , but I didnt have much success (the authentication part worked straight away using my passwd file), And having read more and been told about namespaces on the irc channel, it seemed like I should go that way anyway. If anyone could give me a steer in the right direction, or even tell me i'm wasting my time (tho dont bother telling me how much better maildir etc is, i know!) Thanks for your time. -- Pete

1 1

[Dovecot] dovecot and communitgate (stalker)
by tyco 05 Sep '05

05 Sep '05

hi there, i am totally new to dovecot and use communigate pro stalker.com as my mailserver. everything in communigate is fine. the only problem i do have is imap speed. i just got a login at a dovecot server and i must say WOW its so fast amazing. since communigate does not support indexing on mdir direcotries i need to find a solution. so i am wondering if it would be possible to use dovecot imap server on top of communigate as an imap server? i know that this would not work for special cgp features like shared mailboxes. etc.... thnax christof

1 0