- dovecot - dovecot.org

[Dovecot] imap connection problems
by Ivan Pesin 15 Mar '07

15 Mar '07

Hi, Have encountered some strange behavior of dovecot: after few days of work (5-7 days, ~50 users, imap over ssl or tls) dovecot stops respond with "* OK Dovecot ready.". I.e. connection gets accepted, but no response from dovecot: [ivan@dyn-226 bin]$ telnet imap 143 Trying 192.168.100.9... Connected to imap.n-ix.com.ua (192.168.100.9). Escape character is '^]'. while obvious should be [ivan@dyn-226 bin]$ telnet imap 143 Trying 192.168.100.9... Connected to imap.n-ix.com.ua (192.168.100.9). Escape character is '^]'. * OK Dovecot ready. After dovecot restart everything works OK. This behavior we started to observe since rc24, before that on rc9 we didn't see that problem. Currently running on rc26. Any ideas? Thanks, Iv

2 2

[Dovecot] convert_mail plugin doesn't work
by Giuseppe Giacomini 15 Mar '07

15 Mar '07

Hi I'm trying to use convert_mail plugin to convert wu-imap mailbox to maildir. I'm using dovecot rc 27 on Centos 4.4 linux. I have user INBOX in /var/spool/mail/ and mbox file in mail ~/mail When I do the first login with a test user (test1), the plugin convert all the mbox under ~mail, but doesn't do any conversion on the INBOX (/var/spool/mail/test1). After conversion those are file in MailDir where .testmail is converted from ~mail all other folder (cur,new) are empty rwx------ 2 test1 persone 4096 Mar 15 11:59 cur drwx------ 2 test1 persone 4096 Mar 15 11:59 new drwx------ 5 test1 persone 4096 Mar 15 11:59 .testmail drwx------ 2 test1 persone 4096 Mar 15 11:59 tmp Why doesn't mail in /var/spool/mail/test1 be converted? Thanks This is my dovecot -n protocols: imap imaps pop3 pop3s ssl_cert_file: /usr/share/ssl/certs/dovecot.pem ssl_key_file: /usr/share/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot-login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login first_valid_uid: 200 mail_location: maildir:%h/MailDir:INDEX=%h/.index/%u:CONTROL=%h/.control/%u mail_debug: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins: convert mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xv%08Xu pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: passdb: driver: pam userdb: driver: passwd plugin: convert_mail: mbox:%h/mail:INBOX=/var/spool/mail/%u convert_skip_broken_mailboxes: yes and this is maillog dovecot: POP3(test1): Loading modules from directory: /usr/lib/dovecot/pop3 dovecot: POP3(test1): Module loaded: /usr/lib/dovecot/pop3/lib20_convert_plugin.so dovecot: POP3(test1): Effective uid=10400, gid=502 dovecot: POP3(test1): mbox: data=/homeH2/t/test1/mail:INBOX=/var/spool/mail/test1 dovecot: POP3(test1): mbox: root=/homeH2/t/test1/mail, index=/homeH2/t/test1/mail, inbox=/var/spool/mail/test1 dovecot: POP3(test1): mbox: data=/homeH2/t/test1/mail:INBOX=/var/spool/mail/test1 dovecot: POP3(test1): mbox: root=/homeH2/t/test1/mail, index=/homeH2/t/test1/mail, inbox=/var/spool/mail/test1 dovecot: POP3(test1): maildir: data=/homeH2/t/test1/MailDir:INDEX=/homeH2/t/test1/.index/test1:CONTROL=/homeH2/t/test1/.control/ test1 dovecot: POP3(test1): maildir: root=/homeH2/t/test1/MailDir, index=/homeH2/t/test1/.index/test1, control=/homeH2/t/test1/.contro l/test1, inbox= dovecot: POP3(test1): maildir: data=/homeH2/t/test1/MailDir:INDEX=/homeH2/t/test1/.index/test1:CONTROL=/homeH2/t/test1/.control/ test1 dovecot: POP3(test1): maildir: root=/homeH2/t/test1/MailDir, index=/homeH2/t/test1/.index/test1, control=/homeH2/t/test1/.contro l/test1, inbox= dovecot: POP3(test1): Disconnected: Logged out top=0/0, retr=0/0, del=0/0, size=0

2 1

Re: [Dovecot] Benchmarking CVS HEAD vs. v1.0
by Bill Boebel 15 Mar '07

15 Mar '07

On Wed, March 14, 2007 11:51 am, Timo Sirainen <tss(a)iki.fi> said: > Some new features in CVS HEAD are: > > - Mailbox list index. LIST command can be handled by reading the > mailboxes from the index. The index also contains the mailbox's message > counters, so STATUS command can be handled by only looking into the > index file. Nice. Now that it can pull this from index files, it would be pretty sweet if there was a variant of the STATUS command that would provide STATUS information for all mailboxes at once, rather than just for one. This could be used by webmail applications to update a folder listing that shows unseen mail counters with one command. Like maybe: a1 X-LIST-STATUS (MESSAGES UNSEEN) * X-LIST-STATUS "INBOX" (MESSAGES 8 UNSEEN 0) * X-LIST-STATUS "Drafts" (MESSAGES 0 UNSEEN 0) * X-LIST-STATUS "Trash" (MESSAGES 89 UNSEEN 3) a1 OK X-LIST-STATUS complete.

3 3

[Dovecot] [PATCH] fix gcc warnings in 1.0rc26
by Max Kellermann 15 Mar '07

15 Mar '07

Hi, I have made a small patchset to fix some of the GCC warnings. With these patches, I was able to compile dovecot r_1_0_rc26 with the following options: -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast Wstrict-prototypes -Wredundant-decls -Wcast-align -Wwrite-strings Wpacked -Winline -Wdisabled-optimization -Wno-long-long -Wundef Wfloat-equal -Wsign-compare -Waggregate-return -Werror Some of the changes may be arguable, escpecially the const warning fixes, example: char *pass = ""; I changed that to "pass = NULL" and changed the function call: - auth_request_verify_plain(request, pass, + auth_request_verify_plain(request, pass == NULL ? "" : pass, In other sources, I added "const" to parameters or to the return value where it seemed to make sense and didn't cause harm. Dealing with the const problem can be tricky, and sometimes dirty deconstification hacks are the only way to go.. however I believe we should always turn on "-Wconst" and explicitly add manual deconstitication where we assume it's not dangerous. I didn't fix all "const" and "missing noreturn" warnings, but my patches may be a good start... if there is further interest in fixing all of them, I'd be glad to do it. Max

2 1

[Dovecot] Problems with seen flag on OS X mail
by Nicolas Cianca 15 Mar '07

15 Mar '07

I'm having a problem with dovecot and apple mail not always remembering the seen flag. Some cases when mail is read it stays that way but other times it reverts back to unread on the next connection. I've tried to rebuild the Apple Mail mailbox but that doesn't do it. The mail is stored in Maildir format in the users home directory. All the connections Apple Mail are done via IMAP. I'm currently running rc27 on Centos and this has been ongoing since I switched from cyrus about 3 months ago. Any suggestions? nicolas cianca LIGHTBULB ncianca(a)lightbulb.com

2 1

[Dovecot] mbox and pop3, maildir and imap
by Hans Lammerts 15 Mar '07

15 Mar '07

Hi, Been reading a lot of posts about dovecot configuration, but can't really figure out if what I want is even possible or how to achieve this. My setup is simple : One linux machine that collects mail from my provider and sorts them for me and my wife, where my email is stored in Maildir format in ~myuser/.maildir and my wife's email is stored in mbox format in /var/spool/mail. Before making my wife crazy with a new way of getting and reading email with IMAP, I tried to do the following : My PC (not the linux server) runs either linux or XP, and the client I'm using is Evolution 2.8.2.2. I can get my email using IMAP without problems. My wife's PC just runs XP and the email client is Outlook which gets its email from the linux server through pop3. I've setup Dovecot to service both IMAP and POP3. The default_mail_env is now set to maildir:~%u/.maildir (which of course only reflects Evolution's IMAP need on my own PC) Now for the big question: How can I achieve that when I get email from the server using IMAP, I will automatically just look in the Maildir location (~%u/.maildir) __AND__ when my wife logs on through POP3, dovecot will only look for her email in her mbox directory /var/spool/mail/... ? In other words, different protocols used by (two) different users need to look for email in different locations (maildir and mbox). I tried to get this working using the Namespaces thingy in dovecot, but couldn't get it to work. Any suggestions (hyperlinks) are most welcome. Thanks, Hans

2 1

[Dovecot] solaris 10 + dovecot (1)
by aza zel 15 Mar '07

15 Mar '07

hi... i try to make dovecot (v1.0.r26) in solaris 10 and i have the following problem # ./configure --with-ldap ... ... Install prefix ...................... : /usr/local File offsets ........................ : 64bit I/O loop method ..................... : poll File change notification method ..... : none Building with SSL support ........... : yes (OpenSSL) Building with IPv6 support .......... : yes Building with pop3 server ........... : yes Building with mail delivery agent .. : yes Building with GSSAPI support ........ : no Building with user database modules . : static prefetch passwd passwd-file checkpassword ldap (modules) Building with password lookup modules : passwd passwd-file shadow pam checkpassword ldap (modules) Building with SQL drivers ............: # make ... ... Making all in pop3-login Making all in pop3 /bin/bash ../../libtool --tag=CC --mode=link gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -I/usr/sfw/include -export-dynamic -o pop3 client.o commands.o mail-storage-callbacks.o main.o ../lib-storage/register/libstorage-register.a ../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/mbox/libstorage_mbox.a ../../src/lib-storage/index/dbox/libstorage_dbox.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-index/libindex.a ../lib-storage/libstorage.a ../lib-storage/subscription-file/libstorage_subscription_file.a ../lib-imap/libimap.a ../lib-mail/libmail.a ../lib-dict/libdict.a ../lib-charset/libcharset.a ../lib/liblib.a ../lib/mountpoint.o ../lib/str-sanitize.o -export-dynamic -lsocket -lnsl -lrt -lsendfile gcc -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -I/usr/sfw/include -o pop3 client.o commands.o mail-storage-callbacks.o main.o ../lib/mountpoint.o ../lib/str-sanitize.o ../lib-storage/register/libstorage-register.a../../src/lib-storage/index/maildir/libstorage_maildir.a ../../src/lib-storage/index/mbox/libstorage_mbox.a ../../src/lib-storage/index/dbox/libstorage_dbox.a ../../src/lib-storage/index/libstorage_index.a ../../src/lib-index/libindex.a ../lib-storage/libstorage.a ../lib-storage/subscription-file/libstorage_subscription_file.a ../lib-imap/libimap.a ../lib-mail/libmail.a ../lib-dict/libdict.a ../lib-charset/libcharset.a ../lib/liblib.a -lsocket -lnsl -lrt -lsendfile ld: error de elf: archivo pop3: elf_update: Error de E/S: escritura en salida: No queda espacio de memoria en el dispositivo collect2: ld returned 1 exit status *** Error code 1 make: Fatal error: Command failed for target `pop3' Current working directory /maxi/dovecot-1.0.rc26/src/pop3 *** Error code 1 The following command caused the error: failcom='exit 1'; \ for f in x $MAKEFLAGS; do \ case $f in \ *=* | --[!k]*);; \ *k*) failcom='fail=yes';; \ esac; \ done; \ dot_seen=no; \ target=`echo all-recursive | sed s/-recursive//`; \ list='lib lib-dict lib-sql lib-ntlm lib-settings lib-charset lib-mail lib-imap lib-index lib-storage lib-auth auth dict master login-common imap-login imap pop3-login pop3 deliver util plugins'; for subdir in $list; do \ echo "Making $target in $subdir"; \ if test "$subdir" = "."; then \ dot_seen=yes; \ local_target="$target-am"; \ else \ local_target="$target"; \ fi; \ (cd $subdir && make $local_target) \ || eval $failcom; \ done; \ if test "$dot_seen" = "no"; then \ make "$target-am" || exit 1; \ fi; test -z "$fail" make: Fatal error: Command failed for target `all-recursive' Current working directory /maxi/dovecot-1.0.rc26/src *** Error code 1 The following command caused the error: failcom='exit 1'; \ for f in x $MAKEFLAGS; do \ case $f in \ *=* | --[!k]*);; \ *k*) failcom='fail=yes';; \ esac; \ done; \ dot_seen=no; \ target=`echo all-recursive | sed s/-recursive//`; \ list='src doc'; for subdir in $list; do \ echo "Making $target in $subdir"; \ if test "$subdir" = "."; then \ dot_seen=yes; \ local_target="$target-am"; \ else \ local_target="$target"; \ fi; \ (cd $subdir && make $local_target) \ || eval $failcom; \ done; \ if test "$dot_seen" = "no"; then \ make "$target-am" || exit 1; \ fi; test -z "$fail" make: Fatal error: Command failed for target `all-recursive' Current working directory /maxi/dovecot-1.0.rc26 *** Error code 1 make: Fatal error: Command failed for target `all' if i do # df -h Sistema de archivos tamaño usados aprovechar capacidad Montado en /dev/dsk/c0d0s0 4,4G 4,3G 57M 99% / /devices 0K 0K 0K 0% /devices ctfs 0K 0K 0K 0% /system/contract proc 0K 0K 0K 0% /proc mnttab 0K 0K 0K 0% /etc/mnttab swap 689M 652K 688M 1% /etc/svc/volatile objfs 0K 0K 0K 0% /system/object /usr/lib/libc/libc_hwcap1.so.1 4,4G 4,3G 57M 99% /lib/libc.so.1 fd 0K 0K 0K 0% /dev/fd swap 688M 40K 688M 1% /tmp swap 688M 24K 688M 1% /var/run /dev/dsk/c0d0s7 32G 583M 31G 2% /export/home /export/home/sunone 32G 583M 31G 2% /home/sunone ¿if a dovecot problem with solaris or my configuration of the solaris installation? ¿how i can fix this problem? ¿why this happends? -- Salu2 ;)

4 3

[Dovecot] Newbie index infrastructure and location questions
by Stewart Dean 15 Mar '07

15 Mar '07

I've been lurking for a year or more and am now actually bringing Dovecot up (it seems that any time I make a serious effort at this, something else falls in the pot and I have to give it up yet again). Index questions: I understand the indices should be placed in a non-file-system-quoted place. I have in mind to create /var/dcndx 1) Roughly how much space do indices take up (so I can size space for a directory for them)? I have 4000 users, average mbox inbox size is 5.5MB (totalling 22GB), the number of messages/user mailbox I'd guess to average around 100 and go as high as 5000. They have maybe as much as 3x times space and messages in folders, though I guess the average is about half that of INBOX 2) I'm clear that DC will automagically create the index files, but a) do I have to create a subdirectory for each user, ex: /var/dcndx/user1 b) Is there one index file theat handles a user's mailbox and folders or a separate one for each? -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] Newbie NFS question
by Stewart Dean 15 Mar '07

15 Mar '07

As is usually the case, I'm not sure enough of what the DC docs are referring to; there are some implicit info assumptions that I, the Newbie, miss... Anyway, here is my situation Dovecot is to run on one machine only, its index files are stored in on a separate, non-quotaed, not NFS filesystem. INBOX and folder filesystems (all mbox format) are native to this machine and are NFS exported to three machines with root access. NFS access can be NFS V2, or 3 or 4. 1) a user maintenance server that may add or delete users and their INBOXES/folders 2) a mailing list server that writes mailings email to the NFS mounted file system of user INBOXes 3) A user login machine where the users may access their INBOXes and folders All machines are running vanilla IBM AIX; I have never known there to be corruption from NFS locking problems, and am not aware of any locking/caching parameters for AIX's NFS implementation. All machines are running NTP synched to a common NTP master server My questions: 1) Since my index files are stored in on a separate, non-quotaed, not NFS filesystem, can I correctly assume this means I can ignore the nmap_disable and lock_method parms? 2) The docs say: > The easiest way to get better performance without caching problems is > to just make sure the user is always redirected to the same server. If > you can manage to do that, then it's safe to enable attribute caching. The INBOXes and folders live on the mail server where a) DC is going to run and b) they are exported to the three other machine. Does this mean that I don't have to mess with actimeo? 3) Pardon my ignorance....Is actimeo set on the NFS server as an attribute of exportation or on the NFS client on the imported FS...or both 4) Is there any reason related to data integrity or performance to prefer NFS V2 or 3 or 4? 5) Are there other questions I should ask of IBM about NFS client and Server daemon config Thanks in advance........... -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

2 1

[Dovecot] quota - dict - username = '(null)'
by Andreas Jørgensen 15 Mar '07

15 Mar '07

I am trying setting up at virtual domain with quota using postfix and dovecut. But I can't get the quota to work, every time I try sending a mail the following queries is run on the database. SELECT home, uid, gid FROM mail_view_tmp WHERE account = 'dummy' AND domain = 'example.com' SELECT current FROM mail_quota WHERE path = 'quota/storage' AND username = '(null)' BEGIN;INSERT INTO mail_quota (current, path, username) VALUES ('quota/ storage', 262, '(null)') ON DUPLICATE KEY UPDATE current = current + 262;COMMIT The mail is delivered, but the quota for the user is not updated. Instead I just have an other new row for the user (null). I am using the package dovecot-1.0.rc2p3-mysql on OpenBSD 4.0 for macppc My configuration: (posting the full content of alt the config files seemed unnecessary so I cut out the important bits) /etc/postfix/main.cf ... virtual_transport = dovecot /etc/postfix/master.cf : ... dovecot unix - n n - - pipe flags=DRhu user=vmail argv=/usr/local/libexec/dovecot/deliver -d $ {recipient} /etc/dovecot.conf .... protocol lda { mail_plugins = quota } .. auth default { user = root passdb sql { args = /etc/dovecot-mysql.conf } userdb static { args = uid=2000 gid=2000 home=/var/vmail/%d/%n/ } socket listen { master { path = /var/run/dovecot/auth-master mode = 0600 user = vmail group = vmail } } } dict { quota = mysql:/etc/dovecot-dict-quota.conf } plugin { quota = dict:storage=10240:messages=1000 proxy::quota } /etc/dovecot-mysql.conf: driver = mysql connect = host=localhost dbname=ingoBase user=dovecot password=dovecot default_pass_scheme = CRYPT password_query = SELECT password FROM mail_view_dovecot WHERE account = '%n' AND domain = '%d' user_query = SELECT home, uid, gid FROM mail_view_tmp WHERE account = '%n' AND domain = '%d' or account = '%u' /etc/dovecot-dict-quota.conf connect = host=localhost dbname=ingoBase user=dovecot password=dovecot table = mail_quota select_field = current where_field = path username_field = username Is there something wrong in my configuration or is this a bug in the version i am using ? Thanks in advance ! Andreas

2 1

[Dovecot] login authentication
by juan carlos 15 Mar '07

15 Mar '07

Hi everyone, i used postfix, dovecot and mysql. I have virtual users and domains. I have this configuration in dovecot-mysql.conf: db_host = localhost db_port = 3306 db_unix_socket = /var/run/mysqld/mysqld.sock db = postfix db_user = postfix db_passwd = bscidth46 db_client_flags = 0 default_pass_scheme = CRYPT password_query = SELECT password FROM mailbox WHERE username = '%u' user_query = SELECT maildir, 105 AS uid, 106 AS gid FROM mailbox WHERE username = '%u' The table mailbox: +-------------------+--------------+------------------+-----------+------------+ | username | home | maildir | quota | domain | +-------------------+--------------+------------------+-----------+------------+ | test(a)domain.com | /home/vmail/ | domain.com/test/ | 10240000 | domain.com | | test2(a)domain.com | /home/vmail/ | domain.com/test2/ | 10240000 | domain.com | | test3(a)domain.com | /home/vmail/ | domain.com/test3/ | 10240000 | domain.com | +-------------------+--------------+-------------------+----------+------------+ I have this configuration in smtpd.conf: pwcheck_method: auxprop mech_list: LOGIN CRAM-MD5 DIGEST-MD5 GSSAPI auxprop_plugin: sql sql_verbose: yes sql_engine: mysql sql_hostnames: localhost sql_database: postfix sql_user: postfix sql_passwd: bscidth46 sql_select: select password from mailbox where username = '%u@%r' What can i do to log in with only user part of user(a)domain.com? Thanks in advance

3 2

Re: [Dovecot] imap-login (proxy) Connection queue full
by Bill Boebel 15 Mar '07

15 Mar '07

On Wed, March 14, 2007 1:57 pm, Timo Sirainen <tss(a)iki.fi> said: > On Thu, 2006-08-10 at 23:15 -0400, Bill Boebel wrote: >> On Thu, August 10, 2006 5:22 pm, Timo Sirainen <tss(a)iki.fi> said: >> >> >> Aug 10 16:23:34 director5 dovecot: imap-login: Disconnected: Connection queue >> >> full: >> >> >> >> I am seeing this logged several times per minute. From netstat, the server >> has >> >> 650 proxied IMAP connections and 450 proxied IMAPS connections, there are >> >> currently 10 imap-login processes running, and using the following config: >> > >> > I did some changes to CVS which hopefully should fix this? >> >> It is still disconnecting with "Connection queue full", although less frequently. >> Testing with about 315 IMAP connections right now and same config as earlier >> today, so it should never hit this condition, right? > > BTW. Does this still happen? No, however I haven't had to touch our Dovecot proxies in several months. They just work. We're still running a copy I pulled from CVS just before 1.0.rc8. We're running the new code only on our backend mail servers. I guess we should update our proxies soon. Bill

1 0

[Dovecot] Courier keywords - anyone even tried?
by Troy Engel 14 Mar '07

14 Mar '07

I do realize from the Wiki that the formats are incompatible, and am looking at the Courier spec (http://www.courier-mta.org/imap/?README.imapkeywords.html) and the Dovecot spec (http://wiki.dovecot.org/MailboxFormat/Maildir) trying to see if there's any sane way I could try and write a shellscript. The pain here is the Courier spec, I think I lost a few brain cells trying to understand this convoluted methodology ("When encountering ".N.file" after another ".N.file" was encountered earlier, remove the file with the lesser N, unless the larger of the two Ns is greater than or equals to T." e.g.) Has anyone even started down this path and has some prototype code written that they gave up on? Is this just so painful trying to migrate that I should just give up? Any ideas welcome... -te -- Troy Engel | Systems Engineer Fluid, Inc | http://www.fluid.com

2 1

[Dovecot] Benchmarking CVS HEAD vs. v1.0
by Timo Sirainen 14 Mar '07

14 Mar '07

Some new features in CVS HEAD are: - v1.0 saves most of the data to dovecot.index.cache only when the client is FETCHing the messages. With mboxes the message headers are saved while parsing the mbox, which is almost the same thing. With CVS HEAD the dovecot.index.cache file is updated already when the new messages are being saved (with deliver or IMAP APPEND). This avoids reading the message second time (although if client fetches the new message bodies immediately it doesn't probably help that much). - Mailbox list index. LIST command can be handled by reading the mailboxes from the index. The index also contains the mailbox's message counters, so STATUS command can be handled by only looking into the index file. - Multiple commands can be handled simultaneously. For example you can start a long running SEARCH command and then at the same time continue FETCHing new messages. Or if you're doing a long FETCH (eg. fetching all message bodies) you can do a smaller FETCH while the long one is still running, and get the result in the middle of the long running FETCH reply. There are also indexing support for SORT and THREAD, and full text search indexes for SEARCH BODY/TEXT, but I didn't benchmark these now. It looks like CVS HEAD is quite a lot faster than v1.0. I think that's mostly because of the APPEND optimization. Here are the results: 100MB ext3 filesystem inside a file in XFS. C: CVS HEAD, fsync_disable=yes, mmap_disable=yes S: CVS branch_1_0 (upcoming 1.0.rc28), fsync_disable=yes, mmap_disable=yes ./imaptest seed=1 secs=60 Logi List Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo C: 11275 5647 5597 11275 11264 16179 5571 4126 11256 6074 22531 C: 11287 5740 5606 11287 11275 16193 5698 4154 11267 6064 22553 S: 9201 4660 4575 9197 9190 13107 4614 2843 9184 3601 18382 S: 9271 4701 4657 9267 9260 13189 4580 2799 9256 3540 18522 82% 82% 59% ./imaptest seed=1 secs=60 no_pipelining Logi List Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo C: 5756 2856 2795 5756 5747 8087 2796 1942 5746 5081 11489 C: 5779 2865 2872 5777 5768 8273 2929 1965 5768 5138 11532 S: 5016 2564 2467 5016 5008 7090 2512 1756 5006 4116 10012 S: 5009 2529 2481 5008 4999 7142 2503 1734 4997 4165 9998 87% 89% 81% ---------- Trying to see how much mailbox list indexing code affects the results by disabling LIST and STATUS (which means that CVS HEAD is doing more I/O by updating the list indexes which are never used). Looks like the indexes do help some, since CVS HEAD is ~5% less faster now. ./imaptest seed=1 secs=60 list=0 status=0 Logi Sele Fetc Fet2 Stor Dele Expu Appe Logo C: 11435 11432 11422 16341 5639 4122 11415 5941 22848 S: 9984 9984 9976 14347 5013 2987 9967 3840 19947 87% 65% ./imaptest seed=1 secs=60 list=0 status=0 no_pipelining Logi Sele Fetc Fet2 Stor Dele Expu Appe Logo C: 5778 5778 5768 8105 2922 2021 5767 5107 11533 S: 5240 5239 5230 7384 2525 1823 5229 4343 10460 90% 85% --------------- Any difference with just one client instead of 10 simultaneously running? Looks like with pipelining CVS HEAD is now even faster, but without pipelining it's a bit slower. I'm not sure why. I tried with different max. command queue lengths with CVS HEAD. The C1, C4 and C8 mean queue lengths of 1, 4 and 8 commands. 1 practically disables it, so it runs like v1.0. Doesn't look like the queue length makes much of a different. ./imaptest seed=1 secs=60 list=0 status=0 clients=1 Logi Sele Fetc Fet2 Stor Dele Expu Appe Logo C4: 9968 9968 9967 14244 5020 2664 9967 2990 19934 S : 6510 6510 6508 9340 3216 1729 6508 1942 13017 65% 63% C1: 9956 9956 9954 14314 4959 2642 9954 2987 19907 C4: 9968 9968 9967 14244 5020 2664 9967 2990 19934 C8: 9978 9978 9976 14329 4848 2618 9976 2962 19953 ./imaptest seed=1 secs=60 list=0 status=0 clients=1 no_pipelining Logi Sele Fetc Fet2 Stor Dele Expu Appe Logo C: 1942 1942 1941 2711 962 508 1941 605 3882 S: 1868 1868 1867 2669 965 520 1866 618 3734 96% 102% --------------- mmap_disable=no seems to work more slowly after all even with etx3..: Logi List Stat Sele Fetc Fet2 Stor Dele Expu Appe Logo C: 8254 4150 4139 8254 8244 11813 4126 2791 8234 3658 16487 S: 7833 3940 3910 7829 7821 11243 3846 2345 7816 2966 15646 95% 81%

2 1

Re: [Dovecot] imap-login (proxy) Connection queue full
by Bill Boebel 14 Mar '07

14 Mar '07

On Thu, August 10, 2006 5:22 pm, Timo Sirainen <tss(a)iki.fi> said: >> Aug 10 16:23:34 director5 dovecot: imap-login: Disconnected: Connection queue >> full: >> >> I am seeing this logged several times per minute. From netstat, the server has >> 650 proxied IMAP connections and 450 proxied IMAPS connections, there are >> currently 10 imap-login processes running, and using the following config: > > I did some changes to CVS which hopefully should fix this? It is still disconnecting with "Connection queue full", although less frequently. Testing with about 315 IMAP connections right now and same config as earlier today, so it should never hit this condition, right? The weird thing is sometimes when I am testing via telnet, my session encounters this condition and disconnects within the first 5 seconds. It does this with and without these patches. Bill

2 1

[Dovecot] Sieve plugin - install help - filters ignored
by Brent Hostetler 14 Mar '07

14 Mar '07

Hello, My setup consists of the following: * Freebsd 6.2 system with software installed from ports tree: * Postfix 2.3.8,1 * postfixadmin 2.1.0_7 * mysql 5.0.33 * dovecot-1.0.r25 * dovecot-sieve 1.0.1 * clamav 0.90_3 * SpamAssassin 3.1.8_1 * amavisd-new 2.4.5_1,1 My mail setup is a virtual user setup with all users/domains sharing same UID:GID. Postfix and dovecot get their User information from mysql tables that are administered with postfixadmin. Mail is filtered through clamav and spamassassin using amavisd-new setup as a content filter. All users mail is delivered such as their maildir is /usr/local/vmail/%d/%u using dovecot's lda 'deliver' agent. The system is working fine as configured.. Mail goes where it is supposed to. Trying to get sieve support and unable to get this going. First step is simulating home directories. >From dovecot-mysql.conf ... changed user_query to user_query = SELECT maildir, 5000 AS uid, 5000 AS gid, @home := maildir AS home FROM mailbox WHERE username = '%u' Added the following to a users maildir: .dovecot.sieve require "fileinto"; fileinto "test"; --- Restart all daemons.. Mail still delivers to inbox. Nothing appears in /var/log/maillog or /usr/local/vmail/dovecot-deliver.log that shows anything but the message being delivered to the inbox. HELP! Brent.

4 5

[Dovecot] userdb-vpopmail.c bug in rc27
by Gabor HALASZ 14 Mar '07

14 Mar '07

Hi! I discovered a bug in $subject. Next line caused a compilation error: auth_request_log_debug(auth_request, "vpopmail", "lookup user=%s domain=%s", vpop_user, vpop_domain); I think, te correct version is: auth_request_log_debug(request, "vpopmail", "lookup user=%s domain=%s", vpop_user, vpop_domain); -- Gabor HALASZ <halasz.g(a)freemail.hu>

2 1

[Dovecot] Variable %h not recognized in userdb_mail (passwd-file)
by Michal Soltys 14 Mar '07

14 Mar '07

As in subject, if you for instance create a simple passwd-file with: test@domain.tld:{plain}pass:20000:10::/home/regular/.test::userdb_mail=maildir:%h/maildir Dovecot (rc23 & 27) will expand %h to empty string, and try to make a directory under / Mar 14 14:25:28 rasengan dovecot: IMAP(test(a)domain.tld): mkdir(/maildir/cur) failed: Permission denied Mar 14 14:25:28 rasengan dovecot: IMAP(test(a)domain.tld): mkdir(/maildir/.Trash/cur) failed: Permission denied ... If tilde is used instead of %h, the expansion works properly. While checking it, I tested other variables (putting aside craziness of using some of them), so summing it up - h,w,i,a,b don't work, all the other ones do. In case %h is not actually intended to work in passwd-files, some wiki examples would have to be adjusted.

2 4

[Dovecot] Issue with pop3 & phpList
by Chris Harner 14 Mar '07

14 Mar '07

Hello, all. Dovecot really sparked my interest when I noticed it focused on security. It seems to be a great product thus far. Anyway... I'm new to the mail world (pop3/smtp), and I have a project in which I use a mass mailer known as phpList. If you aren't familiar with it, it has the ability to view and process bounces. Bounces are basically emails that don't quite make it (for the most part). In order for this to work, I must create a pop3 account. I installed Dovecot and now the port is open, which means the service is running. Here is where it gets confusing... When I goto process the bounces, it times out because of the fact that there were too many login attempts. Does dovecot have a default username/password? How do I set up a username and password? Is there a special way to just have the pop3 portion of Dovecot load? I went through the config file and took out some of the #'s like the docs said. Thanks! Server: OpenSUSE 10.1 -- Chris Harner [] Server Engineer [] Arnold Transportation Services

2 1

Re: [Dovecot] solaris 10 + dovecot (1)
by Gábor Lénárt 14 Mar '07

14 Mar '07

Re, On Wed, Mar 14, 2007 at 02:26:53PM +0000, aza zel wrote: > like other suggest me, the cause of problem is that i not have much space in > / (i think that 4.4gb is a lot of space but i wrong) > so, i move to /export/home where i have space and try again and i not have > any problems. > about memory... i don't remeber how much i have but swap have nearly 667mbs > free for proces compile (i only run these proces). Nice :) I've mentioned 'memory' because of the Spanish (is it Spanish? Just guessing) fragment 'espacio de memoria' remembered me to the English word of 'memory', I was wrong here it seems. So forget about memory, it was only my guesswork about your native language :) The lesson here: please translate all messages to English if you want to post to an English mailing list. Otherwise some people (like me) have no chance to understand just guessing ... :) -- - Gábor

1 0

[Dovecot] help with basic setup
by Perish Mutyanda 14 Mar '07

14 Mar '07

I am new to dovecot and would like to setup dovecot with mysql auth. I successfuly installed postfix admin and used the default table structure there, Mail delivery works fine as It gets delivered to mailboxes. My problem is the login, dovecot runs with no errors but I get the error: Mar 14 14:39:43 itecsouth dovecot: auth-worker(default): mysql: Connected to localhost (postfix) Mar 14 14:40:34 itecsouth dovecot: pop3-login: Disconnected: rip=41.xxx.xxx.190, lip=41.243.140.153 Mar 14 14:41:14 itecsouth dovecot: pop3-login: Login failed: Plaintext authentication disabled: rip=41.xxx.xxx.190, lip=41.xxx.xxx.153 Mar 14 14:41:14 itecsouth dovecot: pop3-login: Disconnected: rip=41.xxx.xxx.190, lip=41.xxx.xxx.153 I have tried to change the pass scheme in dovecot-mysql.conf to CRYPT as but says unknown auth_scheme a copy of my dovecot.conf protocols = pop3 listen = * login_process_size = 64 default_mail_env = maildir:/usr/local/virtual/%d/%u/ mail_extra_groups = postfix verbose_proctitle = yes first_valid_uid = 125 first_valid_gid = 125 mbox_read_locks = fcntl mbox_write_locks = fcntl protocol pop3 { pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@ auth_debug = yes auth_verbose = yes auth default { passdb sql { args = /usr/local/etc/dovecot-mysql.conf } userdb sql { args = /usr/local/etc/dovecot-mysql.conf } } -- and the dovecot-mysql.conf # Database driver: mysql, pgsql driver = mysql default_pass_scheme = PLAIN connect = host=localhost dbname=postfix user=dovecot password=dovecot password_query = SELECT password FROM mailbox WHERE username = '%u' AND active = '1' user_query = SELECT maildir, 125 AS uid, 125 AS gid FROM mailbox WHERE username = '%u' AND active = '1'

2 1

[Dovecot] Timed Out or Disconnect Errors on emails with attachments
by Tudor Holton 14 Mar '07

14 Mar '07

dovecot-request(a)dovecot.org wrote: > > On Tue, 2007-03-13 at 16:35 +1100, Tudor Holton wrote: > >> I've migrated our Maildir system from Courier-IMAP-SSL to Dovecot with >> SSL and now we're getting "Connection to <server> Timed Out" errors when >> sending mail with attachments. The mail gets sent, however it doesn't >> save the mail in the user's "Sent" folder. >> > > What OS is Dovecot running in? What Dovecot version? What configure > options? There have been bugs related to this, but I thought they were > all fixed. > I apologise, I just realised that I hadn't included that information. The server is a current Ubuntu Edgy Box. It has Dovecot 1.0rc2. I now see there have been 25 rc's since then. (Yikes!) So I guess I should be complaining upstream. I did search the net for several weeks, however, and found no mention of this problem, even in the Dovecot wiki or mailing list archive. So if you say it's fixed, then I'll put something in the wiki to that effect and go badger the Ubuntu guys for an upgrade. :-) Cheers, Tudor.

2 1

[Dovecot] HTML mails
by Timo Sirainen 14 Mar '07

14 Mar '07

I think I configured Mailman to drop all text/html MIME parts. Lets see if it works. html -> text translation is also enabled.

2 1

[Dovecot] Dovecot for "push email"
by Matthew Sheffield 14 Mar '07

14 Mar '07

Does anyone have experience here using a combination of Dovecot and a Windows or Palm client that supports IMAP IDLE to achieve "push email?" I'm doing some research into how feasible this is for companies and non-profits.

2 1

[Dovecot] imaptest updates
by Timo Sirainen 13 Mar '07

13 Mar '07

I spent the last 5 hours or so updating my imaptest tool. It's beginning to become almost like a real IMAP client. http://dovecot.org/tools/imaptest10.c contains a version that compiles against Dovecot v1.0 (instead of against CVS HEAD). imaptest is this tool that I've been using for a few years to do stress testing. It can create a lot of dummy IMAP client connections which execute some commands. Today I added some new features to it: - Support for pipelining commands (where allowed by IMAP spec). Looks like it about doubles the throughput. "no_pipelining" option disables this. - Support for MULTIAPPEND extension. When multiple mails are APPENDed one after another this extension is used to save them all in one transaction. - Previous versions gave an error when trying to append large mails. Now large mails work too. - By default the commands are executed in one specific order. Using "random" option randomizes the order. - You can separately specifify probabilities of how often to execute each command. 0 means never, 100 means always, 10 means 10% of the time and so on. 100,30 means that it's always executed, and then it's executed again and again with 30% probability. The basic way to run it is: ./imaptest user=test pass=password host=imap.domain.org mbox=/home/user/mail/dovecot clients=1 Or if you want to run multiple users, you can use user=test%d which will use users test1..test100 (the size is hardcoded in USER_RAND define). If you want to do benchmarking, you can set it to run for specified amount of time, and you should also give random number generator the same seed every time: ./imaptest seed=123 secs=300 If you want to test/benchmark only the login+logout speed, use: ./imaptest - select=0 To create a lot of long-running clients doing STATUS and NOOPs: ./imaptest clients=100 - logout=0 status=50 noop=50 delay=100 To test copying messages: ./imaptest copybox=Trash By default LOGIN command is used. If you want to try AUTHENTICATE: ./imaptest auth=100 Hmm. I guess that's about it. The list of commands that you can use starts from line 134. You can use either the long names or the short names.

3 4