- dovecot - dovecot.org

[Dovecot] Helping OS's page cache
by Timo Sirainen 20 Nov '07

20 Nov '07

http://dovecot.org/patches/1.1/fadvise.diff http://dovecot.org/patches/1.0/fadvise.diff These patches try to tell kernel when mail files are wanted to be read and when they're wanted out of memory, so the memory could be used for more important things such as index files. I'd like to hear if someone sees any actual changes (for better or worse) in the system load because of this. I'm not sure if I should add this to v1.1 and if it should be enabled by default.

1 0

[Dovecot] src/lib/Makefile.am: a trivial ``$(srcdir)'' patch
by Ivan Shmakov 20 Nov '07

20 Nov '07

May I suggest the following trivial patch? diff -r ff9e591a2aa5 src/lib/Makefile.am --- a/src/lib/Makefile.am Sun Nov 18 21:44:22 2007 +0200 +++ b/src/lib/Makefile.am Tue Nov 20 00:29:04 2007 +0600 @@ -4,9 +4,9 @@ BUILT_SOURCES = unicodemap.c EXTRA_DIST = unicodemap.c unicodemap.pl -unicodemap.c: +$(srcdir)/unicodemap.c: test -f UnicodeData.txt || wget http://www.unicode.org/Public/UNIDATA/UnicodeData.txt - perl unicodemap.pl < UnicodeData.txt > $@ + perl $(srcdir)/unicodemap.pl < UnicodeData.txt > $@ liblib_a_SOURCES = \ backtrace-string.c \

2 1

[Dovecot] imap process consuming 100% CPU (Dovecot 1.0.3)
by Robert Tomanek 20 Nov '07

20 Nov '07

Hi, I have yet another problem with Dovecot: sometimes (rarely, maybe once every few days) one of the imap processes will 'hang', consuming all available CPU time. It does not seem to 'finish' in any reasonable amount of time (in one instance I waited a few days). This process will not even exit gracefully, it needs to be killed with 'kill -9 <PID>'. It has just happened again. The output from gdb is: > # gdb attach 29401 > GNU gdb 6.3 > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you are > welcome to change it and/or distribute copies of it under certain conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for details. > This GDB was configured as "i586-suse-linux"...attach: No such file or directory. > > Attaching to process 29401 > Reading symbols from /usr/local/libexec/dovecot/imap...done. > Using host libthread_db library "/lib/tls/libthread_db.so.1". > Reading symbols from /lib/libdl.so.2...done. > Loaded symbols for /lib/libdl.so.2 > Reading symbols from /lib/tls/libc.so.6...done. > Loaded symbols for /lib/tls/libc.so.6 > Reading symbols from /lib/ld-linux.so.2...done. > Loaded symbols for /lib/ld-linux.so.2 > 0x0806049d in imap_sync_more (ctx=0x80d9770) at imap-sync.c:104 > 104 if (ctx->seq == 0) { > (gdb) bt full > #0 0x0806049d in imap_sync_more (ctx=0x80d9770) at imap-sync.c:104 > flags = 1075042320 > keywords = <value optimized out> > str = (string_t *) 0x80c31e0 > ret = 1 > #1 0x08060797 in cmd_sync_continue (cmd=0x80ccdbc) at imap-sync.c:207 > ctx = (struct cmd_sync_context *) 0x80cf000 > ret = <value optimized out> > #2 0x0805ad5a in _client_output (context=0x80ccd78) at client.c:465 > cmd = (struct client_command_context *) 0x80ccdbc > ret = 0 > #3 0x080af0bd in stream_send_io (context=0x80cceb0) at ostream-file.c:356 > ostream = (struct ostream *) 0x80ccee0 > ret = <value optimized out> > #4 0x080aa441 in io_loop_handler_run (ioloop=0x80cb9b0) at ioloop-epoll.c:203 > ctx = (struct ioloop_handler_context *) 0x80cb9d8 > list = (struct io_list *) 0x80d7780 > io = (struct io *) 0x80dc430 > tv = {tv_sec = 2, tv_usec = 540048} > events_count = 4 > t_id = 2 > msecs = <value optimized out> > ret = 1 > i = 0 > j = 1 > call = <value optimized out> > #5 0x080a9889 in io_loop_run (ioloop=0x80cb9b0) at ioloop.c:329 > No locals. > #6 0x08062087 in main (argc=1, argv=0xbffffaf4, envp=0xbffffafc) at main.c:290 > plugin_dir = <value optimized out> Mail log does not reveal anything immediately interesting. Thoughts? Server config ('dovecot -n -c /etc/dovecot/dovecot.conf'): > # 1.0.3: /etc/dovecot/dovecot.conf > base_dir: /var/run/dovecot/ > protocols: imap imaps pop3 pop3s > ssl_ca_file: /etc/ssl/current/cacert.pem > ssl_cert_file: /etc/ssl/current/server.pem > ssl_key_file: /etc/ssl/current/private.pem > disable_plaintext_auth: no > login_dir: /var/run/dovecot//login > login_executable(default): /usr/local/libexec/dovecot/imap-login > login_executable(imap): /usr/local/libexec/dovecot/imap-login > login_executable(pop3): /usr/local/libexec/dovecot/pop3-login > first_valid_uid: 50 > mail_debug: yes > mail_drop_priv_before_exec: yes > mail_executable(default): /usr/local/libexec/dovecot/imap > mail_executable(imap): /usr/local/libexec/dovecot/imap > mail_executable(pop3): /usr/local/libexec/dovecot/pop3 > mail_plugin_dir(default): /usr/local/lib/dovecot/imap > mail_plugin_dir(imap): /usr/local/lib/dovecot/imap > mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 > mail_log_prefix: %Us(%u)(%p): > pop3_uidl_format(default): > pop3_uidl_format(imap): > pop3_uidl_format(pop3): %08Xu%08Xv > auth default: > debug_passwords: yes > passdb: > driver: passwd-file > args: /etc/dovecot/passwd > userdb: > driver: passwd-file > args: /etc/dovecot/passwd > socket: > type: listen > client: > path: /var/spool/postfix/private/auth > mode: 432 > user: postfix > group: postfix -- Best regards, Robert Tomanek mailto:rth23@poczta.onet.pl

4 14

[Dovecot] mail_location backends
by Harrison Metzger 19 Nov '07

19 Nov '07

Hello, Where I work we have have an interesting setup, we have 2 machines with mail accounts on them and both have dovecot. We would really like to centralize all the mail accounts on one machine, but unfortunately the administration has not approved it. However, if we could create the "illusion" that they are on the same machine that would be acceptable. If we have a 3rd machine, lets say called mail.example.com, could we install dovecot on it (using LDAP authorization), such that when a user connects to this machine, it then connects to one of the 2 other machines to retrieve their mail (instead of reading from /var/spool/mail). So in essence, the mail backend is just another POP or IMAP server. In the ldap directory we could have a field that says the mail location is: "imap://machine1.example.com" for some users and "imap://machine2.example.com" (Of course it dosent have to look like that, but I hope you get my idea), then dovecot would make a connection to those servers and read the user's mail. Does such a backend even exist? Can dovecot's plugin support register a mail_location backend (such as mbox:/blah/blah, ...)? Harrison Metzger

2 1

[Dovecot] deliver and namespaces in 1.1
by Nikolay Shopik 19 Nov '07

19 Nov '07

> Namespaces are supported everywhere now. Does this means what we can finally use "deliver" to deliver messages in namespaces?

4 5

[Dovecot] MANAGESIEVE patch v9 for dovecot 1.0.7
by Stephan Bosch 19 Nov '07

19 Nov '07

Hello Dovecot users, Since v8, I have updated the MANAGESIEVE patch to fix various issues reported by users. Although I planned to upgrade the next release after v8 to Dovecot v1.1, I release these changes for Dovecot 1.0 first. If no further major issues are found, I can upgrade to Dovecot 1.1. Change Log V9 ------------- + Definitively fixed the segfault mentioned in V8. It proved to be very time-constrained and thus hard to reproduce. The error turned out to be related to the input handling of the login daemon during authentication. + Checked for changes in the imap daemon that weren't propagated to the managesieve implementation due to code duplication. + Fixed a bug in the autodetection of the sieve storage location. + Fixed bug in the sieve storage that failed to refresh the symlink if the storage was moved. + Improved error handing in the sieve-storage implementation in various places. + Fixed the situation in which the active script link is located in the sieve storage. + Added managesieve configuration to dovecot-example.conf and made the example in this file more concise. This patch still includes (yet another) instance of the CMU Sieve source, as explained in one of my previous e-mails (http://dovecot.org/list/dovecot/2006-July/015016.html) The latest patch can be downloaded at: http://sinas.rename-it.nl/~sirius/ The README.managesieve is located in the root of the dovecot source tree after applying the patch. The dovecot-example.conf file is updated with a configuration example for managesieve. Have fun testing the patch. Don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl IRC: Freenode, #dovecot, S[r]us

1 0

[Dovecot] Search inside body of message
by Nikolay Shopik 18 Nov '07

18 Nov '07

Hi list, I was wondering about server-side search inside entire message, is dovecot support only english encoding now? I'm using Thunderbird but it can't find anything if I'm using language other than English.

3 9

[Dovecot] unlink_directory(....Trash.NewFolder) failed: Directory not empty
by Adam McDougall 18 Nov '07

18 Nov '07

I noticed the following this week. No idea how long its been happening because I have not tested deleting folders hardly at all. Steps to reproduce: 1. Create a folder "NewFolder", click on it in thunderbird so an index dir is created: ls -ldi Maildir/.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ total 0 4198833 -rw------- 1 mcdouga9 egrstaff 128 Nov 16 19:44 dovecot.index.log 2. Delete "NewFolder" which makes Thunderbird move both the folder under Trash, and seems to "rename" the .NewFolder index dir to .Trash.NewFolder (same inode #): ls -ldi Maildir/.Trash.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.Trash.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ total 4 4198833 -rw------- 1 mcdouga9 egrstaff 128 Nov 16 19:44 dovecot.index.log 3. Right click on Trash folder in Thunderbird, choose "Empty Trash": Nov 16 19:47:25 boomhauer dovecot: IMAP(mcdouga9): unlink_directory(/home/mcdouga9/Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder) failed: Directory not empty ls -ldi Maildir/.Trash.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.Trash.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:47 Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ (sometimes has a .nfs.blahblah file, I think I failed to catch it quick enough this time) The folder dissapears from Thunderbird's view but stays on disk, and will reappear in Thunderbird if you collapse and re-expand the folder tree, or close and open thunderbird. Repeatable after more "Empty Trash" or directly trying to delete the folder in thunderbird from in Trash. # 1.1.beta8: /usr/local/etc/dovecot.conf ssl_cert_file: /usr/local/etc/apache2/ssl/mail.egr.msu.edu.pem ssl_key_file: /usr/local/etc/apache2/ssl/mail.egr.msu.edu.pem login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_extra_groups: postlocal mail_location: maildir:%h/Maildir:CONTROL=%h/Maildir/dovecot/private/control:INDEX=%h/Maildir/dovecot/%q/private/indexes mmap_disable: yes dotlock_use_excl: yes mail_nfs_storage: yes mail_nfs_index: yes mail_plugins: acl fts fts_squat mail_log_max_lines_per_sec: 0 imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: Mail/ hidden: yes subscriptions: yes namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/%q/public/indexes/decs list: yes subscriptions: yes auth default: passdb: driver: pam userdb: driver: passwd args: system_user= socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix group: postfix plugin: acl: vfile:/usr/local/etc/dovecot-acls:cache_secs=10 fts: squat

2 2

[Dovecot] umask not applied
by Thomas 18 Nov '07

18 Nov '07

Hi all! I am trying to get dovecot-1.0.rc15 to create files with mode 660 in my virtual mailboxes. I set umask=0007 in dovecot.conf, restarted dovecot (/etc/init.d/dovecot restart) and send me an e-mail but it is still 600. "dovecot -n" says "umask: 7" How come the zeros are not displayed? Is this by intention or is something wrong? Here is the complete output: # /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_extra_groups: mail mail_location: maildir:/home/vmail/%d/%n umask: 7 auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: static args: uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail I searched the wiki and googled but couldn't find anything helpful. Do you have any ideas? ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

4 4

[Dovecot] SIGSEGV (Segmentation fault) with antispam plugin
by Boky 18 Nov '07

18 Nov '07

Hi all. I am trying to get dovecot (1.0.rc17) running with antispam plugin. I have created another backend, which executes "sa-learn" from spamassassin's arsenal. The backend is modeled after sendmail backend. But I can't seem to get the plugin working wit either my backend or signature-log. This is my ".config": DOVECOT=/usr/src/dovecot-1.0.7 DOVECOT_VERSION=1.0 BACKEND=spamassassin-exec INSTALLDIR=/usr/lib/dovecot/modules/imap/ PLUGINNAME=antispam This is how I make the plugin: make && make install && chmod 644 /usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so Since Ubuntu server does not come with dovecot sources, I have downloaded dovecot-1.0.7 and put it in /usr/src. As far as I understand, only the headers are needed, so this should not be the cause of the crash (if the headers hadn't changed). When invoked from dovecot process, the "imap" dies with signal 11. When running: strace /usr/sbin/dovecot --exec-mail imap This is how it ends: etdents64(8, /* 14 entries */, 4096) = 592 getdents64(8, /* 0 entries */, 4096) = 0 open("/usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so", O_RDONLY) = 9 read(9, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\340\21"..., 512) = 512 fstat64(9, {st_mode=S_IFREG|0644, st_size=19252, ...}) = 0 mmap2(NULL, 16148, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 9, 0) = 0xb7f29000 mmap2(0xb7f2c000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 9, 0x2) = 0xb7f2c000 close(9) = 0 close(8) = 0 stat64("/var/mail/mailboxes/boky/Maildir/subscriptions", 0xbfc17d2c) = -1 EACCES (Permission denied) lstat64("/var/mail/mailboxes/boky/Maildir/cur", 0xbfc17c3c) = -1 EACCES (Permission denied) write(2, "imap(boky): ", 12imap(boky): ) = 12 write(2, "Error: ", 7Error: ) = 7 write(2, "lstat(/var/mail/mailboxes/boky/M"..., 69lstat(/var/mail/mailboxes/boky/Maildir/cur) failed: Permission denied) = 69 write(2, "\n", 1 ) = 1 open("/etc/localtime", O_RDONLY) = 8 fstat64(8, {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 fstat64(8, {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7de2000 read(8, "TZif\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\6\0\0\0\6\0"..., 4096) = 696 close(8) = 0 munmap(0xb7de2000, 4096) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 --- SIGSEGV (Segmentation fault) @ 0 (0) --- +++ killed by SIGSEGV +++ Process 4707 detached antispam plugin was downloaded from: http://git.sipsolutions.net/?p=dovecot-antispam.git;a=snapshot;h=HEAD;sf=tgz Please advise me n next steps; I'm just a beginner with debugging C/C++. Thank you all. Boky

3 2

[Dovecot] crash with fts_squat on an identified email
by Adam McDougall 18 Nov '07

18 Nov '07

I have some folders with a good amount of spam. While demonstrating full text search to a user, we found a folder that would crash dovecot while doing a fts. While splitting up the mailbox to narrow it down, I found there are a good number of messages in that folder that all made it crash in the same manner. I figured I'd narrow down a single one, get that fixed, then retest the rest. I also added to my todo list to try a full text search on as much email as I can find, to try to weed out any other problems (and see if fts is realistic to use in production). Nov 17 09:03:26 boomhauer dovecot: IMAP(mcdouga9): file message-decoder.c: line 201 (translation_buf_decode): assertion failed: (*size >= skip) Nov 17 09:03:26 boomhauer dovecot: child 14668 (imap) killed with signal 6 Let me know if this is not reproducable with the attached tgz containing a maildir with one message, I could do a local gdb if needed.

2 1

[Dovecot] mailbox size limit
by Bazy 18 Nov '07

18 Nov '07

Hi guys, I was wondering... my Inbox is 1.3GB large, my mailbox size limit is 6GB (6442450941). Other users have 500+ MB in their Inbox. I have about 27GB of mail. I'm running dovecot 1.0.7 now under Fedora 7 with postfix. I have no trouble at all, everything is working perfect. I use ext3 as my file system, and I store mail in maildir format. Will I have any inode, file system, issues? Is anyone storing more then 27GB in maildir format on only one ext3 partition? Here is my dovecot -n output: # 1.0.7: /etc/dovecot.conf log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 ssl_cert_file: /etc/postfix/smtpd.cert ssl_key_file: /etc/postfix/smtpd.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_max_processes_count: 512 mail_location: maildir:/home/vmail/%d/%n/ mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-userdb-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: quota: maildir:storage=102400 [root:pts/0][~]# cat /etc/dovecot-sql.conf driver = mysql connect = host=/var/lib/mysql/mysql.sock user=mail_admin password=XXXXXXXX dbname=mail default_pass_scheme = CRYPT password_query = SELECT password FROM users WHERE CONCAT(SUBSTRING_INDEX(email,'@',1)) = '%n' AND CONCAT(SUBSTRING_INDEX(email,'@',-1)) = '%d'; [root:pts/0][~]# cat /etc/dovecot-userdb-sql.conf driver = mysql connect = host=/var/lib/mysql/mysql.sock user=mail_admin password=XXXXXXXX dbname=mail user_query = SELECT CONCAT(('/home/vmail/'), SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/') as home, 5000 as uid, 5000 as gid, CONCAT('maildir:storage=', floor(quota/1024)) as quota FROM users WHERE email = '%u';

5 9

[Dovecot] can't rename folder whiten with non ASCI charters
by Nikolay Shopik 17 Nov '07

17 Nov '07

Running dovecot 1.0.5 on Debian testing. I've just tried to create folder using Russian charters after that I'm tried to renamed it without luck. Folder removed and no new created and I still subscribed to old folder even its not exist anymore.

2 2

[Dovecot] using # special charter in config
by Nikolay Shopik 17 Nov '07

17 Nov '07

Before dovecot I'm using # charter to mark public folders. So if I want set prefix = # its of course won't work, I tried using \# combination without luck. Is this possible anyway?

2 1

[Dovecot] Path to public folder subscription file not created in 1.1b7?
by Adam McDougall 17 Nov '07

17 Nov '07

I use CONTROL=%h/Maildir/dovecot/public/control/[namespace] for each of my public namespaces. A few nights ago, I noticed having a new user subscribe to public folders for the first time will silently fail, becuase the path up to the subscriptions file will not be created. I am pretty sure dovecot used to create it for me, but maybe that changed in a recent version, or maybe I did something to break it? Work around is to mkdir -p /home/[user]/Maildir/dovecot/public/control/[namespace] but I'd like to avoid having to do that. Once I create the directory and make sure it is writable, the client can subscribe to public folders in that namespace. If they do not have permission, it still silently fails. namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/%q/public/indexes/decs list: yes subscriptions: yes

2 1

[Dovecot] RHEL 5.1 Can't compile with --with-linux-quota
by Laurent PELLISSIER 16 Nov '07

16 Nov '07

Hi, On a freshly installed RedHat RHEL 5.1 x86 with quota-3.13-1.2.3.2.el5.rpm I can't compile neither dovecot 1.0.7 nor 1.1beta8 : $ ./configure --with-linux-quota && make [...] gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../../src/lib -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -I/usr/kerberos/include -MT quota-fs.lo -MD -MP -MF .deps/quota-fs.Tpo -c quota-fs.c -fPIC -DPIC -o .libs/quota-fs.o quota-fs.c: In function 'fs_quota_get_linux': quota-fs.c:442: error: 'yes' undeclared (first use in this function) quota-fs.c:442: error: (Each undeclared identifier is reported only once quota-fs.c:442: error: for each function it appears in.) make[4]: *** [quota-fs.lo] Error 1 make[4]: leaving directory « /home/kermit/dovecot-1.1.beta8/src/plugins/quota » $ make distclean && ./configure --without-linux-quota && make -> same error $ make distclean && ./configure --disable-linux-quota && make -> compile fine Best regards, -- Laurent PELLISSIER @ Ecole des Mines d'Alès

2 2

[Dovecot] Mail.app IDLE support
by Martin R. Ehmsen 16 Nov '07

16 Nov '07

Hi, I'm trying to use the new IDLE support in Mail.app on Mac OS 10.5, and it works sort of, but it seems to miss some notifications. My guess is the IDLE support in Mail.app is implemented such that it sets up a connection for IDLE notifications and then checks the mail via another connection, and because of that the "IDLE-connection" gets disconnected for inactivity after 30 min. The reason for my guess is that I get the following in my logs: dovecot: Nov 14 17:00:29 Info: imap-login: Login: user=<amanda>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:29 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:30 Info: imap-login: Login: user=<amanda>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:50 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:51 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:04:58 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:30:40 Info: IMAP(amanda): Disconnected for inactivity dovecot: Nov 14 17:43:29 Info: IMAP(amanda): Disconnected for inactivity Is there something I can do about this problem? Is the IDLE implementation in the 1.1 branch different from the implementation in the 1.0 branch of dovecot? Or can I debug this issue further? I guess these things are standardized, but it seems hard for Apple to follow a standard :-) Thanks in advance, Martin R. Ehmsen

5 10

Re: [Dovecot] umask not applied
by Nikolay Shopik 15 Nov '07

15 Nov '07

- original message - Subject: Re: [Dovecot] umask not applied From: Thomas <lists(a)abelonline.de> Date: 15/11/2007 00:46 Quoting Troy Engel <tengel(a)fluid.com>: > I'll be the first to mention that 1.0rc15 is ancient by dovecot > standards, upgrade to 1.0x first and see if it's still broken. I am running a debian etch server. Unfortunately 1.0rc15 is the lastest version available in the stable tree. I would really like to remain in stable if somehow possible since I think combining stable and unstable will lead to chaos. I'll check the changes in later version and if they mention something about umask. ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program. If you are stick with debian stable just use backports so you don't mess up anything and still will be running stable and almost latest packages.

3 5

[Dovecot] Is there any way to query a secure imap server for certificate details
by Stewart Dean 15 Nov '07

15 Nov '07

? -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

3 2

[Dovecot] SSL/TLS with Outlook client
by Jonathan Bond-Caron 15 Nov '07

15 Nov '07

Anyone have any solution to this? I also getting a "The target principal name is incorrect." in Outlook 2007 Is this a problem with dovecot?

10 20

[Dovecot] dovecot.index mtime
by Matt 15 Nov '07

15 Nov '07

Is there anyway I can get Dovecot to update mtime on dovecot.index everytime a user successfully checks there email? Or perhaps there is a better way to do what I want here. I am working on a script that I want to check when the last time a user checked there email account. If a user has not checked it in say 6 months I want to automatically suspend the account through the MTA. If they start checking it again I also want to automatically reinstate it. What I thought was a good way was to look at the mtime on dovecot.index but a user can be checking there email daily but if they do not receive a new message in say 6 months the mtime will date back to 6 months still. Ran into this with an email address used by a fax machine. So is there a better way with dovecot to determine this? I am using dovecot-1.0.rc29 right now. Matt

5 17

[Dovecot] New full text search indexer
by Timo Sirainen 14 Nov '07

14 Nov '07

As described earlier (http://dovecot.org/list/dovecot/2006-December/018055.html) Dovecot nowadays has full text search indexing support in CVS HEAD. Currently there are two backends: Lucene and Squat. Lucene's problem is that standard IMAP SEARCH command can't be used with it without breaking IMAP RFC. So Lucene can be used only with non-standard X-BODY-FAST and X-TEXT-FAST search commands. Squat's code then is quite complex and it's pretty slow. It works with 4 character blocks, so it can answer: - Search string < 4 characters: Can't answer anything - Search string = 4 characters: Definite yes/no - Search string > 4 characters: Probable yes / definite no Since search strings are usually more than 4 characters, Dovecot uses the index only to filter out messages which definitely won't match and then does regular searching for the non-filtered messages. It works ok, but it could work better. The Squat indexes take maybe 30-50% of the mailbox's size. Most of the space goes to UID lists (list of messages matching each 4 character block). For example one UID list could be "2,4-10,20-30". This is already stored in a compressed format by storing the UID numbers relative to previous UID, which allows storing them usually with a single byte per UID, even if the UIDs are large. So, this morning I had an idea how this could maybe be improved with two changes: 1. Don't use 4 character blocks. Instead allow variable sized paths, and keep track of the UIDs for each node in the path. So for example adding "abc" to UID 1 will place the UID 1 to node "a", "ab" and "abc". 2. Use UIDs relative to parent's UIDs. For example if node "a" has UIDs 1,3,5 and "ab" is added for UID 5, the UID is changed to 2 (3th in 1,3,5 list - 1). This can help the compression a lot. The best case scenario for the above example is if "ab" contains also 1,3,5 UIDs. Then it can be written with a single 0-2 range. With these changes, the indexer can be configured to perform in different ways. Text can be indexed in two ways: full words, and substrings within those words (as required by IMAP). I think a useful combination of these would be to index all 4 character substrings and all full words up to 10 characters or so. This kind of an index can answer: - Search string <= 4 characters: Definite yes/no - For X-BODY-FAST / X-TEXT-FAST: - Search string 5-10 characters: Definite yes/no - Search string 11+ characters: Probable yes / definite no - For standard IMAP SEARCH: - Search string 5-10 characters: Definite yes if message contains the key as non-substring, otherwise same as below. This helps only if user does a search that matches a lot of messages. - Search string 11+ characters: Probable yes / definite no UTF-8 text is indexed as bytes, but the path depth can be counted as characters instead of as bytes. I've a test program finished, and unless there are some bugs left I think it shows that this can work pretty well: Squat-like 4 byte substrings (but can answer 1-3 char queries also): Message count: 7495 Index time: 4.19 CPU seconds (7.39MB/CPUs) Node memory: 3014072 bytes (2943 kB) in 90550 nodes UID memory: 8277212 bytes (8083 kB) in 352778 lists Total: 11291284 / 32474899 bytes = 34.77% Indexing the same mailbox file with squat-test gives: - Index time: 9.55 CPU seconds, 9.63 real seconds (3.24MB/CPUs) - 4145192 bytes in 102208 nodes (12.76%) - 7286058 bytes in 305501 uid_lists (22.44%) - 11431250 bytes total of 32474899 (35.20%) So the new indexer is over twice as fast and uses slightly less space. Indexing 4 char substrings and words up to 10 chars: Index time: 5.13 CPU seconds (6.04MB/CPUs) Node memory: 6002804 bytes (5862 kB) in 615501 nodes UID memory: 9044610 bytes (8832 kB) in 519488 lists Total: 15047414 / 32474899 bytes = 46.34% So it takes somewhat more space, but definitely less than having both Squat + Lucene. No substring indexing, words up to 10 chars (Lucene replacement): Index time: 1.39 CPU seconds (22.28MB/CPUs) Node memory: 3297663 bytes (3220 kB) in 548540 nodes UID memory: 1803735 bytes (1761 kB) in 213554 lists Total: 5101398 / 32474899 bytes = 15.71% Is there a need for Lucene anymore with this kind of a speed and disk space usage? :) The above tests are run with everything being indexed except space and control chars (ie. practically space + tab). If only alphanumeric characters are indexed, the total lines are (in same order as above): Total: 7048664 / 32474899 bytes = 21.70% (-13.07%) Total: 9610543 / 32474899 bytes = 29.59% (-16.75%) Total: 3963335 / 32474899 bytes = 12.20% (-3.51%) There are probably still a few optimizations that can be done to get the disk space usage even lower. I did spent quite a lot of time making it use less CPU though. Even tried a bit different coding style variations in the critical functions to get gcc to create faster code.. One interesting thing I noticed was that binary searching a character from a char array was slower than just sequentially going through the characters. I tried adding checks to do it only if the array was big, but it was always slower. Maybe something to do with CPU cache. If you want to try yourself, the test program is in http://dovecot.org/tmp/new-indexer.c

7 10

Re: [Dovecot] SSL/TLS with Outlook client
by Nikolay Shopik 14 Nov '07

14 Nov '07

Agree with Hugo most root CA have intermidate certificates which should supplied with your server certificate. Otherwise chain won't work and any client don't trust it. - original message - Subject: Re: [Dovecot] SSL/TLS with Outlook client From: Hugo Monteiro <hugo.monteiro(a)fct.unl.pt> Date: 14/11/2007 00:14 Eli Sand wrote: > Hugo Monteiro wrote: > >> Ah ... wildcard certs .. from what i recall, certs issued like >> *.example.com were not very well accepted by M$ clients. You should >> test against non wildcard certs and see how it behaves. >> > > Already have and no luck :( My domain is elisand.com and I have tried > *.elisand.com, mx1.elisand.com (I believe that's what my MX record is... if > not, whatever it is is what I tried) and mail.elisand.com which is the > smtp/imap server name I use in Outlook. All three yield the same result :( > > Eli. > > > I have taken the liberty to connect to your server, using openssl, i've seen the following: $ openssl s_client -CApath /usr/share/ca-certificates/cacert.org/ -connect mail.elisand.com:993 CONNECTED(00000003) depth=1 /O=Root CA/OU=http://www.cacert.org/CN=CA Cert Signing Authority/emailAddress=support(a)cacert.org verify return:1 depth=0 /CN=*.elisand.com verify return:1 --- Certificate chain 0 s:/CN=*.elisand.com i:/O=Root CA/OU=http://www.cacert.org/CN=CA Cert Signing Authority/emailAddress=support(a)cacert.org --- i believe you should change two things. If the name you wish to use on your clients is mail.alisand.com, then the certificate should read CN=mail.elisand.com. Furthermore, it's always a good idea to provide the chaining certificate path on dovecots side. Try using the ssl_ca_file directive on dovecot's configuration. Regards, Hugo Monteiro. -- ci.fct.unl.pt:~# cat .signature Hugo Monteiro Email : hugo.monteiro(a)fct.unl.pt Telefone : +351 212948300 Ext.15307 Centro de Informática Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa Quinta da Torre 2829-516 Caparica Portugal Telefone: +351 212948596 Fax: +351 212948548 www.ci.fct.unl.pt apoio(a)fct.unl.pt ci.fct.unl.pt:~# _

1 0

[Dovecot] Using Dovecot as Asterisk PBX voicemail server
by Kenneth Porter 14 Nov '07

14 Nov '07

I'm reading the Asterisk book, 2nd edition, and it describes how one can set up voicemail to be delivered by IMAP to a voicemail folder. Asterisk can monitor flags on the folder so that the "message available" light on one's phone tracks the state of the "read" flag in the folder. One can either dial in for one's voicemail or listen to it from one's favorite IMAP client. (Dovecot is mentioned in the book.) I'm wondering how one would set up auth for this? Asterisk needs to log in to the account to deliver the voicemail and to check its state, but I wouldn't want to put everyone's mail password in plaintext in Asterisk's voicemail.conf file. Would I set up a separate IMAP account for each user to hold their voicemail, and use simple passwords (such as the PIN they use for phone access to voicemail) in the Asterisk config? Or is there a way to set up Dovecot to allow a second user to login to a specific IMAP folder in all accounts, in the same way the local delivery agent has write access to all users' mailbox? Google's page for the book: <http://books.google.com/books?id=vtQxJ3oSm64C&dq=asterisk+book> Dovecot mentions: <http://books.google.com/books?id=vtQxJ3oSm64C&dq=asterisk+book&q=dovecot#se…>

3 3

[Dovecot] namespace public folders
by Nikolay Shopik 13 Nov '07

13 Nov '07

Hi list, Here is thing im trying to accomplish. I would like to setup public folders which resposible for delivering mails for some speical addresses like info(a)example.com. And it will be perfect if "seen" status for this folder will be saved per user. I mean if one user read message and set it as read other user should see it still as unread. As I far i know there some limitation in 1.0 tree but not in lates 1.1. My question is can I do such setup with dovecot+postfix. Im really appreciate for simple examples how can i accomplish this kind setup if it possible :)

3 3