- dovecot - dovecot.org

[Dovecot] MANAGESIEVE patch v9 for dovecot 1.0.7
by Stephan Bosch 19 Nov '07

19 Nov '07

Hello Dovecot users, Since v8, I have updated the MANAGESIEVE patch to fix various issues reported by users. Although I planned to upgrade the next release after v8 to Dovecot v1.1, I release these changes for Dovecot 1.0 first. If no further major issues are found, I can upgrade to Dovecot 1.1. Change Log V9 ------------- + Definitively fixed the segfault mentioned in V8. It proved to be very time-constrained and thus hard to reproduce. The error turned out to be related to the input handling of the login daemon during authentication. + Checked for changes in the imap daemon that weren't propagated to the managesieve implementation due to code duplication. + Fixed a bug in the autodetection of the sieve storage location. + Fixed bug in the sieve storage that failed to refresh the symlink if the storage was moved. + Improved error handing in the sieve-storage implementation in various places. + Fixed the situation in which the active script link is located in the sieve storage. + Added managesieve configuration to dovecot-example.conf and made the example in this file more concise. This patch still includes (yet another) instance of the CMU Sieve source, as explained in one of my previous e-mails (http://dovecot.org/list/dovecot/2006-July/015016.html) The latest patch can be downloaded at: http://sinas.rename-it.nl/~sirius/ The README.managesieve is located in the root of the dovecot source tree after applying the patch. The dovecot-example.conf file is updated with a configuration example for managesieve. Have fun testing the patch. Don't hesitate to notify me when there are problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl IRC: Freenode, #dovecot, S[r]us

1 0

[Dovecot] Search inside body of message
by Nikolay Shopik 18 Nov '07

18 Nov '07

Hi list, I was wondering about server-side search inside entire message, is dovecot support only english encoding now? I'm using Thunderbird but it can't find anything if I'm using language other than English.

3 9

[Dovecot] unlink_directory(....Trash.NewFolder) failed: Directory not empty
by Adam McDougall 18 Nov '07

18 Nov '07

I noticed the following this week. No idea how long its been happening because I have not tested deleting folders hardly at all. Steps to reproduce: 1. Create a folder "NewFolder", click on it in thunderbird so an index dir is created: ls -ldi Maildir/.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.NewFolder/ total 0 4198833 -rw------- 1 mcdouga9 egrstaff 128 Nov 16 19:44 dovecot.index.log 2. Delete "NewFolder" which makes Thunderbird move both the folder under Trash, and seems to "rename" the .NewFolder index dir to .Trash.NewFolder (same inode #): ls -ldi Maildir/.Trash.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.Trash.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ total 4 4198833 -rw------- 1 mcdouga9 egrstaff 128 Nov 16 19:44 dovecot.index.log 3. Right click on Trash folder in Thunderbird, choose "Empty Trash": Nov 16 19:47:25 boomhauer dovecot: IMAP(mcdouga9): unlink_directory(/home/mcdouga9/Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder) failed: Directory not empty ls -ldi Maildir/.Trash.NewFolder/ 1504062 drwx------ 5 mcdouga9 egrstaff 4096 Nov 16 19:44 Maildir/.Trash.NewFolder/ ls -ldi Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ 4198832 drwx------ 2 mcdouga9 egrstaff 4096 Nov 16 19:47 Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ ls -li Maildir/dovecot/boomhauer/private/indexes/.Trash.NewFolder/ (sometimes has a .nfs.blahblah file, I think I failed to catch it quick enough this time) The folder dissapears from Thunderbird's view but stays on disk, and will reappear in Thunderbird if you collapse and re-expand the folder tree, or close and open thunderbird. Repeatable after more "Empty Trash" or directly trying to delete the folder in thunderbird from in Trash. # 1.1.beta8: /usr/local/etc/dovecot.conf ssl_cert_file: /usr/local/etc/apache2/ssl/mail.egr.msu.edu.pem ssl_key_file: /usr/local/etc/apache2/ssl/mail.egr.msu.edu.pem login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_extra_groups: postlocal mail_location: maildir:%h/Maildir:CONTROL=%h/Maildir/dovecot/private/control:INDEX=%h/Maildir/dovecot/%q/private/indexes mmap_disable: yes dotlock_use_excl: yes mail_nfs_storage: yes mail_nfs_index: yes mail_plugins: acl fts fts_squat mail_log_max_lines_per_sec: 0 imap_client_workarounds: delay-newmail netscape-eoh tb-extra-mailbox-sep namespace: type: private separator: / inbox: yes list: yes subscriptions: yes namespace: type: private separator: / prefix: mail/ hidden: yes subscriptions: yes namespace: type: private separator: / prefix: Mail/ hidden: yes subscriptions: yes namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/%q/public/indexes/decs list: yes subscriptions: yes auth default: passdb: driver: pam userdb: driver: passwd args: system_user= socket: type: listen client: path: /var/spool/postfix/private/auth mode: 384 user: postfix group: postfix plugin: acl: vfile:/usr/local/etc/dovecot-acls:cache_secs=10 fts: squat

2 2

[Dovecot] umask not applied
by Thomas 18 Nov '07

18 Nov '07

Hi all! I am trying to get dovecot-1.0.rc15 to create files with mode 660 in my virtual mailboxes. I set umask=0007 in dovecot.conf, restarted dovecot (/etc/init.d/dovecot restart) and send me an e-mail but it is still 600. "dovecot -n" says "umask: 7" How come the zeros are not displayed? Is this by intention or is something wrong? Here is the complete output: # /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S login_dir: /var/run/dovecot/login login_executable: /usr/lib/dovecot/imap-login mail_extra_groups: mail mail_location: maildir:/home/vmail/%d/%n umask: 7 auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: static args: uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail I searched the wiki and googled but couldn't find anything helpful. Do you have any ideas? ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

4 4

[Dovecot] SIGSEGV (Segmentation fault) with antispam plugin
by Boky 18 Nov '07

18 Nov '07

Hi all. I am trying to get dovecot (1.0.rc17) running with antispam plugin. I have created another backend, which executes "sa-learn" from spamassassin's arsenal. The backend is modeled after sendmail backend. But I can't seem to get the plugin working wit either my backend or signature-log. This is my ".config": DOVECOT=/usr/src/dovecot-1.0.7 DOVECOT_VERSION=1.0 BACKEND=spamassassin-exec INSTALLDIR=/usr/lib/dovecot/modules/imap/ PLUGINNAME=antispam This is how I make the plugin: make && make install && chmod 644 /usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so Since Ubuntu server does not come with dovecot sources, I have downloaded dovecot-1.0.7 and put it in /usr/src. As far as I understand, only the headers are needed, so this should not be the cause of the crash (if the headers hadn't changed). When invoked from dovecot process, the "imap" dies with signal 11. When running: strace /usr/sbin/dovecot --exec-mail imap This is how it ends: etdents64(8, /* 14 entries */, 4096) = 592 getdents64(8, /* 0 entries */, 4096) = 0 open("/usr/lib/dovecot/modules/imap/lib90_antispam_plugin.so", O_RDONLY) = 9 read(9, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\340\21"..., 512) = 512 fstat64(9, {st_mode=S_IFREG|0644, st_size=19252, ...}) = 0 mmap2(NULL, 16148, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 9, 0) = 0xb7f29000 mmap2(0xb7f2c000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 9, 0x2) = 0xb7f2c000 close(9) = 0 close(8) = 0 stat64("/var/mail/mailboxes/boky/Maildir/subscriptions", 0xbfc17d2c) = -1 EACCES (Permission denied) lstat64("/var/mail/mailboxes/boky/Maildir/cur", 0xbfc17c3c) = -1 EACCES (Permission denied) write(2, "imap(boky): ", 12imap(boky): ) = 12 write(2, "Error: ", 7Error: ) = 7 write(2, "lstat(/var/mail/mailboxes/boky/M"..., 69lstat(/var/mail/mailboxes/boky/Maildir/cur) failed: Permission denied) = 69 write(2, "\n", 1 ) = 1 open("/etc/localtime", O_RDONLY) = 8 fstat64(8, {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 fstat64(8, {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7de2000 read(8, "TZif\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\6\0\0\0\6\0"..., 4096) = 696 close(8) = 0 munmap(0xb7de2000, 4096) = 0 stat64("/etc/localtime", {st_mode=S_IFREG|0644, st_size=696, ...}) = 0 --- SIGSEGV (Segmentation fault) @ 0 (0) --- +++ killed by SIGSEGV +++ Process 4707 detached antispam plugin was downloaded from: http://git.sipsolutions.net/?p=dovecot-antispam.git;a=snapshot;h=HEAD;sf=tgz Please advise me n next steps; I'm just a beginner with debugging C/C++. Thank you all. Boky

3 2

[Dovecot] crash with fts_squat on an identified email
by Adam McDougall 18 Nov '07

18 Nov '07

I have some folders with a good amount of spam. While demonstrating full text search to a user, we found a folder that would crash dovecot while doing a fts. While splitting up the mailbox to narrow it down, I found there are a good number of messages in that folder that all made it crash in the same manner. I figured I'd narrow down a single one, get that fixed, then retest the rest. I also added to my todo list to try a full text search on as much email as I can find, to try to weed out any other problems (and see if fts is realistic to use in production). Nov 17 09:03:26 boomhauer dovecot: IMAP(mcdouga9): file message-decoder.c: line 201 (translation_buf_decode): assertion failed: (*size >= skip) Nov 17 09:03:26 boomhauer dovecot: child 14668 (imap) killed with signal 6 Let me know if this is not reproducable with the attached tgz containing a maildir with one message, I could do a local gdb if needed.

2 1

[Dovecot] mailbox size limit
by Bazy 18 Nov '07

18 Nov '07

Hi guys, I was wondering... my Inbox is 1.3GB large, my mailbox size limit is 6GB (6442450941). Other users have 500+ MB in their Inbox. I have about 27GB of mail. I'm running dovecot 1.0.7 now under Fedora 7 with postfix. I have no trouble at all, everything is working perfect. I use ext3 as my file system, and I store mail in maildir format. Will I have any inode, file system, issues? Is anyone storing more then 27GB in maildir format on only one ext3 partition? Here is my dovecot -n output: # 1.0.7: /etc/dovecot.conf log_path: /var/log/dovecot.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 ssl_cert_file: /etc/postfix/smtpd.cert ssl_key_file: /etc/postfix/smtpd.key login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_max_processes_count: 512 mail_location: maildir:/home/vmail/%d/%n/ mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle delay-newmail imap_client_workarounds(imap): outlook-idle delay-newmail imap_client_workarounds(pop3): outlook-idle pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-userdb-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix plugin: quota: maildir:storage=102400 [root:pts/0][~]# cat /etc/dovecot-sql.conf driver = mysql connect = host=/var/lib/mysql/mysql.sock user=mail_admin password=XXXXXXXX dbname=mail default_pass_scheme = CRYPT password_query = SELECT password FROM users WHERE CONCAT(SUBSTRING_INDEX(email,'@',1)) = '%n' AND CONCAT(SUBSTRING_INDEX(email,'@',-1)) = '%d'; [root:pts/0][~]# cat /etc/dovecot-userdb-sql.conf driver = mysql connect = host=/var/lib/mysql/mysql.sock user=mail_admin password=XXXXXXXX dbname=mail user_query = SELECT CONCAT(('/home/vmail/'), SUBSTRING_INDEX(email,'@',-1),'/',SUBSTRING_INDEX(email,'@',1),'/') as home, 5000 as uid, 5000 as gid, CONCAT('maildir:storage=', floor(quota/1024)) as quota FROM users WHERE email = '%u';

5 9

[Dovecot] can't rename folder whiten with non ASCI charters
by Nikolay Shopik 17 Nov '07

17 Nov '07

Running dovecot 1.0.5 on Debian testing. I've just tried to create folder using Russian charters after that I'm tried to renamed it without luck. Folder removed and no new created and I still subscribed to old folder even its not exist anymore.

2 2

[Dovecot] using # special charter in config
by Nikolay Shopik 17 Nov '07

17 Nov '07

Before dovecot I'm using # charter to mark public folders. So if I want set prefix = # its of course won't work, I tried using \# combination without luck. Is this possible anyway?

2 1

[Dovecot] Path to public folder subscription file not created in 1.1b7?
by Adam McDougall 17 Nov '07

17 Nov '07

I use CONTROL=%h/Maildir/dovecot/public/control/[namespace] for each of my public namespaces. A few nights ago, I noticed having a new user subscribe to public folders for the first time will silently fail, becuase the path up to the subscriptions file will not be created. I am pretty sure dovecot used to create it for me, but maybe that changed in a recent version, or maybe I did something to break it? Work around is to mkdir -p /home/[user]/Maildir/dovecot/public/control/[namespace] but I'd like to avoid having to do that. Once I create the directory and make sure it is writable, the client can subscribe to public folders in that namespace. If they do not have permission, it still silently fails. namespace: type: public separator: / prefix: #shared/decs/ location: maildir:/egr/mail/shared/decs:CONTROL=%h/Maildir/dovecot/public/control/decs:INDEX=%h/Maildir/dovecot/%q/public/indexes/decs list: yes subscriptions: yes

2 1

[Dovecot] RHEL 5.1 Can't compile with --with-linux-quota
by Laurent PELLISSIER 16 Nov '07

16 Nov '07

Hi, On a freshly installed RedHat RHEL 5.1 x86 with quota-3.13-1.2.3.2.el5.rpm I can't compile neither dovecot 1.0.7 nor 1.1beta8 : $ ./configure --with-linux-quota && make [...] gcc -DHAVE_CONFIG_H -I. -I. -I../../.. -I../../../src/lib -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -I/usr/kerberos/include -MT quota-fs.lo -MD -MP -MF .deps/quota-fs.Tpo -c quota-fs.c -fPIC -DPIC -o .libs/quota-fs.o quota-fs.c: In function 'fs_quota_get_linux': quota-fs.c:442: error: 'yes' undeclared (first use in this function) quota-fs.c:442: error: (Each undeclared identifier is reported only once quota-fs.c:442: error: for each function it appears in.) make[4]: *** [quota-fs.lo] Error 1 make[4]: leaving directory « /home/kermit/dovecot-1.1.beta8/src/plugins/quota » $ make distclean && ./configure --without-linux-quota && make -> same error $ make distclean && ./configure --disable-linux-quota && make -> compile fine Best regards, -- Laurent PELLISSIER @ Ecole des Mines d'Alès

2 2

[Dovecot] Mail.app IDLE support
by Martin R. Ehmsen 16 Nov '07

16 Nov '07

Hi, I'm trying to use the new IDLE support in Mail.app on Mac OS 10.5, and it works sort of, but it seems to miss some notifications. My guess is the IDLE support in Mail.app is implemented such that it sets up a connection for IDLE notifications and then checks the mail via another connection, and because of that the "IDLE-connection" gets disconnected for inactivity after 30 min. The reason for my guess is that I get the following in my logs: dovecot: Nov 14 17:00:29 Info: imap-login: Login: user=<amanda>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:29 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:30 Info: imap-login: Login: user=<amanda>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:50 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:00:51 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:04:58 Info: imap-login: Login: user=<ehmsen>, method=PLAIN, rip=::ffff:xxx.xxx.xxx.xxx, lip=::ffff:192.168.1.2, TLS dovecot: Nov 14 17:30:40 Info: IMAP(amanda): Disconnected for inactivity dovecot: Nov 14 17:43:29 Info: IMAP(amanda): Disconnected for inactivity Is there something I can do about this problem? Is the IDLE implementation in the 1.1 branch different from the implementation in the 1.0 branch of dovecot? Or can I debug this issue further? I guess these things are standardized, but it seems hard for Apple to follow a standard :-) Thanks in advance, Martin R. Ehmsen

5 10

Re: [Dovecot] umask not applied
by Nikolay Shopik 15 Nov '07

15 Nov '07

- original message - Subject: Re: [Dovecot] umask not applied From: Thomas <lists(a)abelonline.de> Date: 15/11/2007 00:46 Quoting Troy Engel <tengel(a)fluid.com>: > I'll be the first to mention that 1.0rc15 is ancient by dovecot > standards, upgrade to 1.0x first and see if it's still broken. I am running a debian etch server. Unfortunately 1.0rc15 is the lastest version available in the stable tree. I would really like to remain in stable if somehow possible since I think combining stable and unstable will lead to chaos. I'll check the changes in later version and if they mention something about umask. ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program. If you are stick with debian stable just use backports so you don't mess up anything and still will be running stable and almost latest packages.

3 5

[Dovecot] Is there any way to query a secure imap server for certificate details
by Stewart Dean 15 Nov '07

15 Nov '07

? -- ==== Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sdean(a)bard.edu voice: 845-758-7475, fax: 845-758-7035

3 2

[Dovecot] SSL/TLS with Outlook client
by Jonathan Bond-Caron 15 Nov '07

15 Nov '07

Anyone have any solution to this? I also getting a "The target principal name is incorrect." in Outlook 2007 Is this a problem with dovecot?

10 20

[Dovecot] dovecot.index mtime
by Matt 15 Nov '07

15 Nov '07

Is there anyway I can get Dovecot to update mtime on dovecot.index everytime a user successfully checks there email? Or perhaps there is a better way to do what I want here. I am working on a script that I want to check when the last time a user checked there email account. If a user has not checked it in say 6 months I want to automatically suspend the account through the MTA. If they start checking it again I also want to automatically reinstate it. What I thought was a good way was to look at the mtime on dovecot.index but a user can be checking there email daily but if they do not receive a new message in say 6 months the mtime will date back to 6 months still. Ran into this with an email address used by a fax machine. So is there a better way with dovecot to determine this? I am using dovecot-1.0.rc29 right now. Matt

5 17

[Dovecot] New full text search indexer
by Timo Sirainen 14 Nov '07

14 Nov '07

As described earlier (http://dovecot.org/list/dovecot/2006-December/018055.html) Dovecot nowadays has full text search indexing support in CVS HEAD. Currently there are two backends: Lucene and Squat. Lucene's problem is that standard IMAP SEARCH command can't be used with it without breaking IMAP RFC. So Lucene can be used only with non-standard X-BODY-FAST and X-TEXT-FAST search commands. Squat's code then is quite complex and it's pretty slow. It works with 4 character blocks, so it can answer: - Search string < 4 characters: Can't answer anything - Search string = 4 characters: Definite yes/no - Search string > 4 characters: Probable yes / definite no Since search strings are usually more than 4 characters, Dovecot uses the index only to filter out messages which definitely won't match and then does regular searching for the non-filtered messages. It works ok, but it could work better. The Squat indexes take maybe 30-50% of the mailbox's size. Most of the space goes to UID lists (list of messages matching each 4 character block). For example one UID list could be "2,4-10,20-30". This is already stored in a compressed format by storing the UID numbers relative to previous UID, which allows storing them usually with a single byte per UID, even if the UIDs are large. So, this morning I had an idea how this could maybe be improved with two changes: 1. Don't use 4 character blocks. Instead allow variable sized paths, and keep track of the UIDs for each node in the path. So for example adding "abc" to UID 1 will place the UID 1 to node "a", "ab" and "abc". 2. Use UIDs relative to parent's UIDs. For example if node "a" has UIDs 1,3,5 and "ab" is added for UID 5, the UID is changed to 2 (3th in 1,3,5 list - 1). This can help the compression a lot. The best case scenario for the above example is if "ab" contains also 1,3,5 UIDs. Then it can be written with a single 0-2 range. With these changes, the indexer can be configured to perform in different ways. Text can be indexed in two ways: full words, and substrings within those words (as required by IMAP). I think a useful combination of these would be to index all 4 character substrings and all full words up to 10 characters or so. This kind of an index can answer: - Search string <= 4 characters: Definite yes/no - For X-BODY-FAST / X-TEXT-FAST: - Search string 5-10 characters: Definite yes/no - Search string 11+ characters: Probable yes / definite no - For standard IMAP SEARCH: - Search string 5-10 characters: Definite yes if message contains the key as non-substring, otherwise same as below. This helps only if user does a search that matches a lot of messages. - Search string 11+ characters: Probable yes / definite no UTF-8 text is indexed as bytes, but the path depth can be counted as characters instead of as bytes. I've a test program finished, and unless there are some bugs left I think it shows that this can work pretty well: Squat-like 4 byte substrings (but can answer 1-3 char queries also): Message count: 7495 Index time: 4.19 CPU seconds (7.39MB/CPUs) Node memory: 3014072 bytes (2943 kB) in 90550 nodes UID memory: 8277212 bytes (8083 kB) in 352778 lists Total: 11291284 / 32474899 bytes = 34.77% Indexing the same mailbox file with squat-test gives: - Index time: 9.55 CPU seconds, 9.63 real seconds (3.24MB/CPUs) - 4145192 bytes in 102208 nodes (12.76%) - 7286058 bytes in 305501 uid_lists (22.44%) - 11431250 bytes total of 32474899 (35.20%) So the new indexer is over twice as fast and uses slightly less space. Indexing 4 char substrings and words up to 10 chars: Index time: 5.13 CPU seconds (6.04MB/CPUs) Node memory: 6002804 bytes (5862 kB) in 615501 nodes UID memory: 9044610 bytes (8832 kB) in 519488 lists Total: 15047414 / 32474899 bytes = 46.34% So it takes somewhat more space, but definitely less than having both Squat + Lucene. No substring indexing, words up to 10 chars (Lucene replacement): Index time: 1.39 CPU seconds (22.28MB/CPUs) Node memory: 3297663 bytes (3220 kB) in 548540 nodes UID memory: 1803735 bytes (1761 kB) in 213554 lists Total: 5101398 / 32474899 bytes = 15.71% Is there a need for Lucene anymore with this kind of a speed and disk space usage? :) The above tests are run with everything being indexed except space and control chars (ie. practically space + tab). If only alphanumeric characters are indexed, the total lines are (in same order as above): Total: 7048664 / 32474899 bytes = 21.70% (-13.07%) Total: 9610543 / 32474899 bytes = 29.59% (-16.75%) Total: 3963335 / 32474899 bytes = 12.20% (-3.51%) There are probably still a few optimizations that can be done to get the disk space usage even lower. I did spent quite a lot of time making it use less CPU though. Even tried a bit different coding style variations in the critical functions to get gcc to create faster code.. One interesting thing I noticed was that binary searching a character from a char array was slower than just sequentially going through the characters. I tried adding checks to do it only if the array was big, but it was always slower. Maybe something to do with CPU cache. If you want to try yourself, the test program is in http://dovecot.org/tmp/new-indexer.c

7 10

Re: [Dovecot] SSL/TLS with Outlook client
by Nikolay Shopik 14 Nov '07

14 Nov '07

Agree with Hugo most root CA have intermidate certificates which should supplied with your server certificate. Otherwise chain won't work and any client don't trust it. - original message - Subject: Re: [Dovecot] SSL/TLS with Outlook client From: Hugo Monteiro <hugo.monteiro(a)fct.unl.pt> Date: 14/11/2007 00:14 Eli Sand wrote: > Hugo Monteiro wrote: > >> Ah ... wildcard certs .. from what i recall, certs issued like >> *.example.com were not very well accepted by M$ clients. You should >> test against non wildcard certs and see how it behaves. >> > > Already have and no luck :( My domain is elisand.com and I have tried > *.elisand.com, mx1.elisand.com (I believe that's what my MX record is... if > not, whatever it is is what I tried) and mail.elisand.com which is the > smtp/imap server name I use in Outlook. All three yield the same result :( > > Eli. > > > I have taken the liberty to connect to your server, using openssl, i've seen the following: $ openssl s_client -CApath /usr/share/ca-certificates/cacert.org/ -connect mail.elisand.com:993 CONNECTED(00000003) depth=1 /O=Root CA/OU=http://www.cacert.org/CN=CA Cert Signing Authority/emailAddress=support(a)cacert.org verify return:1 depth=0 /CN=*.elisand.com verify return:1 --- Certificate chain 0 s:/CN=*.elisand.com i:/O=Root CA/OU=http://www.cacert.org/CN=CA Cert Signing Authority/emailAddress=support(a)cacert.org --- i believe you should change two things. If the name you wish to use on your clients is mail.alisand.com, then the certificate should read CN=mail.elisand.com. Furthermore, it's always a good idea to provide the chaining certificate path on dovecots side. Try using the ssl_ca_file directive on dovecot's configuration. Regards, Hugo Monteiro. -- ci.fct.unl.pt:~# cat .signature Hugo Monteiro Email : hugo.monteiro(a)fct.unl.pt Telefone : +351 212948300 Ext.15307 Centro de Informática Faculdade de Ciências e Tecnologia da Universidade Nova de Lisboa Quinta da Torre 2829-516 Caparica Portugal Telefone: +351 212948596 Fax: +351 212948548 www.ci.fct.unl.pt apoio(a)fct.unl.pt ci.fct.unl.pt:~# _

1 0

[Dovecot] Using Dovecot as Asterisk PBX voicemail server
by Kenneth Porter 14 Nov '07

14 Nov '07

I'm reading the Asterisk book, 2nd edition, and it describes how one can set up voicemail to be delivered by IMAP to a voicemail folder. Asterisk can monitor flags on the folder so that the "message available" light on one's phone tracks the state of the "read" flag in the folder. One can either dial in for one's voicemail or listen to it from one's favorite IMAP client. (Dovecot is mentioned in the book.) I'm wondering how one would set up auth for this? Asterisk needs to log in to the account to deliver the voicemail and to check its state, but I wouldn't want to put everyone's mail password in plaintext in Asterisk's voicemail.conf file. Would I set up a separate IMAP account for each user to hold their voicemail, and use simple passwords (such as the PIN they use for phone access to voicemail) in the Asterisk config? Or is there a way to set up Dovecot to allow a second user to login to a specific IMAP folder in all accounts, in the same way the local delivery agent has write access to all users' mailbox? Google's page for the book: <http://books.google.com/books?id=vtQxJ3oSm64C&dq=asterisk+book> Dovecot mentions: <http://books.google.com/books?id=vtQxJ3oSm64C&dq=asterisk+book&q=dovecot#se…>

3 3

[Dovecot] namespace public folders
by Nikolay Shopik 13 Nov '07

13 Nov '07

Hi list, Here is thing im trying to accomplish. I would like to setup public folders which resposible for delivering mails for some speical addresses like info(a)example.com. And it will be perfect if "seen" status for this folder will be saved per user. I mean if one user read message and set it as read other user should see it still as unread. As I far i know there some limitation in 1.0 tree but not in lates 1.1. My question is can I do such setup with dovecot+postfix. Im really appreciate for simple examples how can i accomplish this kind setup if it possible :)

3 3

[Dovecot] Caching?
by Bjørn T Johansen 13 Nov '07

13 Nov '07

Any way to minimize the number of sql statements that dovecot do? (and I tried adding userdb prefetch { } but number of sql calls are still the same) Am I doing something wrong or? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

2 2

[Dovecot] v1.1.beta8 released
by Timo Sirainen 13 Nov '07

13 Nov '07

http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta8.tar.gz http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta8.tar.gz.sig Changes since beta7: - Added a new "raw" mail storage backend which allows opening files/streams as single mail mailboxes. deliver uses this now instead of opening the incoming mail as a mbox. So deliver should be now faster and it doesn't anymore remove Dovecot's private mbox headers if you're not using mbox. - Cache file tracks message expunges again - All kinds of other fixes - Some optimizations I think we're getting closer to v1.1 RCs.

9 17

[Dovecot] Dovecot does not fetch mails from Maildir
by Aras Koktas 13 Nov '07

13 Nov '07

Hello I have the following configuration. I am trying to login through pop3 and fetch e-mails but it does not fetch anything. I see that there is a mail there. Here is what i have List from my homedir. Set correct on MySQL as (home) -- [root@axis info]# ls -al new total 12 drwx------ 2 exim exim 4096 Nov 12 21:11 . drwxrwx--- 6 exim exim 4096 Nov 12 21:11 .. -rw------- 1 exim exim 1996 Nov 12 21:11 1194919868.H288251P7967.axis.phidot.com -- -- FROM sql File-- password_query = SELECT userid as user, password FROM mailacct WHERE userid = '%u' user_query = SELECT home, uid, gid FROM mailacct WHERE userid = '%' -- DOVECOT CONFIG -- # 1.0.7: /usr/local/etc/dovecot.conf base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /usr/share/ssl/certs/dovecot.pem ssl_key_file: /usr/share/ssl/private/dovecot.pem disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login first_valid_uid: 93 mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: mechanisms: PLAIN passdb: driver: sql args: /etc/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot-sql.conf

2 4

[Dovecot] Missing deliver
by Sean Smitz 13 Nov '07

13 Nov '07

I've installed Red Hat Enterprise Linux 5 on a new server. I'm configuring sendmail and dovecot; however, /usr/local/libexec/dovecot was not created when I installed the dovecot rpm (rpm -Uvh dovecot-1.0-1.2.rc15.el5.x86_64.rpm). The problem is I can't find the deliver executable which is supposed to be in this directory. Any help would be appreciated.

2 1

[Dovecot] login_process_size too small on x86_64 Fedora/RHEL
by Tomas Janousek 12 Nov '07

12 Nov '07

Hello, as described in [253363], login_process_size of 32M is not enough on 64-bit versions of Fedora and RHEL (and possibly other distributions as well). [253363] https://bugzilla.redhat.com/show_bug.cgi?id=253363 As I understand it, there's an intersegment gap between read-only/executable and writable segments of shared libs. That's probably a security feature or something. I found a similar issue here[1], if anyone wants a comment from someone who understands it. [1] http://gcc.gnu.org/ml/libstdc++/2006-12/msg00033.html Shall we just increase login_process_size or make it arch-dependent or something? Regards, -- Tomas Janousek, SW Engineer, Red Hat, Inc.

2 2

[Dovecot] Secure authentication?
by Bjørn T Johansen 12 Nov '07

12 Nov '07

I have enabled SSL support for my dovecot installation but if I enable secure authentication in my MUA, I get an error from dovecot telling me that this is not supported.. Is this because dovecot does not support this or am I missing some config? Regards, BTJ -- ----------------------------------------------------------------------------------------------- Bjørn T Johansen btj(a)havleik.no ----------------------------------------------------------------------------------------------- Someone wrote: "I understand that if you play a Windows CD backwards you hear strange Satanic messages" To which someone replied: "It's even worse than that; play it forwards and it installs Windows" -----------------------------------------------------------------------------------------------

7 9

[Dovecot] dovecot 1.1b7: mail-cache-lookup.c: line 68: unreached
by Adam McDougall 12 Nov '07

12 Nov '07

I have since upgraded to 1.1b8 but this morning my attention was called to this error from 1.1b7: Nov 11 06:35:17 hill dovecot: IMAP(voice): file mail-cache-lookup.c: line 68: unreached Nov 11 06:35:17 hill dovecot: child 70673 (imap) killed with signal 6 Nov 11 06:35:17 hill dovecot: IMAP(voice): Connection closed bytes=262/25869 I can't say for sure but it was probably a squirrelmail connection. It wasn't me, and I wasn't even awake at the time so I don't know how to reproduce it.

1 0

[Dovecot] dovecot: pipe() failed: Too many open files
by Ralf Hildebrandt 12 Nov '07

12 Nov '07

I'm encountering lots of Oct 31 11:14:25 postamt dovecot: pipe() failed: Too many open files errors around midday ever since the latest upgrade to 1.0.7. The errors appear in pairs like this one: Oct 31 11:20:01 postamt dovecot: pipe() failed: Too many open files Oct 31 11:20:01 postamt dovecot: imap-login: Internal login failure: user=<username>, method=PLAIN, rip=193.175.174.239, lip=141.42.4.250, TLS What gives? -- Ralf Hildebrandt (Ralf.Hildebrandt(a)charite.de) plonk(a)charite.de Postfix - Einrichtung, Betrieb und Wartung Tel. +49 (0)30-450 570-155 http://www.arschkrebs.de We're using Postfix - it generally seems to take the approach that the message that arrives is the message that gets delivered, without any extra bits being added. -- Chris Stratford

2 3

[Dovecot] v2.0 / Master/config rewrite
by Timo Sirainen 12 Nov '07

12 Nov '07

If anyone's interested, I updated my master/config rewrite to latest Dovecot v1.1 tree and added it to hg: http://hg.dovecot.org/dovecot-master-rewrite/ It probably doesn't work, but with the exception of plugins it compiles anyway. :) I'm thinking that maybe after v1.1.0 I could continue with the rewrite and create v2.0 after all instead of v1.2. Just look at how much cleaner deliver.c is :) http://hg.dovecot.org/dovecot-master-rewrite/file/59ebbfcf21cb/src/deliver/… vs http://hg.dovecot.org/dovecot/file/eb4f1fbeecda/src/deliver/deliver.c Another thing with v2.0 I was thinking about was to change index file formats to be more efficient.

2 1

[Dovecot] some mail accesses in dovecot 1.1 stall for a bit (in progress)
by Adam McDougall 11 Nov '07

11 Nov '07

I noticed this in an earlier beta and took a note, and I still see it sometimes in 1.1b4, but it is only occasional so I have not tracked down yet what dovecot is doing. Just a FYI for the list incase others see it and to say that its an issue I tend to track down that I did not see in 1.0, and its been low on my list until now. Sometimes when I login to dovecot and read a message from an imap maildir folder, the message contents do not load for at least 10 seconds, sometimes closer to a minute, but after that first message loads, the rest seem fine in that mailbox. The time seems to vary some, usually longer rather than shorter.

2 9

[Dovecot] imap search/content-transfer-encoding assertion failed
by Andrew Garner 11 Nov '07

11 Nov '07

When performing an imap search, I hit the following assertion failure: imap(vmail): Panic: file unichar.c: line 128 (uni_ucs4_to_utf8_c): assertion failed: (chr <= 0x40000000) imap(vmail): Error: Raw backtrace: /usr/lib/dovecot/imap [0x80c7f7f] -> /usr/lib/dovecot/imap [0x80c7d6a] -> /usr/lib/dovecot/imap [0x80d8616] -> /usr/lib/dovecot/imap(uni_utf8_to_decomposed_titlecase+0x9f) [0x80d892f] -> /usr/lib/dovecot/imap(message_decoder_decode_next_block+0x679) [0x80c46e9] -> /usr/lib/dovecot/imap(message_search_more+0x3e) [0x80c2e8e] -> /usr/lib/dovecot/imap(message_search_msg+0x72) [0x80c3012] -> /usr/lib/dovecot/imap [0x8093f47] -> /usr/lib/dovecot/imap [0x80b7719] -> /usr/lib/dovecot/imap(mail_search_args_foreach+0x32) [0x80b77c2] -> /usr/lib/dovecot/imap(index_storage_search_next_nonblock+0x243) [0x8093af3] -> /usr/lib/dovecot/imap [0x805cdc7] -> /usr/lib/dovecot/imap [0x805d138] -> /usr/lib/dovecot/imap(io_loop_handle_timeouts+0x112) [0x80ce892] -> /usr/lib/dovecot/imap(io_loop_handler_run+0x66) [0x80cf316] -> /usr/lib/dovecot/imap(io_loop_run+0x28) [0x80ce768] -> /usr/lib/dovecot/imap(main+0x4ab) [0x806675b] -> /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xc8) [0xb7e68ea8] -> /usr/lib/dovecot/imap [0x8059141] My quick analysis: This seemed to be caused by a single message in this mailbox. I think dovecot is expanding base64 encoded binary data and then inevitably failing on the utf8 conversion of the decoded random binary data. The mime headers for this message are: MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="------------080305000603070709090808" ... This is a multi-part message in MIME format. --------------080305000603070709090808 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit <text content> ... --------------080305000603070709090808 Content-Type: application/x-zip-compressed; name="xxxxxxxx.zip" Content-Transfer-Encoding: base64 Content-Disposition: inline; filename="xxxxxxxxxxxx.zip" <base64 encoded zip file> ... --------------080305000603070709090808-- # dovecot -n # 1.1.beta6: /etc/dovecot/dovecot.conf protocols: imap pop3 listen: 127.0.0.1 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no first_valid_uid: 89 mail_location: maildir:~/Maildir mail_debug: yes mmap_disable: yes mail_nfs_storage: yes mail_nfs_index: yes mail_executable(default): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/rawlog /usr/lib/dovecot/pop3 mail_plugins(default): fts fts_lucene mail_plugins(imap): fts fts_lucene mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 mail_log_prefix: %Us(%u[%r]): mail_log_max_lines_per_sec: 100 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f auth default: mechanisms: plain cram-md5 verbose: yes debug: yes debug_passwords: yes passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: sql args: /etc/dovecot/dovecot-sql.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail group: vmail plugin: fts: lucene

2 1

[Dovecot] assertion failed: (mailbox_list_is_valid_existing_name(_list, name))
by Adam McDougall 11 Nov '07

11 Nov '07

Do you need a gdb backtrace for this one? I'm not sure why all of a sudden this started happening, its probably due to me adding a folder somewhere? not sure. It happened when I went to open my folder subscriptions in thunderbird. It was taking longer than usual (call this phase 1) and I noticed this in the logs: (cant remember if this was phase 1 or 2 but the error is probably the same) Nov 11 00:38:38 boomhauer dovecot: imap-login: Login: user=<mcdouga9>, method=PLAIN, rip=208.53.102.126, lip=35.9.37.190, TLS Nov 11 00:38:39 boomhauer dovecot: IMAP(mcdouga9): fchown(/egr/mail/shared/decs/temp.boomhauer.3050.af3db3ac545170a7) failed: Operation not permitted Nov 11 00:38:44 boomhauer dovecot: IMAP(mcdouga9): file mailbox-list-maildir.c: line 186 (maildir_list_get_path): assertion failed: (mailbox_list_is_valid_existing_name(_list, name)) Nov 11 00:38:44 boomhauer dovecot: child 3050 (imap) killed with signal 6 Nov 11 00:38:45 boomhauer dovecot: imap-login: Login: user=<mcdouga9>, method=PLAIN, rip=208.53.102.126, lip=35.9.37.190, TLS Nov 11 00:38:45 boomhauer dovecot: IMAP(mcdouga9): fchown(/egr/mail/shared/decs/temp.boomhauer.3052.5538be060c2f9c7d) failed: Operation not permitted Nov 11 00:38:46 boomhauer dovecot: IMAP(mcdouga9): file mailbox-list-maildir.c: line 186 (maildir_list_get_path): assertion failed: (mailbox_list_is_valid_existing_name(_list, name)) Nov 11 00:38:46 boomhauer dovecot: child 3052 (imap) killed with signal 6 When I cancelled the subscription window, "phase 2" is the same thing but happening more rapidly. I traced what tbird is doing and can reproduce it with: ? OK Logged in. a list "" "#shared/decs/%/%" Connection closed by foreign host. Doing a list on #shared/decs/% works though.

2 2

[Dovecot] Outlook can't see namespace folders
by James 10 Nov '07

10 Nov '07

Hi guys i understand that you can't subscribe to the Prefix names of namespace folders right now with dovecot. But for instance if i user outlook express and it can't see the prefix name then it can't see the subfolders of that "prefix folder" either. So even though it can detect and see the subfolders it won't display them cause it can't see the "parent" Is there any fix for this? it's also kind of annoying in thunderbird but at least you can still see the subfolders. TIA James Here's my config # /etc/dovecot/dovecot.conf protocols = imap imaps pop3 pop3s log_timestamp = "%Y-%m-%d %H:%M:%S " first_valid_uid = 100 login_user=vmail mail_extra_groups = mail mail_debug = yes pop3_uidl_format = %08Xu%08Xv mail_location = maildir:/home/vmail/domains/%n/Maildir #default_mail_env = maildir:/home/vmail/domains/%n/Maildir auth default { mechanisms = plain passdb ldap { args = /etc/dovecot/dovecot-ldap.conf } userdb ldap { args = /etc/dovecot/dovecot-ldap.conf } } # maildir namespace private { separator = / prefix = location = maildir:/home/vmail/domains/%n/Maildir inbox = yes hidden = no } # mbox namespace private { separator = / prefix = "Mbox/" location = mbox:/home/vmail/domains/%n/Mbox inbox = no hidden = no } #public spam folder namespace public { separator = / prefix = /Spam/ location = maildir:/home/vmail/domains/Spam/Maildir/ hidden = no } ssl_disable = no ssl_cert_file = /etc/ssl/certs/dovecot.pem ssl_key_file = /etc/ssl/private/dovecot.pem ssl_verify_client_cert = no ssl_cipher_list = ALL:!LOW:HIGH:MEDIUM:+SSLv2:RSA

3 10

[Dovecot] Request for variable unique to each server?
by Adam McDougall 10 Nov '07

10 Nov '07

I've been looking for a variable I can use in my dovecot.conf within the INDEX= setting so I can have one index dir per imap server on NFS. I've been looking at http://wiki.dovecot.org/Variables but no variable seems to contain something like server hostname, and I've been hunting for the variable expansion code in dovecot but haven't been able to find it. %l (local IP) won't help me because when using our load balancer, %l is the same IP on all of my servers. %r is close to useful but having a local webmail server on each server means I'd end up with 127.0.0.1 being shared (also I would end up with one directory per unique user/clientIP combo). Is there a variable that holds the server hostname or something else unique per server, or could one be added, or could someone point me at the code? Thanks.

2 2

[Dovecot] UTF-8 in dovecot-sieve ?
by Arthur Pétry 10 Nov '07

10 Nov '07

Hi, Reading http://tools.ietf.org/html/rfc3028#section-2.7.2 I thought that out-of-the-box dovecot can filter messages by matching header in UTF-8. But when I tested it, it failed : (I'm using 1.0.5 with sieve plugin) Here is my .dovecot.sieve file : ---------- require ["fileinto", "imapflags"]; if allof(header :contains "subject" "filtre") { addflag "test_1"; } if allof(header :contains "subject" "là") { addflag "test_2"; } if allof(header :comparator "i;ascii-casemap" :contains "subject" "hé") { addflag "test_3"; } ---------- Only the first of the three rules do work. When I try to match a subject string with accent encoded in ISO-8859 like "hélà" : "=?ISO-8859-1?Q?h=E9l=E0?=" there is no match Am I doing something wrong ?

2 1

[Dovecot] 1.0beta7 still has SEARCH TEXT not search the FROM
by Asheesh Laroia 10 Nov '07

10 Nov '07

I just tried out 1.0beta7 and erased all my indexes and with fts and fts_squat enabled, and when I SEARCH TEXT in Dovecot, it does *not* find messages where the thing I SEARCH for appear only in the From: header. Timo, can you confirm or deny that you still see this behavior? I did clear my indexes before doing it. -- Asheesh. -- Man is the measure of all things. -- Protagoras

2 2

[Dovecot] Index corruption ?
by Geoffroy Desvernay 09 Nov '07

09 Nov '07

Hi, We are using dovecot for some times (a little before 1.0), for IMAP and (a little for the moment) deliver. We have ~20000 logins/day, Maildirs are over NFS (with indexes too, for the moment...) Up to 1.0.5, we sometime have this error in maillog: ________________________________________________________________________ Nov 1 13:55:41 tic dovecot: IMAP(login): file mail-index-view-sync.c: line 666 (mail_index_view_sync_end): assertion failed: (view->log_file_offset >= view->map->hdr.log_file_int_offset) ________________________________________________________________________ I didn't find any bits on google, nor on this list's archive... # gdb (without debug, I may do it if required) ________________________________________________________________________ Program terminated with signal 6, Aborted. Reading symbols from /usr/local/lib/libiconv.so.3...(no debugging symbols found)...done. Loaded symbols for /usr/local/lib/libiconv.so.3 Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /libexec/ld-elf.so.1...(no debugging symbols found)...done. Loaded symbols for /libexec/ld-elf.so.1 #0 0x182ad51f in kill () from /lib/libc.so.6 (gdb) bt #0 0x182ad51f in kill () from /lib/libc.so.6 #1 0x182ad4be in raise () from /lib/libc.so.6 #2 0x182ac0e8 in abort () from /lib/libc.so.6 #3 0x080a85da in i_set_failure_syslog () #4 0x080a80e1 in data_stack_deinit () #5 0x08092c97 in mail_index_view_sync_end () #6 0x0808229e in index_mailbox_sync_next () #7 0x0000001c in ?? () #8 0xbfbfe7e8 in ?? () #9 0x080d3140 in ?? () #10 0x080d8044 in ?? () #11 0x0000001c in ?? () #12 0xbfbfe828 in ?? () #13 0x08060761 in imap_sync_deinit () Previous frame inner to this frame (corrupt stack?) ____________________________________________________________________ dovecot -n # 1.0.5: /usr/local/etc/dovecot.conf ssl_ca_file: /etc/ssl/cacert.pem ssl_cert_file: /etc/ssl/private/imaps.ec-marseille.fr.pem ssl_key_file: /etc/ssl/private/imaps.ec-marseille.fr.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_greeting: IMAP Centrale ready. login_greeting_capability: yes login_process_size: 64 login_processes_count: 20 login_max_processes_count: 512 valid_chroot_dirs: /users:/home max_mail_processes: 2048 verbose_proctitle: yes first_valid_uid: 1000 last_valid_uid: 55000 first_valid_gid: 999 last_valid_gid: 55000 mail_extra_groups: mail mail_location: maildir:%h/Maildir/ mmap_disable: yes lock_method: flock maildir_stat_dirs: yes maildir_copy_with_hardlinks: yes mail_drop_priv_before_exec: yes mail_executable: /usr/local/libexec/dovecot/imap_convert imap_client_workarounds: delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep auth default: verbose: yes worker_max_count: 60 passdb: driver: pam args: imap passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: passwd userdb: driver: ldap args: /usr/local/etc/dovecot-uldap.conf socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 plugin: quota: fs ___________________________________________________________________ # dovecot-ldap.conf (dovecot-uldap.conf is a symlink) ___________________________________________________________________ hosts = ldapr.serv.int:389 ldap:389 dn = <our binddn> dnpass = <our pass> auth_bind = yes ldap_version = 3 base = ou=People,<our_basedn> deref = never scope = onelevel user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid,uid=system_user user_filter = (&(objectClass=inetLocalMailRecipient)(|(uid=%u)(mail=%u)(mail=%n@<our_primary_domain>))) pass_attrs = uid=user pass_filter = (&(objectClass=inetLocalMailRecipient)(|(uid=%u)(mail=%u)(mail=%n@<our_primary_domain>))) ____________________________________________________________________ -- ___________________________________________________________ / Geoffroy DESVERNAY | \ /\ `Service info` | Tel: (+33|0)4 91 05 45 24 /\ \/ Ecole Centrale de Marseille | Fax: (+33|0)4 91 05 45 98 \/ \ (ex-EGIM) | Mail: dgeo(a)ec-marseille.fr / -----------------------------------------------------------

3 2

[Dovecot] IMAP outlook express error
by Hannibal Ndlovu 09 Nov '07

09 Nov '07

Hi Am running debian etch + exim4 + dovecot 1.0.rc15-2etch with both an IMAP and a POP3 server The issue is when i try and get my mail using the IMAP protocol outlook gives and error "cannot find Inbox on 192.0.0.1" its happens with thunderbird and with Kmail - I assume i have misconfigured it some how and my mail is set to "mail_spool" in Exim4 I have pasted the output of "dovecot -n" # /etc/dovecot/dovecot.conf log_path: /var/log/dovecot/dovecot.log info_log_path: /var/log/dovecot/dovecot-info.log log_timestamp: %Y-%m-%d %H:%M:%S protocols: pop3 imap listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_disable: yes disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login login_greeting: The Chisipite Mail Server is ready. login_processes_count: 5 max_mail_processes: 100 verbose_proctitle: yes mail_extra_groups: mail Debian-exim mailbox_idle_check_interval: 5 mail_debug: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv auth default: verbose: yes passdb: driver: pam passdb: driver: passwd args: /etc/passwd passdb: driver: shadow args: /etc/shadow userdb: driver: passwd

2 2

[Dovecot] Dovecot I/O scheduling (all versions)
by mikkel＠euro123.dk 08 Nov '07

08 Nov '07

I have experienced this on all versions of Dovecot that Ive used (1.0 - 1.1b6) using IMAP (its difficult to test if its also there with POP3). What I see is that if there is a peak in disk usage at the time of a specific request that requests stalls. The saturation of disk I/O is momentary but when its done (maybe after one or two seconds) Dovecot still waits for its I/O operation instead of continuing as soon as resources are available. Now, I would expect Dovecot to only wait until there are resources available and not stall for at long time (sometimes it stalls for like 10 seconds, and sometimes completely). This could be OS specific (Im using ZFS and Solaris 10 on Sparc) but it may also be due to the way dovecot is programmed. Theres always plenty of RAM and CPU available so thats not whats causing troubles. Is anyone else familiar with this issue? Regards, Mikkel

2 1

[Dovecot] IDLE with Leopard Mail
by Scott Murman 08 Nov '07

08 Nov '07

imap IDLE is now built into the apple mail client in Leopard (finally!!). anyone looked at compatibility issues with dovecot? -SM-

2 1

[Dovecot] v1.1.beta7 released
by Timo Sirainen 08 Nov '07

08 Nov '07

http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta7.tar.gz http://dovecot.org/releases/1.1/beta/dovecot-1.1.beta7.tar.gz.sig Changes since beta6: - Beginnings of unit tests, as I mentioned in a previous mail - Message parsing fixes - Cache file handling fixes Known bugs: - Cache file doesn't keep track of how much it contains deleted data, which means it could grow infinitely. This worked at some point, so I'm not sure what I did to break it. I'll figure it out later. - Apparently for some use cases v1.1 is still slower (about 2x) than v1.0. Probably more or less specific to NFS + mmap_disable=yes.

1 0

Re: [Dovecot] Unit testing
by Alan Ferrency 07 Nov '07

07 Nov '07

Timo Sirainen <tss(a)iki.fi> wrote: > I finally added beginnings of unit tests to Dovecot v1.1 code tree: > http://hg.dovecot.org/dovecot/rev/4e4a5d6bb2cb Great! Unit testing is good, even though it's boring and not very glamorous. I wonder if you have seen or considered libtap, possibly as an optional dependency for those who care about running the tests? http://jc.ngo.org.uk/trac-bin/trac.cgi/wiki/LibTap It looks like it could almost drop in, in place of some of your existing test helpers. It is also compatible with a variety of end user test tools. However, I could see hesitation in adding external dependencies where they aren't really necessary. If you had TAP compatibility through libtap or other means, I could easily drop dovecot into our existing suite of nightly smoke tests on FreeBSD. > I'm probably going to be pretty lazy at adding more of those tests, so > if you've ever wanted to get your own code to Dovecot, now would be a > great time to do it! :) With a 5 month old and a 4 year old on hand, "copious free time" isn't my strong point, but I'll at least attempt to provide tests with any future bug reports. Thanks! Alan Ferrency

1 0

[Dovecot] How to set multi backends (with same type)
by maximatt 07 Nov '07

07 Nov '07

hi..... i don't know if its posible. i have two ldap directories, and i want use them to use as my dovecot users backend... so i have two configurations files... "dovecot-ldap1.conf" and " dovecot-ldap2.conf" and i try setting like: Test 1: (simil postfix ) :D This dont work auth default { : : passdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf, /etc/dovecot/etc/ldap/dovecot-ldap2.conf } userdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf, /etc/dovecot/etc/ldap/dovecot-ldap2.conf } } Test 2: This dont work auth default { : : passdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf/etc/dovecot/etc/ldap/dovecot- ldap2.conf } userdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf/etc/dovecot/etc/ldap/dovecot- ldap2.conf } } Test 3: (looking "passbd ldap" as a set) :) this work, but dovecot-ldap2.conf override dovecot-ldap1.conf (the set vision, none) auth default { : : passdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf args= /etc/dovecot/etc/ldap/dovecot-ldap2.conf } userdb ldap { args= /etc/dovecot/etc/ldap/dovecot-ldap1.conf args= /etc/dovecot/etc/ldap/dovecot-ldap2.conf } } ¿How could i do this? :( Thanks in advance :) -- Salu2 ;)

1 1

[Dovecot] imaptest update
by Timo Sirainen 07 Nov '07

07 Nov '07

http://dovecot.org/tools/imaptest.c now keeps track of messages' metadata and complains if they change. It relies on Message-ID: header being unique in the source mailbox, otherwise it'll give bogus errors. I might fix that some day. I changed the code from using simple line-based parsing to Dovecot's imap-parser code. Unfortunately it looks like it's pretty slow. At least I'm pretty sure imaptest didn't take more than a few % of CPU before, while now it's showing 35% CPU usage.. I guess I'll have to profile it a bit to see what's eating the CPU. And yes, looks like it found a couple of bugs from Dovecot 1.1's MIME parsing (BODY/BODYSTRUCTURE replies change). That was actually why I wrote this code in the first place, I was trying to figure out how to reproduce a bug. I'm getting closer to my stress testing dream tool. :) http://mailman1.u.washington.edu/pipermail/imap-protocol/2007-March/000413.…

1 0

[Dovecot] Unit testing
by Timo Sirainen 07 Nov '07

07 Nov '07

I finally added beginnings of unit tests to Dovecot v1.1 code tree: http://hg.dovecot.org/dovecot/rev/4e4a5d6bb2cb There are currently just a couple of tests implemented in test-lib (lib/ functions) and test-mail (lib-mail/ functions). I'm probably going to be pretty lazy at adding more of those tests, so if you've ever wanted to get your own code to Dovecot, now would be a great time to do it! :)

1 0

[Dovecot] index corruption
by rosenfield＠users.sourceforge.net 07 Nov '07

07 Nov '07

Hi people Just switched to Dovecot yesterday, and I've already got about five reports of users with duplicate mail in their inbox :-/. Not as bad as lost email, mind you, but pretty annoying still. Checking the server log, it says: postfix/smtpd: disconnect from unknown deliver: msync() failed with index file maildir/dovecot.index: Input/output error unionfs: new lower inode mtime (bindex=0, name=maildir) dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error IMAP: Disconnected: Internal error occurred. Refer to server log for more information. This is dovecot version 1.0.3, the log presented here relates to only one user; user name snipped for anonymity purposes. Afterwards things just get worse and worse with the affected user: dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: Corrupted transaction log file maildir/.SPAM/dovecot.index.log: invalid new transaction log sequence (1 >= 1) dovecot: IMAP: fscking index file maildir/.SPAM/dovecot.index dovecot: IMAP: Transaction log file maildir/.SPAM/dovecot.index.log: marked corrupted dovecot: IMAP: Corrupted transaction log file maildir/.SPAM/dovecot.index.log: invalid new transaction log sequence (2 >= 2) dovecot: IMAP: fscking index file maildir/.SPAM/dovecot.index dovecot: IMAP: Corrupted transaction log file maildir/.Junk/dovecot.index.log: invalid new transaction log sequence (1 >= 1) dovecot: IMAP: fscking index file maildir/.Junk/dovecot.index dovecot: IMAP: Transaction log file maildir/.Junk/dovecot.index.log: marked corrupted dovecot: IMAP: Corrupted transaction log file maildir/.Junk/dovecot.index.log: invalid new transaction log sequence (2 >= 2) dovecot: IMAP: fscking index file maildir/.Junk/dovecot.index deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error deliver: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error dovecot: IMAP: msync() failed with index file maildir/dovecot.index: Input/output error What could be the problem? How do I go about debugging an issue such as this?

2 2

[Dovecot] IMAP - Empty attachments error
by Tomáš Klandra 06 Nov '07

06 Nov '07

Hallo, I have one problem with the following configuration: - server: debian, dovecot used as an IMAP server, version 0.99.14. - stations: windows 2k/XP, mailer seamonky 1.1.4 Sometimes (let's say once in 20 attemptes) when saving attachments, they are empty (zero size files). Simple re-saving them helps. I was looking on mozilla forums if it's not a bug in SeaMonkey, which looked more likely to me, but didn't find anything, so I got the idea it could be a bug in dovecot. If someone saw this as well or have any ideas, I would really appreciate any help about it, as the error is really annoying. Thank you, Tom

2 1

[Dovecot] assertion failed with hg current
by Jakob Hirsch 06 Nov '07

06 Nov '07

Hi, I get a lot of these after updating to the current 1.1 hg version: > Nov 6 16:05:35 seba deliver(jh): file mail-cache-transaction.c: line 736 (mail_cache_header_add_field): assertion failed: (cache->field_file_map[field_idx] != (uint32_t)-1) > Nov 6 16:05:35 seba deliver(jh): Raw backtrace: /usr/local/libexec/dovecot/deliver(i_syslog_fatal_handler+0x2b) [0x80bbeab] -> /usr/local/libexec/dovecot/deliver [0x80bbd4c] -> /usr/local/libexec/dovecot/deliver(mail_cache_add+0x2d2) [0x8091da2] -> /usr/local/libexec/dovecot/deliver(index_mail_cache_add_idx+0x69) [0x8085629] -> /usr/local/libexec/dovecot/deliver [0x806f776] -> /usr/local/libexec/dovecot/deliver(mail_storage_copy+0x53) [0x80ab3b3] -> /usr/local/libexec/dovecot/deliver(maildir_copy+0x52) [0x8067802] -> /usr/local/libexec/dovecot/deliver(deliver_save+0xcf) [0x80592df] -> /usr/local/libexec/dovecot/deliver(main+0x1317) [0x805a7e7] -> /lib/libc.so.6(__libc_start_main+0xe0) [0x948f70] -> /usr/local/libexec/dovecot/deliver [0x8058541] Besides that, it seems to run fine.

2 1

[Dovecot] User keywords limit to 26
by Arthur Pétry 06 Nov '07

06 Nov '07

Hi, I'm planning to use dovecot 1.0.5 for a webmail using a lot of user- defined tags. Recently, I just saw the limit of 26 of them when messages are stored in maildir format. This is an important issue for me, since I didn't find how to remove a flag from the dovecot-keywords database. Is there any plan to get rid of the keywords limit ? Or perhaps the new dbox storage format can fix that ? By the way, the comportement of Dovecot when we try to add a new flag while the limit is exceeded is strange : (C: is client and S: Dovecot) The store of the flags is ok : C: RUBY0094 UID STORE 89 +FLAGS (test_0 test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26) S: * 81 FETCH (UID 89 FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26 test_0)) S: RUBY0094 OK Store completed. And then when we fetch them, dovecot reply 2 times. The first time with all the flags, and the second time with only the 26 flags stored in maildir. (I suppose Dovecot try to sync the flags when we fetch it) : C: RUBY0095 UID FETCH 89 FLAGS S: * 81 FETCH (FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_26 test_0) UID 89) S: * 81 FETCH (FLAGS (\Seen test_1 test_2 test_3 test_4 test_5 test_6 test_7 test_8 test_9 test_10 test_11 test_12 test_13 test_14 test_15 test_16 test_17 test_18 test_19 test_20 test_21 test_22 test_23 test_24 test_25 test_0)) S: RUBY0095 OK Fetch completed.

2 1

[Dovecot] Sent vs Sent Items
by Ed W 06 Nov '07

06 Nov '07

Religious wars about which is "best" aside - some mail clients seem to default to using "Sent Items" folder for saving sent mail, and others (many) default to "Sent". Seems that in the interests of compatibility and "doing the right thing" (tm) that a symlink from one folder to the other name would ensure that either default would give the same result (in a mixed client setup)? However, I wonder if someone has already written a plugin to do something simple like this? More generally I guess it's folder aliasing, so that Sent == Sent Items and perhaps there are also synonyms for Drafts/Templates? Anyone got any thoughts on this simple idea? (The prob with sym links is a) creating them at mailbox setup time and b) what happens when someone tries to delete the folder...) Cheers Ed W

6 6