- dovecot - dovecot.org

Re: [Dovecot] Upgraded dovecot - now it insists on imap TLS
by Alan Brown 13 Sep '10

13 Sep '10

Marcus Rueckert wrote: > > What am I missing? > dovecot -n output would help. It would, but I found/fixed the problem already. I had to set the following: protocol imap { disable_plaintext_auth=no } The default has changed from "no" to "yes" between 1.1.20 and 2.0.1, but the conversion routine didn't pick it up (the wiki Documentation suggests the default is still "no". Perhaps this should be updated?) This still requires TLS on port 993, so there's no additional hole opened. Ironically, we published plans some time back to disable local-access plaintext imap logins in October and have been warning users to change their settings but 90% of them hadn't yet done so.

2 1

[Dovecot] Virtual mailbox help
by Joy 13 Sep '10

13 Sep '10

Dear All, I am trying to configure Virtual mailbox but having issue my squirrelmail is showing following error:- ERROR: Connection dropped by IMAP server. Query: LSUB "" "*" I have also check Thunderbird but having same issue. Please check my configuration and let me know any issue detected in it, Here is my configuration:- # 2.0.0: /usr/local/dovecot/etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686 i686 Debian 5.0.5 mail_location = maildir:~/Maildir mail_plugins = quota acl virtual namespace { inbox = yes location = prefix = separator = . type = private } namespace { list = children location = maildir:/var/mail/public prefix = Public. separator = . subscriptions = no type = public } namespace { location = virtual:~/Maildir/.virtual:LAYOUT=maildir++ prefix = virtual. separator = . } plugin { acl = vfile:/usr/local/dovecot/dovecot-acl/acl } After doing all configuration i created the following dir under .virtual dir. /home/domain/user/Maildir/.virtual/.Unseen /home/domain/user/Maildir/.virtual/.Unseen/ here created dovecot-virtual file with following text .. INBOX Unseen Restarted and set proper permission on all created directories then tried to login to client and getting the follwoing error in log file .. Sep 09 13:02:47 imap-login: Info: Login: user=<piyush>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3505, secured Sep 09 13:02:48 imap(piyush): Panic: file strfuncs.c: line 72 (p_strndup): assertion failed: (max_chars != (size_t)-1) Sep 09 13:02:48 imap(piyush): Error: Raw backtrace: /usr/local/dovecot/lib/dovecot/libdovecot.so.0 [0x9fefd9e1] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0 [0x9fefda5f] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(i_error+0) [0x9fefdd18] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0 [0x9ff1a2df] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(t_strndup+0x30) [0x9ff1a310] -> /usr/local/dovecot/lib/dovecot/lib01_acl_plugin.so [0x9fd32747] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_list_iter_next+0x12) [0x9ff559f2] -> dovecot/imap [0x8051deb] -> dovecot/imap(cmd_list_full+0x424) [0x8052d34] -> dovecot/imap(cmd_lsub+0x19) [0x8053129] -> dovecot/imap [0x805671c] -> dovecot/imap [0x80567b9] -> dovecot/imap(client_handle_input+0x2d) [0x805692d] -> dovecot/imap(client_input+0x5f) [0x805731f] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xf5) [0x9ff0a275] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(io_loop_run+0x30) [0x9ff09250] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(master_service_run+0x2a) [0x9fef672a] -> dovecot/imap(main+0x2b5) [0x805ff95] -> /lib/i686/cmov/libc.so.6(__libc_start_main+0xe5) [0x9fd66455] -> dovecot/imap [0x804eac1] Sep 09 13:02:48 master: Error: service(imap): child 3505 killed with signal 6 (core dumps disabled) Please let me know the issue ??

2 1

[Dovecot] Dovecot 2.0.2 breakes LMTP delivery for me
by Fabian Ruff 13 Sep '10

13 Sep '10

Hi, I'm onboard Debian Lenny (amd64) and just reverted from 2.0.2-0~auto+4 back to 2.0.1-0~auto+1 because LMTP stopped working completly with the above Package. In my setup delivery is done from exim via LMTP to dovecot (Maildir/ext3). The lmtp dovecot config looks like this: > service lmtp { > user = vmail > inet_listener lmtp { > address = 127.0.0.1 > port = 24 > } > > unix_listener lmtp { > } > } > protocol lmtp { > hostname = [...].de > mail_plugins = sieve quota listescape > postmaster_address = postmaster@[...].de > } With the new version I get no LMTP log message at all from dovecot and Exim fails with: > LMTP timeout after initial connection When I do "/etc/init.d/dovecot stop" some process remain alive and I ultimately have to SIGKILL the lmtp process to get rid of it. > trench:/tmp# ps auwx |grep dovecot > root 2643 0.0 0.0 8224 768 pts/1 R+ 22:50 0:00 grep dovecot > root 31778 0.0 0.0 12384 684 pts/2 S+ 22:36 0:00 tail -f > /var/log/mail/dovecot.log > dovecot 32368 0.0 0.0 12656 996 ? S 22:40 0:00 dovecot/anvil > root 32369 0.0 0.0 12788 1124 ? S 22:40 0:00 dovecot/log > root 32371 0.0 0.0 20148 4404 ? S 22:40 0:00 > dovecot/config > vmail 32764 99.9 0.0 36400 2612 ? R 22:40 10:08 dovecot/lmtp > trench:/tmp# kill 32368 > trench:/tmp# kill 32369 > trench:/tmp# ps auwx |grep dovecot > root 2689 0.0 0.0 8224 768 pts/1 R+ 22:50 0:00 grep dovecot > root 31778 0.0 0.0 12384 684 pts/2 S+ 22:36 0:00 tail -f > /var/log/mail/dovecot.log > root 32371 0.0 0.0 20148 4404 ? S 22:40 0:00 > dovecot/config > vmail 32764 99.8 0.0 36400 2612 ? R 22:40 10:20 dovecot/lmtp > trench:/tmp# ps auwx |grep dovecot > root 2692 0.0 0.0 8224 764 pts/1 R+ 22:50 0:00 grep dovecot > root 31778 0.0 0.0 12384 684 pts/2 S+ 22:36 0:00 tail -f > /var/log/mail/dovecot.log > root 32371 0.0 0.0 20148 4404 ? S 22:40 0:00 > dovecot/config > vmail 32764 99.9 0.0 36400 2612 ? R 22:40 10:28 dovecot/lmtp > trench:/tmp# kill 32764 > trench:/tmp# ps auwx |grep dovecot > root 2700 0.0 0.0 8224 768 pts/1 R+ 22:50 0:00 grep dovecot > root 31778 0.0 0.0 12384 684 pts/2 S+ 22:36 0:00 tail -f > /var/log/mail/dovecot.log > root 32371 0.0 0.0 20148 4404 ? S 22:40 0:00 > dovecot/config > vmail 32764 99.9 0.0 36400 2612 ? R 22:40 10:41 dovecot/lmtp > trench:/tmp# kill -9 32764 > trench:/tmp# ps auwx |grep dovecot > root 2830 0.0 0.0 8224 768 pts/1 R+ 22:51 0:00 grep dovecot > root 31778 0.0 0.0 12384 684 pts/2 S+ 22:36 0:00 tail -f > /var/log/mail/dovecot.log The older version works without any problems for me. Any ideas whats the Problem? Could there be a regression from the LMTP fixes introduced in 2.0.2? Cheers, Fabian Ruff

2 1

[Dovecot] xxxx-login: Error: open(proxy-notify) failed: No such file or directory
by Luca Palazzo 13 Sep '10

13 Sep '10

Hi All, just noted this error message. What does it mean? System seem to work fine but i get a lot of them. Luca

2 1

[Dovecot] Global ACLs
by Paweł Madej 13 Sep '10

13 Sep '10

Hello, how can I do this every user have .Spam mailbox and i want user spamadmin to have access to it i got global acl file with content user=spamadmin lrp but I cannot list other users .Spam mailboxes Greets and thanks in advance for any help and suggestions -- Paweł Madej

2 2

[Dovecot] Certificate for outlook 2003
by Richard Gliebe 13 Sep '10

13 Sep '10

Hi all, We are running "dovecot-1.0.7-7.el5" on a CentOS release 5.5 (Final) box. I know, its an old version, but it cames up with the CentOS release (yum). Anyway. Is there a way to import the certificate, which was generated with "mkcert_dovecot.sh", permanently to the outlook 2003 clients? Every time, when our office 2003 clients fetches there emails (POP3s) from our dovecot server, they will be asked "......, the CN-Name of this certificate doesn't match with the taken Value. Do you want to continue with this server?. sorry for the poor english translation. Here in german (for some german people): Der Server, mit dem Sie verbunden sind, verwendet ein Sicherheitszertifikat, das nicht verifiziert werden konnte. Der CN-Name des Zertifikates stimmt nicht mit dem übergebenen Wert überein. Möchten Sie diesen Server weiterhin verwenden? many thanks for some hints Richard

4 4

[Dovecot] mdbox, doveadm force-resync crashing
by Brandon Lamb 13 Sep '10

13 Sep '10

doveadm force-resync -u johnh(a)vinemaker.com INBOX doveadm(johnh(a)vinemaker.com): Error: Corrupted index file /mail/mail2/j/vinemaker.com/johnh/./mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: messages_count too large (414 > 385) doveadm(johnh(a)vinemaker.com): Warning: fscking index file /mail/mail2/j/vinemaker.com/johnh/./mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index doveadm(johnh(a)vinemaker.com): Error: Fixed index file /mail/mail2/j/vinemaker.com/johnh/./mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: messages_count 414 -> 385 doveadm(johnh(a)vinemaker.com): Error: Fixed index file /mail/mail2/j/vinemaker.com/johnh/./mdbox/mailboxes/INBOX/dbox-Mails/dovecot.index: seen_messages_count 386 -> 379 doveadm(johnh(a)vinemaker.com): Panic: file mail-index-write.c: line 188 (mail_index_write): assertion failed: (index->log_locked) doveadm(johnh(a)vinemaker.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x39c1a) [0x7f39c4bf5c1a] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x37) [0x7f39c4bf5cf7] -> /usr/local/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f39c4bd3026] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_write+0x793) [0x7f39c56eac73] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_fsck+0xc7e) [0x7f39c56d5cee] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x42577) [0x7f39c56d8577] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x59) [0x7f39c56d8a79] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x3d599) [0x7f39c56d3599] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mail_index_open+0x118) [0x7f39c56d3938] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_open+0xbc) [0x7f39c5705e9c] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(dbox_mailbox_open+0x61) [0x7f39c5720f61] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0x2e161) [0x7f39c56c4161] -> /usr/local/bin/doveadm() [0x409518] -> /usr/local/bin/doveadm() [0x4095cf] -> /usr/local/bin/doveadm() [0x409aee] -> /usr/local/bin/doveadm(doveadm_mail_single_user+0x53) [0x409be3] -> /usr/local/bin/doveadm() [0x409f51] -> /usr/local/bin/doveadm(doveadm_mail_try_run+0x141) [0x40a191] -> /usr/local/bin/doveadm(main+0x381) [0x40e091] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f39c446dc4d] -> /usr/local/bin/doveadm() [0x409319] Aborted

2 1

[Dovecot] v2.0.2 released
by Timo Sirainen 13 Sep '10

13 Sep '10

http://dovecot.org/releases/2.0/dovecot-2.0.2.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.2.tar.gz.sig Many small fixes and logging improvements, but most importantly fixes LMTP with Maildir. * vpopmail support is disabled for now, since it's broken. You can use it via checkpassword support or its sql/ldap database directly. - maildir: Fixed "duplicate uidlist entry" errors that happened at least with LMTP when mail was delivered to multiple recipients - Deleting ACLs didn't cause entries to be removed from acl_shared_dict - mail_max_lock_timeout setting wasn't working with all locks - auth_cache_size setting's old-style value wasn't autoconverted and it usually also caused a crash

3 4

[Dovecot] Upgraded dovecot - now it insists on imap TLS
by Alan Brown 13 Sep '10

13 Sep '10

This is definitely an operator error issue, but I'm under a bit of pressure. I updated our 1.1.20 installation to 2.0.1 over the weekend and discovered this morning that it's insisting on TLS imap on port 143 as well as port 993 What am I missing? Thanks in advance Alan

2 1

[Dovecot] SSHA256 password too short
by Osvaldo Alvarez Pozo 13 Sep '10

13 Sep '10

Hi all I am upgrading a mail system. So I installed aside a new server with debian lenny dovecot 1.2 from backports , postfix 2.5, mysql 5. I recovered the database from the actual production system with a dump. But when i started testing I found this in my logs Sep 13 09:45:07 auth-worker(default): Info: sql(user(a)domain.tld,127.0.0.1): Password mismatch Sep 13 09:45:07 auth-worker(default): Error: ssha256_verify(user(a)domain.tld): SSHA256 password too short Sep 13 09:45:07 auth-worker(default): Warning: Invalid OTP data in passdb Sep 13 09:45:07 auth-worker(default): Warning: Invalid OTP data in passdb But the same users gets connected normally to the production system. I use mysql as driver and my default_schema is md5 Any ideas ?? Thanks in advance

3 2

[Dovecot] Proper use of convert plugin?
by Donny Brooks 13 Sep '10

13 Sep '10

I am trying to convert from mbox to maildir on our mail server here at work. The specs are as follows: Fedora 11 x86-64 dovecot-1.2.11-3.fc11.x86_64 postfix-2.5.6-3.fc11.x86_64 dovecot-managesieve-1.2.11-3.fc11.x86_64 We are currently using mbox format with the users INBOX set to /var/spool/mail/username and other mail is in /home/username/Mail. I would like to migrate to maildir format. I tried using the convert plugin as the wiki suggested: mail_location = maildir:~/Maildir protocol imap { mail_plugins = convert } protocol pop3 { mail_plugins = convert } plugin { convert_mail = mbox:/home/%u/Mail:INBOX=/var/spool/mail/%u } When doing this I get this scrolling in the /var/log/maillog... Sep 11 14:41:38 roark dovecot: IMAP(username): Mailbox conversion: Lock creation timeouted Sep 11 14:41:39 roark dovecot: IMAP(username): Fatal: Mailbox conversion failed, exiting Sep 11 14:56:53 roark dovecot: POP3(otheruser): Mailbox conversion: rename(/home/otheruser/Mail, /home/otheruser/Mail-converted) failed: Directory not empty it does this for some users only. Mine for instance never errored and completed perfectly from what I can tell (other than the new mail issue below). The server load has skyrocketed though, so that is most likely part of it. Also, while testing this, new mail was not delivered to the maildir but rather to the old mbox in /var/spool/mail/username. The new mail never showed up until I switched the config back over to the mbox settings. Am I missing something here? Thanks for any insight -- Donny B.

2 1

[Dovecot] Question about LDA+spamassassin
by Javier de Miguel Rodríguez 13 Sep '10

13 Sep '10

Hello I am using dovecot 1.2.11 (openexchange not still fully supported with dovecot 2.0). In my setup I use ldap to store quota information, and I want to accomplish the following: per-user spamassassin rules (MDA style), but my setup has the following requeriments: mail_uid= entrega mail_gid= entrega LDA & SIEVE: sieve_dir=/buzones/my_domain/%2.26Hn/%2.200Hn/%n/sieve/ mail_location=maildir:/buzones/my_domain/%2.26Hn/%2.200Hn/%n I have been reading in the wiki, but I am not sure how I can have in $mail_location/user1 a .spamassassin directory per-user and lda+sieve work together to make spam rules by user Regards Javier

1 0

[Dovecot] Dovecot 2.0.2 and Pigeonhole-0.2.0
by Matthias Quernheim 12 Sep '10

12 Sep '10

I upgraded today to Dovecot 2.0.2 and Pigeonhole-0.2.0 based on debian lenny. Looked not to bad, but when I activated sieve in the lda section the following error appeared for each delivery Sep 11 18:13:11 lda: Error: dlopen(/usr/local/lib/dovecot/lda/lib90_sieve_plugin.so) failed: /usr/local/lib/dovecot/lda/lib90_sieve_plugin.so: undefined symbol: tried_default_save Sep 11 18:13:11 lda: Fatal: Couldn't load required plugins I found some hints regarding on old versoin of deliver, but it is the current one. Any ideas? Thanks Matthias

2 1

Re: [Dovecot] lda: internal error
by Dirk Heinrichs 11 Sep '10

11 Sep '10

Am 11.09.2010 12:53, schrieb axel Egal: > all files in /etc/dovecot have already 0666 permission. What about the directory? Bye... Dirk

1 0

[Dovecot] lda: internal error
by axel Egal 11 Sep '10

11 Sep '10

Hi, i'm trying to relay local post from Postfix to Dovecot-lda. It's running on opensuse11.3-64bit with postfix V2.7.1 and dovecot V2.01. sending local message like: echo foo | /usr/sbin/sendmail -f root root gets no logdata in dovecot.err, -.info,-.debug. but the postfix-logfile tells: Sep 11 10:56:12 server postfix/cleanup[3027]: 94027A65BC: message-id=<20100911085612.94027A65BC(a)Server.Firma> Sep 11 10:56:12 server postfix/qmgr[1544]: 94027A65BC: from=<root(a)Server.Firma>, size=277, nrcpt=1 (queue active) Sep 11 10:56:12 server postfix/local[3029]: 94027A65BC: to=<root(a)Server.Firma>, orig_to=<root>, relay=local, delay=0.22, delays=0.14/0.01/0/0.06, dsn=4.3.0, status=deferred (temporary failure. Command output: lda: Error: user root: Error reading configuration: net_connect_unix(/etc/dovecot/dovecot.conf) failed: Permission denied lda: Fatal: Internal error occurred. Refer to server log for more information. ) There is no further loginfo in any other logfiles Is the internal-error a result of wrong parameters?

2 1

[Dovecot] Dovecot 2.0.1 Quota dict timeout
by David Jonas 10 Sep '10

10 Sep '10

Since an upgrade to 2.0.1 from 1.2.x we're seeing this on (mostly) large mailboxes (Maildir) Sep 4 11:27:25 dovecot: dict: mysql: Connected to 192.168.dd.dd (accounts) ... Sep 4 11:27:46 kelly-a dovecot: lda(u1(a)example.com):) msgid=<123@xxx>: saved mail to INBOX Sep 4 11:27:47 dovecot: dict: Error: sql dict: commit failed: Not connected to database Sep 4 11:27:47 dovecot: imap(u1(a)example.com): Error: dict quota: Quota update failed, it's now desynced The dict is MySQL on another server, same switch. It does appear that the quota gets out of sync. From the entries I checked an email is often being delivered shortly before the error (as above). But I also see it happen with the lda: Sep 4 08:27:11 dovecot: pop3(u2(a)example.com): Disconnected: Logged out... Sep 4 08:42:48 dovecot: lda(u2(a)example.com): msgid=<123@aaa>: saved mail to INBOX Sep 4 08:43:26 dovecot: lda(u2(a)example.com): msgid=<123@bbb>: saved mail to INBOX Sep 4 08:43:26 dovecot: dict: Error: sql dict: commit failed: Not connected to database Sep 4 08:43:26 dovecot: lda(u2(a)example.com): Error: dict quota: Quota update failed, it's now desynced Sep 4 08:46:14 dovecot: pop3-login: Login: user=<u2(a)example.com>,... This is happening on two different dovecot servers. The only thing they share is the MySQL server, but it has a load of 0.5 at peak. Is there something that can be tuned to keep this from happening? Possibly relevant entries from `doveconf -n`. Any tuning regarding dict can be assumed as default: maildir_very_dirty_syncs = yes mail_plugins = quota plugin { quota = dict:user:%LTd-%LTn:proxy::quota } Thanks! David

2 6

[Dovecot] nfs director
by Edward avanti 10 Sep '10

10 Sep '10

Halo, Please can you explain why this is advantage over a hardware load balancer. I fail to see advantage if anything it add in more point of failure, with several hundred thousand user, we can ill afford to mess around or add to complexity, sometime keeping it simple is simply way to be, when use qmail/vpopmail, we never had one failure or problem, ever, we very proud of this record so our users. if director service assign 60K user to each front end, how it handle if 5K simultaneous user login, but all 5K happen to be assign to that one machine, it do all work whilst other 7 server sit there do nothing negating what the LB is design for? Is it really worth it? Do we really need this, or just let foundry switch handle it as it does now. We also have 24 front end SMTP server, these deliver mail to netapp filer, all 24 plus 8 pop3 server and 2 webmail imap server all mount /vmail, so all access same maildir. it seem work very effective thus far and for many many year when we use qmail and vpopmail. Thaks

16 48

[Dovecot] Sub-Sub-Subfolders not shown after converting from maildir to mdbox
by Patrick Westenberg 10 Sep '10

10 Sep '10

Hi again, I just recognized a problem concerning subfolders after converting from maildir to mdbox. Thunderbird and SeaMonkey don´t show folders that are subfolders of subfolders. Have a look at the filesystem: discovery:/var/mail/domain.tld/patrick/mdbox/mailboxes/Folder1/Folder2# ls -l insgesamt 8 drwx------ 2 vmail vmail 4096 5. Sep 23:42 dbox-Mails drwx------ 3 vmail vmail 4096 5. Sep 23:42 Folder3 Using Thunderbird or Seamonkey, Folder1 and Folder2 are listed and can be subscribed to but Folder3 never gets listed. If I create Folder4 as a new subfolder from Folder2 it works, so the problem only exists with existing folders from converted maildirs. I had to use a namespace for the convert from my old Courier IMAP. Any hints? Regards Patrick # 2.0.1: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-amd64 x86_64 Debian 5.0.5 auth_mechanisms = plain login mail_gid = vmail mail_location = mdbox:~/mdbox mail_plugins = quota mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = maildir:User quota } protocols = imap sieve service imap-login { service_count = 1 } service managesieve-login { inet_listener sieve { port = 4190 } inet_listener sieve_deprecated { port = 2000 } service_count = 1 } ssl = required ssl_cert = </etc/ssl/certs/imap.crt ssl_key = </etc/ssl/certs/imap.key userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_plugins = $mail_plugins imap_quota }

3 7

[Dovecot] Released Pigeonhole v0.2.0 for Dovecot v2.0.2
by Stephan Bosch 10 Sep '10

10 Sep '10

Hello Dovecot users, I have finally finished the first release of Pigeonhole for Dovecot v2.0. The most notable change from previous Dovecot v1.2 Sieve/ManageSieve releases is that all is now integrated in a single package and there is no need to patch Dovecot anymore to gain ManageSieve support. Changelog v0.2.0: * Merged Sieve and ManageSieve packages into a single Pigeonhole package. There is also no need to patch Dovecot anymore to gain ManageSieve support. Version numbering of previous Sieve releases is continued as v0.2.0. The sources originally branched off from Sieve v0.1.5 and ManageSieve v0.11.4, but the NEWS history of much more recent releases for Dovecot v1.2 is included since these changes are all included in this release as well. * The ManageSieve service now binds to TCP port 4190 by default due to the IANA port assignment for the ManageSieve service. When upgrading from v1.2, this should be taken into account. The service can be configured manually to listen on both 2000 and 4190. * The Dovecot configuration now calls the ManageSieve protocol 'sieve' in stead of 'managesieve' because it is registered as such with IANA. The binaries and the services are still called managesieve and managesieve-login. * The binary representation of a compiled Sieve script is updated to include source code locations of all commands and arguments. This is implemented in a similar manner as such debug information is included in some system executables and libraries (DWARF-like). Run-time errors can now always refer to the proper line number in the Sieve source script. * The Sieve plugin is adapted to work properly with the new LMTP service introduced with Dovecot v2.0. The same plugin is used for both LDA and LMTP. * The 'sieve_subaddress_sep' setting for the Sieve subaddress extension is now known as 'recipient_delimiter'. Although the deprecated sieve_subaddress_sep setting is still recognized for backwards compatibility, it is recommended to update the setting to the new name, since the new LMTP service also use the recipient_delimiter setting. * ManageSieve: changed default IMPLEMENTATION capability to from 'Dovecot' to 'Dovecot Pigeonhole'. * Renamed the sieved tool to sieve-dump. The original name was somewhat confusing. * Updated man pages to match style and structure of new Dovecot man pages. * Made testsuite commands more uniform and cleaned up many of the testsuite scripts. Some minor new tests were added in the process. + Simplified string matching API to use abstract string lists as data sources. This will also make implementing the index extension easier in the future. + Significantly improved trace debugging with the sieve-test tool. The full execution of the script can be examined, including the matched values and keys of the respective Sieve test commands. The executed statements are listed with their line number (and code address when requested). The level of detail is configurable from the command line. + The SIEVE and NOTIFY capabilities reported by the ManageSieve protocol can now be configured manually. If left unconfigured, the capabilities are determined from the default Sieve and ManageSieve configuration. User-specific capabilities aren't reported until after authentication. + Significantly improved file error handling. This means that administrators get a more useful and informative log message when file operations fail. The most notable example is that when the LDA Sieve plugin is trying to store a binary for a global script, the resulting failure message also points the administrator towards pre-compiling the script with sievec. + Added runtime argument value checking for several commands (redirect, date, vacation). When variables are used, these checks cannot be performed at compiletime. A proper runtime error now is produced when invalid data is encountered. + UTF8 validity of fileinto command argument is now checked either at compile time or at runtime. Previously, it was not checked until the store action was executed. + Validity of IMAP flags for the imap4flags extension is now checked also at runtime. Previously, it was not checked until the store action was executed. + Simplified and restructured error handling. Also made sure that user-caused errors are no longer written to the Dovecot master/LDA log. - Multiscript: fixed duplicate implicit keep caused by erroneous execution state update. - Prevented assertion failure due to currupt binary string representation. If the string was missing a final \0 character an assertion was produced in stead of a binary corruption error. - Imap4flags: fixed bug in setflag command; when parameter was a stringlist, only the last item was actually set. - Variables extension: fixed :length set modifier to recognize utf8 characters in stead of octets. - Testsuite: prevented innocent warning messages, i.e. those that are part of the test, from showing up by default. - ManageSieve/Sieve storage: fixed error handling of PUTSCRIPT commmand; save commit errors would not make the command fail. - ManageSieve: enforced protocol syntax better with some of the commands; some commands allowed spurious extra arguments. - Fixed Sieve script name checking to properly handle length limit and added 0x00ff as invalid character. - Removed spurious old stdio.h (top) includes; these caused compile issues on specific systems. - Fixed default Sieve capability (as reported by ManageSieve): extra extensions spamtest, spamtestplus and virustest were enabled by default. These should, however, only be enabled when properly configured and there is no default configuration. The release is available as follows: http://www.rename-it.nl/dovecot/2.0/dovecot-2.0-pigeonhole-0.2.0.tar.gz http://www.rename-it.nl/dovecot/2.0/dovecot-2.0-pigeonhole-0.2.0.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.0 wiki for more information. Have fun testing this first release and don't hesitate to notify me when there are any problems. The bugfixes above are also applied to the Dovecot v1.2 Sieve and ManageSieve sources and I'll produce new releases for those in the next few days. Oh.. and if anyone is wondering what those duplicate notifications are on the dovecot-cvs list.. well.. oops. :) Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] master user login dovecot 2.02 trouble
by Robert Schetterer 10 Sep '10

10 Sep '10

Hi , i got trouble with master login thunderbird anounces no INBOX there at master login also telnet looks strange normal user login 1 login ...... 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA ACL RIGHTS=texk] Logged in 2 list "" "*" 2 BAD Error in IMAP command : Unknown command. 3 list "" "*" * LIST (\HasNoChildren) "/" "Trash" * LIST (\HasNoChildren) "/" "Junk" * LIST (\HasNoChildren) "/" "Sent" * LIST (\HasNoChildren) "/" "Drafts" * LIST (\HasNoChildren) "/" "Templates" * LIST (\HasNoChildren) "/" "Archives" * LIST (\HasNoChildren) "/" "INBOX" 3 OK List completed. 4 logout master login * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE STARTTLS AUTH=PLAIN AUTH=LOGIN] imap, pop ready 1 login .....*...... 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT IDLE CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS QUOTA ACL RIGHTS=texk] Logged in 2 list "" "*" * LIST (\Unmarked) "/" "INBOX" 2 OK List completed. 3 logout * BYE Logging out 3 OK Logout completed. something broken ? -- Best Regards MfG Robert Schetterer Germany/Munich/Bavaria

1 1

[Dovecot] Question on Mail Formats
by Giovanni Giorgi 09 Sep '10

09 Sep '10

Hi, I am still tuning my dovecot, but I find myself very confortable with it. I am going to structure my imap folder with a new namespace (somthing you cannot do with GMail :) and I can choose the mailbox format. What is the difference between the two mailbox format "mbox" and "maildir"? I know mbox is older, but there is a good reason to use maildir instead? I can get for instance some performance improvement? Better archiving? Thank you! -- Senior Consultant http://gioorgi.com

2 1

[Dovecot] LMTP logging configuration
by Rainer Frey 09 Sep '10

09 Sep '10

Hi, I'm using Dovecot 2.0.1, and I log to a custom syslog facility (local0) in the main configuration (I want a separate log file, but I want to make use of rsyslogd's capabilities). I overwrite the syslog facility for LDA (mail) to have all delivery related stuff in /var/log/mail.log, and that works fine. I tried to do the same for LMTP with protocol lmtp { syslog_facility = mail } but this has no effect, LMTP logs to local0. Is this supposed to work, or is this not implemented at all? If not, is using a logfile in main config, but syslog in lmtp supported? Thanks Rainer

2 4

[Dovecot] Dovecot and OpenSSO
by Javier de Miguel Rodríguez 09 Sep '10

09 Sep '10

Has anybody tried to use opensso as authentication source for dovecot ? Maybe using PAM+Opensso? Regards Javier

1 0

[Dovecot] Pigeonhole and Dovecot2 with custom config file
by Cassidy Larson 08 Sep '10

08 Sep '10

I start my dovecot with the "-c /path/to/custom/config" option so I can run multiple instances. Been trying out 2.0.1 so I can upgrade my boxes cleanly, but I require managesieve. So after installing the latest sources of the Pigeonhole plugin, I'm getting this when trying to start dovecot: # /usr/local/sbin/dovecot -c /usr/local/etc/dovecot/dovecot_custom.conf managesieve(root): Fatal: Error reading configuration: net_connect_unix(/usr/local/etc/dovecot/dovecot.conf) failed: No such file or directory doveconf: Error: managesieve-login: dump-capability process returned 89 Running Dovecot 2.0.1 on FreeBSD 8.1. Any help would be appreciated. Thanks! Cassidy

3 4

Re: [Dovecot] Sub-Sub-Subfolders not shown after converting from maildir to mdbox
by Patrick Westenberg 08 Sep '10

08 Sep '10

Timo Sirainen schrieb: > Or just from mdbox:~/mdbox to mdbox:~/mdbox:LAYOUT=maildir++ This doesn´t work: Initialization failed: Namespace 'INBOX.': Mailbox list driver maildir++: maildir_name not supported by this driver or without namespace: Initialization failed: Initializing mail storage from mail_location setting failed: Mailbox list driver maildir++: maildir_name not supported by this driver

1 0

[Dovecot] What's %%h ?
by William Blunn 08 Sep '10

08 Sep '10

What's %%h ? http://wiki2.dovecot.org/Variables says that "%%" expands to "%", so according to that, "%%h" expands to "%h". But I have seen people using "%%h", so it must mean something else. Bill

2 2

[Dovecot] Bad HTML at http://wiki2.dovecot.org/
by William Blunn 07 Sep '10

07 Sep '10

Bad HTML at http://wiki2.dovecot.org/ <div style="padding: 0.2em; background-color: #50bead"> This documentation is for<strong>Dovecot v2.0</strong>, see<a href="http://wiki1.dovecot.org/ <view-source:http://wiki1.dovecot.org/>">wiki1</a> for v1.x documentation.</a> </div> After "documentation." there is a closing</a> tag with no corresponding opening tag. A similar issue appears on http://wiki.dovecot.org/ Bill

2 1

[Dovecot] Problems setting up dovecot 2.0.1 with kerberos auth
by Dirk Heinrichs 07 Sep '10

07 Sep '10

Hi, I'm trying to setup dovecot 2.0.1 on a debian squeeze test box. I want to integrate it into an already working kerberos5 setup, but I don't get it to work. I've added created host/ smtp/ and imap/ service principals with random key for the test machine and added them to its keytab. I can also obtain user credentials using kinit, but when I try to telnet to port 143, I only get the following: # kinit heini Password for heini(a)ALTUM.DE: # klist Ticket cache: FILE:/tmp/krb5cc_0 Default principal: heini(a)ALTUM.DE Valid starting Expires Service principal 09/05/10 18:56:30 09/06/10 04:56:30 krbtgt/ALTUM.DE(a)ALTUM.DE renew until 09/06/10 18:56:27 # telnet localhost 143 Trying 127.0.0.1... Connected to localhost (127.0.0.1). Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE AUTH=GSSAPI] Dovecot ready. a authenticate GSSAPI a NO [UNAVAILABLE] Temporary authentication failure. ^] telnet> Connection closed. This is in the logs: Sep 5 18:56:47 oldbox dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Sep 5 18:56:47 oldbox dovecot: auth: Debug: auth client connected (pid=27684) Sep 5 18:56:58 oldbox dovecot: auth: Debug: client in: AUTH#0111#011GSSAPI#011service=imap#011secured#011lip=127.0.0.1#011rip=127.0.0.1#011lport=143#011rport=33753 Sep 5 18:56:58 oldbox dovecot: auth: Debug: gssapi(?,127.0.0.1): Obtaining credentials for imap@rohan Sep 5 18:56:58 oldbox dovecot: auth: gssapi(?,127.0.0.1): While acquiring service credentials: Unspecified GSS failure. Minor code may provide more information Sep 5 18:56:58 oldbox dovecot: auth: gssapi(?,127.0.0.1): While acquiring service credentials: Permission denied Sep 5 18:57:00 oldbox dovecot: auth: Debug: client out: FAIL#0111#011temp Sep 5 18:57:05 oldbox dovecot: imap-login: Disconnected (auth failed, 1 attempts): method=GSSAPI, rip=127.0.0.1, lip=127.0.0.1, mpid=0, secured My configuration: # doveconf -n # 2.0.1 (a05834588ffb): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-5-486 i586 Debian squeeze/sid auth_debug = yes auth_gssapi_hostname = rohan auth_krb5_keytab = /etc/krb5.keytab auth_mechanisms = gssapi auth_verbose = yes disable_plaintext_auth = no listen = * mail_location = maildir:~/mail managesieve_notify_capability = mailto managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap ssl = no ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = uid=vmail gid=vmail home=/var/vmail/%u driver = static } And here's the content of the kerberos keytab: # ktutil ktutil: rkt /etc/krb5.keytab ktutil: l slot KVNO Principal ---- ---- --------------------------------------------------------------------- 1 3 host/oldbox.altum.de(a)ALTUM.DE 2 3 host/oldbox.altum.de(a)ALTUM.DE 3 3 host/oldbox.altum.de(a)ALTUM.DE 4 3 host/oldbox.altum.de(a)ALTUM.DE 5 3 imap/oldbox.altum.de(a)ALTUM.DE 6 3 imap/oldbox.altum.de(a)ALTUM.DE 7 3 imap/oldbox.altum.de(a)ALTUM.DE 8 3 imap/oldbox.altum.de(a)ALTUM.DE 9 3 smtp/oldbox.altum.de(a)ALTUM.DE 10 3 smtp/oldbox.altum.de(a)ALTUM.DE 11 3 smtp/oldbox.altum.de(a)ALTUM.DE 12 3 smtp/oldbox.altum.de(a)ALTUM.DE I also don't see any connection attempt in the KDC's log file. Any idea what could be wrong? Thanks... Dirk

2 6

[Dovecot] dovecot-uidlist: Duplicate file entry at line
by Luca Palazzo 07 Sep '10

07 Sep '10

Hi All, we are experiencing another strange problem after upgrading to 2.0.1 from 1.2. Many people's client aree-retrieving mail from server due to some problem with dovecot-uidlist file. Looking at log file seem that all file content is sometime duplicated and appended to the and of same file. It look as another process was accesing and trying to modify uidlist table. Our setup has a load balance (dovecot director) and three backend server. All of them use 2.0.1. MTA is a cluster of postfix that deliver mail to load balancer by LMTP. How can I collect some more information? or, better, solve it? Regards Luca PS: Backend configuration is: # 2.0.1: /etc/dovecot/dovecot.conf # OS: Linux 2.6.26-2-686-bigmem i686 Debian 5.0.5 auth_master_user_separator = * auth_verbose = yes disable_plaintext_auth = no mail_location = maildir:~/Maildir mail_plugins = $mail_plugins notify mail_log quota managesieve_notify_capability = mailto managesieve_sieve_capability = comparator-i;octet comparator-i;ascii-casemap fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date spamtest spamtestplus virustest passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid from size quota = maildir:User quota quota_warning = storage=95%% quota-warning.sh 95 %u quota_warning2 = storage=80%% quota-warning.sh 80 %u sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve } protocols = imap pop3 lmtp sieve service auth { unix_listener auth-userdb { group = dovecot mode = 0600 user = dovecot } } service director { inet_listener { port = 8100 } } service lmtp { inet_listener lmtp { address = 10.194.1.31 127.0.0.1 ::1 port = 24 } } service managesieve-login { inet_listener sieve { address = 10.194.1.31 127.0.0.1 ::1 port = 4190 } process_min_avail = 0 service_count = 1 } service quota-warning { executable = script /virtual/shared/quota-warning.sh unix_listener quota-warning { user = vmail } user = dovecot } ssl_cert = </etc/ssl/certs/dovecot.pem ssl_key = </etc/ssl/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = $mail_plugins quota sieve } protocol lda { mail_plugins = $mail_plugins quota } protocol imap { mail_plugins = $mail_plugins quota imap_quota } protocol pop3 { mail_plugins = $mail_plugins quota }

4 19

[Dovecot] Dovecot director - silly questions
by Guy 07 Sep '10

07 Sep '10

Hi, I'm currently using Dovecot 1.1.18 with storage over NFS and there's been the occasional corrupt index. I'm going to be installing a new set of servers soon and would like to start using Dovecot 2.0. I've had a look at the bit there is on the new Dovecot director, but I'm not totally sure how it's intended to be used. Should I install Dovecot on the software load balancers (IMAP/POP3 and other services balanced by haproxy) and configure the director on there? I'm also using maildrop at the moment but would like to switch to Dovecot deliver at some stage. Since mail is delivered to a random mail server (they both have access to the NFS shares), won't I run into the same index problem? Should I look at per user transports before then or can director also be used to effect Dovecot deliver? Thanks Guy -- Don't just do something...sit there!

2 1

[Dovecot] cant see public mailbox
by spamvoll＠googlemail.com 07 Sep '10

07 Sep '10

hi.. im running dovecot 2.0.1 sharing mailboxes works like a charm, but now im trying to create a public undetected-SPAM folder. thunderbird shows the public namespace but no mailboxes. ive created the public folder and did a mkdir for the folder.. after that doesnt work ive created cur,new,tmp in .undetected-SPAM /home/MAILBOXES/public# ls -al drwx------ 3 vmail vmail 74 7. Sep 14:23 . drwxr-xr-x 57 vmail vmail 4096 7. Sep 14:23 .. -rw------- 1 vmail vmail 0 7. Sep 14:23 dovecot-acl-list -rwx------ 1 vmail vmail 0 7. Sep 13:19 dovecot-shared drwx------ 5 vmail vmail 36 7. Sep 14:17 .undetected-SPAM doveconf -n mail_location = maildir:~/mail namespace { inbox = yes location = prefix = separator = / type = private } namespace { list = children location = maildir:%%h/mail:INDEX=~/mail/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace { list = children location = maildir:/home/MAILBOXES/public:INDEX=~/mail/public prefix = public/ separator = / subscriptions = no type = public } any ideas ? Hans

1 1

[Dovecot] v1.2.14 released
by Timo Sirainen 07 Sep '10

07 Sep '10

http://dovecot.org/releases/1.2/dovecot-1.2.14.tar.gz http://dovecot.org/releases/1.2/dovecot-1.2.14.tar.gz.sig + virtual mailboxes: Added support for IDLE notifications. - master: Don't crash on config reload when using dict processes. - IMAP: QRESYNC parameters for SELECT weren't handled correctly.

2 1

[Dovecot] Plugin execution order and Sieve
by Charly 07 Sep '10

07 Sep '10

Hello, I use dovecot 2.0.1 and pigeonhole Sieve (version of August), I try to create a deliver plugin (lda or lmtp), but if I declare, in addition to my plugin, sieve, sieve is called first, and my plugin is never called. I tried to change the order of declaration of plugins, but nothing changes. If I remove Sieve, my plugin is properly called. protocol lmtp { #mail_plugins = $mail_plugins myplugin sieve ## sieve called first, my plugin is never called #mail_plugins = $mail_plugins sieve myplugin ## sieve called first, my plugin is never called mail_plugins = $mail_plugins myplugin ## my plugin is called } I try to patch Pigeonhole Sieve to call other plugin at the end of execution with : --- dovecot-2-0-pigeonhole-d51650c8af85/src/plugins/lda-sieve/lda-sieve-plugin.c.next_deliver 2010-08-23 19:26:12.000000000 +0200 +++ dovecot-2-0-pigeonhole-d51650c8af85/src/plugins/lda-sieve/lda-sieve-plugin.c 2010-09-02 11:48:22.000000000 +0200 @@ -775,7 +775,8 @@ } T_END; - return ret; + //return ret; + return next_deliver_mail(mdctx,storage_r); } /* With this patch, my plugin is called, but, always AFTER Sieve... How can I call my plugin before Sieve and do I need to patch Pigeonhole Sieve ? Thank you, Charly.

2 2

[Dovecot] LAYOUT=maildir++ under mbox?
by William Blunn 06 Sep '10

06 Sep '10

Whilst documenting LAYOUT=maildir++ under dbox, that got me thinking: Can we specify :LAYOUT=maildir++ with mbox? If I have it right, this should then remove the problem of not being able to have messages and mail subfolders in the same mail folder. So for example if we had mail location specified as: mail_location = mbox:~/mail:LAYOUT=maildir++ we would have files: ~/mail/inbox - file storing messages in INBOX ~/mail/.foo - file storing messages in mail folder "foo" ~/mail/.foo.bar - file storing messages in mail folder "foo/bar" and I think all of Dovecot's indexes would go under ~/mail/.imap Bill

3 8

[Dovecot] extended search
by Daniel-Constantin Mierla 06 Sep '10

06 Sep '10

Hello, is it safe to use arg_new_human_date() from src/lib-storage/mail-search-register-human.c instead of arg_new_date() inside src/lib-storage/mail-search-register-imap.c? The benefit is ability to use interval based search rules, e.g., SINCE 2days. I run it for couple of days and looks fine, used for virtual folders. This kind of search I missed for usage on laptop - I have pretty huge inboxes, thunderbird was over 20% CPU all the time. I switched on using dovecot locally and thunderbird connected to it, my common searches (before: thunderbird's "save as folder" searches) are virtual folders. Everything works great, cpu usage is less than 1% (I have to say that I also moved many filtering rules (for sorting incoming messages to folders) from TB to be done by imapfilter, but the reason was mainly sorting flexibility and rescanning folders). If all is safe, would it be considered for addition in the future version? The patch is trivial, I can leave with patching every release, but I believe is a nice thing to have. Afaik, should not break IMAP SEARCH specs, being an extended version. An alternative would be to add 'X-' commands (e.g., X-SINCE 2days). Thanks, Daniel -- Daniel-Constantin Mierla http://www.asipto.com

2 4

[Dovecot] Problems with zlib
by Andre 06 Sep '10

06 Sep '10

Sometimes I see lines like these in my log: 20100906 11:34:32 imap(username(a)domain.com): Panic: file istream-zlib.c: line 173 (i_stream_zlib_read): assertion failed: (zstream->high_pos == 0) 20100906 11:34:32 imap(username(a)domain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x7f328d2244a2] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f328d22450a] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f328d2248b3] -> /usr/lib/dovecot/modules/lib20_zlib_plugin.so [0x7f328be444fc] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x6b) [0x7f328d22a10b] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x4d) [0x7f328d22a3fd] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f328d21476e] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f328d214cbe] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x29) [0x7f328d2148c9] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_body+0x23) [0x7f328d214a43] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x7f328d4cb72f] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x7f328d4cb84a] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_special+0x3dc) [0x7f328d4cc99c] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x7f328d4dd86d] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID] [0x41256a] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID](imap_fetch_more+0x16c) [0x412b0c] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID](cmd_fetch+0x3fa) [0x40acea] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID] [0x41031c] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID] [0x4103cd] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID](client_handle_input+0x45) [0x410545] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID](client_input+0x62) [0x410f72] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xcb) [0x7f328d22f3ab] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x18) [0x7f328d22e4c8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f328d21dd63] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID](main+0x281) [0x419201] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f328caa81a6] -> dovecot/imap [username(a)domain.com 192.168.4.253 UID] [0x408bd9] Here is the backtrace: [New process 11474] #0 0x00007f328cabbed5 in raise () from /lib/libc.so.6 (gdb) bt #0 0x00007f328cabbed5 in raise () from /lib/libc.so.6 #1 0x00007f328cabd3f3 in abort () from /lib/libc.so.6 #2 0x00007f328d2244b5 in ?? () from /usr/lib/dovecot/libdovecot.so.0 #3 0x00007f328d22450a in ?? () from /usr/lib/dovecot/libdovecot.so.0 #4 0x00007f328d2248b3 in i_panic () from /usr/lib/dovecot/libdovecot.so.0 #5 0x00007f328be444fc in ?? () from /usr/lib/dovecot/modules/lib20_zlib_plugin.so #6 0x00007f328d22a10b in i_stream_read () from /usr/lib/dovecot/libdovecot.so.0 #7 0x00007f328d22a3fd in i_stream_read_data () from /usr/lib/dovecot/libdovecot.so.0 #8 0x00007f328d21476e in ?? () from /usr/lib/dovecot/libdovecot.so.0 #9 0x00007f328d214cbe in ?? () from /usr/lib/dovecot/libdovecot.so.0 #10 0x00007f328d2148c9 in message_parser_parse_next_block () from /usr/lib/dovecot/libdovecot.so.0 #11 0x00007f328d214a43 in message_parser_parse_body () from /usr/lib/dovecot/libdovecot.so.0 #12 0x00007f328d4cb72f in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #13 0x00007f328d4cb84a in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #14 0x00007f328d4cc99c in index_mail_get_special () from /usr/lib/dovecot/libdovecot-storage.so.0 #15 0x00007f328d4dd86d in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #16 0x000000000041256a in ?? () #17 0x0000000000412b0c in imap_fetch_more () #18 0x000000000040acea in cmd_fetch () #19 0x000000000041031c in ?? () #20 0x00000000004103cd in ?? () #21 0x0000000000410545 in client_handle_input () #22 0x0000000000410f72 in client_input () #23 0x00007f328d22f3ab in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 #24 0x00007f328d22e4c8 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 #25 0x00007f328d21dd63 in master_service_run () from /usr/lib/dovecot/libdovecot.so.0 #26 0x0000000000419201 in main () here is the relevant plugin section: plugin { zlib_save = gz zlib_save_level = 6 } What can I do to investigate deeper? TIA Andre

2 1

Re: [Dovecot] dovecot Digest, Vol 89, Issue 27
by Alan Brown 06 Sep '10

06 Sep '10

> > Timo Sirainen <tss(a)iki.fi> Wrote: > > > > > On Mon, 2010-09-06 at 14:26 +0100, Alan Brown wrote: > > > > Is there any way of enforcing a Maildir per-folder message limit in > > > > Dovecot? > > > > > No. > > > > Would you consider it as a feature request? > What if you just create a script that automatically archives older mails to <box>/archive/yyyy-mm mailboxes when number of messages in a mailbox increases too high for too long? Or something like that. I'm looking at doing that anyway, however it would be much easier to train the users if the server says "folder full"

1 0

Re: [Dovecot] dovecot Digest, Vol 89, Issue 25
by Alan Brown 06 Sep '10

06 Sep '10

Timo Sirainen <tss(a)iki.fi> Wrote: > On Mon, 2010-09-06 at 14:26 +0100, Alan Brown wrote: > > Is there any way of enforcing a Maildir per-folder message limit in > > Dovecot? > No. Would you consider it as a feature request? > > We're finding major performance hits once a threshold of files/directory > > is exceeded. This applies across all common filesystems with the > > threshold differing depending on the FS. GFS2 pretty much _STOPS_ for 10 > > minutes when users put 65k+ messages in one folder... > mdbox would probably work nicely. :) Yes, it probably would, however I have several layers of resistance to get past in order to implement that (ie, up to 2 years to get approval to switch to dbox) > > I'm currently running 1.1.20 but looking to update (RHEL5 cluster > > installation) > With v1.2+ you could also try maildir_very_dirty_syncs=yes That won't help much for initial directory opens, which is where most of the pain is. Past that point, the index of ~/Maildir/.folder/cur is mostly cached until you hit about 16,000 messages(files) on GFS2 and some people are insisting on 32k+ files in one folder with the odd few trying 65k or more (I'm surprised their clients don't break). For info sake: we have Dovecot running on a pair of dedicated dual E5530 (quad-core X86 1300MHZ FSB cpu) servers (RH cluster+GFS2) with 24Gb RAM apiece and ~2TB of 8Gb/s san-attached storage available. There are only ~250 accounts but there's around 600Gb in the maildir folder areas and another 300Gb in a separate dedicated inbox area - and I believe there's another 1TB of stuff in client local folders we're trying to pull back to the servers in order to simplify backups. Even with this kind of horsepower available, over-large folders can render the setup completely unresponsive for minutes at a time. I know this is a case of "work smarter, not harder", but I'm facing major delays until we're able to change the on-disk storage format. Alan

2 1

Re: [Dovecot] dovecot Digest, Vol 89, Issue 26
by Alan Brown 06 Sep '10

06 Sep '10

Timo Sirainen <tss(a)iki.fi> Wrote: >On Mon, 2010-09-06 at 12:37 +0100, William Blunn wrote: > > Whilst documenting LAYOUT=maildir++ under dbox, that got me thinking: > > > > Can we specify :LAYOUT=maildir++ with mbox? > Yes, ever since LAYOUT was added. > > If I have it right, this should then remove the problem of not being > > able to have messages and mail subfolders in the same mail folder. > Yes. Also it might be possible to use DIRNAME with LAYOUT=fs to solve > that problem, but I'm less sure about that. I anyway doubt most mbox > users want to switch to a whole new layout. Mbox users might not, but Maildir or dbox users might want to, especially if users have a lot of folders (One of mine has ~2500) Directories definitely get slower to list with more files/subdirectories in them and there are knee points beyond which they get substantially slower (Where the knee is depends on the type of FS but it's usually a power of 2)

1 0

[Dovecot] mdbox: Cannot create subfolder called "dbox-Mails" (2.0beta5)
by William Blunn 06 Sep '10

06 Sep '10

I am trying out "mdbox" under Dovecot 2.0beta5. Looking in the "mailboxes" directory under the mdbox storage root ("~/dbox" in my case), I can see that the mail folders are mapped into filesystem directories. But Dovecot seems to put all the message list information ("dovecot.index.cache", "dovecot.index.log") for any given mail folder into a directory called "dbox-Mails"... But this directory name exists in the same namespace as that used for mail subfolders... So this means we cannot create a mail subfolder whose name is "dbox-Mails"! I concede that this eventuality may be unlikely, but when designing in a green field, surely we should avoid such obvious pitfalls? Surely we would want to make it so that these objects exist in different namespaces, so that mail folders can be created with any name? So perhaps the directory "dbox-Mails" should use a character in its name which could not be used in mail folder names. Or mail folder names could have a non-identity mapping into directory names such that the directory name can never be "dbox-Mails". Regards, Bill

4 14

[Dovecot] Specify auth service for protocols
by Lukas Garberg 06 Sep '10

06 Sep '10

Hi all, I'm building a mail system where two machines are functioning both as POP3/IMAP-proxy (using dovecot 1.2.12) and SMTP-server with authentication for outgoing mail. The SMTP-server is postfix with dovecot SASL as authentication backend. User credentials for SMTP auth as well as the mapping from account to final server for the proxy is stored in a MySQL-database which dovecot queries. As I want the POP3/IMAP-proxy to accept any username and password (as the final POP3/IMAP server takes care of the authentication) the passdb SQL query has the statements "NULL AS password, 'Y' AS nopassword, 'Y' AS proxy" added to the query. As these additions cannot be used in the SQL query for the auth service used by postfix (as users would be able to authenticate with any password) I have defined a second auth service (auth postfix { ... }) in dovecot.conf which is slightly different; it returns the password hash instead of NULL as password and skips the proxy and nopasswd part. This works fine on one server, but on the other one the auth services get mixed up and the service defined for postfix (missing password and proxy stuff) is used by the POP3 and IMAP services and vice versa, which breaks the proxying. I've been trying my best to find any difference between the configuration of the two machines, but without result. The configurations are simply copies of each other. So, to finally arrive at my question: Is there any way to specify which authentication service is to be used by each protocol in dovecot.conf? Or is the solution instead to rewrite the passdb-query to take the service into account and return 'Y' AS proxy when the service is postfix and 'N' AS proxy when the service is POP3 or IMAP as I then would be able to use only one authentication backend? Sorry for the lengthy post and thank you in advance! Regards, Lukas Garberg

2 2

[Dovecot] notification plugin
by Wolfgang Rosenauer 06 Sep '10

06 Sep '10

Hi, I'm pretty new to dovecot's codebase and trying to write a plugin which performs certain plugins if new mail arrives in a user's mailbox. I saw the mail-log plugin and was playing around with it but it seems to not create events if new mails arrive but only if mail are copied or saved from an IMAP connection. Are there any hooks I can base my plugin on to get events in the above case? Any pointers? Thanks, Wolfgang

2 3

[Dovecot] Quotas - per folder message limits?
by Alan Brown 06 Sep '10

06 Sep '10

Is there any way of enforcing a Maildir per-folder message limit in Dovecot? We're finding major performance hits once a threshold of files/directory is exceeded. This applies across all common filesystems with the threshold differing depending on the FS. GFS2 pretty much _STOPS_ for 10 minutes when users put 65k+ messages in one folder... I'm currently running 1.1.20 but looking to update (RHEL5 cluster installation)

2 1

[Dovecot] Documentation for "altpath" / "altmove" / ?"Alternate storage"
by William Blunn 06 Sep '10

06 Sep '10

I was thinking about documentation for alternate storage. We have a few mentions at: http://wiki2.dovecot.org/MailboxFormat/dbox http://wiki2.dovecot.org/Tools/Doveadm http://wiki2.dovecot.org/Tools/Doveadm/Altmove But I was thinking it would be helpful if there could be a page about alternate storage. I could write the page, but I currently have so many unknowns that I think it would be better to gather some more information before writing the first draft. Note that I don't necessarily fully understand all the surrounding concepts, so I could have written something below which is based on a (vague) belief. Please correct me if I am wrong, or even if it's sort-of right but doesn't quite hit the point squarely. We might want to have a name for the wiki page. Perhaps "AlternateStorage"? Of course if it only applies to dbox, then another idea is to make it a section on the page "MailboxFormat/dbox". All suggestions gratefully received. I would be interested in an overview of what alternate storage is. It seems to be a way of transparently moving message data to alternare storage, with the idea that the alternate storage may be on a different filesystem which may be cheaper and/or slower than the main storage, which may be an economic way to store messages where the fastest access to them is less important. It is transparent in as much as IMAP/POP users will not normally be able to tell if any given message has been moved to alternate storage. A single mail folder can end up containing a mixture of messages stored in main storage and alternate storage. (Another question begged here of what consistent term should be used to refer to the main storage. Could be "main storage", "normal storage", "ordinary storage".) Also I would be interested to know the development/stability status of alternate storage: experimental / alpha / beta / stable. Also I would be interested to know the applicability against mailbox formats: mbox / maildir / sdbox / mdbox / cydir. Also I would be interested to know which data gets moved to the alternate storage, and which data stays in the main storage: message-data / control-data / index-data / combined-control-and-index-data. Also I would be interested to know how data can be moved to alternate storage. Seems to be that is only done by invocation of "doveadm altmove". There is a page for that already so we can link to that. Also it would be interesting to have some idea of how it works. For example there might be an "alternate storage" flag in the indexes, or Dovecot tries the main location first and if not found there then it tries the alternate storage. Just a brief overview, and any pertinent ramifications of that. Bill

2 4

Re: [Dovecot] \" character in folder name results in strange LIST
by Samuel Kvasnica 06 Sep '10

06 Sep '10

Hi Timo, >> * LIST (\HasNoChildren) "/" "folder1" >> * LIST (\HasNoChildren) "/" "folder2" >> * LIST (\HasNoChildren) "/" {9} >> six"wafer >> . OK List completed. >> >> Note the {9} length of the following real folder name. Is this normal >> handling of special folder names ? >Yes. Well, I did try other servers and e.g. on scalix I'm getting this: * LIST (\X-DirectRef=000d7f94a4731510 \X-ModDate=20100814200222) "/" "six\"wafer" I cannot find anything relevant in RFC3501 >> Mail clients do not seem to like this response. >What clients? They're buggy then.. Well, of course, way too many clients are :( at least Thunderbird will go totally crazy when getting this kind response. (My old python scripts expecting string, not a tuple go crazy as well... :-< )

5 26

[Dovecot] Alternate mail_location prefix for homedir
by Henry C. 05 Sep '10

05 Sep '10

Hi, I'm switching from UW-imap to dovecot 2.0.1 and was wondering about the mail_location config: mail_location = mbox:~/.:INBOX=/var/mail/%u Notice '.' in '~/.' above. This seems to resolve the ~/mail problem when switching from UW-imap (ie, no 'mail' prefix). doc/wiki/Migration.UW.txt doesn't mention using '~/.', so I was wondering whether there are any gotchas anyone can think of. Thanks Henry

3 2

[Dovecot] psr2md
by Benoit LORAND 05 Sep '10

05 Sep '10

hello, I just write script who converts outlook pst files to the maildir format. I want to share it to community. I have tried it with outlook 2003 and outlook 2007. http://www.blorand.org/index.php/Pst2md i hope it will help someone. -- Benoît LORAND http://www.blorand.org benoit.lorand(a)blorand.org

1 0

Re: [Dovecot] Problems with dovecot 2.0, sieve and mdbox
by Patrick Westenberg 04 Sep '10

04 Sep '10

Why so complicated?   ---- Originalnachricht ---- Von: fakessh <fakessh(a)fakessh.eu> Gesendet: 4 Sep 2010 17:31 +02:00 An: Patrick Westenberg <pw(a)wk-serv.de> CC: <dovecot(a)dovecot.org> Betreff: Re: [Dovecot] Problems with dovecot 2.0, sieve and mdbox On Sat, 04 Sep 2010 15:27:26 +0200, Patrick Westenberg <pw(a)wk-serv.de> wrote: > Hi guys, > > I tried to use a global sieve skript to sort spam mails into > a subfolder of INBOX. I´m using mdbox. > > The log shows that the script is called and executed but it is > not able to find or create the mailbox: > > Sep 4 15:18:55 mercury dovecot: lmtp(6237, mail(a)steulerfliesen.de) > Debug: Namespace : Permission lookup failed from > /var/mail/steulerfliesen.de/mail/mdbox/mailboxes/Spamverdacht > Sep 4 15:18:55 mercury dovecot: lmtp(6237, mail(a)steulerfliesen.de) > Debug: Namespace : Using permissions from > /var/mail/steulerfliesen.de/mail/mdbox: mode=0700 gid=-1 > > Sep 4 15:22:37 mercury dovecot: lmtp(6261, mail(a)steulerfliesen.de) > Debug: Namespace : Permission lookup failed from > /var/mail/steulerfliesen.de/mail/mdbox/mailboxes/INBOX.Spamverdacht > Sep 4 15:22:37 mercury dovecot: lmtp(6261, mail(a)steulerfliesen.de) > Debug: Namespace : Using permissions from > /var/mail/steulerfliesen.de/mail/mdbox: mode=0700 gid=-1 > > My skript looks like this: > > require "fileinto"; > if header :contains "X-Spam-Flag" "YES" { > fileinto "Spamverdacht"; > } > > I also tried: > > require "fileinto"; > if header :contains "X-Spam-Flag" "YES" { > fileinto "INBOX.Spamverdacht"; > } > > How can I fix this? > > Regards > Patrick the script should be require ["fileinto","regex","comparator-i;ascii-numeric","reject","relational"]; # rule:[spammanage-before] if header :value "ge" :comparator "i;ascii-numeric" ["X-Spam-score"] ["500"] { discard; stop; } if header :value "ge" :comparator "i;ascii-numeric" ["X-Spam-score"] ["100"] { fileinto "Junk.spam"; stop; } if header :value "ge" :comparator "i;ascii-numeric" ["X-Spam-score"] ["10"] { fileinto "Junk"; } elsif anyof ( header :contains "Received" [ "[4.63. "[218.160.", "[218.242.]" ] ) { fileinto "Junk"; } elsif anyof ( header :contains ["SPAM", "X-Spam-hits"] ["ADDRESSES_ON_CD", "X_OSIRU_DUL", "X_OSIRU_SPAMWARE_SITE", "X_OSIRU_SPAM_SRC" ] ) { fileinto "Junk"; }

1 0

[Dovecot] fts, solr, and client support
by Kelsey Cummings 04 Sep '10

04 Sep '10

I've been playing around with the fts plugins and currently have solr up and running. While the initial indexing time is pretty rough, the search performance is impressive. I've run into a problem though- so far as I can tell, thunderbird (and most other popular clients?) won't actually take advantage of it. Even using thunderbird's advanced search and checking the 'run serach on server' box doesn't push the search to the server. If most popular clients don't support it, there doesn't seem much point in setting it up; which is a shame, solr beats the snot out of the built in search for thunderbird. That said, is anyone running any of the fts plugins in a large scale environment? If so, what kind of scaling issues do you see? How do the search servers compare hardware wise to users count/spool size? -- Kelsey Cummings - kgc(a)corp.sonic.net sonic.net, inc. System Architect 2260 Apollo Way 707.522.1000 Santa Rosa, CA 95407

1 0

[Dovecot] a question about QRESYNC extension
by Joe Wong 04 Sep '10

04 Sep '10

Hi Timo, How long is the MODSEQ NUMBER kept for each UID ever exists in the mailbox? - Joe

2 3