August 2008 - dovecot

[Dovecot] v1.1.2 released
by Timo Sirainen 04 Aug '08

04 Aug '08

http://dovecot.org/releases/1.1/dovecot-1.1.2.tar.gz http://dovecot.org/releases/1.1/dovecot-1.1.2.tar.gz.sig Development of new features in this release and the upcoming multi-master replication are sponsored by Directi (www.directi.com) Lucene indexing is currently deprecated in favor of the new Solr indexing. I'm even considering removing the Lucene C++ library support, so if you're interested in keeping it send me a mail. Note that the current fts-lucene is somewhat broken as well as non-optimal. Anyone interested in using zlib plugin with Maildir should read http://wiki.dovecot.org/Plugins/Zlib. I'm hoping to get the first v1.2 betas out in a couple of weeks and an eventual v1.2.0 release in a couple of months. + Added full text search indexing support for Apache Lucene Solr server: http://wiki.dovecot.org/Plugins/FTS/Solr + IMAP SORT: Added X-SCORE sort key for use with Solr searches. + zlib plugin supports now bzip2 also. + quota: All backends now take noenforcing parameter. + Maildir: Add ,S=<size> to maildir filename whenever quota plugin is loaded, even when not using Maildir++ quota. + deliver: Allow lda section to override plugin settings. + deliver: Giving a -m <namespace prefix> parameter now silently saves the mail to INBOX. This is useful for e.g. -m INBOX/${extension} + Added a new maildirlock utility for write-locking Dovecot Maildir. + dict-sql: Support non-MySQL databases by assuming they implement the "INSERT .. ON DUPLICATE KEY" using an INSERT trigger. - SORT: Fixed several crashes/errors with sort indexing. - IMAP: BODYSTRUCTURE is finally RFC 3501 compliant. Earlier versions didn't include Content-Location support. - IMAP: Fixed bugs with listing INBOX. - Maildir: maildirfolder file wasn't created when dovecot-shared file existed on the root directory - deliver didn't expand %variables in namespace location settings. - zlib: Copying non-compressed messages resulted in empty mails (except when hardlink-copying between maildirs). - mbox-snarf plugin was somewhat broken - deliver + Maildir: If uidlist couldn't be locked while saving, we might have assert-crashed - mbox: Fixed an assert-crash with \Recent flag handling

5 8

[Dovecot] Help with auto vacation replies
by CJ Keist 04 Aug '08

04 Aug '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, I'm testing out dovecot with postfix. I'm running postfix 2.5.2 with dovecot version 1.1.1 with dovecot sieve plugin version 1.1.5. I have everything compiled and working except for the sieve plugin. I'm now trying to test out the sieve plugin and having no luck in getting a simple auto vacation reply to work. Here is my .dovecot.sieve script: require ["fileinto", "vacation"]; # BEGIN VACATION vacation :days 30 :subject "Out of Office Reply" :addresses ["cj.keist(a)colostate.edu"] "OUT OF THE OFFICE"; I know the dovecot delivery program is reading my script as the .dovecot.sievec file is being created and there is no .dovecot.sieve.err file. Permissions of the files are in my ownership. The files are located in my home directory as well. The log files simply show delivery of the message and nothing else: Aug 4 09:06:28 mail2.engr.colostate.edu postfix/local[7480]: [ID 197553 mail.info] 622BB59EFA: to=<cjay(a)engr2.colostate.edu>, relay=local, delay=0.89, delays=0 .18/0.08/0/0.64, dsn=2.0.0, status=sent (delivered to command: /userM/mail-services/dovecot/libexec/dovecot/deliver) Aug 4 09:06:28 mail2.engr.colostate.edu postfix/qmgr[4666]: [ID 197553 mail.info] 622BB59EFA: removed Any help as to why it is not sending any replies? Dovecot -n follows: # 1.1.1: /userM/mail-services/dovecot/etc/dovecot.conf Warning: fd limit 256 is lower than what Dovecot can use under full load (more than 1500). Either grow the limit or change login_max_processes_count and max_mail_processes settings base_dir: /var/run/dovecot/ protocols: imap imaps pop3 pop3s ssl_cert_file: /userM/mail-services/dovecot/etc/ssl/dovecot.pem ssl_key_file: /userM/mail-services/dovecot/etc/ssl/privkey.pem ssl_parameters_regenerate: 0 ssl_cipher_list: MEDIUM:!LOW disable_plaintext_auth: no login_dir: /var/run/dovecot//login login_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap-login login_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3-login login_greeting: Cyrus ready. login_max_processes_count: 500 max_mail_processes: 500 mail_location: mbox:~/:INBOX=/userM/mail/%u mmap_disable: yes mail_nfs_index: yes mail_executable(default): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(imap): /userM/mail-services/dovecot/libexec/dovecot/imap mail_executable(pop3): /userM/mail-services/dovecot/libexec/dovecot/pop3 mail_plugin_dir(default): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(imap): /userM/mail-services/dovecot/lib/dovecot/imap mail_plugin_dir(pop3): /userM/mail-services/dovecot/lib/dovecot/pop3 auth default: mechanisms: plain login verbose: yes debug: yes passdb: driver: pam passdb: driver: passwd args: blocking=yes userdb: driver: passwd args: blocking=yes socket: type: listen client: path: /userM/mail-services/postfix/var/private/auth mode: 432 user: postfix group: postfix - -- C. J. Keist Email: cj.keist(a)colostate.edu UNIX/Network Manager Phone: 970-491-0630 Engineering Network Services Fax: 970-491-5569 College of Engineering, CSU Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness' -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIlyB8A29OFr7C6jcRAt5lAKCiP5Zh1WIMrg+QWPprcxi9Gp5Z3QCgxhbj A6ivJ6XeA8MuoA19y2xEFjI= =uT1j -----END PGP SIGNATURE-----

2 2

[Dovecot] bugzilla or other similar bug tracking systems
by Diego Liziero 04 Aug '08

04 Aug '08

I was wondering if it could be useful to use such tools to keep track of users bugs. I find somehow harder to search the mailing list if a bug is known, if it's being worked on, if it needs more feedback, in witch release it has been eventually solved, and so on. Any thoughts? Regards, Diego.

3 3

Re: [Dovecot] how to store flags \Seen into read-only mailbox?
by seriv＠parkheights.dyndns.org 04 Aug '08

04 Aug '08

This problem is apparently about changeset http://hg.dovecot.org/dovecot-1.1/rev/eec74a6ad62e. This change makes dovecot behaviour different from what is described in wiki, about sharing and making private /Seen flags, see http://wiki.dovecot.org/SharedMailboxes?highlight=(flags are shared or private) When I've tried to revert it, first time with my client it worked perfectly. But then clients were not able to open any mail folders, and imap processes were dying. -- Sergey Ivanov. ----- seriv(a)parkheights.dyndns.org wrote: > Hi, > I'm trying to use dovecot for storing mailing lists and read-only > access for users. > The OS is Solaris, authentication for all readers of these lists are > from Ldap through PAM, and one local user "listuser" will receive all > mail and store them into it's folders (Maildirs). These maildirs are > readable (read-only) for all others and they are shared by setting > --- > mail_location: > maildir:/home/vmail/listuser/Maildir:CONTROL=/home/vmail/%u/Maildir/control:INDEX=/home/vmail/%u/Maildir/index > --- > Mail became readable because in each mail folder to be shared there is > dovecot-shared with mode 064, and all users included into his group. > > But this is the problem: how to have flag \Seen stored in read-only > mailbox? As recorded by rawlog, it is ignored now: > --- > bash-3.00# cat 20080724-103219-10616.in > 3 namespace > 4 lsub "" "*" > 5 list "" "INBOX" > 6 list "" "Trash" > 7 create "Trash" > 8 select "OmniTI.FreeLotto.Ops" > 9 UID fetch 1:* (FLAGS) > 10 uid store 1:3 +Flags (\Seen) > 11 IDLE > DONE > 12 close > 13 logout > bash-3.00# cat 20080724-103219-10616.out > * OK [RAWLOG TIMESTAMP] 2008-07-24 10:32:19 > * NAMESPACE (("" ".")) NIL NIL > 3 OK Namespace completed. > * LSUB () "." "OmniTI.FreeLotto.ODS" > * LSUB () "." "OmniTI.FreeLotto.Ops" > 4 OK Lsub completed. > * LIST (\HasNoChildren) "." "INBOX" > 5 OK List completed. > 6 OK List completed. > 7 NO Internal error occurred. Refer to server log for more > information. [2008-07-24 10:32:19] > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft) > * OK [PERMANENTFLAGS ()] Read-only mailbox. > * 3 EXISTS > * 0 RECENT > * OK [UNSEEN 1] First unseen. > * OK [UIDVALIDITY 1216906857] UIDs valid > * OK [UIDNEXT 4] Predicted next UID > 8 OK [READ-ONLY] Select completed. > * 1 FETCH (UID 1 FLAGS ()) > * 2 FETCH (UID 2 FLAGS ()) > * 3 FETCH (UID 3 FLAGS ()) > 9 OK Fetch completed. > 10 OK Store ignored with read-only mailbox. > + idling > 11 OK Idle completed. > 12 OK Close completed. > * BYE Logging out > 13 OK Logout completed. > --- > > -- > Sergey ivanov.

2 1

[Dovecot] plus addressing bug in dovecot 1.1.x?
by Jon Fullmer 04 Aug '08

04 Aug '08

I had recently upgraded from Dovecot 1.0.14 to 1.1.0, and then to 1.1.1. Ever since the upgrade to 1.1.0, I noticed that "plus addressing" has failed. In case I'm using a foreign phrase, this is the concept of sending an e-mail to "user+spam(a)domain.com", and having dovecot (dovecot LDA, specifically), deliver this to the "spam" submailbox to "user(a)domain.com". I've been using this successfully since 1.0.3. When I upgraded to 1.1.0, I noticed that e-mails were no longer being delivered to the submailboxes as they had been (though they would arrive in the central INBOX). I checked the "dovecot-deliver.log", and I noticed that, ever since I had brought up 1.1.0, I would see: save failed to spam: Unknown namespace ("spam" is the submailbox) After the upgrade to 1.1.1, I still would see these messages (and behavior). I have since installed 1.0.15. The plus addressing now works again, as it had been. With all of these "upgrades" and "downgrades", the config file has remained exactly the same. There have been no other changes to any components on the host system (i.e., new OS-es, new postfix, etc.). Thoughts? Is this a known issue? - Jon

4 7

[Dovecot] nfs_flush errors
by Hans Wunsch 04 Aug '08

04 Aug '08

I'm looking for some help with an nfs error that is filling our logs. I get a constant stream of these messages: Jul 8 10:47:08 servername dovecot: [ID 107833 mail.error] IMAP(username): nfs_flush_file_handle_cache_dir: rmdir(/var/mail) failed: Device busy I have two dovecot IMAP servers. All mailboxes are NFS mounted. The INBOX is /var/mail and the rest are in /home/<user>/mail. It looks like work was done on this back in January: http://www.dovecot.org/list/dovecot-cvs/2008-January/010638.html And again in February: http://hg.dovecot.org/dovecot-1.1/rev/258477a3f1e7 Was a there another fix that I missed or is anybody else is still seeing the same issue? Thanks, Hans

3 4

[Dovecot] Problem: delivery with mode 600 into shared folder
by seriv＠parkheights.dyndns.org 04 Aug '08

04 Aug '08

Hi, I have a problem, delivery called from /etc/aliases file by pipe delivers with mode 0600. I need system users with shared mail folders (Maildir format). When I changed alias to pipe to shell wrapper with mode 002 set in it, nothing changed. MTA is sendmail, OS Solaris, and dovecot version 1.1.1. Can somebody help? Here are dovecot settings: --- /opt/dovecot11/sbin/dovecot -n # 1.1.1: /opt/dovecot11/etc/dovecot.conf base_dir: /var/run/dovecot/ log_path: /var/log/dovecot.log login_dir: /var/run/dovecot//login login_executable: /opt/dovecot11/libexec/amd64/dovecot/imap-login max_mail_processes: 128 mail_location: maildir:/home/vmail/listuser/Maildir:CONTROL=/home/vmail/%u/Maildir/control:INDEX=/home/vmail/%u/Maildir/index mail_debug: yes auth default: verbose: yes debug: yes debug_passwords: yes passdb: driver: pam args: imap userdb: driver: passwd socket: type: listen master: path: /var/run/dovecot/auth-master mode: 432 user: daemon group: other plugin: sieve: /opt/dovecot11/sieve-scripts/folders.sieve --- And this is the alias to pipe: --- grep deliver /etc/aliases listuser(a)domain.com: "|/opt/dovecot11/libexec/dovecot/deliver -d listuser" -- Sergey Ivanov.

3 4

[Dovecot] Recieving e-mail is not updating quota
by M. Rodrigo Monteiro 04 Aug '08

04 Aug '08

Hello again. When I send e-mail locally from userX@mydomain to userY@mydomain the quota in userY@mydomain isn't updated with the new message, but the message arrives fine. It's not a userX problem, because it's equal if it's userY sending userX. When I save an message, the quota is updated. Or when the userX sends the e-mail, his quota is updated too. The problem is that the quota don't update when a new message arrives. What could it be? Now I empty the mailbox of the userY, and the maildirsize is like this: 16777216S 0 0 1151862 1 2837616 1 2838683 1 5674797 2 -5674797 -2 -5674797 -2 1151862 1 -1151862 -1 -1151862 -1 The user quota from ldap is 16MB. In the user dir, the size is 452K # du -kh . --max-depth=0 452K . Now, I send an e-mail about 900k from userX to userY, and the quota display still 0M, but the user dir is 1,6M # du -kh . --max-depth=0 1,6M . My confs/logs # /usr/local/dovecot/sbin/dovecot -n # 1.1.1: /usr/local/dovecot/etc/dovecot.conf log_path: /var/log/dovecot.log info_log_path: /var/log/dovecot-info.log ssl_disable: yes disable_plaintext_auth: no login_dir: /usr/local/dovecot/var/run/dovecot/login login_executable: /usr/local/dovecot/libexec/dovecot/imap-login valid_chroot_dirs: /home/vmail/domains verbose_proctitle: yes first_valid_uid: 200 last_valid_uid: 200 first_valid_gid: 200 last_valid_gid: 200 mail_privileged_group: vmail mail_uid: 200 mail_gid: 200 mail_location: maildir:/home/vmail/domains/%d/%n mail_debug: yes mail_plugins: quota imap_quota auth default: user: dovecot-auth passdb: driver: ldap args: /usr/local/dovecot/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/dovecot/etc/dovecot-ldap.conf plugin: quota_rule: *:storage=1G quota_rule2: Trash:storage=10%% quota_rule3: Lixeira:storage=10%% quota_rule4: Spam:storage=10%% quota: maildir # grep -v '^ *$#.*$\?$' /usr/local/dovecot/etc/dovecot-ldap.conf hosts = localhost dn = cn=dovecot,dc=xxxxxx,dc=ce,dc=gov,dc=br dnpass = xxxxx ldap_version = 3 base = o=mail, dc=xxxxxx, dc=ce, dc=gov, dc=br deref = never scope = subtree user_attrs = homeDirectory=home,quota=quota_rule=*:storage=%$M user_filter = (&(objectClass=JammMailAccount)(mail=%u)(accountActive=TRUE)(delete=FALSE)) pass_attrs = userPassword=password pass_filter = (&(objectClass=JammMailAccount)(mail=%u)(accountActive=TRUE)(delete=FALSE)) # tail /var/log/mail.log dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Loading modules from directory: /usr/local/dovecot/lib/dovecot/imap dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib10_quota_plugin.so dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Module loaded: /usr/local/dovecot/lib/dovecot/imap/lib11_imap_quota_plugin.so dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Effective uid=200, gid=200, home=/home/vmail/domains dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota root: name= backend=maildir args= dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=* bytes=16777216 (0%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Trash bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Lixeira bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): Quota rule: root= mailbox=Spam bytes=1677721 (10%) messages=0 (0%) dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): maildir: data=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo dovecot: Jul 25 14:05:00 Info: IMAP(userY(a)xxxxxx.ce.gov.br): maildir++: root=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo, index=, control=, inbox=/home/vmail/domains/xxxxxx.ce.gov.br/rodrigo Regards, Rodrigo. -- M. Rodrigo Monteiro falecom(a)rodrigomonteiro.net "Free as in Freedom, not free as in free beer" Linux User # 403730

2 2

[Dovecot] dovecot 1.1.2 assertion
by Nuno Lopes 04 Aug '08

04 Aug '08

Hi, I've upgraded to last version of dovecot and am now getting the following assertions: Jul 25 00:00:34 bld3 dovecot: Panic: IMAP(example1(a)example.com): file index-sort-string.c: line 542 (index_sort_add_ids_range): assertion failed: (left_idx == 0 && right_idx == rightmost_idx) Jul 25 00:00:34 bld3 dovecot: IMAP(example1(a)example.com): Raw backtrace: imap [0x5555555d30f0] -> imap [0x5555555d3157] -> imap [0x5555555d27d8] -> imap(index_sort_list_finish_string+0xe8e) [0x5555555a01de] -> imap(index_storage_search_next_nonblock+0x432) [0x55555559caa2] -> imap(mailbox_search_next+0x21) [0x5555555a4051] -> imap(imap_sort+0xdc) [0x555555577d3c] -> imap(cmd_sort+0x33d) [0x555555570e1d] -> imap(cmd_uid+0x54) [0x555555571894] -> imap [0x5555555722ac] -> imap [0x555555572362] -> imap [0x555555572b7f] -> imap(client_input+0x62) [0x555555572da2] -> imap(io_loop_handler_run+0xf8) [0x5555555da0c8] -> imap(io_loop_run+0x1d) [0x5555555d918d] -> imap(main+0x462) [0x55555557a552] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2ae31494c154] -> imap [0x55555556c859] in another instance: Jul 25 00:08:48 bld4 dovecot: Panic: IMAP(example2(a)example.com): file index-sort-string.c: line 607 (index_sort_add_ids_range): assertion failed: (skip > 0) Jul 25 00:08:48 bld4 dovecot: IMAP(example2(a)example.com): Raw backtrace: imap [0x5555555d30f0] -> imap [0x5555555d3157] -> imap [0x5555555d27d8] -> imap(index_sort_list_finish_string+0xedc) [0x5555555a022c] -> imap(index_storage_search_next_nonblock+0x432) [0x55555559caa2] -> imap(mailbox_search_next+0x21) [0x5555555a4051] -> imap(imap_sort+0xdc) [0x555555577d3c] -> imap(cmd_sort+0x33d) [0x555555570e1d] -> imap(cmd_uid+0x54) [0x555555571894] -> imap [0x5555555722ac] -> imap [0x555555572362] -> imap [0x555555572b7f] -> imap(client_input+0x62) [0x555555572da2] -> imap(io_loop_handler_run+0xf8) [0x5555555da0c8] -> imap(io_loop_run+0x1d) [0x5555555d918d] -> imap(main+0x462) [0x55555557a552] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b64897fc154] -> imap [0x55555556c859] If this is not enough for you to solve it ... Some problems were solved upgrading from 1.1.1 but these ones remained. Thanks, -- Nuno

2 3

[Dovecot] namespaces at v1.0.15
by Evaggelos Balaskas 04 Aug '08

04 Aug '08

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, i need to create a public maildir folder for virtual users so i did this: dovecot-1.0.15: namespace public { prefix = public/ separator = / location = maildir:/var/mail/shared:INDEX=/var/mail/shared/%u/index/:CONTROL=/var/mail/shared/%u/control/ } namespace private { separator = / prefix = inbox = yes } umask = 007 and everything works fine, but ... when one user reads an email from the public folder then the status (flag read) changes to all users. How i can fix this? How every virtual user (same uid.gid) can have its own index (perhaps?) Evaggelos Balaskas - Unix System Engineer Informatics Engineer Technological Education http://ebalaskas.gr/wk/ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIku4ZWIK+Pe9twhoRAokDAJ9u2/SjCqgabHvJFlTXlDART6+sngCghNA/ Ufl8U5GQ0mS3tVUU8idtNwY= =BUGu -----END PGP SIGNATURE-----

3 3