May 2011 - dovecot - dovecot.org

[Dovecot] fts crash
by Daniel L. Miller 22 May '11

22 May '11

I've completed my mailbox rebuild - theoretically I should be free of corruption. I used dsync to export from mdbox to maildir (so should be clean) then used a virtual machine with Dovecot to import back to mdbox in another location. So...theoretically I should be free of all corruption now... Running an fts update - "doveadm search text -u user(a)domain.com xyzzyx" works on some users - other mailboxes crash with: doveadm(dmiller(a)amfes.com): Panic: file squat-trie.c: line 876 (squat_build_word): assertion failed: (i + bytelen <= size) doveadm(dmiller(a)amfes.com): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x3ccca) [0x7ffee92b6cca] -> /usr/local/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x32) [0x7ffee92b6db2] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x16dda) [0x7ffee9290dda] -> /usr/local/lib/dovecot/lib21_fts_squat_plugin.so(+0x5bbd) [0x7ffee6607bbd] -> /usr/local/lib/dovecot/lib21_fts_squat_plugin.so(squat_trie_build_more+0x153) [0x7ffee6607d13] -> /usr/local/lib/dovecot/lib20_fts_plugin.so(+0x59bc) [0x7ffee68159bc] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x20) [0x7ffee99ac180] -> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x26) [0x7ffee99ac1d6] -> doveadm() [0x40ce47] -> doveadm() [0x409304] -> doveadm(doveadm_mail_single_user+0x8c) [0x40961c] -> doveadm() [0x409817] -> doveadm(doveadm_mail_try_run+0x141) [0x409c31] -> doveadm(main+0x3b1) [0x40dfd1] -> /lib/libc.so.6(__libc_start_main+0xfe) [0x7ffee8b09d8e] -> doveadm() [0x408c09] Aborted -- Daniel

1 0

[Dovecot] Behavior difference in mbox versus Maildir listing
by Bruno Prémont 21 May '11

21 May '11

Hi, My MUA (claws-mail) is having a hard time listing directories for a mail account with two namespaces, one of which using mbox and the other one using maildir to store mails. Let's call the namespaces "#mbox." and "#maildir." and have "." as separator. Assume I have the following folder hierarchy: $namespace $namespace folder $namespace folder folder1a $namespace folder folder1b $namespace folder folder1c The resulting IMAPv4 session is: mb1 LIST "" "#mbox.%" * LIST (\Noselect \HasChildren) "." "#mbox.folder" mb1 OK List completed. mb2 LIST "" "#mbox.folder.%" * LIST (\Noselect \HasChildren) "." "#mbox.folder." * LIST (\NoInferiors \UnMarked) "." "#mbox.folder.folder1a" * LIST (\NoInferiors \UnMarked) "." "#mbox.folder.folder1b" * LIST (\NoInferiors \UnMarked) "." "#mbox.folder.folder1c" mb2 OK List completed. md1 LIST "" "#maildir.%" * LIST (\HasChildren) "." "#maildir.folder" md1 OK List completed. md2 LIST "" "#maildir.folder.%" * LIST (\HasNoChildren) "." "#maildir.folder.folder1a" * LIST (\HasNoChildren) "." "#maildir.folder.folder1b" * LIST (\HasNoChildren) "." "#maildir.folder.folder1c" md2 OK List completed. Notice the extra presence of listed folder itself with trailing "." in mb2 that has no equivalent in md2! Is this expected listing behavior? If so, why the differing behavior between both storage engines? Affected dovecot versions: at least 1.1.16 and 2.0.11 (installed from Gentoo packages) System is x86 on XFS Thanks, Bruno

2 4

[Dovecot] IMAP COMPRESS not announced while using imap_zlib plugin
by Henrik Larsson 21 May '11

21 May '11

I'm trying to enable the IMAP COMPRESS plugin listed here: http://wiki2.dovecot.org/Plugins/Compress I have added zlib globally and imap_zlib to the imap protocol. This is the output from doveconf -n with regards to mail_plugins: --cut-- mail_plugins = zlib protocol imap { mail_plugins = zlib imap_zlib } --cut But it seem like the feature is not announced when connecting to the IMAP server: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS LOGINDISABLED AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. I would expect something like COMPRESS=DEFLATE. I haven't enabled any compression for the Maildir files, zlib_save_level and zlib_save is not set. Does IMAP COMPRESS only work if the mailbox is compressed? Best regards Henrik Larsson

2 3

Re: [Dovecot] How to stop mail_executable from cwd to ~home
by Joseph Tam 21 May '11

21 May '11

Gary Duncan <gduncan(a)engr.UVic.CA> writes: > In our environment home directories are auto-mounted via /home/<user> > including on the server provided mail. > Within the various mail services though we try to isolate > and override with local /mail/home/<user> > > Works well except that dovecot still wants to cd to the real home > triggering a useless and potentially hindering automount This becomes really apparent if you have an organization wide-mailing list, and one delivery to it causes a flurry of automounts. I similarly replace per-user mounts with a home mount bundle. > when it invokes the imap or pop3 process specified by mail_executable, > ie an lsof of the process shows cwd of /home/<user> and the automounted home. I see the same behaviour in 2.0.13, which process tracing of imap shows more clearly (/nfs/user is per user mount, /nfs/home/user is user home bundle) ... 4087: getuid() = 12345 [12345] 4087: chdir("/nfs/test") = 0 4087: stat64("/nfs/home/test/mail", 0xFFBFF6C0) = 0 4087: stat64("/nfs/home/test/mail", 0xFFBFF5A0) = 0 4087: stat64("/nfs/home/test/mail", 0xFFBFF6C0) = 0 ... This happens fairly early after imap-login forks and execs the imap process. I'll see if I can find it after building a debug version, but I think Timo will beat me to this. Joseph Tam <jtam.home(a)gmail.com>

2 2

[Dovecot] dovecot & OCFS2 Cluster
by Osvaldo Alvarez Pozo 20 May '11

20 May '11

hi all We have an ocfs2 cluster compose of 4 Debian lenny serveurs wich have access to an ISCSI LUN we have create a partition on this Lun and formated this partition as OCFS2. 2 serveurs does mail delivery (SMTP) and the two other are pop/imap servers. The smtp servers use dovecot LDA to deliver to mailboxes. La version de dovecot is 1.2.13, ldirectord balance conexion to the servers(pop/pops/imap/imaps to the two imap/pop serveurs) (smtp to the two smtp servers). this is a part of my dovecot.conf mail_location = maildir:/var/vmail/%d/%u/Maildir mail_access_groups = mail first_valid_uid = 5000 last_valid_uid = 5000 mail_max_userip_connections = 100 maildir_copy_with_hardlinks = yes disable_plaintext_auth = no dotlock_use_excl=yes mmap_disable = yes protocols = imap imaps pop3 pop3s managesieve protocol imap { mail_plugins = quota imap_quota imap_client_workarounds = outlook-idle delay-newmail } protocol pop3 { mail_plugins = quota pop3_client_workarounds = outlook-no-nuls oe-ns-eoh pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = quota sieve log_path = /var/log/dovecot-deliver.log info_log_path = /var/log/dovecot-deliver.log } protocol managesieve { managesieve_implementation_string = dovecot } auth default { mechanisms = plain login passdb sql { args = /etc/dovecot/sql.conf } userdb prefetch { } userdb sql { args = /etc/dovecot/sql.conf } user = nobody socket listen { master { path = /var/run/dovecot/auth-master mode = 0660 user = vmail group = mail } client { path = /var/spool/postfix/private/auth mode = 0660 user = postfix group = mail } We are having severals problems from "cpu stuck for 61 seconds" to "too many connexion". I wonder if there is a configuation type of dovecot when using ocfs2. In tje dovecot site they give advices about how to configure dovecot when using NFS, but not about OCFS2. Somme people say that lda shuld not be used. Any help please? Thanks nebano

7 17

[Dovecot] Migrate to new server without raw copy
by Daniel L. Miller 20 May '11

20 May '11

I've setup a new virtual machine to run my mail servers. Dovecot is installed and talking with the LDAP server for the user list. Now the question is how to migrate the data from the old Dovecot to the new. The data is stored in mdbox, with some possible corruption. Accordingly, any form of simple file copy is not the answer - I need the messages to be processed by something and then stored fresh on the new server. I do have NFS access both ways if that does anything. I tried imapsync - but it quickly broke on some of the messages. Is dsync the answer? Or do I use a MUA and drag-n-drop the messages a batch at a time between the servers? -- Daniel

3 2

[Dovecot] xi.rename-it.nl down?
by Jim Knuth 19 May '11

19 May '11

Hello, http://xi.rename-it.nl/debian/dists/stable-auto/dovecot-2.0 not available? -- Mit freundlichen Grüßen, with kind regards, Jim Knuth --------- Mit dem Geist ist es wie mit dem Magen: Mann kann ihm nur Dinge zumuten, die er verdauen kann. [Churchill]

2 2

[Dovecot] Released Pigeonhole Sieve v0.1.19 and ManageSieve v0.11.13 for Dovecot v1.2.17
by Stephan Bosch 19 May '11

19 May '11

Hello Dovecot users, As promised, I hereby release new versions of Sieve and ManageSieve for Dovecot v1.2. These releases consist entirely of (backported) bugfixes and introduce no new features. There is a good chance that these are the last releases for Dovecot v1.2. Changelog Sieve v0.1.19: - Enotify extension: fixed inappropriate return type in mailto URI parse function, also fixing ARM compiler warning. - Vacation extension: fixed handling of sendmail errors. It produced an additional confusing success message in case of error. - Removed header MIME-decoding to fix erroneous address parsing. Applies to address test and vacation command. Changelog ManageSieve v0.11.13: - ManageSieve: fixed bug in UTF-8 checking of string values. The releases are available as follows: Sieve http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.19.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-sieve-0.1.19.tar.gz.sig ManageSieve http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.13.tar.gz http://www.rename-it.nl/dovecot/1.2/dovecot-1.2-managesieve-0.11.13.tar.gz.… ManageSieve patch http://www.rename-it.nl/dovecot/1.2/dovecot-1.2.17-managesieve-0.11.13.diff… http://www.rename-it.nl/dovecot/1.2/dovecot-1.2.17-managesieve-0.11.13.diff… Refer to http://pigeonhole.dovecot.org and the Dovecot wiki for more information. Don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

[Dovecot] How to stop mail_executable from cwd to ~home
by Gary Duncan 19 May '11

19 May '11

In our environment home directories are auto-mounted via /home/<user> including on the server provided mail. Within the various mail services though we try to isolate and override with local /mail/home/<user> Works well except that dovecot still wants to cd to the real home triggering a useless and potentially hindering automount when it invokes the imap or pop3 process specified by mail_executable, ie an lsof of the process shows cwd of /home/<user> and the automounted home. It does this even though home is properly overridden within. I suspect this is part of changing to invoke as the user as the *-login process are ok but then they are still running as dovecot. Various recent attempts to explicitly respecify HOME for mail_executable via a wrapper script or using env have been to no avail (as seen below). How can I resolve? And no I don't just want to override /home at the system level. Thanks -- Gary # 1.0.9: /etc/dovecot.conf base_dir: /var/run/dovecot/ syslog_facility: local1 protocols: imap imaps pop3 pop3s listen(default): *:143 listen(imap): *:143 listen(pop3): *:110 ssl_listen(default): *:993 ssl_listen(imap): *:993 ssl_listen(pop3): *:995 ssl_ca_file: /etc/ssl/certs/gd_bundle.crt ssl_cert_file: /etc/ssl/certs/engr.uvic.ca.crt ssl_key_file: /etc/ssl/private/engineeringwildcard.key ssl_parameters_regenerate: 24 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_log_format_elements: %u [%r] %c login_process_size: 32 login_processes_count: 8 login_max_processes_count: 150 verbose_proctitle: yes first_valid_uid: 100 default_mail_env: mbox:/mail/home/%u/mail/:INBOX=/mail/boxes/%u:INDEX=/mail/indexes/%u mail_location: mbox:/mail/home/%u/mail/:INBOX=/mail/boxes/%u:INDEX=/mail/indexes/%u mbox_read_locks: fcntl dotlock mbox_write_locks: fcntl dotlock mail_executable(default): /bin/env 'HOME=/mail/home/$USER' /usr/libexec/dovecot/imap mail_executable(imap): /bin/env 'HOME=/mail/home/$USER' /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3-home mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %v.%u pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): oe-ns-eoh outlook-no-nuls auth default: passdb: driver: pam userdb: driver: passwd args: home=/mail/home/%u plugin: home: /mail/home/%u

2 1

[Dovecot] v2.0.13 released
by Timo Sirainen 19 May '11

19 May '11

http://dovecot.org/releases/2.0/dovecot-2.0.13.tar.gz http://dovecot.org/releases/2.0/dovecot-2.0.13.tar.gz.sig I've almost managed to read my email backlog, but there are still some unanswered mails. Feel free to resend if you think I should have answered some of your mails. The most important changes since v2.0.12: + Added "doveadm index" command to add unindexed messages into index/cache. If full text search is enabled, it also adds unindexed messages to the fts database. + added "doveadm director dump" command. + pop3: Added support for showing messages in "POP3 order", which can be different from IMAP message order. This can be useful for migrations from other servers. Implemented it for Maildir as 'O' field in dovecot-uidlist. - doveconf: Fixed a wrong "subsection has ssl=yes" warning. - mdbox purge: Fixed wrong warning about corrupted extrefs. - sdbox: INBOX GUID changed when INBOX was autocreated, leading to trouble with dsync. - script-login binary wasn't actually dropping privileges to the user/group/chroot specified by its service settings. - Fixed potential crashes and other problems when parsing header names that contained NUL characters.

5 12