- dovecot - dovecot.org

[Dovecot] xexec and dovecot 1.1
by subscriber＠viliar.net.ru 22 Mar '08

22 Mar '08

subscriber(a)viliar.net.ru schreef: > I'll test very interesting plugin xexec. It seems very nice and can be used in many things. It's compiled perfect with dovecot 1.0, but certanly > not with dovecot 1.1. It's stopped with next error: > I did not write that module, but tonight I got a bit bored, so I gave it a quick try to port it to Dovecot 1.1. The attached patch provides a compile fix to make it compile without warnings for dovecot-1.1. I only tested whether the module is successfully loaded by Dovecot and not whether XEXEC still does what it is supposed to. It does not segfault on the xexec command, but that is all I tested. I got a backend command error and now it is bed time for me, but there is a good chance that this works if you bother to read the wiki page properly ;) So, consider this to be more like an 'It compiles! Ship it!' kind of fix. But, anyways, it should help you to get where you want. Just apply inside the xexec directory using the usual patch -p1. Let me know what you find out. Regards, Stephan. Thank you, Stephan, for your help. Patch applies without any problem and compilation was successful. According maillog, Dovecot load it without problems too: Mar 19 09:06:37 mx3 dovecot: IMAP(alx(a)skymail.alx.in): Module loaded: /usr/lib/dovecot/imap/lib10_xexec_plugin.so I have activate it in config as for dovecot 1.0. But "sub commands" does not started: [root@mx3 rpms]# telnet 127.0.0.1 143 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. * OK Dovecot ready. 001 login alx@xxx xxxxxxx 001 OK Logged in. 002 noop 003 OK NOOP completed. 003 noop 003 OK NOOP completed. 004 xexec user 004 NO command failed same command exucuted ok with dovecot 1.0. from config: plugin { xexec2 = user:/usr/local/bin/user %u } According strace -vfF -p there is segfault :-( read(0, "004 xexec user\r\n", 4044) = 16 pipe([6, 7]) = 0 pipe([8, 9]) = 0 pipe([10, 11]) = 0 clone(Process 4093 attached child_stack=0, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0xb7f17708) = 4093 [pid 4061] close(6) = 0 [pid 4061] close(9) = 0 [pid 4061] close(11) = 0 [pid 4061] _llseek(7, 0, 0xbfb8ca40, SEEK_CUR) = -1 ESPIPE (Illegal seek) [pid 4061] getsockname(7, 0xbfb8ca34, [28]) = -1 ENOTSOCK (Socket operation on non-socket) [pid 4061] fstat64(8, {st_dev=makedev(0, 5), st_ino=5022779, st_mode=S_IFIFO|0600, st_nlink=1, st_uid=2004, st_gid=12, st_blksize=4096, st_blocks=0, st_size=0, st_atime=2008/03/19-09:08:00, st_mtime=2008/03/19-09:08:00, st_ctime=2008/03/19-09:08:00}) = 0 [pid 4061] fstat64(10, {st_dev=makedev(0, 5), st_ino=5022780, st_mode=S_IFIFO|0600, st_nlink=1, st_uid=2004, st_gid=12, st_blksize=4096, st_blocks=0, st_size=0, st_atime=2008/03/19-09:08:00, st_mtime=2008/03/19-09:08:00, st_ctime=2008/03/19-09:08:00}) = 0 [pid 4061] gettimeofday({1205932080, 941409}, {4294967116, 0}) = 0 [pid 4061] select(11, [8 10], [], [8 10], {2147483, 0} <unfinished ...> [pid 4093] close(0) = 0 [pid 4093] close(1) = 0 [pid 4093] close(2) = 0 [pid 4093] close(7) = 0 [pid 4093] close(8) = 0 [pid 4093] close(10) = 0 [pid 4093] dup2(6, 0) = 0 [pid 4093] close(6) = 0 [pid 4093] dup2(9, 1) = 1 [pid 4093] close(9) = 0 [pid 4093] dup2(11, 2) = 2 [pid 4093] close(11) = 0 [pid 4093] --- SIGSEGV (Segmentation fault) @ 0 (0) --- Process 4093 detached <... select resumed> ) = 2 (in [8 10], left {2147482, 996000}) --- SIGCHLD (Child exited) @ 0 (0) --- gettimeofday({1205932080, 943134}, {4294967116, 0}) = 0 read(10, "", 1024) = 0 read(8, "", 1024) = 0 close(7) = 0 close(8) = 0 close(10) = 0 waitpid(4093, [{WIFSIGNALED(s) && WTERMSIG(s) == SIGSEGV}], 0) = 4093 gettimeofday({1205932080, 943814}, NULL) = 0 setsockopt(1, SOL_TCP, TCP_CORK, [1], 4) = 0 write(1, "004 NO command failed\r\n", 23) = 23 setsockopt(1, SOL_TCP, TCP_CORK, [0], 4) = 0 I will try to use gdb to attach proccess and found something.

2 1

[Dovecot] Question about log entry?
by Knute Johnson 22 Mar '08

22 Mar '08

dovecot: POP3(knute): mbox sync: Expunged message reappeared in mailbox /var/mail/knute (UID 585 < 379664, seq=2, idx_msgs=0): 1 Time(s) dovecot: POP3(knute): mbox sync: UID inserted in the middle of mailbox /var/mail/knute (379664 > 585, seq=2, idx_msgs=1): 1 Time(s) I've been getting these lately. Any idea what causes them? Should I worry about it? Thanks, -- Knute Johnson Molon Labe...

3 2

[Dovecot] IMAP creates .userid directory even after pop.
by Jorgen Lundman 21 Mar '08

21 Mar '08

We are currently running dovecot-1.0.10 on Solaris 10 x86. Several users has noticed that they get different emails when using pop vs using IMAP. When I check a user's home directory, I find the following situation: /nfs/mail/1/1/hiro.11/mail/: drwx------ 6 176785 1000 512 Mar 21 07:53 . drwxr-xr-x 3 176785 1000 512 Feb 29 17:01 .. drwx------ 5 176785 1000 512 Feb 19 12:52 .hiro_11_c7 drwx------ 2 176785 1000 8192 Mar 21 07:53 cur -rw------- 1 176785 1000 1445 Mar 21 07:53 dovecot-uidlist -rw------- 1 176785 1000 144 Mar 21 07:53 dovecot.index -rw------- 1 176785 1000 57344 Mar 21 07:53 dovecot.index.cache -rw------- 1 176785 1000 66424 Mar 21 07:53 dovecot.index.log drwx------ 2 176785 1000 7680 Mar 21 10:34 new drwx------ 2 176785 1000 1536 Mar 21 10:34 tmp /nfs/mail/1/1/hiro.11/mail/.hiro_11_c7/: drwx------ 5 176785 1000 512 Feb 19 12:52 . drwx------ 6 176785 1000 512 Mar 21 07:53 .. drwx------ 2 176785 1000 512 Feb 19 12:52 cur -rw------- 1 176785 1000 1037 Feb 19 12:52 dovecot-uidlist -rw------- 1 176785 1000 120 Feb 19 12:52 dovecot.index -rw------- 1 176785 1000 24 Feb 19 12:52 dovecot.index.log -rw------- 1 176785 1000 0 Feb 19 12:52 maildirfolder drwx------ 2 176785 1000 1536 Feb 19 12:52 new drwx------ 2 176785 1000 1536 Feb 19 12:52 tmp I suspect that is less than ideal. What exactly is creating these folders, and how do we stop it? I can clean it up ok (which I'd rather do as one maintenance) but only once I know it wont happen again. Should also mention that we have a mbox convert script running for a couple of months, to convert their old mail. Then it will be removed: convert_mail = mbox:/export/mbox/migrate/%u:INBOX=/export/mbox/migrate/%u/%u:INDEX=Maildir:%h/mail/ Should also mention, one server in the cluster was incorrectly running version dovecot-1.0.2 (boy was that fun to track down). Lund -- Jorgen Lundman | <lundman(a)lundman.net> Unix Administrator | +81 (0)3 -5456-2687 ext 1017 (work) Shibuya-ku, Tokyo | +81 (0)90-5578-8500 (cell) Japan | +81 (0)3 -3375-1767 (home)

1 1

[Dovecot] Rootless installation gets ssl-parameters.dat errors
by Daniel Bretoi 20 Mar '08

20 Mar '08

In the logfile, i see this: dovecot: Mar 18 16:24:30 Error: ssl-build-param: Can't create temporary SSL parameters file /var/lib/dovecot/ssl-parameters.dat.tmp: Permission denied dovecot: Mar 18 16:24:30 Error: child 21836 (ssl-build-param) returned error 89 dovecot: Mar 18 16:24:30 Error: link(/var/lib/dovecot/ssl- parameters.dat, /usr/local/sb/daniel/rm/trunk/var/run/dovecot/login/ ssl-parameters.dat.tmp) failed: Permission denied dovecot: Mar 18 16:24:30 Error: file_copy(/var/lib/dovecot/ssl- parameters.dat, /usr/local/sb/daniel/rm/trunk/var/run/dovecot/login/ ssl-parameters.dat) failed: No such file or directory It is true that I as a user do not have permissions to read this file, however, I followed all the instructions to run as a rootless user. I don't seem to be able to specify anywhere where this ssl- parameters file should be copied from. Please note, I'm running this as user daniel (not root). Btw, there seems to have been a ssl_parameters_file keyword in the past, but it doesn't work with my version (nor with the latest 1.0.13). non-SSL IMAP works fine, but obviously SSL has issues. Thank you in advance for any help, Daniel #### SYSTEM INFO ##################################### $ dovecot --version 1.0.rc15 $ uname -a Linux myhost.com 2.6.22.18-vs2.3.0.32.1 #1 SMP Mon Feb 11 07:07:23 EST 2008 x86_64 x86_64 x86_64 GNU/Linux $ cat /etc/redhat-release CentOS release 5 (Final) #### CONFIG FILE #################################### $ perl -e 'for (<>){ next if /^\s*(#|$)/; print $_; }' dovecot.conf base_dir = /usr/local/sb/daniel/rm/trunk/var/run/dovecot protocols = imap imaps protocol imap { listen = *:8300 ssl_listen = *:8301 } log_path = /usr/local/sb/daniel/rm/trunk/var/logs/dovecot.log info_log_path = /usr/local/sb/daniel/rm/trunk/var/logs/dovecot.info.log ssl_cert_file = /usr/local/sb/daniel/rm/trunk/etc/dovecot.cert.pem ssl_key_file =/usr/local/sb/daniel/rm/trunk/etc/dovecot.private.pem login_chroot = no login_user = daniel login_process_size = 64 login_greeting = daniel's Dovecot ready. mail_location = mbox:/usr/local/sb/daniel/rm/trunk/var/mail:INBOX=/usr/ local/sb/daniel/rm/trunk/var/mail/INBOX mail_debug = yes protocol imap { } protocol pop3 { } protocol lda { postmaster_address = postmaster(a)example.com } auth default { mechanisms = plain passdb passwd-file { args = /usr/local/sb/daniel/rm/trunk/var/dovecot.passwd } userdb passwd { } userdb passwd-file { args = /usr/local/sb/daniel/rm/trunk/var/dovecot.passwd } user = daniel } dict { } plugin { }

3 6

[Dovecot] Using IMAP keywords instead of mailboxes for spam with dovecot-antispam
by Jan Oravec 20 Mar '08

20 Mar '08

Hi, Some email clients, like Evolution, use IMAP keywords to flag spam instead of moving mail to dedicated spam mailbox. This is very useful, as false positives can be easily "moved" to original mailbox simply by removing $Junk keyword. I couldn't find a way how to integrate antispam software, like dspam, with dovecot, so that antispam automatically learns ham/spam. I have found Johannes's dovecot-antispam plugin. Unfortunatelly, it doesn't have IMAP keywords support, autolearn is based on folders. Is there any solution for this use case? Thanks, Jan

5 9

[Dovecot] Automatic Debian repository now provides source packages
by Stephan Bosch 20 Mar '08

20 Mar '08

Hello Dovecot users, Last week I announced my automatic Debian repository for dovecot-1.1. Asheesh Laroia requested source package support and as promised I built it this weekend. Now that it has succesfully released new packages for Timo's latest changes I have activated the new script. To use the source packages you must add the following line to your /etc/apt/sources.list deb-src http://xi.rename-it.nl/debian/ testing-auto main Package versions now look as follows: 1:<upstream-version>-0~auto+<build number> Current latest version: 1:1.1.rc3-0~auto+3 For questions, comments and requests, you can send me an e-mail. Regards, -- Stephan Bosch stephan(a)rename-it.nl IRC: Freenode, #dovecot, S[r]us

2 1

[Dovecot] Dovecot 1.0.13 ignores auth_krb5_keytab settings
by christop 20 Mar '08

20 Mar '08

Greetings, i am using here FreeBSD 7.0-RELEASE amd64 with dovecot 1.0.13. Gssapi auth on our dovecot setup did not work for some time, so i wanted to fix it today. I run into an auth failure, where my mutt was not able to login. Also mutt was not able to login, i had a imap/mail2.physik-pool.tu-berlin.de principal in my credentials cache after an try. I can work around with a "ln -s /etc/mail.krb5.keytab /etc/krb5.keytab" to this. MfG Christop Logoutput while try to login with mutt: [ Mar 19 22:31:01 emmi dovecot: auth(default): new auth connection: pid=228 Mar 19 22:31:01 emmi dovecot: auth(default): client in: AUTH 1 GSSAPI service=IMAP secured lip=130.149.58.162 rip=130.149.58.145 resp=bla Mar 19 22:31:01 emmi dovecot: auth(default): gssapi(?,130.149.58.145): Obtaining credentials for imap(a)mail2.physik-pool.tu-berlin.de Mar 19 22:31:01 emmi dovecot: auth(default): gssapi(?,130.149.58.145): While processing incoming data: Miscellaneous failure (see text) Mar 19 22:31:01 emmi dovecot: auth(default): gssapi(?,130.149.58.145): While processing incoming data: failed to find imap/mail2.physik-pool.tu-berlin.de@REALM(kvno 1) in keytab /etc/krb5.keytab Mar 19 22:31:02 emmi dovecot: auth(default): client out: FAIL 1 ] dovecot -n [ # 1.0.13: /usr/local/etc/dovecot.conf protocols: imaps pop3s listen: mail2.physik-pool.tu-berlin.de ssl_ca_file: /etc/CA ssl_cert_file: /etc/CERT ssl_key_file: /etc/PRIVATEKEY login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login verbose_proctitle: yes first_valid_uid: 200 first_valid_gid: 0 mail_privileged_group: mail mail_location: maildir:~/maildir mmap_disable: yes maildir_copy_with_hardlinks: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): outlook-idle pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh namespace: type: private separator: / inbox: yes namespace: type: private separator: / prefix: mail/ location: mbox:~/mail auth default: mechanisms: gssapi plain login krb5_keytab: /etc/mail.krb5.keytab gssapi_hostname: mail2.physik-pool.tu-berlin.de verbose: yes debug: yes debug_passwords: yes passdb: driver: pam userdb: driver: passwd ]

1 0

[Dovecot] IMAP - multi-simultaneous-user mail store
by Tim Alberts 19 Mar '08

19 Mar '08

I'm finishing converting from POP to IMAP and I'm seeing some potentially powerful uses, but I wonder if my ideas aren't more abuses. I want to create 'multi-user' accounts that allow groups of users to archive and share emails with each other. For example, in the case of a sales department, emails from customers may have requests for new product features. I could create an IMAP storage for sales that allows the sales staff to copy these requests into a common email account. These could then be sorted and searched by the product development team to better determine what customers want where product development should go. Another example, a service/support group has some problem customers that frequently call multiple technicians for support. The service group can save all correspondence with this customer in a single location so they can better work together to provide support for this customer. The possibilities for sharing emails in groups seem endless to me, but it depends on if it's a 'use' or 'abuse' of the IMAP protocol, and if Dovecot in-particular is designed to be able to handle this. Thoughts?

2 3

[Dovecot] Converting from UW-IMAP to dovecot - odd client problems
by Michael Durket 19 Mar '08

19 Mar '08

Our installation currently uses an old version of UW-IMAP. Instead of upgrading to the latest version, we're in the process of testing dovecot 1.0.13 on a Solaris 9 machine (using a different set of network ports of course so both the old and new systems can coexist during testing). We've been asking selected users to switch from UW-IMAP to dovecot in order to test various clients and OSes with dovecot. On our system the inboxes are always on local disk, but the indexes and any folders may be on NFS or local disk (it has to do with how and where we added disk as our user population increased over time). Only a single server is ever used and I've made sure for our version of dovecot that the settings specified for NFS are as described in the Wiki article. We've noticed some oddities which we can't figure out: 1) When siwtching a Thunderbird user running on a Fedora system (latest version of Thunderbird) Thunderbird couldn't see his mail folders even when the appropriate checkbox (Server Settings -> Advanced -> Show Only Subscribed Folders) was unchecked. Clearing out the IMAP Server Directory setting seemed to fix this, but the very next day, the folders were gone again and we've been unable since to get Thunderbird to see them. Using the same version of Thunderbird, running on Mac OS X 10.5.2 yields no such problem. Another problem with this same user involved a test wherein we created a new mail folder and then deleted it. The deletion caused an error message to be displayed (inferior folders, etc) but on the Mac OS X version no such error occurred and the folder was deleted. Investigating the protocol traces for Thunderbird showed that in the error case, it attempted to rename the deleted folder as a subfolder of the Trash folder (thus generating the error message) but on the Mac OS X version, it actually deleted the folder (which would seem to make more sense). The settings pertaining to the Trash folder are the same on both clients. 2) When switching an Apple Mail.app user running on Mac OS X 10.4.11 (Tiger) at the latest patch level, things appeared to work fine, and then the user mentioned that no mail was showing up in her inbox. Closing and restarting Mail.app appeared to fix that temporarily. She normally keeps a large number of messages in her inbox (approximately 7000+) and receives a large number of messages each day (several hundred). In this case, the Postfix mail logs showed that mail was being received, and the procmail delivery log for this user showed that procmail was putting the mail in her inbox, yet Mail.app was not indicating the presence of new mail (until it was restarted). Also Mail.app became very very slow at startup and shutdown (taking several minutes as compared to a few seconds normally). We've had no problems so far with another Tiger Mail.app user (but his inbox is considerably smaller) and no problems yet with converting a Eudora user running under Windows, but this is a stumbling block in our efforts to convert to dovecot since we'd hoped to be able to switch users over fairly easily (just by changing the port address mostly). While these woud seem to be client problems at first glance, the common factor of course is dovecot. There are no problems with any of these clients using UW-IMAP. I'm hoping that perhaps there are some readers of this list that might have seen similar problems and know of solutions, or could point me to some ways of debugging these problems (with Thunderbird I can at least debug IMAP protocol exchanges, but since dovecot doesn't log IMAP exchanges for specific IPs and since the socket connections are all via STARTTLS I can't use tcpdump so I'm kind of at a loss for how to track these things down short of patching the dovecot code to put in tracing messages). Any suggestions would be appreciated (and would help us complete our conversion to dovecot). Michael Durket

2 1

[Dovecot] Dovecot / FreeBSD / Nfs mailstore / Index=memory
by Xavier Beaudouin 19 Mar '08

19 Mar '08

Hello, I have recently changed imap from Courier-imap to dovecot because of serial problems with courier-imap, I have being forced to do it very quickly... and without extensives tests. I have 3 mails servers (freebsd based) behind a load balancer and a nfs mailstore on a netapp. On my first tests I have setup the index into some nfs shared mount, but it seems that some imap clients are going mad when deleting files (mostly because they do open some new imap connection and the index was not clean) so I have changed index to memory. This has fixed one of my problems. Now I have some strange problems is that NFS activity passed from about... 5mbps to more than 70Mpbs... Is there any reasons about that ? OS: FreeBSD 6.2-p11 / x86 Dovecot : 1.0.13 (freebsd ports) Auth: ldap based Nfs mail spool : filer:/vol/vol0/mail /var/mailusers nfs rw,nfsv3,mntudp,bg,noatime,nolockd 0 0 Thanks, /Xavier

3 2