- dovecot - dovecot.org

[Dovecot] Importing emails from PST Archives
by Andre Rodier 27 Mar '13

27 Mar '13

Hello everyone, I am currently migrating a small company from exchange 2003 to Dovecot. So far, the most painful process has been the PST archives. (Except the inconditionals of Outlook) I have been able to create the directory structure using the last version of readpst, with the -r flag. But once this done, I have not been able to find one tool that worked correctly. Maybe the configuration I have is complex. The perl script to transform mbox files into maildirs in the dovecot distribution is old, and crashed many times in the middle of the process. I had a look to the script, and gave up trying to fix it. I found a python script that was supposed to crawl this folder structure, and to replicate it using IMAP commands, but it crashed as well, and restarting the process would import twice the same messages. The script is here: http://costela.net/2011/06/importing-an-outlook-pst-into-imap/ I found another python script that was working better, and seemed to be well written, but with one mbox to one IMAP folder only. It can be found here: http://imap-upload.svn.sourceforge.net/viewvc/imap-upload/trunk/ I have modified, and I have added some minor fixes: - Recursively traverse a folder structure, and replicate it using IMAP commands on the server. - Properly manage folder names with special characters. (dovecot can manage these characters using the listescape plugin). - Avoid taking all the resources of the server (A quirty hack that can change). I am not an expert in Python, and the script has been quickly writter to fit my needs. However I think it can be modified easily to any configuration. In the future, maybe this script can use the libpst python bindings to import the emails directly. The last version of the script, modified is here: https://github.com/arodier/EmailTools/tree/master/Migration. Do not hesitate to help me, to make the script as generic as possible, particularly if you are a python expert. I post this on this list, because I think you maybe interested if you are in the same case as me. The license is not specified, but I will probably use GPLv3. Regards, André

2 2

[Dovecot] Released Pigeonhole v0.2.4 for Dovecot v2.0.14
by Stephan Bosch 26 Mar '13

26 Mar '13

Hello Dovecot users, I release a new version of Pigeonhole tonight. This release extends the configuration capabilities of the include and vacation extensions, adds the ihave extension (RFC 5463), and fixes a few small other things. Judging by Timo's plans, this will be one of the last feature releases for Dovecot v2.0, since I'll be switching active development to Dovecot v2.1 once that matures a little more. Changelog v0.2.4: + Vacation extension: finally added support for using the original recipient in vacation address check. It is also possible to disable the recipient address check entirely. Check doc/vacation.txt for configuration information. + Include extension: made limits on the include depth and the total number of included scripts configurable. Check doc/include.txt for configuration information. + Implemented ihave extension. This allows checking for the availability of Sieve language extensions at 'runtime'. Actually, this is checked at compile time. At runtime the interpreter checks whether extensions that were not previously available are still unavailable. If the situation changed, the script is re-compiled and the ihave tests are evaluated again. + Sieve: optimized compilation of tests that yield constant results (i.e. known at compile tme), such as 'true' and 'false'. No code is produced anymore for script sections that are never executed. Also, semantics are not verified anymore in uncompiled script sections. + Made vnd.dovecot.debug extension available to the LDA plugin instead of only the command line tools. + Sieve: redirect action now adds X-Sieve-Redirected-From header (mainly for people using SPF/SRS). - Sieve: fixed bug in handling flags and keywords; in case of error an assertion was triggered. - Script storage: improved handling of unconfigured user home directory. Originally this would produce an unhelpful error message. - Imap4flags extension: prevent forcibly enabling imap4flags when imapflags is enabled. - Fixed various -Wunused-but-set-variable compiler warnings. - Include extension: forgot to check variable identifier syntax for 'global' command. - Sieve: fixed debug mode; no messages were logged in some situations. - sievec tool: forgot to enable -D (debug) parameter. The release is available as follows: http://www.rename-it.nl/dovecot/2.0/dovecot-2.0-pigeonhole-0.2.4.tar.gz http://www.rename-it.nl/dovecot/2.0/dovecot-2.0-pigeonhole-0.2.4.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.0 wiki for more information. Have fun testing this new release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

2 1

[Dovecot] Per-user seen flags for public read-only mailboxes
by Guido Berhoerster 26 Mar '13

26 Mar '13

Hi, I have some trouble getting per-user SEEN-flags to work with read-only mailboxes in a public namespace. Basically, I'm following the wiki at http://wiki2.dovecot.org/SharedMailboxes/Public#Maildir:_Per-user_.2BAFw-Se… and the relevant configuration is as follows: namespace { inbox = yes location = prefix = separator = / type = private } namespace { location = maildir:/srv/mail/public:LAYOUT=fs:INDEX=~/public prefix = Public/ separator = / subscriptions = no type = public } plugin { acl = vfile ... } protocol imap { mail_plugins = " acl quota trash zlib autocreate imap_acl imap_quota imap_zlib" } I have a virtual-user setup with static userdb and there is no permissions problem since everything is created through dovecot: mail_gid = vmail mail_location = mdbox:~/mdbox mail_uid = vmail [...] userdb { args = uid=vmail gid=vmail home=/srv/mail/virtual/%n driver = static } The content of /srv/mail/public/dovecot-acl (and the one of all mailboxes below it) is: owner lrwstipekxa authenticated lr Users can access all mailboxes in the Public/ namespace and read the messages and I can see that dovecot.index.cache and dovecot.index.log are created under ~/public, however setting the SEEN flag for a message is ignored since the mailbox is read-only. Changing the ACL from authenticated lr to authenticated lrs allows user to set the SEEN flag, but globally on the actual mailbox. How can I get per-user SEEN flags to work? The Dovecot version is 2.0.9. Thanks, -- Guido Berhoerster

3 9

[Dovecot] Dovecot 2.1.15 on CentOS 6.4 with metadata-plugin
by Bruce Marriner 25 Mar '13

25 Mar '13

Hello, I hope somebody can help me with this :) I am trying to get Dovecot 2.1 working with Kolab 3.0 and to start that processes I need? to compile the Dovecot metadata plugin with Dovecot. For the plugin to compile correctly against the Dovecot source code Dovecot must first be patched with a patch from the plugin author (Dennis Schridde) that is currently not part of the Dovecot code (Timo, could this be added to Dovecot?) I am documenting this entire process and once it's finished it may also be helpful to the Dovecot community. You can see some of my progress, or lack of, and errors here : http://bmts.us/wiki/doku.php?id=article:kolab:dovecot In order to compile the plugin I have removed CentOS yum packages for autoconf, automake, and libtool and downloaded, compiled, and installed versions autoconf 2.69, automake 1.12.6, and libtool 2.4.2. If I download Dovecot (not from hg) I can run ./configure and make without any problems. But, to add the patch to Dovecot I need to run the autoreconf command and this is where I have trouble. [root@kolab dovecot-2.1.15]# autoreconf aclocal: warning: autoconf input should be named 'configure.ac', not 'configure.in' configure.in:284: warning: macro 'AM_ICONV' not found in library configure.in:284: error: possibly undefined macro: AM_ICONV If this token and others are legitimate, please use m4_pattern_allow. See the Autoconf documentation. autoreconf: /usr/local/bin/autoconf failed with exit status: 1 I read this is related to gettext, so I installed gettext 0.18.2 from source and now I get the following errors : [root@kolab dovecot-2.1.15]# autoreconf aclocal: warning: autoconf input should be named 'configure.ac', not 'configure.in' automake: warning: autoconf input should be named 'configure.ac', not 'configure.in' automake: warning: autoconf input should be named 'configure.ac', not 'configure.in' src/plugins/acl/Makefile.am:16: error: 'module_LTLIBRARIES' is used but 'moduledir' is undefined src/plugins/acl/Makefile.am:19: warning: variable 'lib01_acl_plugin_la_SOURCES' is defined but no program or src/plugins/acl/Makefile.am:19: library has 'lib01_acl_plugin_la' as canonical name (possible typo) src/plugins/acl/Makefile.am:14: warning: variable 'lib01_acl_plugin_la_LDFLAGS' is defined but no program or src/plugins/acl/Makefile.am:14: library has 'lib01_acl_plugin_la' as canonical name (possible typo) src/plugins/autocreate/Makefile.am:11: error: 'module_LTLIBRARIES' is used but 'moduledir' is undefined src/plugins/autocreate/Makefile.am:14: warning: variable 'lib20_autocreate_plugin_la_SOURCES' is defined but no program or src/plugins/autocreate/Makefile.am:14: library has 'lib20_autocreate_plugin_la' as canonical name (possible typo) src/plugins/autocreate/Makefile.am:9: warning: variable 'lib20_autocreate_plugin_la_LDFLAGS' is defined but no program or src/plugins/autocreate/Makefile.am:9: library has 'lib20_autocreate_plugin_la' as canonical name (possible typo) ... ... ... ... autoreconf: automake failed with exit status: 1

1 0

[Dovecot] doveadm with multiple commands
by Timo Sirainen 25 Mar '13

25 Mar '13

This has been in my TODO for a while and today I implemented it (but didn't dare to test it yet :) So the problem has been that you want to run for example: doveadm expunge -A mailbox Trash savedbefore 7d doveadm purge -A This is annoying because it scans through the users' mailboxes twice, wasting disk IO and CPU. So how to make it do the scan only once? The syntax I thought of today would be: doveadm multi [-A | -u wildcards] <separator string> <comand 1> [<separator string> <command 2> [...]] So the first two commands could be for example: doveadm multi -A : expunge mailbox Trash savedbefore 7d : purge The ':' character is the separator. Any other string could be used as well, for example "?SEP?" or whatever. Thoughts? Any better name for the command than "multi"?

6 13

[Dovecot] dsync replication: assertion failed: (ibc->value_input == NULL)
by Oli Schacher 25 Mar '13

25 Mar '13

current hg (33e78edac8f5) Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Panic: file dsync-ibc-stream.c: line 527 (dsync_ibc_stream_input_next): assertion failed: (ibc->value_input == NULL) Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x5ebea) [0x7f67d85ffbea] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5ec36) [0x7f67d85ffc36] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1fcea) [0x7f67d85c0cea] -> dovecot/doveadm-server() [0x4258ec] -> dovecot/doveadm-server() [0x4268f6] -> dovecot/doveadm-server(dsync_brain_sync_mails+0x426) [0x41aa66] -> dovecot/doveadm-server(dsync_brain_run+0x162) [0x4172a2] -> dovecot/doveadm-server() [0x417940] -> dovecot/doveadm-server() [0x428410] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f67d860ed36] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f67d860fde7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f67d860ecd8] -> dovecot/doveadm-server() [0x414fda] -> dovecot/doveadm-server() [0x40c71f] -> dovecot/doveadm-server() [0x41459a] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f67d860ed36] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f67d860fde7] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f67d860ecd8] -> /usr/lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f67d85c5743] -> dovecot/doveadm-server(main+0x121) [0x414ce1] -> /lib64/libc.so.6(__libc_start_main+0xfd) [0x3400a1ecdd] -> dovecot/doveadm-server() [0x40c109] Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(<munged>): Fatal: master: service(doveadm): child 27336 killed with signal 6 (core dumped) (gdb) bt full #0 0x0000003400a328a5 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x0000003400a34085 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f67d85ffbf8 in default_fatal_finish (type=<value optimized out>, status=0) at failures.c:191 backtrace = 0x1baf510 "/usr/lib64/dovecot/libdovecot.so.0(+0x5ebea) [0x7f67d85ffbea] -> /usr/lib64/dovecot/libdovecot.so.0(+0x5ec36) [0x7f67d85ffc36] -> /usr/lib64/dovecot/libdovecot.so.0(+0x1fcea) [0x7f67d85c0cea] -> dovec"... #3 0x00007f67d85ffc36 in i_internal_fatal_handler (ctx=0x7ffffc4466c0, format=<value optimized out>, args=<value optimized out>) at failures.c:652 status = 0 #4 0x00007f67d85c0cea in i_panic (format=0x6ac8 <Address 0x6ac8 out of bounds>) at failures.c:263 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffffc446790, reg_save_area = 0x7ffffc4466d0}} #5 0x00000000004258ec in dsync_ibc_stream_input_next (ibc=0x1bda990, item=ITEM_MAILBOX_ATTRIBUTE, decoder_r=0x7ffffc446808) at dsync-ibc-stream.c:527 line_item = ITEM_NONE line = <value optimized out> error = <value optimized out> i = <value optimized out> __FUNCTION__ = "dsync_ibc_stream_input_next" #6 0x00000000004268f6 in dsync_ibc_stream_recv_mailbox_attribute (_ibc=0x1bda990, attr_r=0x7ffffc446878) at dsync-ibc-stream.c:1311 ibc = 0x1bda990 pool = 0x1bdabc0 decoder = <value optimized out> attr = 0x1bdabe0 value = <value optimized out> ret = <value optimized out> __FUNCTION__ = "dsync_ibc_stream_recv_mailbox_attribute" #7 0x000000000041aa66 in dsync_brain_recv_mailbox_attribute (brain=0x1bdc890) at dsync-brain-mails.c:68 attr = <value optimized out> input = <value optimized out> ret = <value optimized out> #8 dsync_brain_sync_mails (brain=0x1bdc890) at dsync-brain-mails.c:316 changed = false __FUNCTION__ = "dsync_brain_sync_mails" #9 0x00000000004172a2 in dsync_brain_run_real (brain=0x1bdc890, changed_r=0x7ffffc44698f) at dsync-brain.c:423 changed = false ret = true #10 dsync_brain_run (brain=0x1bdc890, changed_r=0x7ffffc44698f) at dsync-brain.c:452 _data_stack_cur_id = 5 ret = true #11 0x0000000000417940 in dsync_brain_run_io (context=0x1bdc890) at dsync-brain.c:41 brain = 0x1bdc890 changed = false try_pending = true #12 0x0000000000428410 in dsync_ibc_stream_input (ibc=0x1bda990) at dsync-ibc-stream.c:194 No locals. #13 0x00007f67d860ed36 in io_loop_call_io (io=0x1bc9f30) at ioloop.c:387 ioloop = 0x1bb5720 t_id = 4 #14 0x00007f67d860fde7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:215 ctx = 0x1bb8550 events = <value optimized out> event = 0x1bb85c0 ---Type <return> to continue, or q <return> to quit--- list = 0x1bbe320 io = <value optimized out> tv = {tv_sec = 4, tv_usec = 891617} msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run" #15 0x00007f67d860ecd8 in io_loop_run (ioloop=0x1bb5720) at ioloop.c:406 No locals. #16 0x0000000000414fda in cmd_dsync_server_run (_ctx=0x1bcb560, user=0x1bd49b0) at doveadm-dsync.c:862 ctx = 0x1bcb560 ibc = 0x1bda990 brain = 0x1bdc890 temp_prefix = 0x1baf378 #17 0x000000000040c71f in doveadm_mail_next_user (ctx=0x1bcb560, input=<value optimized out>, error_r=0x7ffffc446ae0) at doveadm-mail.c:309 error = <value optimized out> ret = 0 __FUNCTION__ = "doveadm_mail_next_user" #18 0x000000000041459a in doveadm_mail_cmd_server_run (conn=0x1bbe510) at client-connection.c:115 error = 0x7f67d85a1000 "\177ELF\002\001\001" ret = <value optimized out> #19 client_handle_command (conn=0x1bbe510) at client-connection.c:217 ctx = 0x1bcb560 flags = <value optimized out> cmd_name = <value optimized out> input = {module = 0x0, service = 0x42ce7c "doveadm", username = 0x1bad569 "<munged>", session_id = 0x0, local_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, userdb_fields = 0x0, flags_override_add = 0, flags_override_remove = 0, no_userdb_lookup = 0} argc = 2 #20 client_connection_input (conn=0x1bbe510) at client-connection.c:317 args = 0x1bad5b0 _data_stack_cur_id = 3 line = <value optimized out> ok = true #21 0x00007f67d860ed36 in io_loop_call_io (io=0x1bbe2d0) at ioloop.c:387 ioloop = 0x1bb5720 t_id = 2 #22 0x00007f67d860fde7 in io_loop_handler_run (ioloop=<value optimized out>) at ioloop-epoll.c:215 ctx = 0x1bb8550 events = <value optimized out> event = 0x1bb85c0 list = 0x1bbe320 io = <value optimized out> tv = {tv_sec = 2147483, tv_usec = 0} msecs = <value optimized out> ret = 1 i = <value optimized out> call = <value optimized out> __FUNCTION__ = "io_loop_handler_run" #23 0x00007f67d860ecd8 in io_loop_run (ioloop=0x1bb5720) at ioloop.c:406 ---Type <return> to continue, or q <return> to quit--- No locals. #24 0x00007f67d85c5743 in master_service_run (service=0x1bb55c0, callback=<value optimized out>) at master-service.c:550 No locals. #25 0x0000000000414ce1 in main (argc=1, argv=0x1bb53a0) at main.c:91 set_roots = {0x42cc00, 0x0} error = 0x0

2 1

[Dovecot] nopassword not working in Dovecot 2.2rc3?
by Christian Felsing 25 Mar '13

25 Mar '13

Hello, I got some problems while set up a test system for Client Cert Auth, therefore passwords are not requred. SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM users WHERE userid = 'user(a)example.net' shows exactly what is expected, bur Dovecot does net regongnize 'Y' as nopassword: Mar 25 11:18:04 dovecot dovecot: auth: Debug: sql(user(a)example.net,192.168.200.6,<gndyHr3Y/gCwxigG>): query: SELECT NULL AS password, 'Y' as nopassword, userid AS user FROM users WHERE userid = 'user(a)example.net' Mar 25 11:18:04 dovecot dovecot: auth: sql(user(a)example.net,192.168.200.6,<gndyHr3Y/gCwxigG>): Empty password returned without nopassword Mar 25 11:18:06 dovecot dovecot: auth: Debug: client passdb out: FAIL#0112#011user=user(a)example.net Mar 25 11:18:07 dovecot dovecot: imap-login: Disconnected (auth failed, 2 attempts in 9 secs): user=<user(a)example.net>, method=PLAIN, rip=192.168.200.6, lip=192.168.200.22, TLS As shown on http://wiki2.dovecot.org/AuthDatabase/SQL select statement above should prevent Dovecot from verifying password. any hints? best regards Christian

1 0

[Dovecot] Dovecot v2 multiple domains
by Pavel Dimow 25 Mar '13

25 Mar '13

Hello, I would like to have multiple domains on same server (with different ip's) and I want that user logs with username with domain part for every domain, but I can't find any documentation on this. To be more precise I found a post regarding dovecot v1 that suggest making separate init scripts for every domain but it also suggest that dovecot v2 will support this in code. This is the post http://dovecot.org/pipermail/dovecot/2006-April/012455.html Am I missing something or this is not still possible?

2 2

[Dovecot] Dovecot DNS queries its own host many times a second
by Dominic Malolepszy 25 Mar '13

25 Mar '13

Hi, We have observed that Dovecot appears to make a DNS lookup of its own hostname many times a second. Each Dovecot server in our cluster appears to be doing around 50 queries per second to find out its own hostname. Rsyslog was the first thing we assumed was the cause, however stopping it did not help. Also the fact that at the time Dovecot was doing around 50 logins a second, seemed to correlate with it making these queries. Is there any reason why Dovecot would need to do a lookup of its own hosts IP address every time? Seems like a strange thing to do and not cache its own hostname. Dominic

3 2

[Dovecot] Confirmation Please - Dovecot for Email Delivery
by craig.dovecot＠noboost.org 25 Mar '13

25 Mar '13

Hi All, Spec: Centos 6.3x64 Dovecot-2.0.9-5.el6.x86_64 Goal: 1) Inbound emails are delivered by Dovecot and the UID/GID is determined by a local /etc/dovecot/users file. 2) I'd like to have IMAPS clients authenticate with Dovecot via LDAP. Questions: 1) I've attempted to ensure that Dovecot will always use the local password file for mail delivery as no actual password is needed. Then the LDAP server for when the IMAPS email client connects. This appears to be working as I expect, can anyone confirm/deny the below settings are correct? 2) Is there a Dovecot architecture diagram/documentation anywhere? Settings: ------------------------------------------------------------------------- File: dovecot.conf protocols = imap lmtp listen = * File: 10-auth.conf disable_plaintext_auth = yes auth_username_format = %Ln auth_mechanisms = plain !include auth-passwdfile.conf.ext !include auth-ldap.conf.ext File: auth-passwdfile.conf.ext mail_location = maildir:/home/%n/Maildir #passdb { # driver = passwd-file # args = username_format=%n /etc/dovecot/users #} userdb { driver = passwd-file args = username_format=%n /etc/dovecot/users } File: dovecot-ldap.conf.ext hosts = sysvm-ipa.noboost.org tls = yes tls_ca_cert_dir = /etc/openldap/certs auth_bind = yes auth_bind_userdn = uid=%u,cn=users,cn=accounts,dc=noboost,dc=org base = cn=users,cn=accounts,dc=noboost,dc=org pass_attrs = uid=user pass_filter = (&(objectClass=posixAccount)(uid=%u)) File: /etc/dovecot/users craig:x:890:432:Craig:/home/craig:/bin/bash ------------------------------------------------------------------------- cya Craig

1 0