- dovecot - dovecot.org

Dovecot 2.2.34 FTS-SOLR = inconsistent results
by kfx 05 Mar '18

05 Mar '18

Hello, I'm trying to figure why I have inconsistent results with my fts-solr powered search: My test is to find the string "am5oocobey9hait5Wiex8yohgoob9thu" in the 3 emails containing it that I sent to myself: - Directly on the server: doveadm search -u username text am5oocobey9hait5Wiex8yohgoob9thu e2c58a3093235153110800003ea484a8 7937 e2c58a3093235153110800003ea484a8 7938 e0c58a3093235153110800003ea484a8 36479 e0c58a3093235153110800003ea484a8 36480 e0c58a3093235153110800003ea484a8 36481 - RoundCube webmail: 0 Result - On the server with "telnet localhost imap" (2 identical searches): [snip...] a23 SEARCH text am5oocobey9hait5Wiex8yohgoob9thu * SEARCH * 14488 FETCH (FLAGS (\Seen NonJunk)) * 14495 EXISTS a23 OK Search completed (0.015 + 0.000 + 0.004 secs). a25 SEARCH text am5oocobey9hait5Wiex8yohgoob9thu * SEARCH a25 OK Search completed (0.006 + 0.000 + 0.003 secs). Here is my setup: root@myMailServer ~ # uname -a Linux myMailServer.mydomain 3.10.0-693.17.1.el7.x86_64 #1 SMP Thu Jan 25 20:13:58 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux root@myMailServer ~ # cat /etc/redhat-release CentOS Linux release 7.4.1708 (Core) root@plainte ~ # doveconf -n # 2.2.34 (874deae): /usr/local/etc/dovecot/dovecot.conf [50/1259] # Pigeonhole version 0.4.22 (22940fb7) # OS: Linux 3.10.0-693.17.1.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) ext4 # Hostname: myMailServer.mydomain auth_cache_size = 10 M auth_master_user_separator = * auth_socket_path = /var/run/dovecot/auth-userdb auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@* auth_verbose = yes base_dir = /var/run/dovecot/ debug_log_path = /var/log/dovecot-debug.log default_client_limit = 5120 default_process_limit = 1024 default_vsz_limit = 2 G hostname = mydomain info_log_path = /var/log/dovecot.log lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = * log_path = /var/log/dovecot-error.log login_greeting = Welcome login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_gid = vmail mail_location = maildir:/var/vmail/%Ln mail_plugins = fts fts_solr quota stats mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { inbox = yes location = maildir:/var/vmail/%Ln mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = type = private } passdb { args = /usr/local/etc/dovecot/deny-users deny = yes driver = passwd-file } passdb { args = /usr/local/etc/dovecot/master-users driver = passwd-file master = yes } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { fts = solr fts_autoindex = yes fts_autoindex_max_recent = 1000 fts_solr = url=http://127.0.0.1:8983/solr/dovecot/ quota = maildir:User quota quota_rule = *:storage=20GB quota_rule2 = Trash:storage=+200M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = /var/sieve-scripts/%Ln.sieve sieve_dir = /var/vmail/%Ln/home/sieve stats_command_min_time = 1 mins stats_domain_min_time = 12 hours stats_ip_min_time = 12 hours stats_memory_limit = 16 M stats_refresh = 30 secs stats_session_min_time = 15 mins stats_track_cmds = yes stats_user_min_time = 1 hours } postmaster_address = postmaster@mydomain protocols = imap pop3 sieve sieve service auth-worker { user = root } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0777 user = vmail } } service imap-login { inet_listener imaps { port = 993 ssl = yes } process_min_avail = 10 } service imap { process_limit = 2128 } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } service quota-warning { executable = script /usr/local/bin/quota-warning.sh user = nobody } service stats { fifo_listener stats-mail { mode = 0600 user = vmail } } ssl_cert = </etc/letsencrypt/live/myMailServer.mydomain/fullchain.pem ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-ldap-userdb.conf.ext driver = ldap override_fields = uid=vmail gid=vmail home=/var/vmail/%Ln/home } verbose_proctitle = yes protocol lda { mail_plugins = fts fts_solr quota stats sieve virtual } protocol imap { mail_max_userip_connections = 20 mail_plugins = fts fts_solr quota stats imap_quota virtual imap_stats } protocol sieve { mail_max_userip_connections = 20 } SOLR: 7.1.0 configured as pear the wiki. No error in solr.log and it seems to be indexing okay: root@myMailServer /var/vmail/solr # du -hs 22G . CRONTAB: 0 3 * * * /usr/bin/curl http://127.0.0.1:8983/solr/dovecot/update?optimize=true > /dev/null 2>&1 */5 * * * * /usr/bin/curl http://127.0.0.1:8983/solr/dovecot/update?commit=true > /dev/null 2>&1 I would be very grateful if someone can point me where my error is, as I've been on this problem for weeks :( Thanks, kfx

1 0

Sieve filter fileinto doesn't preserve flags
by Konstantinos Tsakiltzidis 05 Mar '18

05 Mar '18

Using `fileinto` to move a mail into another mailbox removes flags that have been set with a previous sieve filter with `addflag`. # 2.2.33.2 (d6601f4ec): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.21 (92477967) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.1 ext4 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes mail_debug = yes mail_location = maildir:/var/vmail/%d/%n managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = . subscriptions = yes type = private } namespace modulus { list = children location = maildir:/var/vmail/%d/Public:INDEXPVT=~/public/indexes mailbox admin { auto = subscribe } mailbox support { auto = subscribe } mailbox telecoms { auto = subscribe } prefix = Public. separator = . subscriptions = yes type = public } passdb { driver = pam } plugin { acl = vfile mail_log_events = flag_change mail_log_fields = box flags uid sieve = ~/dovecot.sieve sieve_before = /var/vmail/global.sieve sieve_dir = ~/sieve sieve_global_dir = /var/vmail/sieve } protocols = " imap lmtp sieve lmtp" service auth { unix_listener /var/spool/postfix/private/auth { group = mail mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 0 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve { process_limit = 1024 } ssl = required ssl_cert = </etc/ssl/certs/mail.crt ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol imap { mail_max_userip_connections = 20 mail_plugins = " mail_log notify acl" passdb { args = /etc/dovecot/dovecot-ldap-users.conf.ext driver = ldap name = } userdb { args = uid=vmail gid=mail home=/var/vmail/%d/%n driver = static name = } } protocol lda { mail_plugins = " sieve acl" userdb { args = /etc/dovecot/dovecot-ldap-users.conf.ext driver = ldap name = override_fields = uid=vmail gid=mail home=/var/vmail/%d/%n } userdb { args = /etc/dovecot/dovecot-ldap-groups.conf.ext driver = ldap name = override_fields = uid=vmail gid=mail home=/var/vmail/%d/Public/.%n mail=maildir:/var/vmail/%d/Public/.%n } } protocol lmtp { mail_plugins = " sieve acl" postmaster_address = postmaster(a)modulus.gr userdb { args = /etc/dovecot/dovecot-ldap-users.conf.ext driver = ldap name = override_fields = uid=vmail gid=mail home=/var/vmail/%d/%n } userdb { args = /etc/dovecot/dovecot-ldap-groups.conf.ext driver = ldap name = override_fields = uid=vmail gid=mail home=/var/vmail/%d/Public/.%n mail=maildir:/var/vmail/%d/Public/.%n } } protocol doveadm { userdb { args = /etc/dovecot/dovecot-ldap-users.conf.ext driver = ldap name = override_fields = uid=vmail gid=mail home=/var/vmail/%d/%n } userdb { args = /etc/dovecot/dovecot-ldap-groups.conf.ext driver = ldap name = override_fields = uid=vmail gid=mail home=/var/vmail/%d/Public/.%n mail=maildir:/var/vmail/%d/Public/.%n } } protocol sieve { mail_max_userip_connections = 10 managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 passdb { args = /etc/dovecot/dovecot-ldap-users.conf.ext driver = ldap name = } userdb { args = uid=vmail gid=mail home=/var/vmail/%d/%n driver = static name = } }

2 3

Re: [enhancement] fts-solr low performance
by azurIt 05 Mar '18

05 Mar '18

>Hi, > >we have activated fts-solr about a week ago and immediately started to >experience really *low* performance with MOVE and EXPUNGE commands. >After several days of googling, tcpdumping and straceing i was able to >find and resolve the problem. > >We are using Dovecot 2.2.27 from Debian Jessie (jessie-backports), >which is doing a soft commit in solr after every MOVE or EXPUNGE >command - this behavior cannot be, currently, changed. The problem is >that this was causing every MOVE/EXPUNGE to take about 6 seconds to >complete. The problem appears to be in very old version of Solr - >3.6.2 (!!). This is the only version which is shipped with current >(Jessie) and also next (Stretch) version of Debian, don't ask my why, >i don't understand it either. Solr versions below 4.0 are NOT >supporting soft commits, so all commits are hard and this was the >problem. Finally, i decided to patch our Dovecot to not send a commit >at all and everything started to be super fast. I'm doing hard commits >every minute via cron so the only consequence of this is that you >cannot search for messages delivered before less then a minute (which >you, usually, don't need to do anyway). > >While googling i also find out that Solr supports autoCommit function >(and from version 4.0 also autoSoftCommit), so there's no reason for >Dovecot to handle this on it's own (and potentially doing hundreds or >thousands of soft commits every second) - you can just set Solr to, >for example, do autoSoftCommit every second and autoCommit every minute: >https://cwiki.apache.org/confluence/display/solr/UpdateHandlers+in+SolrConf… > >Also this wiki page should be updated with warning about old versoins >of Solr not supporting soft commits (you could also mention the >auto[Soft]Commit function): >http://wiki2.dovecot.org/Plugins/FTS/Solr > >I suggest to allow completely disable Solr commits in Dovecot by >configuration, so people like me can handle this easily. What do you >think? > >azur Hi, any news on this? Even Solr documentation suggests to NOT doing commits from applications: https://lucene.apache.org/solr/guide/6_6/shards-and-indexing-data-in-solrcl… Thanks for not ignoring me. azur

2 1

2.2.34 fails to build on OpenBSD
by Brad Smith 04 Mar '18

04 Mar '18

Trying to build Dovecot 2.2.34 on OpenBSD fails. This seems to have been introduced by this commit.. https://github.com/dovecot/core/commit/4a9020ed888caf03fd3132a30a7818b01daa… Fairly -current.. /usr/bin/libtool --tag=CC --mode=link cc -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -L/usr/local/lib -o libssl_iostream.la iostream-ssl.lo libtool: link: ar cru .libs/libssl_iostream.a .libs/iostream-ssl.o libtool: link: ranlib .libs/libssl_iostream.a cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -DMODULE_DIR=\""/usr/local/lib/dovecot"\" -I/usr/local/include -I../../src/lib -I../../src/lib-test -DMODULE_DIR=\""/usr/local/lib/dovecot"\" -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -MT test_ssl_iostream-test-ssl-iostream.o -MD -MP -MF .deps/test_ssl_iostream-test-ssl-iostream.Tpo -c -o test_ssl_iostream-test-ssl-iostream.o `test -f 'test-ssl-iostream.c' || echo './'`test-ssl-iostream.c mv -f .deps/test_ssl_iostream-test-ssl-iostream.Tpo .deps/test_ssl_iostream-test-ssl-iostream.Po /usr/bin/libtool --tag=CC --mode=link cc -I../../src/lib -I../../src/lib-test -DMODULE_DIR=\""/usr/local/lib/dovecot"\" -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -L/usr/local/lib -o test-ssl-iostream test_ssl_iostream-test-ssl-iostream.o libssl_iostream_openssl.la libssl_iostream.la ../lib-test/libtest.la ../lib/liblib.la -export-dynamic warning: library filename /home/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-ssl-iostream/.libs/libssl_iostream_openssl.so has no version number libtool: link: cc -o .libs/test-ssl-iostream -I../../src/lib -I../../src/lib-test -DMODULE_DIR="/usr/local/lib/dovecot" -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -Wl,-E test_ssl_iostream-test-ssl-iostream.o /home/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-ssl-iostream/.libs/libssl_iostream.a /home/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-test/.libs/libtest.a /home/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib/.libs/liblib.a -L.libs -lssl_iostream_openssl -lssl -lcrypto -Wl,-rpath,/usr/local/lib/dovecot /home/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib/.libs/liblib.a(net.o): In function `net_connect_unix_with_retries': net.c:(.text+0x852): warning: rand() may return deterministic values, is that what you want? .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_cert_match_name' .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_context_deinit' .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_handshake' .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_unref' .libs/libssl_iostream_openssl.so: undefined reference to `iostream_ssl_module_init' .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_has_valid_client_cert' cc: error: linker command failed with exit code 1 (use -v to see invocation) Error while executing cc -o .libs/test-ssl-iostream -I../../src/lib -I../../src/lib-test -DMODULE_DIR="/usr/local/lib/dovecot" -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wno-duplicate-decl-specifier -Wstrict-aliasing=2 -Wl,-E test_ssl_iostream-test-ssl-iostream.o /home/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-ssl-iostream/.libs/libssl_iostream.a /home/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-test/.libs/libtest.a /home/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib/.libs/liblib.a -L.libs -lssl_iostream_openssl -lssl -lcrypto -Wl,-rpath,/usr/local/lib/dovecot A 6.0-ish build.. /usr/bin/libtool --tag=CC --mode=link cc -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -L/usr/local/lib -o libssl_iostream.la iostream-ssl.lo libtool: link: ar cru .libs/libssl_iostream.a .libs/iostream-ssl.o libtool: link: ranlib .libs/libssl_iostream.a cc -DHAVE_CONFIG_H -I. -I../.. -I../../src/lib -I../../src/lib-test -DMODULE_DIR=\""/usr/local/lib/dovecot"\" -I/usr/local/include -I../../src/lib -I../../src/lib-test -DMODULE_DIR=\""/usr/local/lib/do vecot"\" -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -MT test_ssl_iostream-test-ssl-iostream.o -MD -MP -MF .deps/test_ssl_iostream-test-ssl-iostream.Tpo -c -o test_ssl_iostream-test-ssl-iostream.o `test -f 'test-ssl-iostream.c' || echo './'`test-ssl-iostream. c mv -f .deps/test_ssl_iostream-test-ssl-iostream.Tpo .deps/test_ssl_iostream-test-ssl-iostream.Po /usr/bin/libtool --tag=CC --mode=link cc -I../../src/lib -I../../src/lib-test -DMODULE_DIR=\""/usr/local/lib/dovecot"\" -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpoi nter-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -L/usr/local/lib -o test-ssl-iostream test_ssl_iostream-test-ssl-iostream.o libssl_io stream_openssl.la libssl_iostream.la ../lib-test/libtest.la ../lib/liblib.la -export-dynamic warning: library filename /home/brad/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-ssl-iostream/.libs/libssl_iostream_openssl.so has no version number libtool: link: cc -o .libs/test-ssl-iostream -I../../src/lib -I../../src/lib-test -DMODULE_DIR="/usr/local/lib/dovecot" -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-ar ith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -Wl,-E test_ssl_iostream-test-ssl-iostream.o /home/brad/ports/pobj/dovecot-2.2.34-no_db-no_ldap- no_mysql-no_postgresql/dovecot-2.2.34/src/lib-ssl-iostream/.libs/libssl_iostream.a /home/brad/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-test/.libs/libtest.a /home /brad/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib/.libs/liblib.a -L.libs -lssl_iostream_openssl -lssl -lcrypto -Wl,-rpath,/usr/local/lib/dovecot .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_cert_match_name' .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_context_deinit' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_ref' .libs/libssl_iostream_openssl.so: undefined reference to `t_malloc' .libs/libssl_iostream_openssl.so: undefined reference to `buffer_append_space_unsafe' .libs/libssl_iostream_openssl.so: undefined reference to `i_error' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_get_fd' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_compress' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_set_max_buffer_size' .libs/libssl_iostream_openssl.so: undefined reference to `p_strdup' .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_handshake' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_unref' .libs/libssl_iostream_openssl.so: undefined reference to `safe_memset' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_alloc' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_get_data_size' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_get_buffer_used_size' .libs/libssl_iostream_openssl.so: undefined reference to `i_strdup_printf' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_close' .libs/libssl_iostream_openssl.so: undefined reference to `i_fatal_status' .libs/libssl_iostream_openssl.so: undefined reference to `buffer_append' .libs/libssl_iostream_openssl.so: undefined reference to `i_strdup' .libs/libssl_iostream_openssl.so: undefined reference to `i_strocpy' .libs/libssl_iostream_openssl.so: undefined reference to `str_printfa' .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_unref' .libs/libssl_iostream_openssl.so: undefined reference to `i_panic' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_get_max_buffer_size' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_try_alloc' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_unref' .libs/libssl_iostream_openssl.so: undefined reference to `buffer_append_zero' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_get_name' .libs/libssl_iostream_openssl.so: undefined reference to `i_debug' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_set_name' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_create' .libs/libssl_iostream_openssl.so: undefined reference to `iostream_ssl_module_init' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_get_fd' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_close' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_create' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_skip' .libs/libssl_iostream_openssl.so: undefined reference to `io_stream_set_error' .libs/libssl_iostream_openssl.so: undefined reference to `i_fatal' .libs/libssl_iostream_openssl.so: undefined reference to `str_c' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_send' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_flush' .libs/libssl_iostream_openssl.so: undefined reference to `buffer_delete' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_set_flush_pending' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_uncork' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_get_data' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_switch_ioloop' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_get_error' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_set_flush_callback' .libs/libssl_iostream_openssl.so: undefined reference to `t_strsplit_spaces' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_get_name' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_read_data' .libs/libssl_iostream_openssl.so: undefined reference to `i_info' .libs/libssl_iostream_openssl.so: undefined reference to `t_strdup_noconst' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_get_error' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_get_buffer_avail_size' .libs/libssl_iostream_openssl.so: undefined reference to `t_strndup' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_set_input_pending' .libs/libssl_iostream_openssl.so: undefined reference to `i_stream_set_name' .libs/libssl_iostream_openssl.so: undefined reference to `buffer_create_dynamic' .libs/libssl_iostream_openssl.so: undefined reference to `pool_alloconly_create' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_set_no_error_handling' .libs/libssl_iostream_openssl.so: undefined reference to `default_pool' .libs/libssl_iostream_openssl.so: undefined reference to `ssl_iostream_has_valid_client_cert' .libs/libssl_iostream_openssl.so: undefined reference to `buffer_free' .libs/libssl_iostream_openssl.so: undefined reference to `t_strdup_printf' .libs/libssl_iostream_openssl.so: undefined reference to `buffer_get_writable_size' .libs/libssl_iostream_openssl.so: undefined reference to `net_ip_compare' .libs/libssl_iostream_openssl.so: undefined reference to `o_stream_cork' .libs/libssl_iostream_openssl.so: undefined reference to `t_str_new' .libs/libssl_iostream_openssl.so: undefined reference to `t_strconcat' collect2: ld returned 1 exit status Error while executing cc -o .libs/test-ssl-iostream -I../../src/lib -I../../src/lib-test -DMODULE_DIR="/usr/local/lib/dovecot" -std=gnu99 -O2 -pipe -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpoi nter-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -I/usr/include -Wl,-E test_ssl_iostream-test-ssl-iostream.o /home/brad/ports/pobj/dovecot-2.2.34-no_db-n o_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-ssl-iostream/.libs/libssl_iostream.a /home/brad/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib-test/.libs/libtest. a /home/brad/ports/pobj/dovecot-2.2.34-no_db-no_ldap-no_mysql-no_postgresql/dovecot-2.2.34/src/lib/.libs/liblib.a -L.libs -lssl_iostream_openssl -lssl -lcrypto -Wl,-rpath,/usr/local/lib/dovecot

2 1

Virtual question
by LuKreme 03 Mar '18

03 Mar '18

“For each virtual directory you need to create a dovecot-virtual file. Its syntax is like:” OK, where does this file get created? Say I want the users to have a virtual mailbox that is messages received in the last month, does that file go into each user' s Maildir path? It sounds like I have to create a virtual folder for each user, then any folders inside that folders, and then the config files in each of the sub folders. user1/Maildir/virtual/month/dovecot-virtual user1/Maildir/virtual/week/dovecot-virtual user1/Maildir/virtual/flagged/dovecot-virtual user1/Maildir/virtual/Amazon/dovecot-virtual user2/Maildir/virtual/month/dovecot-virtual user2/Maildir/virtual/week/dovecot-virtual user2/Maildir/virtual/flagged/dovecot-virtual user2/Maildir/virtual/Amazon/dovecot-virtual Yes? If so, is there anyway to have a "global”virtual that applies to all users (but not that unifies the mail between users or anything like that). Also, will virtual mailboxes show up automatically for the user in the folder list or will they have to specifically subscribe to them? (Assuming they use a client that allows subscribing instead of auto showing all mailboxes like iOS). ˜kremels/ $ cat Maildir/virtual/month/dovecot-vitual # ~/Maildir/virtual/month/dovecot-virtual INBOX work/* all younger 2678400 That should create a mailbox "month” in a folder named "virtual” that shows all the messages from the last 31d, yes? And I should be able to access that mailbox in a MUA like Roundcube or <spit>Thunderbird? -- My main job is trying to come up with new and innovative and effective ways to reject even more mail. I'm up to about 97% now.

4 7

Debian: Dovecot 2.3.0.1 won't start if dovecot-pop3d is missing
by Markus Schönhaber 03 Mar '18

03 Mar '18

Hello, given a Debian 9 system with Dovecot 2.2.34 installed from self-built packages made from the official tarball combined with Stephan Bosch's debian files (upgraded multiple times from packages made in a similar way). Today, I updated this system to 2.3.0.1 from the official repository at repo.dovecot.org. After the update, dovecot wouldn't start because of: > dovecot: master: Fatal: service(pop3) access(/usr/lib/dovecot/pop3) failed: No such file or directory Obviously, installing the dovecot-pop3d package, which provides the pop3 binary, made the error go away. Nevertheless, until v. 2.2.34 not installing the pop3 binary had never been a problem. Trying to solve this, I even commented the following sections in the config (which previously hadn't caused problems since the lines defining the ports etc. had already been commented): > 10-master.conf: > service pop3-login { > inet_listener pop3 { > #port = 110 > } > inet_listener pop3s { > #port = 995 > #ssl = yes > } > } > service pop3 { > # Max. number of POP3 processes (connections) > #process_limit = 1024 > } > 10-director.conf: > service pop3-login { > #executable = pop3-login director > } After those changes I had the configuration shown below, which produced the described error. Why would Dovecot insist that the pop3 binary has to exist on the system? BTW: Note the protocols = line in the doveconf -n output, whereas > # grep -R protocols /etc/dovecot/ > /etc/dovecot/dovecot.conf:# Most (but not all) settings can be overridden by different protocols and/or > /etc/dovecot/dovecot.conf:# Enable installed protocols > /etc/dovecot/dovecot.conf:!include_try /usr/share/dovecot/protocols.d/*.protocol > /etc/dovecot/conf.d/20-managesieve.conf:#protocols = $protocols sieve > /etc/dovecot/conf.d/10-ssl.conf:# SSL protocols to use > /etc/dovecot/conf.d/10-ssl.conf:#ssl_protocols = !SSLv2 > # ll /usr/share/dovecot/protocols.d/ > insgesamt 12 > -rw-r--r-- 1 root root 28 Mär 2 14:51 imapd.protocol > -rw-r--r-- 1 root root 28 Mär 2 14:51 lmtpd.protocol > -rw-r--r-- 1 root root 29 Mär 2 14:51 managesieved.protocol Regards mks doveconf -n # 2.3.0.1 (ffd8a29): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca2) # OS: Linux 4.9.0-6-amd64 x86_64 Debian 9.3 ext4 auth_master_user_separator = * auth_mechanisms = plain login dict { quota = mysql:/etc/dovecot/dovecot-dict-sql.conf.ext } imap_id_log = * mail_home = /var/spool/vmail/home/%d/%n mail_location = mdbox:/var/spool/vmail/mail/%d/%n mail_log_prefix = "%s[%p](%u)<%{session}>: " mail_plugins = " quota acl" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace { list = children location = mdbox:/var/spool/vmail/mail/Public:INDEXPVT=/var/spool/vmail/home/Public prefix = Public/ separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = /etc/dovecot/dovecot-proxy-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-system-sql.conf.ext driver = sql } plugin { acl = vfile mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = dict:User quota::proxy::quota recipient_delimiter = + sieve = file:~/sieve;active=~/.dovecot.sieve sieve_after = /var/spool/vmail/home/1-global/sieve } protocols = imap pop3 lmtp imap lmtp sieve service auth { inet_listener { port = 12345 } unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap_2 { port = 10143 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/ssl/certs/complete.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/master-users default_fields = master_user=%u driver = passwd-file } userdb { args = /etc/dovecot/dovecot-sql.conf.ext default_fields = master_user=%u driver = sql } userdb { args = /etc/dovecot/dovecot-system-sql.conf.ext driver = sql } verbose_proctitle = yes protocol lmtp { mail_plugins = " quota acl quota sieve" postmaster_address = postmaster@<domain> } protocol lda { mail_plugins = " quota acl sieve" } protocol imap { mail_max_userip_connections = 40 mail_plugins = " quota acl imap_quota acl" } remote 192.168.1.116 { protocol imap { disable_plaintext_auth = no } } remote 192.168.1.127 { protocol imap { disable_plaintext_auth = no } }

3 4

Re: Upgrade to 2.3.0.1 bre aks server
by post＠volker-wysk.de 03 Mar '18

03 Mar '18

Another remark: I have installed the new version from the PPA provided by dovecot.org: deb https://repo.dovecot.org/ce-2.3-latest/ubuntu/xenial xenial main Before (2.2.22) I had installed it from the ubuntu (canonical) package sources - and not the PPA provided by dovecot.org. Could it be, that the two don't play together? Bye Volker

1 0

Re: Upgrade to 2.3.0.1 bre aks server
by post＠volker-wysk.de 03 Mar '18

03 Mar '18

Here is my "dovecot -n": # 2.3.0.1 (ffd8a29): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.0.1 (d33dca2) # OS: Linux 4.4.0-116-generic x86_64 Ubuntu 16.04.4 LTS auth_debug = yes auth_username_format = %n auth_verbose = yes hostname = volker-wysk.de log_path = /var/log/dovecot.log mail_debug = yes mail_location = mdbox:~/lib/Dovecot-Mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Entwürfe { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Papierkorb { special_use = \Trash } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox "Versendete Nachrichten" { special_use = \Sent } prefix = separator = . } passdb { driver = pam } plugin { imapsieve_mailbox1_before = file:/usr/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * sieve = ~/.dovecot.sieve sieve_dir = ~/lib/Sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } postmaster_address = post(a)volker-wysk.de protocols = imap lmtp sieve ssl = required ssl_cert = </etc/ssl/certs/dovecot.pem ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { driver = passwd } protocol lmtp { mail_plugins = " sieve mail_log notify" } protocol lda { mail_plugins = " sieve" } protocol imap { mail_max_userip_connections = 50 mail_plugins = " imap_sieve" }

1 0

Upgrade to 2.3.0.1 breaks server
by post＠volker-wysk.de 03 Mar '18

03 Mar '18

Hi I've upgraded dovecot from 2.2.22 to 2.3.0.1, and now I can't log in any longer. My mail client says that the user name and password are rejected by dovecot. I get this messsage in the system logs: % journalctl -u dovecot.service (...) Mär 03 01:39:23 desktop systemd[1]: Stopped Dovecot IMAP/POP3 email server. Mär 03 01:39:23 desktop systemd[1]: Started Dovecot IMAP/POP3 email server. Mär 03 01:39:39 desktop auth[5736]: PAM audit_log_acct_message() failed: Operation not permitted I've followed the instructions in https://wiki2.dovecot.org/Upgrading/2.3 and https://repo.dovecot.org/ (for Ubuntu Xenial). Any ideas..? Bye V.W.

1 0

Autoexpunge of lazy_expunge namespace
by Angel L. Mateo 02 Mar '18

02 Mar '18

Hi, I'm using autoexpunge to clean my users' Trash and Spam mailboxes. But I'm also using lazy_expunge to keep a copy of deleted messages. Is there any to configure lazy_expunge namespace to be autoexpunged too? My lazy_expunge configuration is the "1 Namespace" described at https://wiki2.dovecot.org/Plugins/Lazyexpunge -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 868888337

1 0