- dovecot - dovecot.org

Issue in 2.3.18 with fts_header_excludes/includes
by Alessio Cecchi 03 Mar '22

03 Mar '22

Hi, I'm still doing some test with fts-flatcurve, after updating to 2.3.18 I enabled: fts_header_excludes = * fts_header_includes = From To Cc Bcc Subject Message-ID but when I try to re-index all messages with FTS flatcurve the fts-flatcurve/ folder inside the Maildir/ become huge. Taking for example a Maildir with cur folder of 1.1G the related fts-flatcurve folder passed from 140M to 2.2G. After remove fts_header_excludes/includes config options, and re-index all messages, the fts-flatcurve/ size return to normal size. Is an issue? Thanks -- Alessio Cecchi Postmaster @http://www.qboxmail.it https://www.linkedin.com/in/alessice

1 1

Does disabling POP3 just mean removing it from the `protocols` list?
by Sean McBride 02 Mar '22

02 Mar '22

Hi all, Hopefully a simple question. If I want to disable POP3 support (because everyone is using IMAP anyway), it is just a matter of removing `pop3` from the `protocols` setting in dovecot.conf? Are there side effects or other considerations I should be aware of? Thanks, Sean

7 9

multiple doveadm ports?
by Joachim Lindenberg 02 Mar '22

02 Mar '22

Hello, I am trying to add another doveadm listener but am struggling with that. The primary reason is that I want to enable replication between two systems and want the replication to be encrypted using TLS. However there are also other doveadm clients locally that are not using TLS and I don´t want to touch all of them. I tried to define something like service doveadm { inet_listener { port = 2425 } inet_listener { port = 2426 ssl = true } } But didn´t get that to work. Is that not possible? I also tried service doveadm { inet_listener { port = 2425 } inet_listener http { port = 2426 ssl = yes } } but then I failed with plugin { mail_replica = https:dove2.example.com:2426 } Can someone please share what is supported and what not, or any pointer to documentation that does? Thanks a lot! Regards, Joachim

2 4

Apple Mail behaviour: can not create sub-folders
by Joseph Tam 02 Mar '22

02 Mar '22

One of my Apple Mail users recently complained his mail reader couldn't create sub-folders -- he could only create top-level folders. Playing around with this, I discovered that I could create folders ( as opposed to mialboxes) *if* I specified mailbox name with a trailing slash. Has anyone come across this? Is this related to https://doc.dovecot.org/configuration_manual/mail_location/mbox/mboxchildfo… ? Joseph Tam <jtam.home(a)gmail.com>

2 2

Re: dovecot Digest, Vol 212, Issue 56
by Korehicom 01 Mar '22

01 Mar '22

1 0

Custom Authentication Method
by Matthew R 01 Mar '22

01 Mar '22

Hi guys, we're using Dovecot/Postfix here for our mail system. I'd like to switch the `passdb` authentication on Dovecot from PAM over to a custom implementation. We'd prefer to have some sort of script check the password with an external IAM provider via HTTP. Is there any way we can accomplish this? The idea is to have Dovecot somehow call a script or send a username/password to some service, which checks the username/password against the identity provider and returns a "yes/no" back to Dovecot. `checkpassword` seems like it may work but I see no documentation on its API. Matthew R, AD, FSEN, FSO, FSCR Chief Director of Engineering & Chairman of the Board of Directors Library of Code sp-us matthew(a)staff.libraryofcode.org

3 2

General Locking & Replication Issues
by Paul Kudla (Scom.ca Internet Services Inc.) 01 Mar '22

01 Mar '22

Ok I am running two dovecot servers and feel pretty close to getting things resolved config wise there are however 2 or 3 issues that all seem to be related i have enclosed FULL config files for both mail18.scom.ca & mail19.scom.ca I have a private network that is used for the replication (10.221.0.0/24) - port 12345 is blocked by pf firewall from outside. I am running freebsd 12.1 and built one server and then raid copied it to the second (mail19) so all the ports / builds etc are identical I did start with dovecot-2.3.14 but pigeonhole would not build on freebsd (thanks for that advice / reply )until upgrade to dovecot-2.3.18 dovecot-2.3.18 was built and installed on both servers along with a good build (freebsd build error was fixed after upgrading) dovecot-2.3-pigeonhole-0.5.18 please note that the second mailserver (mail19) is on an nfs share dedicated to the server (i am awaiting sdram drives to replace this issue) but since i am getting errors on both servers i feel nfs share is not the issue (and yes i enabled dlock) mail18 is on normal sdram drives (more of an fyi as i dont think this is the issue) neither mail server is connected to the other in any kind of a shared way - other then replication postfix should be delivering via : pipe -n dovecot -t unix flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${recipient} Replication only works properly at startup (ie the mail boxes do sync), afterwhich nothing seems to trigger the differences between the servers to update (notify i believe) manually running : [05:04:46] mail18.scom.ca [root:0] /usr/local/etc/dovecot # doveadm sync -u paul(a)scom.ca remote:10.221.0.19 & [05:21:18] mail19.scom.ca [root:0] /usr/local/etc/dovecot # doveadm sync -u paul(a)scom.ca remote:10.221.0.18 does seem to work but with mixed results. I also included postfix main.cf & master.cf as well as some googling has indicated the file locking may be on the postfix side ?? Also more then happy to donate just can not figure out how ??? so that being said : General logging errors are as follows ? [04:46:43] peer1.scom.ca [paul:0] /home/paul ## log dovecot rror Filtering by : dovecot & rror mail18 02-28 04:46:58 {dovecot} [30374] (859753649) doveadm(ed(a)scom.ca)<30486><SUtDJMGZHGIWdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:47:00 {dovecot} [22194] (859753669) doveadm(paul(a)scom.ca)<22219><KQzDNbyZHGLLVgAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds mail18 02-28 04:47:05 {dovecot} [30374] (859753724) doveadm(ed.hanna(a)dssmgmt.com)<30484><0dYbI8G ZHGIUdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail18 02-28 04:47:14 {dovecot} [30374] (859753799) doveadm(paul(a)scom.ca)<30485><W/KsI8GZHGIVdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail18 02-28 04:47:57 {dovecot} [30374] (859754250) doveadm(paul(a)paulkudla.net)<30676></v6tIASaH GLUdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail18 02-28 04:49:05 {dovecot} [30374] (859754939) doveadm(keith(a)elirpa.com)<30675><aasfIASaHGL TdwAAz1jc/w>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:54:45 {dovecot} [22194] (859759457) doveadm(paul(a)paulkudla.net)<22533><m1NpN4GbH GIFWAAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:55:07 {dovecot} [22194] (859759868) doveadm(ed(a)scom.ca)<22535><UrLTOYGbHGIHWAAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:55:28 {dovecot} [22194] (859760130) doveadm(ed.hanna(a)dssmgmt.com)<22534><kc2dOIG bHGIGWAAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds mail19 02-28 04:58:52 {dovecot} [22194] (859762842) replicator: Error: Raw backtrace: #0 fatal_handler_real[0x11370e50] -> #1 i_internal_fatal_handler[0x11370f80] -> #2 i_panic[0x112c4456] -> #3 mem_block_alloc.cold[0x112c3d0d] -> #4 t_malloc_real[0x1136a420] -> #5 pool_data_stack_realloc[0x113905f0] -> #6 buffer_alloc[0x11366060] -> #7 buffer_append[0x11366390] -> #8 replicator_queue_push[0x01026fb0] -> #9 dsync_callback[0x01026730] -> #10 dsync_callback[0x01025e60] -> #11 dsync_input[0x010 mail19 02-28 04:58:52 {dovecot} [22194] (859762844) replicator: Error: 0x11388360] -> #14 io_loop_handler_run[0x11386fb0] -> #15 io_loop_run[0x11387130] -> #16 master_service_run[0x112f9c00] -> #17 main[0x01024de0] -> #18 _start[0x01024ff0] -> #19 [unw_get_proc_name() failed: -1] mail19 02-28 04:58:55 {dovecot} [22194] (859762875) doveadm(keith(a)elirpa.com)<22532><zxU4NoGbHGI EWAAA0dxyZQ>: Error: write(<local>) failed: Timed out after 60 seconds Dovecot config for mail18.scom.ca (server - 1) [05:03:57] mail18.scom.ca [root:0] /usr/local/etc/dovecot # cat dovecot.conf # 2.3.14 (cee3cbc0d): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 12.1-RELEASE amd64 # Hostname: mail18.scom.ca auth_debug = no auth_debug_passwords = no mail_debug = no #lock_method = dotlock #mail_max_lock_timeout = 300s #mbox_read_locks = dotlock #mbox_write_locks = dotlock mmap_disable = yes mail_fsync = always mail_nfs_storage = yes mail_nfs_index = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /data/dovecot/run/ debug_log_path = syslog disable_plaintext_auth = no dsync_features = empty-header-workaround #imapc_features = rfc822.size fetch-headers #imapc_host = mail.scom.ca #imapc_password = Pk554669 #imapc_user = paul(a)scom.ca info_log_path = syslog login_greeting = SCOM.CA Internet Services Inc. - Dovecot ready login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_location = maildir:~/ mail_plugins = " virtual" mail_prefetch_count = 20 protocols = imap pop3 sieve mail_plugins = $mail_plugins notify replication protocol lmtp { mail_plugins = $mail_plugins notify replication sieve } protocol lda { mail_plugins = $mail_plugins notify replication sieve } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-pgsql.conf driver = sql } doveadm_port = 12345 doveadm_password = secretxxxx service doveadm { inet_listener { port = 12345 } } #dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u #dsync_remote_cmd = doveadm sync -d -u%u replication_dsync_parameters = -d -N -l 30 -U plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid, box, msgid, from, subject, size, vsize, flags sieve = file:~/sieve/sieve;active=~/sieve/.dovecot.sieve sieve_duplicate_default_period = 1h sieve_duplicate_max_period = 1d mail_replica = tcp:10.221.0.19 #mail_replica = remote:10.221.0.19 replication_sync_timeout = 2 } service anvil { unix_listener anvil { group = vmail mode = 0666 } } service auth { unix_listener /usr/home/postfix/private/auth { mode = 0660 user = postfix group = postfix } } service stats { unix_listener stats-reader { group = vmail mode = 0660 } unix_listener stats-writer { group = vmail mode = 0660 } } userdb { args = /usr/local/etc/dovecot/dovecot-pgsql.conf driver = sql } protocol imap { mail_max_userip_connections = 50 mail_plugins = $mail_plugins notify replication } protocol pop3 { mail_max_userip_connections = 50 mail_plugins = $mail_plugins notify replication } service managesieve-login { inet_listener sieve { port = 4190 } } verbose_proctitle = yes replication_max_conns = 10 replication_full_sync_interval = 30m service replicator { unix_listener replicator-doveadm { mode = 0666 user = vmail } } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } #Addition ssl config !include sni.conf And dovecot-pgsql.conf file (same on both servers) : driver = pgsql connect = host=localhost port=5433 dbname=scom_billing user=pgsql password=Scom411400 default_pass_scheme = PLAIN password_query = SELECT username as user, password FROM email_users WHERE username = '%u' and password <> 'alias' and status = True and destination = '%u' user_query = SELECT home, uid, gid FROM email_users WHERE username = '%u' and password <> 'alias' and status = True and destination = '%u' iterate_query = SELECT user, password FROM email_users WHERE username = '%u' and password <> 'alias' and status = True and destination = '%u' Mail 19 dovecot config file : [05:05:40] mail19.scom.ca [root:0] /usr/local/etc/dovecot # cat dovecot.conf # 2.3.14 (cee3cbc0d): /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 12.1-RELEASE amd64 # Hostname: mail19.scom.ca auth_debug = no auth_debug_passwords = no mail_debug = no #lock_method = dotlock #mail_max_lock_timeout = 5s #mbox_read_locks = dotlock #mbox_write_locks = dotlock mmap_disable = yes mail_fsync = always mail_nfs_storage = yes mail_nfs_index = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /data/dovecot/run/ debug_log_path = syslog disable_plaintext_auth = no dsync_features = empty-header-workaround #imapc_features = rfc822.size fetch-headers #imapc_host = mail.scom.ca #imapc_password = Pk554669 #imapc_user = paul(a)scom.ca info_log_path = syslog login_greeting = SCOM.CA Internet Services Inc. - Dovecot ready login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c mail_location = maildir:~/ mail_plugins = " virtual" mail_prefetch_count = 20 mail_plugins = $mail_plugins notify replication protocols = imap pop3 sieve protocol lmtp { mail_plugins = $mail_plugins notify replication sieve } protocol lda { mail_plugins = $mail_plugins notify replication sieve } namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /usr/local/etc/dovecot/dovecot-pgsql.conf driver = sql } doveadm_port = 12345 doveadm_password = secretxxxx service doveadm { inet_listener { port = 12345 } } #dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u #dsync_remote_cmd = doveadm sync -d -u%u replication_dsync_parameters = -d -N -l 30 -U plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid, box, msgid, from, subject, size, vsize, flags sieve = file:~/sieve/sieve;active=~/sieve/.dovecot.sieve sieve_duplicate_default_period = 1h sieve_duplicate_max_period = 1d mail_replica = tcp:10.221.0.18 #mail_replica = remote:vmail@10.221.0.18 replication_sync_timeout = 2 } service anvil { unix_listener anvil { group = vmail mode = 0666 } } service auth { unix_listener /usr/home/postfix/private/auth { mode = 0660 user = postfix group = postfix } } service stats { unix_listener stats-reader { group = vmail mode = 0660 } unix_listener stats-writer { group = vmail mode = 0660 } } userdb { args = /usr/local/etc/dovecot/dovecot-pgsql.conf driver = sql } protocol imap { mail_max_userip_connections = 50 mail_plugins = $mail_plugins notify replication } protocol pop3 { mail_max_userip_connections = 50 mail_plugins = $mail_plugins notify replication } service managesieve-login { inet_listener sieve { port = 4190 } } verbose_proctitle = yes replication_max_conns = 10 replication_full_sync_interval = 30m service replicator { unix_listener replicator-doveadm { mode = 0666 user = vmail } } service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service replicator { unix_listener replicator-doveadm { mode = 0600 user = vmail } } replication_dsync_parameters = -d -N -l 30 -U #Addition ssl config !include sni.conf sni.conf file (same on both servers) : #sni.conf ssl = yes verbose_ssl = yes ssl_dh =</usr/local/etc/dovecot/dh-4096.pem ssl_prefer_server_ciphers = yes #ssl_min_protocol = TLSv1.2 #Default *.scom.ca ssl_key =</usr/local/etc/dovecot/scom.pem ssl_cert =</usr/local/etc/dovecot/scom.pem ssl_ca =</usr/local/etc/dovecot/scom.pem local_name .scom.ca { ssl_key = /programs/common/getssl.cert -c *.scom.ca -q yes ssl_cert = /programs/common/getssl.cert -c *.scom.ca -q yes ssl_ca = /programs/common/getssl.cert -c *.scom.ca -q yes } local_name mail.clancyca.com { ssl_key = /programs/common/getssl.cert -c mail.clancyca.com -q yes ssl_cert = /programs/common/getssl.cert -c mail.clancyca.com -q yes ssl_ca = /programs/common/getssl.cert -c mail.clancyca.com -q yes } local_name secure.clancyca.com { ssl_key = /programs/common/getssl.cert -c secure.clancyca.com -q yes ssl_cert = /programs/common/getssl.cert -c secure.clancyca.com -q yes ssl_ca = /programs/common/getssl.cert -c secure.clancyca.com -q yes } local_name mail.paulkudla.net { ssl_key = /programs/common/getssl.cert -c mail.paulkudla.net -q yes ssl_cert = /programs/common/getssl.cert -c mail.paulkudla.net -q yes ssl_ca = /programs/common/getssl.cert -c mail.paulkudla.net -q yes } local_name mail.ekst.ca { ssl_key = /programs/common/getssl.cert -c mail.ekst.ca -q yes ssl_cert = /programs/common/getssl.cert -c mail.ekst.ca -q yes ssl_ca = /programs/common/getssl.cert -c mail.ekst.ca -q yes } local_name mail.hamletdevelopments.ca { ssl_key = /programs/common/getssl.cert -c mail.hamletdevelopments.ca -q yes ssl_cert = /programs/common/getssl.cert -c mail.hamletdevelopments.ca -q yes ssl_ca = /programs/common/getssl.cert -c mail.hamletdevelopments.ca -q yes } Postfix main.cf (same on both servers) [05:15:03] mail19.scom.ca [root:0] /usr/home/postfix.local/config # cat main.cf # Global Postfix configuration file. This file lists only a subset # of all parameters. For the syntax, and for a complete parameter # list, see the postconf(5) manual page (command: "man 5 postconf"). # # For common configuration examples, see BASIC_CONFIGURATION_README # and STANDARD_CONFIGURATION_README. To find these documents, use # the command "postconf html_directory readme_directory", or go to # http://www.postfix.org/. # # For best results, change no more than 2-3 parameters at a time, # and test if Postfix still works after every change. alternate_config_directories = /usr/home/postfix/config data_directory = /var/lib/postfix.local maillog_file = /var/log/postfix.local compatibility_level=2 #compatibility_level=3.6 # SOFT BOUNCE # # The soft_bounce parameter provides a limited safety net for # testing. When soft_bounce is enabled, mail will remain queued that # would otherwise bounce. This parameter disables locally-generated # bounces, and prevents the SMTP server from rejecting mail permanently # (by changing 5xx replies into 4xx replies). However, soft_bounce # is no cure for address rewriting mistakes or mail routing mistakes. # soft_bounce = no #relayhost = 216.106.96.23 # LOCAL PATHNAME INFORMATION # # The queue_directory specifies the location of the Postfix queue. # This is also the root directory of Postfix daemons that run chrooted. # See the files in examples/chroot-setup for setting up Postfix chroot # environments on different UNIX systems. # queue_directory = /usr/home/postfix.local # The command_directory parameter specifies the location of all # postXXX commands. # command_directory = /usr/local/sbin # The daemon_directory parameter specifies the location of all Postfix # daemon programs (i.e. programs listed in the master.cf file). This # directory must be owned by root. # daemon_directory = /usr/local/libexec/postfix # QUEUE AND PROCESS OWNERSHIP # # The mail_owner parameter specifies the owner of the Postfix queue # and of most Postfix daemon processes. Specify the name of a user # account THAT DOES NOT SHARE ITS USER OR GROUP ID WITH OTHER ACCOUNTS # AND THAT OWNS NO OTHER FILES OR PROCESSES ON THE SYSTEM. In # particular, don't specify nobody or daemon. PLEASE USE A DEDICATED # USER. # mail_owner = postfix # The default_privs parameter specifies the default rights used by # the local delivery agent for delivery to external file or command. # These rights are used in the absence of a recipient user context. # DO NOT SPECIFY A PRIVILEGED USER OR THE POSTFIX OWNER. # #default_privs = nobody # INTERNET HOST AND DOMAIN NAMES # # The myhostname parameter specifies the internet hostname of this # mail system. The default is to use the fully-qualified domain name # from gethostname(). $myhostname is used as a default value for many # other configuration parameters. # #myhostname = localhost myhostname = mail19.scom.ca # The mydomain parameter specifies the local internet domain name. # The default is to use $myhostname minus the first component. # $mydomain is used as a default value for many other configuration # parameters. # #mydomain = localhost mydomain = mail19.scom.ca # SENDING MAIL # # The myorigin parameter specifies the domain that locally-posted # mail appears to come from. The default is to append $myhostname, # which is fine for small sites. If you run a domain with multiple # machines, you should (1) change this to $mydomain and (2) set up # a domain-wide alias database that aliases each user to # user(a)that.users.mailhost. # # For the sake of consistency between sender and recipient addresses, # myorigin also specifies the default domain name that is appended # to recipient addresses that have no @domain part. # myorigin = $myhostname #myorigin = $mydomain # RECEIVING MAIL # The inet_interfaces parameter specifies the network interface # addresses that this mail system receives mail on. By default, # the software claims all active interfaces on the machine. The # parameter also controls delivery of mail to user(a)[ip.address]. # # See also the proxy_interfaces parameter, for network addresses that # are forwarded to us via a proxy or network address translator. # # Note: you need to stop/start Postfix when this parameter changes. # inet_interfaces = 127.0.0.1 #inet_interfaces = $myhostname #inet_interfaces = $myhostname, localhost, 76.74.132.2 #inet_interfaces = mail.dsl.scom.ca, dsl.scom.ca # The proxy_interfaces parameter specifies the network interface # addresses that this mail system receives mail on by way of a # proxy or network address translation unit. This setting extends # the address list specified with the inet_interfaces parameter. # # You must specify your proxy/NAT addresses when your system is a # backup MX host for other domains, otherwise mail delivery loops # will happen when the primary MX host is down. # #proxy_interfaces = #proxy_interfaces = 1.2.3.4 # The mydestination parameter specifies the list of domains that this # machine considers itself the final destination for. # # These domains are routed to the delivery agent specified with the # local_transport parameter setting. By default, that is the UNIX # compatible delivery agent that lookups all recipients in /etc/passwd # and /etc/aliases or their equivalent. # # The default is $myhostname + localhost.$mydomain. On a mail domain # gateway, you should also include $mydomain. # # Do not specify the names of virtual domains - those domains are # specified elsewhere (see VIRTUAL_README). # # Do not specify the names of domains that this machine is backup MX # host for. Specify those names via the relay_domains settings for # the SMTP server, or use permit_mx_backup if you are lazy (see # STANDARD_CONFIGURATION_README). # # The local machine is always the final destination for mail addressed # to user(a)[the.net.work.address] of an interface that the mail system # receives mail on (see the inet_interfaces parameter). # # Specify a list of host or domain names, /file/name or type:table # patterns, separated by commas and/or whitespace. A /file/name # pattern is replaced by its contents; a type:table is matched when # a name matches a lookup key (the right-hand side is ignored). # Continue long lines by starting the next line with whitespace. # # See also below, section "REJECTING MAIL FOR UNKNOWN LOCAL USERS". # #mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain #mydestination = $myhostname, localhost.$mydomain, localhost, $mydomain, # mail.$mydomain, www.$mydomain, ftp.$mydomain # REJECTING MAIL FOR UNKNOWN LOCAL USERS # # The local_recipient_maps parameter specifies optional lookup tables # with all names or addresses of users that are local with respect # to $mydestination, $inet_interfaces or $proxy_interfaces. # # If this parameter is defined, then the SMTP server will reject # mail for unknown local users. This parameter is defined by default. # # To turn off local recipient checking in the SMTP server, specify # local_recipient_maps = (i.e. empty). # # The default setting assumes that you use the default Postfix local # delivery agent for local delivery. You need to update the # local_recipient_maps setting if: # # - You define $mydestination domain recipients in files other than # /etc/passwd, /etc/aliases, or the $virtual_alias_maps files. # For example, you define $mydestination domain recipients in # the $virtual_mailbox_maps files. # # - You redefine the local delivery agent in master.cf. # # - You redefine the "local_transport" setting in main.cf. # # - You use the "luser_relay", "mailbox_transport", or "fallback_transport" # feature of the Postfix local delivery agent (see local(8)). # # Details are described in the LOCAL_RECIPIENT_README file. # # Beware: if the Postfix SMTP server runs chrooted, you probably have # to access the passwd file via the proxymap service, in order to # overcome chroot restrictions. The alternative, having a copy of # the system passwd file in the chroot jail is just not practical. # # The right-hand side of the lookup tables is conveniently ignored. # In the left-hand side, specify a bare username, an @domain.tld # wild-card, or specify a user(a)domain.tld address. # local_recipient_maps = unix:passwd.byname $alias_maps #local_recipient_maps = proxy:unix:passwd.byname $alias_maps #local_recipient_maps = # The unknown_local_recipient_reject_code specifies the SMTP server # response code when a recipient domain matches $mydestination or # ${proxy,inet}_interfaces, while $local_recipient_maps is non-empty # and the recipient address or address local-part is not found. # # The default setting is 550 (reject mail) but it is safer to start # with 450 (try again later) until you are certain that your # local_recipient_maps settings are OK. # #unknown_local_recipient_reject_code = 450 #Set by Mailscanner # TRUST AND RELAY CONTROL # The mynetworks parameter specifies the list of "trusted" SMTP # clients that have more privileges than "strangers". # # In particular, "trusted" SMTP clients are allowed to relay mail # through Postfix. See the smtpd_recipient_restrictions parameter # in postconf(5). # # You can specify the list of "trusted" network addresses by hand # or you can let Postfix do it for you (which is the default). # # By default (mynetworks_style = subnet), Postfix "trusts" SMTP # clients in the same IP subnetworks as the local machine. # On Linux, this does works correctly only with interfaces specified # with the "ifconfig" command. # # Specify "mynetworks_style = class" when Postfix should "trust" SMTP # clients in the same IP class A/B/C networks as the local machine. # Don't do this with a dialup site - it would cause Postfix to "trust" # your entire provider's network. Instead, specify an explicit # mynetworks list by hand, as described below. # # Specify "mynetworks_style = host" when Postfix should "trust" # only the local machine. # #mynetworks_style = class #mynetworks_style = subnet #mynetworks_style = host # Alternatively, you can specify the mynetworks list by hand, in # which case Postfix ignores the mynetworks_style setting. # # Specify an explicit list of network/netmask patterns, where the # mask specifies the number of bits in the network part of a host # address. # # You can also specify the absolute pathname of a pattern file instead # of listing the patterns here. Specify type:table for table-based lookups # (the value on the table right-hand side is not used). # mynetworks = 127.0.0.0/8 65.39.148.0/26 10.220.0.0/16 10.221.0.0/16 #mynetworks = $config_directory/mynetworks #mynetworks = hash:/usr/local/etc/postfix/network_table # The relay_domains parameter restricts what destinations this system will # relay mail to. See the smtpd_recipient_restrictions description in # postconf(5) for detailed information. # # By default, Postfix relays mail # - from "trusted" clients (IP address matches $mynetworks) to any destination, # - from "untrusted" clients to destinations that match $relay_domains or # subdomains thereof, except addresses with sender-specified routing. # The default relay_domains value is $mydestination. # # In addition to the above, the Postfix SMTP server by default accepts mail # that Postfix is final destination for: # - destinations that match $inet_interfaces or $proxy_interfaces, # - destinations that match $mydestination # - destinations that match $virtual_alias_domains, # - destinations that match $virtual_mailbox_domains. # These destinations do not need to be listed in $relay_domains. # # Specify a list of hosts or domains, /file/name patterns or type:name # lookup tables, separated by commas and/or whitespace. Continue # long lines by starting the next line with whitespace. A file name # is replaced by its contents; a type:name table is matched when a # (parent) domain appears as lookup key. # # NOTE: Postfix will not automatically forward mail for domains that # list this system as their primary or backup MX host. See the # permit_mx_backup restriction description in postconf(5). # relay_domains = $mydestination # INTERNET OR INTRANET # The relayhost parameter specifies the default host to send mail to # when no entry is matched in the optional transport(5) table. When # no relayhost is given, mail is routed directly to the destination. # # On an intranet, specify the organizational domain name. If your # internal DNS uses no MX records, specify the name of the intranet # gateway host instead. # # In the case of SMTP, specify a domain, host, host:port, [host]:port, # [address] or [address]:port; the form [host] turns off MX lookups. # # If you're connected via UUCP, see also the default_transport parameter. # #relayhost = [gateway.my.domain] #relayhost = [mailserver.isp.tld] #relayhost = uucphost #relayhost = [an.ip.add.ress] # REJECTING UNKNOWN RELAY USERS # # The relay_recipient_maps parameter specifies optional lookup tables # with all addresses in the domains that match $relay_domains. # # If this parameter is defined, then the SMTP server will reject # mail for unknown relay users. This feature is off by default. # # The right-hand side of the lookup tables is conveniently ignored. # In the left-hand side, specify an @domain.tld wild-card, or specify # a user(a)domain.tld address. # #relay_recipient_maps = hash:/usr/local/etc/postfix/relay_recipients # INPUT RATE CONTROL # # The in_flow_delay configuration parameter implements mail input # flow control. This feature is turned on by default, although it # still needs further development (it's disabled on SCO UNIX due # to an SCO bug). # # A Postfix process will pause for $in_flow_delay seconds before # accepting a new message, when the message arrival rate exceeds the # message delivery rate. With the default 100 SMTP server process # limit, this limits the mail inflow to 100 messages a second more # than the number of messages delivered per second. # # Specify 0 to disable the feature. Valid delays are 0..10. # #in_flow_delay = 1s # ADDRESS REWRITING # # The ADDRESS_REWRITING_README document gives information about # address masquerading or other forms of address rewriting including # username->Firstname.Lastname mapping. # ADDRESS REDIRECTION (VIRTUAL DOMAIN) # # The VIRTUAL_README document gives information about the many forms # of domain hosting that Postfix supports. # "USER HAS MOVED" BOUNCE MESSAGES # # See the discussion in the ADDRESS_REWRITING_README document. # TRANSPORT MAP # # See the discussion in the ADDRESS_REWRITING_README document. # ALIAS DATABASE # # The alias_maps parameter specifies the list of alias databases used # by the local delivery agent. The default list is system dependent. # # On systems with NIS, the default is to search the local alias # database, then the NIS alias database. See aliases(5) for syntax # details. # # If you change the alias database, run "postalias /etc/aliases" (or # wherever your system stores the mail alias file), or simply run # "newaliases" to build the necessary DBM or DB file. # # It will take a minute or so before changes become visible. Use # "postfix reload" to eliminate the delay. # #alias_maps = dbm:/etc/aliases alias_maps = hash:/usr/home/postfix/config/aliases #alias_maps = hash:/etc/aliases, nis:mail.aliases #alias_maps = netinfo:/aliases # The alias_database parameter specifies the alias database(s) that # are built with "newaliases" or "sendmail -bi". This is a separate # configuration parameter, because alias_maps (see above) may specify # tables that are not necessarily all under control by Postfix. # #alias_database = dbm:/etc/aliases #alias_database = dbm:/etc/mail/aliases alias_database = hash:/etc/postfix/aliases #alias_database = hash:/etc/aliases, hash:/opt/majordomo/aliases # ADDRESS EXTENSIONS (e.g., user+foo) # # The recipient_delimiter parameter specifies the separator between # user names and address extensions (user+foo). See canonical(5), # local(8), relocated(5) and virtual(5) for the effects this has on # aliases, canonical, virtual, relocated and .forward file lookups. # Basically, the software tries user+foo and .forward+foo before # trying user and .forward. # recipient_delimiter = + # DELIVERY TO MAILBOX # # The home_mailbox parameter specifies the optional pathname of a # mailbox file relative to a user's home directory. The default # mailbox file is /var/spool/mail/user or /var/mail/user. Specify # "Maildir/" for qmail-style delivery (the / is required). # #home_mailbox = Mailbox #home_mailbox = Maildir/ # The mail_spool_directory parameter specifies the directory where # UNIX-style mailboxes are kept. The default setting depends on the # system type. # #mail_spool_directory = /var/mail # The mailbox_command parameter specifies the optional external # command to use instead of mailbox delivery. The command is run as # the recipient with proper HOME, SHELL and LOGNAME environment settings. # Exception: delivery for root is done as $default_user. # # Other environment variables of interest: USER (recipient username), # EXTENSION (address extension), DOMAIN (domain part of address), # and LOCAL (the address localpart). # # Unlike other Postfix configuration parameters, the mailbox_command # parameter is not subjected to $parameter substitutions. This is to # make it easier to specify shell syntax (see example below). # # Avoid shell meta characters because they will force Postfix to run # an expensive shell process. Procmail alone is expensive enough. # # IF YOU USE THIS TO DELIVER MAIL SYSTEM-WIDE, YOU MUST SET UP AN # ALIAS THAT FORWARDS MAIL FOR ROOT TO A REAL USER. # #mailbox_command = /some/where/procmail #mailbox_command = /some/where/procmail -a "$EXTENSION" # The mailbox_transport specifies the optional transport in master.cf # to use after processing aliases and .forward files. This parameter # has precedence over the mailbox_command, fallback_transport and # luser_relay parameters. # # Specify a string of the form transport:nexthop, where transport is # the name of a mail delivery transport defined in master.cf. The # :nexthop part is optional. For more details see the sample transport # configuration file. # # NOTE: if you use this feature for accounts not in the UNIX password # file, then you must update the "local_recipient_maps" setting in # the main.cf file, otherwise the SMTP server will reject mail for # non-UNIX accounts with "User unknown in local recipient table". # mailbox_transport = dovecot # The fallback_transport specifies the optional transport in master.cf # to use for recipients that are not found in the UNIX passwd database. # This parameter has precedence over the luser_relay parameter. # # Specify a string of the form transport:nexthop, where transport is # the name of a mail delivery transport defined in master.cf. The # :nexthop part is optional. For more details see the sample transport # configuration file. # # NOTE: if you use this feature for accounts not in the UNIX password # file, then you must update the "local_recipient_maps" setting in # the main.cf file, otherwise the SMTP server will reject mail for # non-UNIX accounts with "User unknown in local recipient table". # #fallback_transport = lmtp:unix:/file/name #fallback_transport = cyrus #fallback_transport = # The luser_relay parameter specifies an optional destination address # for unknown recipients. By default, mail for unknown@$mydestination, # unknown@[$inet_interfaces] or unknown@[$proxy_interfaces] is returned # as undeliverable. # # The following expansions are done on luser_relay: $user (recipient # username), $shell (recipient shell), $home (recipient home directory), # $recipient (full recipient address), $extension (recipient address # extension), $domain (recipient domain), $local (entire recipient # localpart), $recipient_delimiter. Specify ${name?value} or # ${name:value} to expand value only when $name does (does not) exist. # # luser_relay works only for the default Postfix local delivery agent. # # NOTE: if you use this feature for accounts not in the UNIX password # file, then you must specify "local_recipient_maps =" (i.e. empty) in # the main.cf file, otherwise the SMTP server will reject mail for # non-UNIX accounts with "User unknown in local recipient table". # #luser_relay = $user(a)other.host #luser_relay = $local(a)other.host #luser_relay = admin+$local # JUNK MAIL CONTROLS # # The controls listed here are only a very small subset. The file # SMTPD_ACCESS_README provides an overview. # The header_checks parameter specifies an optional table with patterns # that each logical message header is matched against, including # headers that span multiple physical lines. # # By default, these patterns also apply to MIME headers and to the # headers of attached messages. With older Postfix versions, MIME and # attached message headers were treated as body text. # # For details, see "man header_checks". # #header_checks = regexp:/usr/local/etc/postfix/header_checks #Divert to Hold Queue #header_checks = regexp:/etc/postfix/header_checks # FAST ETRN SERVICE # # Postfix maintains per-destination logfiles with information about # deferred mail, so that mail can be flushed quickly with the SMTP # "ETRN domain.tld" command, or by executing "sendmail -qRdomain.tld". # See the ETRN_README document for a detailed description. # # The fast_flush_domains parameter controls what destinations are # eligible for this service. By default, they are all domains that # this server is willing to relay mail to. # #fast_flush_domains = $relay_domains # SHOW SOFTWARE VERSION OR NOT # # The smtpd_banner parameter specifies the text that follows the 220 # code in the SMTP server's greeting banner. Some people like to see # the mail version advertised. By default, Postfix shows no version. # # You MUST specify $myhostname at the start of the text. That is an # RFC requirement. Postfix itself does not care. # #smtpd_banner = $myhostname ESMTP $mail_name #smtpd_banner = $myhostname ESMTP $mail_name ($mail_version) # PARALLEL DELIVERY TO THE SAME DESTINATION # # How many parallel deliveries to the same user or domain? With local # delivery, it does not make sense to do massively parallel delivery # to the same user, because mailbox updates must happen sequentially, # and expensive pipelines in .forward files can cause disasters when # too many are run at the same time. With SMTP deliveries, 10 # simultaneous connections to the same domain could be sufficient to # raise eyebrows. # # Each message delivery transport has its XXX_destination_concurrency_limit # parameter. The default is $default_destination_concurrency_limit for # most delivery transports. For the local delivery agent the default is 2. #local_destination_concurrency_limit = 1 #2 #default_destination_concurrency_limit = 100 #20 # DEBUGGING CONTROL # # The debug_peer_level parameter specifies the increment in verbose # logging level when an SMTP client or server host name or address # matches a pattern in the debug_peer_list parameter. # debug_peer_level = 9 # The debug_peer_list parameter specifies an optional list of domain # or network patterns, /file/name patterns or type:name tables. When # an SMTP client or server host name or address matches a pattern, # increase the verbose logging level by the amount specified in the # debug_peer_level parameter. # #debug_peer_list = 127.0.0.1 #debug_peer_list = some.domain # The debugger_command specifies the external command that is executed # when a Postfix daemon program is run with the -D option. # # Use "command .. & sleep 5" so that the debugger can attach before # the process marches on. If you use an X-based debugger, be sure to # set up your XAUTHORITY environment variable before starting Postfix. # debugger_command = PATH=/bin:/usr/bin:/usr/local/bin:/usr/X11R6/bin xxgdb $daemon_directory/$process_name $process_id & sleep 5 # If you can't use X, use this to capture the call stack when a # daemon crashes. The result is in a file in the configuration # directory, and is named after the process name and the process ID. # # debugger_command = # PATH=/bin:/usr/bin:/usr/local/bin; export PATH; (echo cont; # echo where) | gdb $daemon_directory/$process_name $process_id 2>&1 # >$config_directory/$process_name.$process_id.log & sleep 5 # # Another possibility is to run gdb under a detached screen session. # To attach to the screen sesssion, su root and run "screen -r # <id_string>" where <id_string> uniquely matches one of the detached # sessions (from "screen -list"). # # debugger_command = # PATH=/bin:/usr/bin:/sbin:/usr/sbin; export PATH; screen # -dmS $process_name gdb $daemon_directory/$process_name # $process_id & sleep 1 # INSTALL-TIME CONFIGURATION INFORMATION # # The following parameters are used when installing a new Postfix version. # # sendmail_path: The full pathname of the Postfix sendmail command. # This is the Sendmail-compatible mail posting interface. # sendmail_path = /usr/local/sbin/sendmail # newaliases_path: The full pathname of the Postfix newaliases command. # This is the Sendmail-compatible command to build alias databases. # newaliases_path = /usr/local/bin/newaliases # mailq_path: The full pathname of the Postfix mailq command. This # is the Sendmail-compatible mail queue listing command. # mailq_path = /usr/local/bin/mailq # setgid_group: The group for mail submission and queue management # commands. This must be a group name with a numerical group ID that # is not shared with other accounts, not even with the Postfix account. # setgid_group = maildrop # html_directory: The location of the Postfix HTML documentation. # html_directory = no # manpage_directory: The location of the Postfix on-line manual pages. # manpage_directory = /usr/local/man # sample_directory: The location of the Postfix sample configuration files. # This parameter is obsolete as of Postfix 2.1. # #sample_directory = /usr/local/etc/postfix # readme_directory: The location of the Postfix README files. # #readme_directory = no #Auth Stuff smtpd_sasl_auth_enable = yes broken_sasl_auth_clients = yes smtpd_sasl_security_options = noanonymous smtpd_sasl_authenticated_header = yes smtpd_sasl_local_domain = $myhostname smtpd_sasl_path = smtpd smtpd_recipient_restrictions = permit_sasl_authenticated, permit_mynetworks reject_unauth_destination, #check_policy_service unix:private/policyd-spf #TLS Stuff #TLS Stuff #smtpd_tls_mandatory_protocols = !SSLv2,!SSLv3,!TLSv1 #smtp_tls_mandatory_protocols = !SSLv2,!SSLv3,!TLSv1 #smtpd_tls_protocols = !SSLv2,!SSLv3,!TLSv1 #smtp_tls_protocols = !SSLv2,!SSLv3,!TLSv1 smtpd_tls_exclude_ciphers = RC4, aNULL smtpd_tls_ask_ccert = yes smtpd_tls_security_level = may smtp_tls_security_level = may smtpd_tls_req_ccert = no smtpd_tls_auth_only = no smtpd_tls_loglevel = 2 smtp_tls_loglevel = 2 smtpd_use_tls = yes smtp_tls_chain_files = /etc/ssl/.scom.ca smtp_use_tls = yes smtp_tls_chain_files = /etc/ssl/.scom.ca smtpd_tls_session_cache_database = btree:${queue_directory}/smtpd_scache smtp_tls_session_cache_database = btree:${queue_directory}/smtp_scache smtp_tls_CApath = /etc/ssl/certs smtpd_tls_CApath = /etc/ssl/certs #Sort out hard bounce to softbounce smtp_reply_filter = pcre:/usr/home/postfix.local/config/smtp_5xx_to_4xx #General Options delay_warning_time = 1h mailbox_size_limit = 0 message_size_limit = 1000000000 #Mailscanner Options #header_checks = regexp:/usr/local/etc/postfix/header_checks unknown_local_recipient_reject_code = 550 #Dovecot stuff #Postgres Stuff #Temp off till i am a mail server mydestination = pgsql:/usr/home/postfix/config/pgsql-mydestination.cf virtual_maps=pgsql:/usr/home/postfix/config/pgsql-virtual.cf #Dovecot Stuff? dovecot_destination_recipient_limit = 1 virtual_transport = dovecot #Spf filter #policy_time_limit = 3600 #Other restrictions strict_rfc821_envelopes = yes smtpd_client_connection_count_limit = 1000 default_process_limit = 100 #minimal_backoff_time = 300s #maximal_backoff_time = 600s #queue_run_delay = 300s #Duplicate suppresion #enable_original_recipient = no #smtpd_discard_ehlo_keywords = silent-discard, dsn milter_default_action = accept milter_protocol = 6 smtpd_milters = inet:localhost:8891 non_smtpd_milters = inet:localhost:8891 #virtual_mailbox_lock = dotlock Postfix Master.cf : [05:16:09] mail19.scom.ca [root:0] /usr/home/postfix.local/config # cat master.cf # # Postfix master process configuration file. For details on the format # of the file, see the master(5) manual page (command: "man 5 master"). # # Do not forget to execute "postfix reload" after editing this file. # # ========================================================================== # service type private unpriv chroot wakeup maxproc command + args # (yes) (yes) (yes) (never) (100) # ========================================================================== #smtp inet n - n - - smtpd #submission inet n - n - - smtpd #465 inet n - n - - smtpd #995 inet n - n - - smtpd 61220 inet n - n - - smtpd # -o smtpd_tls_security_level=encrypt # -o smtpd_sasl_auth_enable=yes # -o smtpd_client_restrictions=permit_sasl_authenticated,reject # -o milter_macro_daemon_name=ORIGINATING #smtps inet n - n - - smtpd # -o smtpd_tls_wrappermode=yes # -o smtpd_sasl_auth_enable=yes # -o smtpd_client_restrictions=permit_sasl_authenticated,reject # -o milter_macro_daemon_name=ORIGINATING #628 inet n - n - - qmqpd pickup fifo n - n 60 1 pickup cleanup unix n - n - 0 cleanup qmgr fifo n - n 300 1 qmgr #qmgr fifo n - n 300 1 oqmgr tlsmgr unix - - n 1000? 1 tlsmgr rewrite unix - - n - - trivial-rewrite bounce unix - - n - 0 bounce defer unix - - n - 0 bounce trace unix - - n - 0 bounce verify unix - - n - 1 verify flush unix n - n 1000? 0 flush proxymap unix - - n - - proxymap proxywrite unix - - n - 1 proxymap smtp unix - - n - - smtp # When relaying mail as backup MX, disable fallback_relay to avoid MX loops relay unix - - n - - smtp -o smtp_fallback_relay= # -o smtp_helo_timeout=5 -o smtp_connect_timeout=5 showq unix n - n - - showq error unix - - n - - error retry unix - - n - - error discard unix - - n - - discard local unix - n n - - local virtual unix - n n - - virtual lmtp unix - - n - - lmtp anvil unix - - n - 1 anvil scache unix - - n - 1 scache # # ==================================================================== # Interfaces to non-Postfix software. Be sure to examine the manual # pages of the non-Postfix software to find out what options it wants. # # Many of the following services use the Postfix pipe(8) delivery # agent. See the pipe(8) man page for information about ${recipient} # and other message envelope options. # ==================================================================== # # maildrop. See the Postfix MAILDROP_README file for details. # Also specify in main.cf: maildrop_destination_recipient_limit=1 # #maildrop unix - n n - - pipe # flags=DRhu user=vmail argv=/usr/local/bin/maildrop -d ${recipient} # # ==================================================================== # # The Cyrus deliver program has changed incompatibly, multiple times. # #old-cyrus unix - n n - - pipe # flags=R user=cyrus argv=/usr/local/cyrus/bin/deliver -e -m ${extension} ${user} # # ==================================================================== # # Cyrus 2.1.5 (Amos Gouaux) # Also specify in main.cf: cyrus_destination_recipient_limit=1 # #cyrus unix - n n - - pipe # user=cyrus argv=/usr/local/cyrus/bin/deliver -e -r ${sender} -m ${extension} ${recipient} # # ==================================================================== # # See the Postfix UUCP_README file for configuration details. # #uucp unix - n n - - pipe # flags=Fqhu user=uucp argv=uux -r -n -z -a$sender - $nexthop!rmail ($recipient) # # ==================================================================== # # Other external delivery methods. # #ifmail unix - n n - - pipe # flags=F user=ftn argv=/usr/lib/ifmail/ifmail -r $nexthop ($recipient) # #bsmtp unix - n n - - pipe # flags=Fq. user=bsmtp argv=/usr/local/sbin/bsmtp -f $sender $nexthop $recipient # #scalemail-backend unix - n n - 2 pipe # flags=R user=scalemail argv=/usr/lib/scalemail/bin/scalemail-store # ${nexthop} ${user} ${extension} # #mailman unix - n n - - pipe # flags=FR user=list argv=/usr/lib/mailman/bin/postfix-to-mailman.py # ${nexthop} ${user} dovecot unix - n n - - pipe flags=DRhu user=vmail:vmail argv=/usr/local/libexec/dovecot/deliver -f ${sender} -d ${recipient} policyd-spf unix - n n - - spawn user=nobody argv=/usr/local/bin/policyd-spf postlog unix-dgram n - n - 1 postlogd -- Happy Monday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266

2 1

Build with MySQL -> libmysqlclient not found
by Dimitri 28 Feb '22

28 Feb '22

> John: > > ./configure --help > > might also be a good idea, I think it might have some options like: > > --mysql-libs=/path/to/lib > --mysql-includes=/path/to/include > > or something similiar to use. Unfortunately not, just the "--with-mysql" Option. > Oscar: > > You might need CPPFLAGS as well. (e.g. CPPFLAGS="-I/test/core/mariadb/include") > Check also "config.log" for errors. I had already done both, just forgot to mention it. But i should have looked further. Near the end of config.log is saw: ================================ > | /* Override any GCC internal prototype to avoid an error. > | Use char because int might match the return type of a GCC > | builtin and then its argument prototype would still apply. */ > | #ifdef __cplusplus > | extern "C" > | #endif > | char mysql_init (); > | int > | main () > | { > | return mysql_init (); > | ; > | return 0; > | } > configure:23386: result: noconfigure:23520: error: Can't build with MySQL support: libmysqlclient not found ================================ and thought that wouldn't help me. Now i looked again but further up an saw: ================================ > configure:23377: gcc -o conftest -std=gnu99 -g -O2 -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -mfunction-return=keep -mindirect-branch=keep -Wall -W -Wmissing-prototypes -Wmissing-declarations> ... > /usr/bin/ld: cannot find -lzcollect2: error: ld returned 1 exit status ================================ Zlib i have (of course ;) ) also compiled from source. After adding "/test/dep/zlib/include" to CPPFLAGS and "/test/dep/zlib/lib" to LDFLAGS the configuration runs without errors. However i don't understand why the configuration-script takes the non-standard path for openssl automatically and correctly from the PKG_CONFIG_PATH, but the paths to my zlib and mariadb installations, which i also set in PKG_CONFIG_PATH not...

3 3

Build with MySQL -> libmysqlclient not found
by Dimitri 28 Feb '22

28 Feb '22

Hi folks, just step into another problem and don't know why? If i try to configure dovecot with the following: > ./configure --prefix=/test/core/dovecot --with-ssldir=/test/core/dovecot/tls --with-mysql i get > ... > checking for auth_userokay... no > checking for mysql_config... NO > checking for mysql_init in -lmysqlclient... noconfigure: error: Can't build with MySQL support: libmysqlclient not found After that i've tried to configure with following: > LDFLAGS="-L/test/core/mariadb/lib" ./configure --prefix=/test/core/dovecot --with-ssldir=/test/core/dovecot/tls --with-mysql but with same result. The Content of "/test/core/mariadb/lib" is: libmariadbclient.a libmariadb.so -> libmariadb.so.3 libmariadb.so.3 libmysqlclient.a -> libmariadbclient.a libmysqlclient_r.a -> libmariadbclient.a libmysqlclient_r.so -> libmariadb.so.3 libmysqlclient.so -> libmariadb.so.3 libmysqlservices.a pkgconfigplugin Also the Path "/test/core/mariadb/lib/pkgconfig" is in the PKG_CONFIG_PATH variable and the Library-Path "/test/core/mariadb/lib" is known by the dynamic linker (/etc/ld.so.conf.d/mylibs.conf). So what am i doing wrong? My Dovecot version: 2.3.18 My Mariadb version: 10.6.5 My OS: Ubuntu 20.04

4 4

Build with MySQL -> libmysqlclient not found
by Dimitri 27 Feb '22

27 Feb '22

> Why aren't you just using the Ubuntu 20.04 packaged version instead? > > Also, did you install the headers for libmysqlclient properly as > > well? > > What does /test/core/mariadb/includes/ or > > /test/core/includes/... show? Hi John, i just want to manage all the software manually, use own directorie-structur and have all the programs in one place, deepen my understanding how these programs work and build these programs only with the components i need. The content of "/test/core/mariadb/include/mysql" is: > errmsg.h > ma_list.h > ma_pvio.h > mariadb/ > mariadb/ma_io.h > mariadb_com.h > mariadb_ctype.h > mariadb_dyncol.h > mariadb_rpl.h > mariadb_stmt.h > mariadb_version.h > ma_tls.h > my_config.h > my_global.h > mysql/ > mysql/client_plugin.h > mysql/plugin_auth_common.h > mysql/plugin_auth.h > mysql_com.h > mysqld_error.h > mysql.h > mysql_version.h > my_sys.h > server/...

1 0

email location - files or sql
by Robert Moskowitz 25 Feb '22

25 Feb '22

I have been running a Dovecot based mail server for over 10 years and it is time (really past) to upgrade. I really don't want to roll my own anymore. Too much time and too many skills needed. Time to retire. But still want it 'in-house'. What I am seeing is that many of the packages seem to roll the messages into some SQL database. My Dovecot setup uses the /home/vmail/doman/../{cur,new,etc} tree structure. Is there any pros vs cons on this that I can read? Is there some nice packed mailserver I can drop on a Centos-arm server that has Dovecot under the covers and I can easily rsync my current mail store to it? Mail-in-a-box looks interesting. But I have not figured out its internals and if I have to worry about anything compiled for arm that is not part of the distro. Thanks in advance for help.

5 7

Messages reappearing in mailboxes as duplicates
by Andrew Skipper 23 Feb '22

23 Feb '22

Hello, We have 3 nodes running, with a two way replication between 2 of them and a 1 way replication to a DR node running off one. We use mdbox, and directors to split traffic across nodes. There is no shared file system. Users are experiencing messages reappearing in their INBOX as unread with duplicate GUID and message headers. This occurs generally several days after a message was first received (and often actioned; read, moved, trashed, expunged, also often bulk moved/deleted). We have attempted to remove replication from the equation by cutting down to one single node with all replication disabled which did not have any impact. We have also started regular cache and mailbox purging. There are no logged events when mail items reappear, and we only observe it based on user report, mailbox inspection (doveadm looking for duplicate GUIDs/unique message headers) or seeing IMAP commands being done against the same message twice (e.g. monday they copy to trash, delete and expunge from inbox, delete and expunge from trash, then the next monday they will have to do the same for the reappearing message). OS: Centos 7 Dovecot: dovecot -version Scheduled jobs: */15 0 * * 0 doveadm sync -u "*" tcps:<dr node>:12345 > /var/log/dovecot/dr_sync.log 2>&1 1 3 * * * doveadm mailbox cache purge -A INBOX 21 3 * * * doveadm mailbox cache purge -A Trash 0 1 * * 0 /usr/bin/doveadm purge -A >/dev/null 2>&1 Conf: dovecot -n # 2.3.16 (7e2e900c1a): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-1160.53.1.el7.x86_64 x86_64 CentOS Linux release 7.9.2009 (Core) # Hostname: <primary node> auth_master_user_separator = * default_vsz_limit = 1 G disable_plaintext_auth = no dotlock_use_excl = no doveadm_password = # hidden, use -P to show it listen = * mail_fsync = always mail_location = mdbox:~/mail mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = " notify replication" mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { autoexpunge = 30 days special_use = \Trash } prefix = separator = . } passdb { args = /etc/dovecot/conf.d/passwd.masterusers driver = passwd-file master = yes } passdb { args = /etc/dovecot/conf.d/passwd.masterusers driver = passwd-file } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename save flag_change mail_log_fields = uid box msgid size flags mail_log_group_events = mail_replica = tcps:<second node>:12345 } protocols = imap service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service doveadm { inet_listener { port = 12345 ssl = yes } } service imap-login { inet_listener imap { port = 144 } inet_listener imaps { port = 994 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/pki/dovecot/certs/dovecot-internal.pem ssl_cipher_list = TLS_AES_256_GCM_SHA384:TLS_CHACHA20_POLY1305_SHA256:TLS_AES_128_GCM_SHA256:DHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-SHA256:DHE-RSA-AES128-SHA256:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA256:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA ssl_client_ca_file = /etc/ssl/certs/ca-bundle.crt ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it ssl_prefer_server_ciphers = yes userdb { args = /etc/dovecot/conf.d/dovecot-dict-auth.conf.ext driver = dict } userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol imap { mail_max_userip_connections = 9999 mail_plugins = " notify replication mail_log notify" } Any thoughts would be greatly appreciated. Thanks in advance, Andrew

1 0

Pigeonhole page's RFC links broken (fix attached)
by Patrick Nagel 22 Feb '22

22 Feb '22

Hi there, I was just reading https://pigeonhole.dovecot.org/ and noticed that all the links to the RFCs are broken. I fixed them via regexp search & replace curl https://pigeonhole.dovecot.org/ | sed -e 's|https\?://tools.ietf.org/html/rfc$[0-9]\{4\}$/\?|https://www.ietf.org/r…' >Pigeonhole_fixed_rfc_links.html and attached the resulting page. Cheers, Patrick.

1 0

postfix, dovecot-lda, /run/dovecot/stats-writer socket permision and local user delivery, again
by Michael Tokarev 22 Feb '22

22 Feb '22

Hi! There are many questions on the 'net about the same theme: lda(mjt): Error: net_connect_unix(/run/dovecot/stats-writer) failed: Permission denied dovecot-lda is run from postfix as mailbox_command for local users. There's even a suggestion on dovecot wiki to make dovecot-lda setgid (to mail) - for a different reason but people use this trick to shut this error message up. See eg the last message at https://forum.zentyal.org/index.php?topic=35236.0 which points to https://wiki2.dovecot.org/LDA/Postfix . But the thing is: mail delivery stops right after making dovecot-lda setgid, like this: Feb 22 00:06:46 tsrv dovecot: lda(mjt)<253650><s+nnHub+E2LS3gMA7tuOMA>: \ Fatal: setresgid(914(dovecot),914(dovecot),8(mail)) failed with euid=1000(mjt): \ Operation not permitted why the hell lda tries to setuid to dovecot user? It will definitely unable to write to the maildir since it is owned by user mjt, not by user dovecot! And I *only* made it setgid, not setuid. How to use dovecot-lda together with postfix, after all? Thanks, /mjt

2 2

RE: Different auth logging with cache lookup. (OPEN)
by Eikås Arvid 22 Feb '22

22 Feb '22

No, the problem is the logging of the cache lookup with password mismatch. (release 2.3.17) We missing client IP and user in the cache lookup logging. auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given password: xxxx) Arvid -----Original Message----- From: Aki Tuomi <aki.tuomi(a)open-xchange.com> Sent: tirsdag 22. februar 2022 09:15 To: Eikås Arvid <arvid.eikas(a)telenor.no>; dovecot(a)dovecot.org Subject: Re: Different auth logging with cache lookup. (OPEN) > On 22/02/2022 09:42 Eikås Arvid <arvid.eikas(a)telenor.no> wrote: > > > dovecot-2.3.5 and centos 7 > User and IP are logged in both scenarios. > auth-worker(26145): sql(user,1.1.1.1,<XXXXXXXX>): Password mismatch > auth-worker(13380): cache(user(a)online.no,1.1.1.1): Password mismatch > > > > > dovecot-2.3.17 and rhel 8 > Feb 03 14:42:53 auth-worker(1676266): Info: conn unix:auth-worker > (pid=1675846,uid=97): auth-worker<1>: sql(user,127.0.0.1,<XXXXXXXX>): > Password mismatch (given password: xxxx) Feb 03 14:43:48 > auth-worker(1676266): Info: conn unix:auth-worker > (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given > password: xxxx) > > User and IP is not logged in cache lookup. > Is this a design change or a unplanned change? > > Any ide when it was changed? Looks more like 2.3.5 is incorrectly checking both cache and sql? Aki

1 0

Different auth logging with cache lookup. (OPEN)
by Eikås Arvid 22 Feb '22

22 Feb '22

dovecot-2.3.5 and centos 7 User and IP are logged in both scenarios. auth-worker(26145): sql(user,1.1.1.1,<XXXXXXXX>): Password mismatch auth-worker(13380): cache(user(a)online.no,1.1.1.1<mailto:user@online.no,1.1.1.1>): Password mismatch dovecot-2.3.17 and rhel 8 Feb 03 14:42:53 auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<1>: sql(user,127.0.0.1,<XXXXXXXX>): Password mismatch (given password: xxxx) Feb 03 14:43:48 auth-worker(1676266): Info: conn unix:auth-worker (pid=1675846,uid=97): auth-worker<2>: Password mismatch (given password: xxxx) User and IP is not logged in cache lookup. Is this a design change or a unplanned change? Any ide when it was changed?

2 1

/usr/libexec/dovecot/anvil crashes immediately
by Friedrich Kink 21 Feb '22

21 Feb '22

Dear list, I built a dovecot package for openindiana (which is a Solaris derivative) from latest version 2.3.18. Everything compiles and builds fine without any issue. Even subsequent installation and startup of main dovecot process works as expected. But execution of /usr/libexec/dovecot/anvil immediately crashes. To get some more meaningful backtrace I compiled with -g. Below some facts of my environment and a backtrace. Maybe some of you are more familiar with this kind of issue as I, and can give some hint or share ideas how to nail down the problem. Or can it be a configuration issue? BTW it is running in a so-called zone. And former versions, I don't know exactly but I believe up to 2.3.17, did not show this crash. gcc --version gcc (OpenIndiana 7.5.0-il-0) 7.5.0 Configure parameters: gcc_OPT = -g CONFIGURE_OPTIONS+= --sysconfdir=/etc \ --localstatedir=/var \ --with-gssapi=plugin \ --with-ldap=plugin \ --with-sql=plugin \ --with-lua=plugin \ --with-ssl=openssl \ --with-ioloop=poll \ --with-notify=none \ --with-sodium \ --with-mysql \ --with-pgsql \ --enable-static=no \ --without-systemd \ SSL_CFLAGS=-I/usr/openssl/1.1/include \ SSL_LIBS="-L/usr/openssl/1.1/lib/amd64 -lssl -lcrypto" \ LDFLAGS="-lldap_r" Backtrace: (gdb) bt full #0 0x00007fff5d2e6f2a in _lwp_kill () from /lib/64/libc.so.1 No symbol table info available. #1 0x00007fff5d2dd7f0 in thr_kill () from /lib/64/libc.so.1 No symbol table info available. #2 0x00007fff5d27ae7e in raise () from /lib/64/libc.so.1 No symbol table info available. #3 0x00007fff5d254ad8 in abort () from /lib/64/libc.so.1 No symbol table info available. #4 0x00007ffef05367c0 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:459 backtrace = 0x4178b8 "/usr/lib/amd64/dovecot/libdovecot.so.0.0.0'backtrace_append_libc+0x4c [0x7ffef0522042] -> /usr/lib/amd64/dovecot/libdovecot.so.0.0.0'backtrace_append+0x18 [0x7ffef05221c5] -> /usr/lib/amd64/dovecot/li"... recursed = 0 #5 0x00007ffef0536827 in fatal_handler_real (ctx=0x7fffbffff820, format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffbffff850) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:471 status = 0 #6 0x00007ffef0536871 in default_fatal_handler (ctx=0x7fffbffff820, format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)", args=0x7fffbffff850) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:479 No locals. #7 0x00007ffef0536aed in i_panic (format=0x7ffef05d8730 "file %s: line %d (%s): assertion failed: (%s)") at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/failures.c:524 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0, log_prefix = 0x0, log_prefix_type_pos = 0} args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7fffbffff930, reg_save_area = 0x7fffbffff870}} #8 0x00007ffef056048b in io_loop_handle_add (io=0x42d7c0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop-poll.c:94 ctx = 0x423180 condition = IO_READ old_count = 3221223792 index = 0 old_events = 59 fd = 4 __func__ = "io_loop_handle_add" #9 0x00007ffef055c1ab in io_add_file (ioloop=0x423070, fd=4, condition=IO_READ, source_filename=0x7ffef05d9f48 "/usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c", source_linenum=192, callback=0x7ffef05698f4 <signal_read>, context=0x0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop.c:72 io = 0x42d7c0 __func__ = "io_add_file" #10 0x00007ffef055c27a in io_add_to (ioloop=0x423070, fd=4, condition=IO_READ, source_filename=0x7ffef05d9f48 "/usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c", source_linenum=192, callback=0x7ffef05698f4 <signal_read>, context=0x0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/ioloop.c:94 io = 0x7ffef0609aa0 <static_system_pool> __func__ = "io_add_to" #11 0x00007ffef0569289 in lib_signals_init_io (l=0x420a00) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:192 __func__ = "lib_signals_init_io" #12 0x00007ffef056933c in lib_signals_ioloop_ref (ioloop=0x423070) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:205 l = 0x420a00 #13 0x00007ffef0569507 in signal_handler_switch_ioloop (h=0x4209c0) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:232 No locals. #14 0x00007ffef056a10a in lib_signals_set_handler (signo=2, flags=LIBSIG_FLAG_DELAYED, handler=0x7ffef0475e74 <sig_die>, context=0x422f20) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib/lib-signals.c:520 h = 0x4209c0 __func__ = "lib_signals_set_handler" #15 0x00007ffef0477596 in master_service_init_finish (service=0x422f20) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/lib-master/master-service.c:668 sigint_flags = LIBSIG_FLAG_DELAYED st = {st_dev = 79, st_ino = 4209307, st_mode = 1, st_nlink = 79, st_uid = 4218704, st_gid = 0, st_rdev = 17179869185, st_size = 4337776, st_atim = {tv_sec = 140736414612384, tv_nsec = 1}, st_mtim = {tv_sec = 0, tv_nsec = 8388608}, st_ctim = {tv_sec = 0, tv_nsec = 0}, st_blksize = 4378928, st_blocks = 255, st_fstype = " /B\000\000\000\000\000 /B\000\000\000\000"} __func__ = "master_service_init_finish" #16 0x0000000000403cce in main (argc=1, argv=0x7fffbffffc38) at /usr/src/myoi-userland/components/mail/dovecot/dovecot-2.3.18/src/anvil/main.c:80 service_flags = (MASTER_SERVICE_FLAG_UPDATE_PROCTITLE | MASTER_SERVICE_FLAG_DONT_SEND_STATS) error = 0x7fffbffffc10 " \374\377\277\377\177" Thanks a lot for any help, Fritz

2 1

Fwd: Memory problems with config service
by Víctor Rubiella Monfort 21 Feb '22

21 Feb '22

(Resend to list, sorry for personal reply) -------- Mensaje reenviado -------- Asunto: Re: Memory problems with config service Fecha: Wed, 16 Feb 2022 16:19:32 +0100 De: Víctor Rubiella Monfort <vrubiella(a)cdmon.com> Para: Aki Tuomi <aki.tuomi(a)open-xchange.com> # 2.2.27 (): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.16 () # OS: Linux 4.9.0-16-amd64 x86_64 Debian 9.9 auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@& auth_worker_max_count = 25 default_client_limit = 1200 disable_plaintext_auth = no first_valid_uid = 100 info_log_path = /var/log/dovecot-info.log log_path = /var/log/dovecot.log login_greeting = Server ready login_log_format_elements = user=<%u> method=%m port=%a rip=%r lip=%l mpid=%e %c mail_location = maildir:%h mail_max_userip_connections = 100 passdb { args = /etc/dovecot/mailaccounts.db driver = passwd-file } plugin { quota = maildir:User quota quota_rule3 = SPAM:storage=+50M } protocols = imap pop3 service config { vsz_limit = 9 G } service imap-login { process_limit = 500 } service pop3-login { process_limit = 500 } ssl_ca = </home/ssl/system/domain.cat/ca.pem ssl_cert = </home/ssl/system/domain.cat/crt.pem ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/mailaccounts.db driver = passwd-file } valid_chroot_dirs = /home/postfix/ protocol imap { mail_plugins = quota imap_quota mail_log notify } protocol pop3 { mail_plugins = quota mail_log notify } protocol lda { mail_plugins = quota } local_name *.hidden.com { ssl_cert = </home/ssl/dovecot/live/hidden.com/fullchain.pem ssl_key = # hidden, use -P to show it } #3100+ local_name more with different domains. El 16/2/22 a las 10:02, Aki Tuomi escribió: >> On 16/02/2022 07:30 Víctor Rubiella Monfort <vrubiella(a)cdmon.com> wrote: >> >> >> Hi all, >> I'm having problems with memory in config service. I increased >> vsz_limit to 10GB but continue with this errors when try to reload or >> restart dovecot: >> >> config: Panic: data stack: Out of memory when allocating 2147483688 bytes >> master: Error: service(config): command startup failed, throttling >> for 2 secs >> config: Fatal: master: service(config): child 5512 killed with signal >> 6 (core dumps disabled) >> >> Dovecot has a lot of certificates TLS configured (SNI) (about 3k), >> but if I check the size of all of them is aprox 170MB on disk.Why >> does it need so much memory to boot? Is normal? >> >> >> >> service config { >> vsz_limit = {{ vszlimit }} >> } > Hi! > > Can you send your doveconf -n output? > > Aki >

2 2

Index Corruption Problem with new VM Host - But Only With Replication Enabled
by Reuben Farrelly 21 Feb '22

21 Feb '22

Hi, I've recently migrated my two VMs across from Linode (who use KVM) onto a local VPS service (which also uses KVM). Since doing so I have started to see some strange problems with Dovecot relating to indexes and replication. I have copied the configuration files across from old host to new host. The kernel is the same - as this is Gentoo everything was rebuilt and installed from fresh, but with the same options (use flags). Even the Linux kernel is the same version with the exact same options (as is Dovecot). The filesystem is the same EXT4 with the same options too. Here is what is logged: Feb 18 15:20:41 tornado.reub.net dovecot: imap(reuben)<20031><d0yxIEPY3ROfxG3u>: Error: Mailbox INBOX: /home/reuben/Maildir/dovecot.index reset, view is now inconsistent Feb 18 15:20:41 tornado.reub.net dovecot: imap(reuben)<20031><d0yxIEPY3ROfxG3u>: Disconnected: IMAP session state is inconsistent, please relogin. in=146 out=1398 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 The trigger is the move/delete of an email. Just reading seems to be OK. But as soon as you move/delete an email this event occurs and is logged. The move fails on the first attempt (error is logged, client refreshes) but then if attempted again it succeeds. This error causes the clients to be thrown off and the client view refreshed which seems to require a redownload of everything. It is extremely disruptive to client access. The odd thing is that as soon as I disable replication by commenting out the mail_replica line, *all* of the index corruption messages and symptoms go away completely and I don't see this problem occur. As soon as I re-add it they come back. So it appears that replication at least is triggering the problem. Replication is imap1 -> imap2 and on the other host imap2 - imap1 The odd thing is that this never was a problem while the system was on Linode. I have removed all files on the remote and let dovecot re-replicate everything but this didn't help. I can go back to the VPS host and talk to them about it as I have an open ticket but from their perspective it looks like an application level problem, so there's not a lot for them to go on especially given everything else is working OK. Could the underlying host be playing a role in this? It seems unlikely given turning replication or or off causes the problem to appear or disappear. All clients are connecting to only the master of the two replication partners. Many have multiple concurrent sessions (eg my phone, and Thunderbird at the same time) but all are connecting to only one instance at a time. The second instance is only there for a failover scenario (update a DNS entry to failover). There is no NFS or any sort of sharing set up on the VMs. They are dedicated virtual disks. Can anyone give me any ideas how to troubleshoot this further or things to try? Some system details: # 2.3.18 (9dd8408c18): /etc/dovecot/dovecot.conf # Pigeonhole version 0.5.18 (0bc28b32) # OS: Linux 5.16.10-gentoo x86_64 Gentoo Base System release 2.8 # Hostname: tornado.reub.net auth_mechanisms = plain login auth_username_format = %Ln doveadm_password = # hidden, use -P to show it first_valid_uid = 1000 imap_client_workarounds = tb-lsub-flags tb-extra-mailbox-sep last_valid_uid = 1099 login_log_format_elements = user=<%u> auth-method=%m remote=%r local=%l %c %k mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_location = maildir:~/Maildir mail_plugins = notify replication managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = failure_show_msg=yes %s driver = pam } plugin { mail_replica = tcp:imap2.reub.net:4814 replication_full_sync_interval = 2 hours sieve = file:~/sieve;active=~/.dovecot.sieve } postmaster_address = postmaster(a)reub.net protocols = imap lmtp sieve submission sieve recipient_delimiter = - service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = root } unix_listener replication-notify { mode = 0666 user = root } } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { mode = 0777 } } service doveadm { inet_listener { address = 2404:9400:2264:7200::143 port = 4813 ssl = yes } inet_listener { address = 2404:9400:2264:7200::143 port = 4814 ssl = no } user = root } service imap-login { inet_listener imap { port = 143 } } service lmtp { inet_listener lmtp { address = ::1 port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } service submission-login { inet_listener submission { address = 103.4.234.81 2404:9400:2264:7200::587 port = 587 } } ssl_cert = </etc/ssl/dovecot/reub.net.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it submission_client_workarounds = whitespace-before-path submission_relay_host = localhost submission_relay_port = 587 submission_relay_trusted = yes userdb { driver = passwd result_success = continue-ok } protocol lmtp { mail_plugins = notify replication sieve } protocol lda { mail_plugins = notify replication sieve } protocol imap { imap_metadata = yes mail_max_userip_connections = 25 } Thanks, Reuben

2 2

dovecot-2.3-pigeonhole-0.5.18 : Freebsd Will not build
by Paul Kudla (Scom.ca Internet Services Inc.) 21 Feb '22

21 Feb '22

dovecot version : dovecot-2.3.14 freebsd 12.1 dovecot-2.3.14 built manually (no port build) : ./configure --with-pgsql currentconfig (dovecot-2.3-pigeonhole-0.5.18) : ./configure --with-dovecot=/usr/local/lib/dovecot Error when building : Screen Shot (color may help) Actual : libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../../.. -I/usr/local/include/dovecot -I../../../.. -I../../../../src/lib-sieve -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -fstack-protector-strong -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -mfunction-return=keep -mindirect-branch=keep -I../../../.. -MT sieve-dict-script.lo -MD -MP -MF .deps/sieve-dict-script.Tpo -c sieve-dict-script.c -fPIC -DPIC -o .libs/sieve-dict-script.o sieve-dict-script.c: In function 'sieve_dict_script_open': sieve-dict-script.c:84:9: error: variable 'set' has initializer but incomplete type 84 | struct dict_op_settings set = { | ^~~~~~~~~~~~~~~~ sieve-dict-script.c:85:4: error: 'struct dict_op_settings' has no member named 'username' 85 | .username = dstorage->username, | ^~~~~~~~ sieve-dict-script.c:85:15: warning: excess elements in struct initializer 85 | .username = dstorage->username, | ^~~~~~~~ sieve-dict-script.c:85:15: note: (near initialization for 'set') sieve-dict-script.c:84:26: error: storage size of 'set' isn't known 84 | struct dict_op_settings set = { | ^~~ sieve-dict-script.c:88:31: warning: passing argument 3 of 'dict_lookup' from incompatible pointer type [-Wincompatible-pointer-types] 88 | (dscript->dict, &set, script->pool, path, &data_id, &error); | ~~~~~~^~~~~~ | | | pool_t {aka struct pool *} In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:102:15: note: expected 'const char *' but argument is of type 'pool_t' {aka 'struct pool *'} 102 | const char *key, const char **value_r, const char **error_r); | ~~~~~~~~~~~~^~~ sieve-dict-script.c:88:39: warning: passing argument 4 of 'dict_lookup' from incompatible pointer type [-Wincompatible-pointer-types] 88 | (dscript->dict, &set, script->pool, path, &data_id, &error); | ^~~~ | | | const char * In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:102:33: note: expected 'const char **' but argument is of type 'const char *' 102 | const char *key, const char **value_r, const char **error_r); | ~~~~~~~~~~~~~^~~~~~~ sieve-dict-script.c:87:8: error: too many arguments to function 'dict_lookup' 87 | ret = dict_lookup | ^~~~~~~~~~~ In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:101:5: note: declared here 101 | int dict_lookup(struct dict *dict, pool_t pool, | ^~~~~~~~~~~ sieve-dict-script.c:84:26: warning: unused variable 'set' [-Wunused-variable] 84 | struct dict_op_settings set = { | ^~~ sieve-dict-script.c: In function 'sieve_dict_script_get_stream': sieve-dict-script.c:126:9: error: variable 'set' has initializer but incomplete type 126 | struct dict_op_settings set = { | ^~~~~~~~~~~~~~~~ sieve-dict-script.c:127:4: error: 'struct dict_op_settings' has no member named 'username' 127 | .username = dstorage->username, | ^~~~~~~~ sieve-dict-script.c:127:15: warning: excess elements in struct initializer 127 | .username = dstorage->username, | ^~~~~~~~ sieve-dict-script.c:127:15: note: (near initialization for 'set') sieve-dict-script.c:126:26: error: storage size of 'set' isn't known 126 | struct dict_op_settings set = { | ^~~ sieve-dict-script.c:130:32: warning: passing argument 3 of 'dict_lookup' from incompatible pointer type [-Wincompatible-pointer-types] 130 | (dscript->dict, &set, dscript->data_pool, path, &data, &error); | ~~~~~~~^~~~~~~~~~~ | | | pool_t {aka struct pool *} In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:102:15: note: expected 'const char *' but argument is of type 'pool_t' {aka 'struct pool *'} 102 | const char *key, const char **value_r, const char **error_r); | ~~~~~~~~~~~~^~~ sieve-dict-script.c:130:45: warning: passing argument 4 of 'dict_lookup' from incompatible pointer type [-Wincompatible-pointer-types] 130 | (dscript->dict, &set, dscript->data_pool, path, &data, &error); | ^~~~ | | | const char * In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:102:33: note: expected 'const char **' but argument is of type 'const char *' 102 | const char *key, const char **value_r, const char **error_r); | ~~~~~~~~~~~~~^~~~~~~ sieve-dict-script.c:129:8: error: too many arguments to function 'dict_lookup' 129 | ret = dict_lookup | ^~~~~~~~~~~ In file included from sieve-dict-script.c:8: /usr/local/include/dovecot/dict.h:101:5: note: declared here 101 | int dict_lookup(struct dict *dict, pool_t pool, | ^~~~~~~~~~~ sieve-dict-script.c:126:26: warning: unused variable 'set' [-Wunused-variable] 126 | struct dict_op_settings set = { | ^~~ gmake[5]: *** [Makefile:461: sieve-dict-script.lo] Error 1 gmake[5]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18/src/lib-sieve/storage/dict' gmake[4]: *** [Makefile:426: all-recursive] Error 1 gmake[4]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18/src/lib-sieve/storage' gmake[3]: *** [Makefile:909: all-recursive] Error 1 gmake[3]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18/src/lib-sieve' gmake[2]: *** [Makefile:438: all-recursive] Error 1 gmake[2]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18/src' gmake[1]: *** [Makefile:763: all-recursive] Error 1 gmake[1]: Leaving directory '/usr/local/src/mail/dovecot-2.3-pigeonhole-0.5.18' gmake: *** [Makefile:622: all] Error 2 -- Happy Sunday !!! Thanks - paul Paul Kudla Scom.ca Internet Services <http://www.scom.ca> 004-1009 Byron Street South Whitby, Ontario - Canada L1N 4S3 Toronto 416.642.7266 Main 1.866.411.7266 Fax 1.888.892.7266

2 1

initial replication or clone?
by Joachim Lindenberg 20 Feb '22

20 Feb '22

Hello, I want to improve availability of my dovecot installation by implementing replication as outlined in https://wiki.dovecot.org/Replication. I am wondering whether I have to install an empty copy or whether it is also an option to clone the entire existing system and then configure replication, just to avoid the initial overhead. Any input? Thanks, Joachim

1 0

Unable to connect from macOS mail client
by necktwi 19 Feb '22

19 Feb '22

When trying to add mail account to the macOS mail client, I get following error Feb 13 13:05:15 imap-login: Info: Disconnected: Connection closed: SSL_accept() failed: error:14094416:SSL routines:ssl3_read_bytes:sslv3 alert certificate unknown: SSL alert number 46 (no auth attempts in 0 secs): user=<>, rip=157.48.200.20, lip=192.168.1.101, TLS handshaking: SSL_accept() failed: error:14094416:SSL routines:ssl3_read_bytes:sslv3 alert certificate unknown: SSL alert number 46, session=<5mZDV+HXxK+dMMgU> How to fix it? — Necktwi

4 4

--with-textcat: configure error?
by Felipe Gasper 18 Feb '22

18 Feb '22

Hello, With Dovecot 2.3.18 on AlmaLinux 8 I’m trying this: LIBEXTTEXTCAT_LIBS="-L/usr/lib64 -lexttextcat" ./configure --with-textcat … which gives me: checking for special_textcat_Init in -lexttextcat... no checking for special_textcat_Init in -ltextcat... no configure: error: Can't build with textcat support: libtextcat or libexttextcat not found I do have: > ls -la /usr/lib64 | grep textcat lrwxrwxrwx 1 root root 26 Oct 12 2019 libexttextcat-2.0.so.0 -> libexttextcat-2.0.so.0.0.0 -rwxr-xr-x 1 root root 22128 Oct 12 2019 libexttextcat-2.0.so.0.0.0 Is there some way of knowing what command it’s actually running that makes it say “libtextcat or libexttextcat not found”? Thank you! cheers, -Felipe Gasper

1 0

Debug shared namespace issues
by Kees van Vloten 18 Feb '22

18 Feb '22

Hi Team, I am still having troubles with the shared namespace. mail_shared_explicit_inbox = yes namespace { type = shared separator = "~" prefix = shared~%%u~ location = maildir:/srv/mail/vmail/example.com/%%n/store:LAYOUT=fs:FULLDIRNAME=0_Folde… hidden = no list = children subscriptions = no } To rule out ACL issues (for now), I have added: plugin { acl = vfile acl_shared_dict = file:/srv/mail/dovecot/lib/shared-mailboxes.db #acl_defaults_from_inbox = yes acl_user = %n acl_ignore_namespace = shared~ } The client imap communication looks like this: C[0x55ae80480750]: 1 login "test2" "" S[0x55ae8044a600]: 1 OK [CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY SPECIAL-USE ACL RIGHTS=texk] Logged in C[0x55ae80480750]: 2 capability S[0x55ae8044a600]: * CAPABILITY IMAP4rev1 SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SNIPPET=FUZZY PREVIEW=FUZZY STATUS=SIZE SAVEDATE LITERAL+ NOTIFY SPECIAL-USE ACL RIGHTS=texk S[0x55ae8044a600]: 2 OK Capability completed (0.001 + 0.000 secs). C[0x55ae80480750]: 3 ID ("x-originating-ip" "192.168.10.106") S[0x55ae8044a600]: * ID ("name" "Dovecot") S[0x55ae8044a600]: 3 OK ID completed (0.001 + 0.000 secs). C[0x55ae80480750]: 4 namespace S[0x55ae8044a600]: * NAMESPACE (("" "~")) (("shared~" "~")) NIL S[0x55ae8044a600]: 4 OK Namespace completed (0.001 + 0.001 secs). C[0x55ae80480750]: 5 LIST "" "" S[0x55ae8044a600]: * LIST (\Noselect) "~" "" S[0x55ae8044a600]: 5 OK List completed (0.001 + 0.001 secs). C[0x55ae80480750]: 6 getacl "shared~test1~Drafts" S[0x55ae8044a600]: 6 NO [NONEXISTENT] Mailbox doesn't exist: shared~test1~Drafts (0.001 + 0.000 secs). C[0x55ae80480750]: 7 create "shared~test1~Drafts" S[0x55ae8044a600]: 7 NO [CANNOT] Invalid mailbox name 'shared~test1~Drafts': Missing namespace prefix 'shared~test1/Drafts~' (0.001 + 0.000 secs). C[0x55ae80480750]: 8 getacl "shared~test1~Drafts" S[0x55ae8044a600]: 8 NO [NONEXISTENT] Mailbox doesn't exist: shared~test1~Drafts (0.001 + 0.000 secs). C[0x55ae80480750]: 9 select "shared~test1~Drafts" S[0x55ae8044a600]: 9 NO [CANNOT] Invalid mailbox name 'shared~test1~Drafts': Missing namespace prefix 'shared~test1/Drafts~' (0.001 + 0.001 secs). C[0x55ae80480750]: 10 unsubscribe "shared~test1~Drafts" S[0x55ae8044a600]: 10 NO [CANNOT] Invalid mailbox name 'shared~test1~Drafts': Missing namespace prefix 'shared~test1/Drafts~' (0.001 + 0.000 secs). C[0x55ae80480750]: 11 logout S[0x55ae8044a600]: * BYE Logging out The client shows the shared user, but no content. I am using Sogo to test and sometimes Thunderbird to verify it is not a Sogo specific issue. I have currently set these debug options in Dovecot: auth_verbose = yes auth_debug = yes mail_debug = yes Unfortunately this is not enough to get a clue. What more can I do (other debug options?) to figure out what is going on? - Kees

2 5

Using dovecot-shared for an shared index not working
by Achim Gottinger 18 Feb '22

18 Feb '22

Hello I'm in the process to migrate our mail server from version 2.2.13 with maildirs to 2.3.13 with sdbox. On the old server if we wanted an common index for the seen flag on shared folders we created an file called dovecot-shared in the mail_location folder and the mailbox folders. This does not work on the new server for all shared mailboxes the seen flag is stored per user. The log file shows this if the seen flag is changed Feb 18 13:24:15 SERVER dovecot[18887]: imap(USER)<18978><51HhlUnYeOfAwAx3>: Debug: imapsieve: mailbox shared/info: FLAG event (changed flags: \Seen) The dovecot-acl file for the shared/info/INBOX folder has the s flag set. I hope i can get a few pointers here how to get the seen flag working for all users again. On the old server the location variable for the shared folders had the variable INDEX defined which can not be used with sdbox. location = maildir:/home/vmail/%%u/mail:INDEX=/home/vmail/%u/mail/shared/%%u:INBOX=/home/vmail/%%u/mail/.INBOX Does that imply that sharing the seen flag can not be used with sdbox? Thanks in advance, Achim Here is the dovecot -n output: ---------------------------------------------------------------------------------------------------------------------- # Pigeonhole version 0.5.13 (cdd19fe3) # OS: Linux 4.19.0+1 x86_64 Debian 11.2 zfs # Hostname: SERVER auth_cache_size = 5 M auth_gssapi_hostname = SERVER auth_krb5_keytab = /etc/dovecot/dovecot.keytab auth_master_user_separator = % auth_mechanisms = plain login gssapi auth_username_format = %Ln debug_log_path = syslog first_valid_gid = 998 first_valid_uid = 998 imap_max_line_length = 2 M info_log_path = syslog mail_attachment_dir = /var/lib/vmail/attachements mail_debug = yes mail_gid = 998 mail_home = /var/lib/vmail/%u mail_location = sdbox:/var/lib/vmail/%u/sdbox:INDEX=/var/lib/vmail/%u/sdbox mail_plugins = acl fts fts_solr mail_uid = 998 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace { list = children location = sdbox:/var/lib/vmail/%%u/sdbox:INDEXPVT=/var/lib/vmail/%u/sdbox/shared/%%u prefix = shared/%%u/ separator = / subscriptions = no type = shared } namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf.ext driver = ldap } plugin { acl = vfile acl_anyone = allow acl_defaults_from_inbox = yes acl_shared_dict = file:/var/lib/vmail/.shared-mailboxes fts = solr fts_autoindex = yes fts_autoindex_exclude = \Junk fts_autoindex_exclude2 = \Trash fts_solr = url=http://localhost:8983/solr/dovecot/ imapsieve_mailbox1_before = file:/etc/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Junk imapsieve_mailbox2_before = file:/etc/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Junk imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid from subject size sieve = ~/.dovecot.sieve sieve_after = /etc/dovecot/sieve/after.d/ sieve_dir = ~/sieve sieve_global_extensions = +vnd.dovecot.pipe sieve_pipe_bin_dir = /etc/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = " imap lmtp sieve" service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = vmail mode = 0777 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap-postlogin { executable = script-login /etc/dovecot/acl-groups.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0666 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } ssl_cert = </etc/ssl/certs/SERVER.pem ssl_client_ca_dir = /etc/ssl/certs ssl_dh = # hidden, use -P to show it ssl_key = # hidden, use -P to show it userdb { args = /etc/dovecot/dovecot-ldap-user.conf.ext driver = ldap } userdb { args = /etc/dovecot/dovecot-ldap-group.conf.ext driver = ldap } protocol lmtp { mail_plugins = acl fts fts_solr sieve } protocol imap { imap_client_workarounds = delay-newmail mail_plugins = acl fts fts_solr imap_sieve imap_acl fts fts_solr } local_name EXTERN { ssl_cert = </etc/letsencrypt/live/EXTERN/fullchain.pem ssl_key = # hidden, use -P to show it }

1 1