- dovecot - dovecot.org

Question regarding replication - duplicate emails
by Remko Lodder 21 Oct '17

21 Oct '17

Dear Dovecot and community, We run a small email service for our customers, based on two machines that are made “redundant or clustered” by using the replication feature of Dovecot. This works well, for most emails. Sometimes the following happends: Email to our support database arrives at the inbox. Every period a cronjob looks into that mailbox and parses the information and makes a support ticket from that message. The cronjob deletes the email afterwards and sees whether there are more new mails or not. In between the deletion and the (next) check, the email gets “resynced” again from the “other machine”, and is seen as a new email by the cronjob and gets handled again. So basically we get two tickets for one email. After that second run the email is no longer replicated. This behaviour can also be seen via webmail and email clients, this suggests that the replication might not be aware (enough) that the replication is occurring or that an item already had been synced from A to B (and does not need to get back from B to A after A deleted it). Is there a way to fiddle with the acknowledgement timing or give the processes some more space/time to get on par with eachother? Below is the configuration of machine B, they are synchronised through puppet, so only the hostname and IP addresses are different. (so for replication, A has: tcps:hostname_of_b:12346 and B has tcps:hostname_of_a:12346). Also note that HAproxy is prepared but not in use at all. # 2.2.33.1 (e9afa7f18): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: FreeBSD 11.1-RELEASE amd64 auth_mechanisms = plain login disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it haproxy_trusted_networks = IPv4_Haproxy IPv6_Haproxy lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes lmtp_save_to_detail_mailbox = yes mail_fsync = always mail_location = sdbox:~/sdbox mail_plugins = " quota notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapsieve vnd.dovecot.imapsieve namespace { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { driver = pam } plugin { imapsieve_mailbox1_before = file:/usr/local/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/local/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size mail_replica = tcps:hostname_of_machine_a:12346 sieve = ~/.dovecot.sieve sieve_after = /usr/local/etc/dovecot/sieve/after/ sieve_before = /usr/local/etc/dovecot/sieve/global/ sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_vacation_dont_check_recipient = yes } postmaster_address = postmaster(a)ourdomain.tld protocols = imap pop3 lmtp sieve replication_max_conns = 100 service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service doveadm { inet_listener { port = 12346 ssl = yes } } service imap-login { inet_listener imap_haproxy { haproxy = yes port = 10143 } inet_listener imaps_haproxy { haproxy = yes port = 10144 ssl = yes } service_count = 1 } service imap { process_limit = 1024 } service lmtp { inet_listener lmtp { address = IPv4, IPv6, 127.0.0.1 ::1 port = 24 } unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3 { process_limit = 1024 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_ca = </usr/local/etc/letsencrypt/live/host.ourdomain.tld/fullchain.pem ssl_cert = </usr/local/etc/letsencrypt/live/host.ourdomain.tld/cert.pem ssl_client_ca_file = /usr/local/certificates/letsencrypt-ca.pem ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv2 !SSLv3 userdb { driver = passwd } verbose_proctitle = yes protocol lmtp { auth_username_format = %n mail_plugins = quota sieve replication notify postmaster_address = postmaster(a)ourdomain.tld } protocol lda { mail_plugins = " quota notify replication sieve replication notify" } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 50 mail_plugins = " quota notify replication imap_quota imap_sieve" }

2 3

Re: IMAP stops responding.
by Joseph Tam 20 Oct '17

20 Oct '17

S?ren Peter Skou <sps(a)DanskKabelTV.dk> writes: > I've experienced that IMAP/IMAPS stops responding. To restore service > there is only one way, restart Dovecot completely. This leads to > services being interrupted for some people, so it seems to only affect > some of the users on the server. But POP3/POP3s is still running > happily. Also, it happens more as we approach Rush Hour. Help us help you: the problem is most likely pointed out in the log files. Also, a dump of your configurations (doveconf -n) would help. Offhand, it seems you've hit an IMAP resource limit, such as mail_max_userip_connections, or perhaps process/memory limits (e.g. process_limit, vsz_limit, etc.). Joseph Tam <jtam.home(a)gmail.com>

1 0

fts_solr: Indexing failed: 500 Server Error
by Kirill Ponomarev 20 Oct '17

20 Oct '17

Hi, running dovecot 2.2.33.2 with solr 7.1.0 (with new XML scheme instead of JSON) on FreeBSD produces this error message: Oct 20 20:58:29 krion postfix/smtpd[13371]: disconnect from mail-yw0-f169.google.com[209.85.161.169] ehlo=2 +starttls=1 mail=1 rcpt=1 data=1 quit=1 commands=7 Oct 20 20:58:29 krion dovecot: indexer-worker(krion(a)krion.cc): Error: fts_solr: Indexing failed: 500 Server Error Oct 20 20:58:29 krion dovecot: indexer-worker(krion(a)krion.cc): Error: fts_solr: Indexing failed: 500 Server Error Oct 20 20:58:29 krion dovecot: indexer-worker(krion(a)krion.cc): Error: Mailbox INBOX: Transaction commit failed: FTS +transaction commit failed: backend deinit (attempted to index 1 messages (UIDs 166..166)) Oct 20 20:58:30 krion dovecot: imap(krion(a)krion.cc): Connection closed (IDLE finished 451.007 secs ago) in=43 +out=812 K.

1 0

IMAP stops responding.
by Søren Peter Skou 20 Oct '17

20 Oct '17

Hiya all, I've experienced that IMAP/IMAPS stops responding. To restore service there is only one way, restart Dovecot completely. This leads to services being interrupted for some people, so it seems to only affect some of the users on the server. But POP3/POP3s is still running happily. Also, it happens more as we approach Rush Hour. All of this leads me to believe that we're facing a problem with clients somehow. I've searched the net for the problem, and dating back I've found references to Apple units being the culprit. So we've taken an old Apple client, and tried to see how many sessions it actually starts, the result of that test was that regardless what we tried it only opened one extra session. A bit of information, Debian OS : dovecot-core 2:2.2.27-1~auto+44 amd64 secure POP3/IMAP server - core files dovecot-imapd 2:2.2.27-1~auto+44 amd64 secure POP3/IMAP server - IMAP daemon dovecot-mysql 2:2.2.27-1~auto+44 amd64 secure POP3/IMAP server - MySQL support dovecot-pop3d 2:2.2.27-1~auto+44 amd64 secure POP3/IMAP server - POP3 daemon dovecot-sieve 2:2.2.27-1~auto+44 amd64 secure POP3/IMAP server - Sieve filters support the Config itself is fairly simple, lookup through MySQL to find username/password etc - I don't really see any obvious option. Also, limiting users/sessions per IP isn't really a good idea as we have a great deal of customers behind NAT. Med venlig hilsen/Best regards Søren P. Skou Netværkstekniker [logo] Teglholmsgade 1 0900 København C Tlf: 69 12 12 12 E-mail: sps(a)danskkabeltv.dk<mailto:sps@danskkabeltv.dk> Web: www.danskkabeltv.dk<http://www.danskkabeltv.dk/>

2 1

v2.2.33.2 released
by Timo Sirainen 20 Oct '17

20 Oct '17

https://dovecot.org/releases/2.2/dovecot-2.2.33.2.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.33.2.tar.gz.sig One more patch release with some fixes: - doveadm: Fix crash in proxying (or dsync replication) if remote is running older than v2.2.33 - auth: Fix memory leak in %{ldap_dn} - dict-sql: Fix data types to work correctly with Cassandra

1 0

Re: HTTPS for http://xi.dovecot.fi/debian/
by Aki Tuomi 20 Oct '17

20 Oct '17

> On October 20, 2017 at 12:37 PM Florent B <florent(a)coppint.com> wrote: > > > Hi, > > We use Dovecot packages from http://xi.dovecot.fi/debian/. > > Could it be possible to serve it with HTTPS ? > > Thank you. > > Florent Hi! It has now https enabled with valid certificate. Aki

1 0

quota only for oungoing
by Aidar Kamalov 20 Oct '17

20 Oct '17

Hello! I setup quota and quota warnings for my mail system(dovecot+exim). By I want to reject only outgoing messages if quota exceeded. Is it possible to congi dovecot to not reject incoming messages? I use dovecot-lda for mail delivery. ldap_delivery: driver = pipe command = /usr/lib/dovecot/deliver -d "${lookup ldap{user=**********))(mai -f $sender_address -a $original_local_part@$original_domain message_prefix = message_suffix = delivery_date_add envelope_to_add return_path_add log_output return_output user = mail group = mail temp_errors = 64 : 69 : 70: 71 : 72 : 73 : 74 : 75 : 78 -- Aydar A. Kamalov

2 5

Iteration for ldap userdb does not work
by Holger A. Brinkhaus 20 Oct '17

20 Oct '17

Hi, I have a working ldap authentification for dovecot (with ldap based userdb query) for my Active Directory but iterations by doveadm -A runs in timeout. I tried now for three days and get it not to work. Best regards Holger /etc/dovecot/dovecot-ldap-userdb.conf is symlink to /etc/doveconf/doveconf-ldap.conf debug_level = 0 uris = ldaps://server1.office.hb-os.de:636 dn = cn=BINDUSER,cn=Users,dc=SUBDOM,dc=DOM,dc=de dnpass = MYPASSWORD auth_bind = yes ldap_version = 3 deref = never base = cn=Users,dc=SUBDOM,dc=DOM,dc=de scope = subtree user_attrs = =home=/usr/data/vmail/%d/%n, =mail=maildir:/usr/data/vmail/%d/%n/Maildir user_filter = (&(objectClass=person)(mail=%u)) pass_filter = (&(objectClass=person)(mail=%u)) iterate_attrs = mail=user iterate_filter = (objectClass=person) doveconf -n # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.9 auth_mechanisms = plain login base_dir = /var/run/dovecot/ default_vsz_limit = 512 M dict { expire = mysql:/etc/dovecot/dovecot-dict-expire.conf.ext } first_valid_uid = 100 imap_idle_notify_interval = 16 mins lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes log_path = /var/log/dovecot.log log_timestamp = "%Y-%m-%d %H:%M:%S " mail_gid = vmail mail_home = /usr/data/vmail/%d/ mail_location = maildir:~/Maildir:LAYOUT=fs mail_plugins = expire mail_privileged_group = vmail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-ldap.conf driver = ldap } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /usr/data/vmail/spampipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmp_dir = /tmp antispam_spam = Junk;SPAM;Spam antispam_trash = Trash expire = Trash expire2 = Trash/* expire3 = Junk expire_dict = proxy::expire sieve = /usr/data/vmail/%u/sieve/active-script.sieve sieve_before = /usr/data/vmail/sieve/spam-global.sieve sieve_dir = /usr/data/vmail/%d/%n/sieve/scripts/ sieve_max_redirects = 4 sieve_max_script_size = 1M sieve_quota_max_scripts = 128 } postmaster_address = ME(a)DOMAIN.de protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } user = vmail } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_min_avail = 10 service_count = 1 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/ssl/certs/MY_CERT.crt ssl_key = </etc/ssl/private/MY_CERT.key userdb { args = /etc/dovecot/dovecot-ldap-userdb.conf driver = ldap } protocol lmtp { mail_plugins = expire sieve } protocol lda { mail_plugins = expire sieve } protocol imap { mail_max_userip_connections = 10 mail_plugins = expire antispam }

2 2

Dovecot >=2.2.29 + Filesystem quota = incorrect storage information
by Macka 18 Oct '17

18 Oct '17

Hi, I have problem with quota storage information in dovecot-2.2.29 (and newer versions, too - 2.2.30.2). I use FS quota backend. ............................ # 2.2.29.1 (e0b76e3): /etc/dovecot/dovecot.conf # OS: Linux 4.4.68-1 x86_64 mail_plugins = quota plugin { quota = fs:User quota:mount=/poczta:user quota2 = fs:Group quota:mount=/poczta:group } protocol imap { mail_max_userip_connections = 10 mail_plugins = "imap_quota mail_log notify antispam" } ................................. After upgrade from 2.2.27 to 2.2.29 (newest 2.2.30.2 too), dovecot returns incorrect informations about quota storage: # doveadm quota get -u myusername Quota name Type Value Limit % User quota STORAGE 10960896 100000 10960 or # ( echo "A1 GETQUOTAROOT INBOX"; echo "A2 logout" ) | /usr/lib64/dovecot/imap -u myusername * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE NOTIFY SPECIAL-USE QUOTA] Logged in as myusername imap(myusername): Info: Logged out in=31 out=588 * QUOTAROOT INBOX "User quota" * QUOTA "User quota" (STORAGE 10960896 100000) A1 OK Getquotaroot completed (0.001 + 0.000 secs). * BYE Logging out A2 OK Logout completed (0.001 + 0.000 secs). Values are in BYTES and Limit in BLOCKS which gives insane information in % Other server with older version 2.2.27 returns correct numbers (both in BLOCKS) # doveadm quota get -u username2 Quota name Type Value Limit % user STORAGE 558336 614400 90 Is this a bug in new versions? How can I fix this? -- macka

3 6

Re: Last Login example
by Siarhei Chystsiakou 18 Oct '17

18 Oct '17

My config: config plugins: # cat /etc/dovecot/conf.d/90-last_login.conf > dict { > lastlogin = mysql:/etc/dovecot/dict.conf.d/90-lastlogin.conf > } > plugin { > last_login_dict = proxy::lastlogin > } config db connector: # cat /etc/dovecot/dict.conf.d/90-lastlogin.conf > connect=host=localhost dbname=mail_user user=userDB password=Pa$$w0rd > map { > pattern = shared/last-login/$user > table = mailbox > username_field = username > value_field = lastlogin > value_type = uint > fields { > username = $user > } > } config imap and pop3 # cat /etc/dovecot/dict.conf.d/20-imap.conf > protocol imap { > mail_plugins = $mail_plugins quota imap_quota imap_acl last_login > } > # cat /etc/dovecot/dict.conf.d/20-pop3.conf > protocol imap { > mail_plugins = $mail_plugins last_login > } In the database in the table with users to add a column. If you have questions, I'll try to answer 2017-10-14 20:20 GMT+02:00 Jorge Bastos <mysql.jorge(a)decimal.pt>: > Howdy, > > > > Where can i find a configuration example for the last login plugin, that > fits for latest dovecot version? > > Thanks in advanced! > > > > Jorge, >

1 0

Re: Last Login example
by Aki Tuomi 18 Oct '17

18 Oct '17

On 14.10.2017 21:20, Jorge Bastos wrote: > Howdy, > > > > Where can i find a configuration example for the last login plugin, that > fits for latest dovecot version? > > Thanks in advanced! > > > > Jorge, https://wiki.dovecot.org/Plugins/LastLogin Is there some problem you are experiencing? Aki

1 0

Replication between different versions of dovecot
by Dmitry Nezhevenko 18 Oct '17

18 Oct '17

Hi, Can't find any notes about this in documentation. Is replication supposed to work between different versions of dovecot? I've just found that dovecot 2.2.33.1 was uploaded to debian unstable and it crashes on every replication with older dovecot 2.2.27. (version 2.2.32.1 was probably ok) Summary: - 2.2.33.1 crashes when replicating from/to 2.2.27 - 2.2.32.1 probably ok when replicating from/to 2.2.27 I was able to capture backtrace of crashed doveadm-server: Program terminated with signal SIGSEGV, Segmentation fault. #0 i_stream_next_line (stream=stream@entry=0x0) at istream.c:428 428 istream.c: No such file or directory. (gdb) bt #0 i_stream_next_line (stream=stream@entry=0x0) at istream.c:428 #1 0x00007f60244306df in i_stream_read_next_line (stream=0x0) at istream.c:449 #2 0x0000560304f22e79 in server_connection_print_log (conn=0x560305e930f8) at server-connection.c:305 #3 0x0000560304f238af in server_connection_input_one (conn=<optimized out>) at server-connection.c:405 #4 server_connection_input (conn=<optimized out>) at server-connection.c:390 #5 0x00007f602443a572 in io_loop_call_io (io=0x560305e81e30) at ioloop.c:600 #6 0x00007f602443bc1e in io_loop_handler_run_internal (ioloop=ioloop@entry=0x560305e59ad0) at ioloop-epoll.c:223 #7 0x00007f602443a606 in io_loop_handler_run (ioloop=ioloop@entry=0x560305e59ad0) at ioloop.c:649 #8 0x00007f602443a7b8 in io_loop_run (ioloop=0x560305e59ad0) at ioloop.c:624 #9 0x0000560304f0de5a in dsync_connect_tcp (ctx=ctx@entry=0x560305e7e9e8, mail_set=mail_set@entry=0x560305e8ad50, target=0x560305e8b94c "inhex.vpn.local:9993", ssl=ssl@entry=false, error_r=error_r@entry=0x7fff8e40b9e8) at doveadm-dsync.c:850 #10 0x0000560304f0fbe3 in parse_location (error_r=0x7fff8e40b9e8, remote_cmd_args_r=0x7fff8e40b858, location=<optimized out>, mail_set=0x560305e8ad50, ctx=0x560305e7e9e8) at doveadm-dsync.c:875 #11 cmd_dsync_prerun (_ctx=0x560305e7e9e8, service_user=<optimized out>, error_r=0x7fff8e40b9e8) at doveadm-dsync.c:947 #12 0x0000560304f10891 in doveadm_mail_next_user (ctx=ctx@entry=0x560305e7e9e8, cctx=cctx@entry=0x7fff8e40b9f0, error_r=error_r@entry=0x7fff8e40b9e8) at doveadm-mail.c:414 #13 0x0000560304f11473 in doveadm_mail_single_user (ctx=ctx@entry=0x560305e7e9e8, cctx=cctx@entry=0x7fff8e40b9f0, error_r=error_r@entry=0x7fff8e40b9e8) at doveadm-mail.c:460 #14 0x0000560304f262fb in doveadm_mail_cmd_server_run (cctx=0x7fff8e40b9f0, mctx=0x560305e7e9e8, conn=0x560305e7a878) at client-connection.c:246 #15 doveadm_cmd_handle (cctx=0x7fff8e40b9f0, argv=<optimized out>, argc=<optimized out>, cmd_name=<optimized out>, conn=0x560305e7a878) at client-connection.c:329 #16 client_handle_command (args=<optimized out>, conn=0x560305e7a878) at client-connection.c:399 #17 client_connection_input (conn=<optimized out>) at client-connection.c:541 #18 0x00007f602443a572 in io_loop_call_io (io=0x560305e58c40) at ioloop.c:600 #19 0x00007f602443bc1e in io_loop_handler_run_internal (ioloop=ioloop@entry=0x560305e529a0) at ioloop-epoll.c:223 #20 0x00007f602443a606 in io_loop_handler_run (ioloop=ioloop@entry=0x560305e529a0) at ioloop.c:649 #21 0x00007f602443a7b8 in io_loop_run (ioloop=0x560305e529a0) at ioloop.c:624 #22 0x00007f60243bf893 in master_service_run (service=0x560305e52840, callback=<optimized out>) at master-service.c:719 #23 0x0000560304f011d5 in main (argc=<optimized out>, argv=<optimized out>) at main.c:143 -- WBR, Dmitry

2 4

Re: Limit the nuumber of mails POPped at a time
by Joseph Tam 17 Oct '17

17 Oct '17

> I have a piece of software with a mailclient that has problems when it > POP's large amounts of mail. Unfortunately the system can't be updated > or fixed.So I'm trying to figure out if I can limit the number of mails > that can be seen via Dovecot. > ... > So it would be a question of always presenting a maximum of 300 mails > via the POP3.Is it doable? You're probably solving the wrong problem -- the mail client really ought to be able to process 300+ messages. It may be a better use of time to fix that than to torture dovecot to give you what you want. You can try using a plugin to define a virtual INBOX https://wiki.dovecot.org/Plugins/Virtual with search/selection criteria to limit the number of messages. You can also try some LDA script (e.g. procmail) hackery to create INBOX volumes of 300 messages, then do some shuffling around when the INBOX gets emptied. Joseph Tam <jtam.home(a)gmail.com>

1 0

mdbox + director + nfs
by Raymond Sellars 17 Oct '17

17 Oct '17

Hi Matt We've been running this configuration for the past couple of years. Not noticed any locking issues. As I understand it that's the objective of using Director. As Aki notes make sure you have the appropriate NFS settings. Other lessons we encountered. Important to ensure NFS is NTP sync'd and aligned with your hosts, we hit some issues with file timestamps leading to problems. Replication, e.g. for perhaps a backup or DR site. Seems to work but we've had the odd occasion of the indexes drifting. Never tracked the reason down and believe its unrelated to the NFS. Just something to monitor. Regards Raymond ------------------------------ Message: 5 Date: Tue, 17 Oct 2017 08:50:18 +0300 From: Aki Tuomi <aki.tuomi(a)dovecot.fi> To: dovecot(a)dovecot.org Subject: Re: mdbox + director + nfs Message-ID: <70b54e75-14fe-2caa-eccb-1ffc05c2a1e5(a)dovecot.fi> Content-Type: text/plain; charset=utf-8 NFS with mdbox should work just fine, locking should not be an issue, but please read https://wiki.dovecot.org/NFS Aki On 17.10.2017 02:32, Matt Bryant wrote: > Anyone had any experience they can share using a director setup with > NFS and using the mdbox format instead of maildir. Is locking an issue > on index files ?? > > rgds > > Matt

1 0

Dovecot 2.2.31 Incorrect Search
by Siarhei Chystsiakou 17 Oct '17

17 Oct '17

Hi. I have installed dovecot 2.2.31 and fts plugin with Apache Solr 6.6.1. I have found that imap search is not correct in my dovecot. For example, I want to find email from user s.chistiakov(a)example.com. I run IMAP command "SEARCH FROM s.chi" and result is null. But if I run IMAP command "SEARCH FROM s.chistiakov" I get list of emails from this user. Why does this happen and how to fix it? Help me please ) Thanks. Result of my actions in telnet: https://hastebin.com/fewanacafu.md Dovecot config: https://hastebin.com/noqehimaxu.makefile

2 2

Re: Disable PAM
by Aki Tuomi 17 Oct '17

17 Oct '17

Yep. Just remove any passdb/userdb pam blocks ---Aki TuomiDovecot oy -------- Original message --------From: Travis Dolan <travis.dolan(a)gmail.com> Date: 17/10/2017 17:40 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Disable PAM Can I disable PAM auth if all my username/password lookups are via a database connection? I would love to get rid of the following lines in my logs... Oct 17 14:32:14 auth-worker(7809): Info: pam(xxx-xxx-xxx,111.111.111.111,<sdfhgsdfgsd>): pam_authenticate() failed: Authentication failure (password mismatch?) Cheers.

1 0

Disable PAM
by Travis Dolan 17 Oct '17

17 Oct '17

Can I disable PAM auth if all my username/password lookups are via a database connection? I would love to get rid of the following lines in my logs... Oct 17 14:32:14 auth-worker(7809): Info: pam(xxx-xxx-xxx,111.111.111.111,<sdfhgsdfgsd>): pam_authenticate() failed: Authentication failure (password mismatch?) Cheers.

1 0

Limit the nuumber of mails POPped at a time
by K F 17 Oct '17

17 Oct '17

Hi All I'm completely new to the world of Dovecot, so please bear with me if this is a simple noob question (which I fer it is :-) ) I have a postfix/dovecot setup for handling specific mails for clients. I have a piece of software with a mailclient that has problems when it POP's large amounts of mail. Unfortunately the system can't be updated or fixed.So I'm trying to figure out if I can limit the number of mails that can be seen via Dovecot. The procedure would be likeThe client connects. Dovecot limits the number of mails to 300. The client fetches and deletes the POPped mails immediately after retreivel.Next time it POPs it has the next batch. So it would be a question of always presenting a maximum of 300 mails via the POP3.Is it doable? Dovecot is version 2.2.10Server is a CentOS 7. Best regardsK

1 0

Fast replication
by ＠4OS 17 Oct '17

17 Oct '17

Hi, I'm trying to get replication to work with a 2 machines setup. So far full replication is happening at the specified interval (24hrs) without problem but fast sync is not happening. The fast sync counter is always equal to full sync unless i exec dsync manually. doveadm replicator status '*' username priority fast sync full sync success sync failed johndoe(a)oricom.dmz none 00:06:33 00:06:33 00:21:33 - johndoe2(a)oricom.dmz none 00:06:34 00:06:34 00:06:34 - johndoe3(a)oricom.dmz none 00:06:34 00:06:34 00:06:34 - The fast replication part is not clear and i cannot find much about it. There is nothing related with dovecot -a and the documentation does not say much about it. How the fast replication is triggered? Manually or it is supposed to be automatic through some type of config. Some light over this would help me understand the way it work and how to get it setup right. yves

2 2

mdbox + director + nfs
by Matt Bryant 17 Oct '17

17 Oct '17

Anyone had any experience they can share using a director setup with NFS and using the mdbox format instead of maildir. Is locking an issue on index files ?? rgds Matt -- <https://www.postbox-inc.com/?utm_source=email&utm_medium=siglink&utm_campai…>

3 2

Trash plugin unexpected results
by Stephan Herker 16 Oct '17

16 Oct '17

I have the trash plugin enabled and testing it out I had an account with a 30MB quota. In the accounts trash it had an email with a large attachment. I sent the same email again to the account expecting the trash plugin to purge the message from trash to make space for the new message in the inbox. However I got an error saying it couldn't remove enough trash to make space. This behavior seems unexpected because it seems like the trash plugin didn't account for the quota and size available. Debug logs and dovecot -n output below. Oct 07 17:33:13 lmtp(31543): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 07 17:33:13 lmtp(31543): Info: Connect from local Oct 07 17:33:13 lmtp(31543): Debug: Loading modules from directory: /usr/lib64/dovecot Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib11_trash_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib20_autocreate_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: auth input: 123(a)testdo.com home=/home/vmail/testdo.com/123 mail=maildir:/home/vmail/testdo.com/123 uid=2000 gid=2000 quota_rule=*:storage=30000 Oct 07 17:33:13 lmtp(31543): Debug: Added userdb setting: mail=maildir:/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543): Debug: Added userdb setting: plugin/quota_rule=*:storage=30000 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Effective uid=2000, gid=2000, home=/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota root: name=User quota backend=dict args=:proxy::quotadict Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=* bytes=30720000 messages=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota grace: root=User quota bytes=3072000 (10%) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: dict quota: user=123(a)testdo.com, uri=proxy::quotadict, noenforcing=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: maildir++: root=/home/vmail/testdo.com/123, index=, indexpvt=, control=, inbox=/home/vmail/testdo.com/123, alt= Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Added 'Spam' with priority 1 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Added 'Trash' with priority 2 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: sieve: Pigeonhole version 0.4.2 initializing Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: using the following location for user's Sieve script: /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: loading script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: script binary /home/vmail/testdo.com/123/.dovecot.svbin successfully loaded Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: binary save: not saving binary /home/vmail/testdo.com/123/.dovecot.svbin, because it is already stored Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: executing script from /home/vmail/testdo.com/123/.dovecot.svbin Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Failed to remove enough messages (needed 17035766 bytes, expunged only 16803594 bytes) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Info: uFHMBEly2Vk3ewAAobcTNA: sieve: msgid=<c5189e27-b2e3-bcc2-b34f-ecffa9d614cc(a)keagaming.com>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Info: uFHMBEly2Vk3ewAAobcTNA: sieve: execution of script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script failed with unsuccessful implicit keep (user logfile /home/vmail/testdo.com/123/.dovecot.sieve.log may reveal additional details) Oct 07 17:33:13 lmtp(31543): Info: Disconnect from local: Successful quit # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } first_valid_uid = 2000 hostname = testdo.com last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota trash expire" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quotadict quota_grace = 10%% quota_rule2 = Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = administrator(a)testdo.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota trash expire autocreate sieve quota" postmaster_address = postmaster(a)testdo.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota trash expire imap_quota notify quota" } protocol pop3 { mail_plugins = " quota trash expire quota" } Any help is appreciated, thanks.

3 5

SSL overview...
by SH Development 16 Oct '17

16 Oct '17

Can someone help me understand the overall picture of SSL certificates in this scenario? I have a working dovecot/postfix/mysql server. It has a certificate. I now want to create a second, essentially duplicate configured server for use with replication. What is the relationship between the certificate and the hostname, or the DNS entry since the certs are created using the server’s domain name? mail.serverA.mydomain has a certificate that was created using mail.serverA.mydomain. The server's hostname is mail.serverA.mydomain. Now enter the new server. It would probably be: mailserverB.mydomain and a certificate created using mail.serverB.mydomain. The server’s hostname would be mail.serverB.mydomain. My questions: 1. Can I use the same certificate on both servers since they are serving email for the same domain? 2. Does the hostname have to be the same as the domain name, and thus the name used to create the cert? Sorry if I’m muddled about this. It was never really an issue until I wanted to add a secondary server into the mix. Ethon B.

2 3

Convert from mbox to Maildir
by Josef Wolf 16 Oct '17

16 Oct '17

Hello everybody, I am in the process to install dovecot as an IMAP server. Currently, this system runs postfix and uses procmail for local (mbox style) delivery. Procmail ist started by postfix like this: /etc/postfix/main.cf: mailbox_command = /usr/bin/procmail ~/.forward: "|IFS=' ' && exec /usr/bin/procmail -f- || exit 75 # jw" Before going into IMAP details, I decided to convert the system to Maildir as a first step. So I created a procmail-entryrecipe to populate a test folder: ~/.procmailrc: :0 * ^Subject:.*dovecot-test { ORGMAIL="${HOME}/Maildir/" DEFAULT=${ORGMAIL} DELIVER="/usr/lib/dovecot/deliver -o mail_location=maildir:~/Maildir -o lda_mailbox_autocreate=yes" :0 | $DELIVER -m dovecot-test } This setup seems to work. But there is one point that bugs me: in the first tests, dovecot was mis-configured (the two -o options were missing) and the test mails were silently lost. No errors in the procmail logfile. Only dovecot reports errors in its logfile. But the error seems not to be noticed by procmail. Therefore procmail assumes deliver could store the mail successfully and won't keep a backup of it. I am sure, I'm doing something stupid here. I have never seen such behavior from procmail before. Normally procmail would report failure of sub-commands. Now I hesitate to go forward in this conversion process. I don't want to loose mails if something is wrong with the dovcot setup. Besides: I wonder whether the setting DEFAULT=${ORGMAIL} is a good idea. Wouldn't it be better to have DEFAULT=/var/spool/mail/$USER so there would be a fallback in case there are delivery problems to ${ORGMAIL} Any thougths? -- Josef Wolf jw(a)raven.inka.de

4 5

Question about ITERINDEX in 2.2.32
by María Arrea 16 Oct '17

16 Oct '17

Hello I have a question about the new setting ITERINDEX. This is my filesystem layout /indices_dovecot : 8 x Fast SSD drives /buzones : 32x SAS 10k rpm disks /buzones/alternativo : 24 x SAS 7.2k rpm slow disks This is my mail_location: mail_location = mdbox:/buzones/domain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n:ALT=/buzones/alternativo/domain/%2.26Hn/%2.200Hn/%n What should I write in mail_location with the new ITERINDEX setting? Regards María

2 6

Locking Errors
by List 16 Oct '17

16 Oct '17

We recently upgraded to version 2.2.10-8 on Centos 7 (from 2.2.10-7) and immediately started experiencing errors in the log file that look like this: Error: Broken file /mail/user/Maildir/dovecot-uidlist line 891: Invalid data: Error: Timeout (180s) while waiting for lock for transaction log file /mail/user/Maildir/dovecot.index.log Error: /mail/user/Maildir/.Trash/dovecot-uidlist: next_uid was lowered (421 -> 419, hdr=418) Error: Corrupted index cache file /mail/user/Maildir/dovecot.index.cache: invalid record size Error: Broken file /mail/user/Maildir/.Trash/dovecot-uidlist line 156: Invalid data: Error: Corrupted index cache file /mail/user/Maildir/dovecot.index.cache: invalid record size Error: Index /mail/user/Maildir/dovecot.index: Lost log for seq=2 offset=2392 Error: fcntl(write-lock) locking failed for file /mail/user/Maildir/dovecot.index.log: Stale file handle We are not sure what might be causing this, can anyone help illuminate what’s going on?

3 5

Setting up replication - First steps...
by SH Development 16 Oct '17

16 Oct '17

Just had my first (non-Dovecot) server failure due to dried out caps on the motherboard. Got me to thinking about my single-point-of-failure mail server. Currently running Dovecot and Postfix with no issues, but want to start taking steps just to be safe. I currently run a filesystem backup every 24 hours to a tar file over NFS to another server in our rack. I am backing up: /home/vmail /etc/dovecot /etc/postfix Unfortunately, the vmail directory has grown to 27GB and takes around 7 hours now to backup as described above. Which leads me to start thinking about how quickly I could restore the server from a backup if need be, and that time is at least 7 hours just to copy and untar the files onto another hard drive. I’m sure I could hook up a HD up directly to the backup server, then I could considerably reduce the time, but I’m making the assumption that I won’t always have quick physical access to the location. So I believe my first step is to set up another server, on another IP, different hostname, with Dovecot and Postfix, and simply use the files from the /etc directories of the existing server to configure it (changing the IP and hostname of course). Am I on the right track so far? Next steps involve setting up replication with dsync? If I have successfully setup replication between the two servers, does this mean users can then actually log into either server and have their “stuff” intact? So I could set up DNS failover in case the primary server fails? Would this make the setup acceptable for secondary MX as everything should sync to the primary server when it comes back online? Sorry for thinking out loud, but I want to make sure I’m understanding the bigger picture here. Jeff

4 3

Re: Newbie question...
by SH Development 16 Oct '17

16 Oct '17

I see you haven’t received an answer. Sorry people here don’t seem to have time or inclination to answer basic questions. I’ve tried. You’re better to search elsewhere. Ethon > On Oct 11, 2017, at 12:17 PM, Michael Segel <dovecot_mjs(a)hotmail.com <mailto:dovecot_mjs@hotmail.com>> wrote: > > Hi, > > I’ve downloaded and built dovecot from the source. > Now I’ve run in to a couple of issues. > Like namespaces. > > Is there an example of the namespaces settings? Nothing fancy, just the basics… > > These are private mailboxes, but still need to know what I have to do to set this correctly. > > Thanks In Advance, > > -Mike >

3 4

Filtering by country
by Anvar Kuchkartaev 16 Oct '17

16 Oct '17

Is it possible to filter out logins by country (I would like to limit dovecot instance users to log in only from specific countries)?‎‎ Anvar Kuchkartaev anvar(a)anvartay.com

3 2

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Aki Tuomi 14 Oct '17

14 Oct '17

We'll take a look ---Aki TuomiDovecot oy -------- Original message --------From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 12/10/2017 07:50 (GMT+02:00) To: Aki Tuomi <aki.tuomi(a)dovecot.fi> Subject: Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) Hi Aki, I think I posted a bt full of this in the original email I sent to the list: https://www.dovecot.org/pipermail/dovecot/2017-October/109583.html I've got heaps of coredumps if we need to pick apart one specific one now though. Reuben On 12/10/2017 3:36 PM, Aki Tuomi wrote: > can you provide bt full output from core? > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Reuben Farrelly <reuben-dovecot(a)reub.net> > Date: 12/10/2017 06:22 (GMT+02:00) > To: Aki Tuomi <aki.tuomi(a)dovecot.fi>, dovecot(a)dovecot.org > Subject: Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) > > Hi, > > Just to confirm this is still a major problem for me with the 2.2.33.1 > release (did not exist in previous releases). > > Reuben > > > On 8/10/2017 6:30 AM, Aki Tuomi wrote: >> Thanks! We'll look into it. >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> -------- Original message -------- >> From: Reuben Farrelly <reuben-dovecot(a)reub.net> >> Date: 07/10/2017 13:08 (GMT+02:00) >> To: dovecot(a)dovecot.org >> Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) >> >> This appears to be breaking dsync at the moment and is caused by >> something committed in the last week or so. This is with the current >> -git of dovecot-2.2 (eaf276b33). >> >> The crash happens all the time - the logs are full of this message. >> >> Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O >> leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) >> Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file >> ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != >> NULL) >> Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw >> backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] >> -> /usr/lib64/dovecot/li >> bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> >> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> >> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 >> 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) >> [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) >> [0x7f8bb65815f8] -> /usr/lib64/dovec >> ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> >> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] >> -> /usr/lib64/dovecot/libssl_iost >> ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> >> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) >> [0x7f8bb12da52e] -> / >> usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] >> -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) >> [0x7f8bb657e765] -> >> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] >> -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> >> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> >> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] >> -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) >> [0x7f8bb657e93f] -> >> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] >> -> dovecot/doveadm-server() [0x444a35] -> >> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> >> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) >> [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> >> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() >> [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) >> [0x7f8bb656d241] -> >> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) >> [0x7f8bb656fe58] -> >> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) >> [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) >> [0x7f8bb656d345] >> Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: >> service(doveadm): child 27186 killed with signal 6 (core dumped) >> >> >> thunderstorm reuben # file core >> core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, >> from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: >> 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', >> platform: 'x86_64' >> >> thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core >> GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 >> Copyright (C) 2017 Free Software Foundation, Inc. >> License GPLv3+: GNU GPL version 3 or later >> <http://gnu.org/licenses/gpl.html> >> This is free software: you are free to change and redistribute it. >> There is NO WARRANTY, to the extent permitted by law. Type "show copying" >> and "show warranty" for details. >> This GDB was configured as "x86_64-pc-linux-gnu". >> Type "show configuration" for configuration details. >> For bug reporting instructions, please see: >> <https://bugs.gentoo.org/>. >> Find the GDB manual and other documentation resources online at: >> <http://www.gnu.org/software/gdb/documentation/>. >> For help, type "help". >> Type "apropos word" to search for commands related to "word"... >> Reading symbols from /usr/libexec/dovecot/doveadm-server...done. >> [New LWP 27186] >> [Thread debugging using libthread_db enabled] >> Using host libthread_db library "/lib64/libthread_db.so.1". >> Core was generated by `dovecot/doveadm-server'. >> Program terminated with signal SIGABRT, Aborted. >> #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 >> (gdb) bt full >> #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 >> No symbol table info available. >> #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 >> No symbol table info available. >> #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, >> status=0) at failures.c:201 >> backtrace = 0x228e4d8 >> "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> >> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> >> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... >> #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, >> format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", >> args=0x7ffef81daa70) >> at failures.c:670 >> status = 0 >> #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line >> %d (%s): assertion failed: (%s)") at failures.c:275 >> ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, >> timestamp_usecs = 0} >> args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = >> 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}} >

3 6

Updating keywords on copy/move
by Daniele Ricci 14 Oct '17

14 Oct '17

Hello, I'm working on my virtual keywords plugin [1] to add an apparently simple feature: add a keyword to a message when it is moved or copied into a virtual folder (let's forget about what keyword to add, I'm starting with a hard-coded one to understand Dovecot plugin development). So I've added a mail_copy hook by the notify plugin [2] and did a simple call to mail_update_keywords [3]. The current source code shows a call to mail_get_backend_mail, this is me experimenting, I've also tried calling mail_update_keywords directly on "dst" mail. The result is an imap crash: Oct 14 21:22:26 notebook dovecot: imap(daniele): Panic: file mail-log-plugin.c: line 461 (mail_log_mail_transaction_commit): assertion failed: (msg->pretext == NULL) Oct 14 21:22:26 notebook dovecot: imap(daniele): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x9f0a2) [0x7f81af52f0a2] -> /usr/lib/dovecot/libdovecot.so.0(+0x9f19a) [0x7f81af52f19a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f81af4bfcf8] -> /usr/lib/dovecot/modules/lib20_mail_log_plugin.so(+0x19e8) [0x7f81aeae89e8] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(notify_contexts_mail_transaction_commit+0x58) [0x7f81aecec548] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(+0x2105) [0x7f81aeced105] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x52) [0x7f81af807ca2] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0x21) [0x7f81af807d71] -> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_transaction_commit+0x78) [0x7f81ae8e2fb8] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(+0x20ec) [0x7f81aeced0ec] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x52) [0x7f81af807ca2] -> dovecot/imap(+0x10084) [0x563d0ff2b084] -> dovecot/imap(command_exec+0x5c) [0x563d0ff37d9c] -> dovecot/imap(+0x1b322) [0x563d0ff36322] -> dovecot/imap(+0x1b3bc) [0x563d0ff363bc] -> dovecot/imap(client_handle_input+0x18d) [0x563d0ff3677d] -> dovecot/imap(client_input+0xac) [0x563d0ff36ccc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f81af544742] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) [0x7f81af545d8e] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) [0x7f81af5447d6] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f81af544988] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f81af4ca353] -> dovecot/imap(main+0x329) [0x563d0ff29139] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f81af1132e1] -> dovecot/imap(_start+0x2a) [0x563d0ff292ca] This happens after my hook returns. Now, before activating core dumps and starting to do some serious debugging and reverse engineering, I ask: do I have to do something extra such as opening a transaction or something? Isn't the notify plugin supposed to do that already? Thanks for your help! [1] http://github.com/daniele-athome/dovecot-virtual-keywords-plugin [2] https://github.com/daniele-athome/dovecot-virtual-keywords-plugin/blob/keyw… [3] https://github.com/daniele-athome/dovecot-virtual-keywords-plugin/blob/keyw… -- Daniele

1 0

Last Login example
by Jorge Bastos 14 Oct '17

14 Oct '17

Howdy, Where can i find a configuration example for the last login plugin, that fits for latest dovecot version? Thanks in advanced! Jorge,

1 0

Re: Solr/Basic Auth?
by Aki Tuomi 14 Oct '17

14 Oct '17

You can include it in the url, like http://user:pass@host/---Aki TuomiDovecot oy -------- Original message --------From: Larry Rosenman <larryrtx(a)gmail.com> Date: 13/10/2017 23:32 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Subject: Solr/Basic Auth? Does the fts-solr plugin support solr's basic auth plugin? If not, can it? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Solr/Basic Auth?
by Larry Rosenman 13 Oct '17

13 Oct '17

Does the fts-solr plugin support solr's basic auth plugin? If not, can it? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

Re: Convert from mbox to Maildir
by Joseph Tam 13 Oct '17

13 Oct '17

Nikolai Lusan <nikolai(a)lusan.id.au> writes: >> Just went through this one recently using CentOS with SendMail, Procmail >> and IMAP conversion from mbox to Maildir - I needed to make sure I could >> run both formats while I migrated users one-by-one. > > When I have migrated solutions from mbox to maildir (I have done more than > one) I found it easier to get a mail client to do the hard work for me (if > you're on a LAN with the server it's faster). I created new usernames with > maildir as their base, and copied the folder over. Reading over David's and various schemes, the tricky part is consistency: avoiding race conditions where you have the user manipulating their mailboxes and your MTA/LDA delivering mail, while simultaneously doing mbox->Maildir conversion. To guarantee consistency, it's necessary to lock out other avenues of mbox changes while the conversion takes place. Otherwise, you'll have the situation where mail can get duplicated, or worse, deleted. For example, think of this sequence: convert B, user moves message A->B, convert A. I think the safest is method is 1) Deny the user access to IMAP/POP: deny userdb/passdb, or lock their password and flush their auth cache entry. 2) TEMPFAIL MTA delivery to user during conversion 3) Kick the user 4) Do the conversion 5) Undo 1+2 If you have a smart conversion script (one that recognizes changes and only do delta updates) you can greatly speed up step 4 and minimize outage time. 0) Do an initial conversion that will do the bulk of the work but does not guranatee consistency. Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: v2.2.33 released
by Aki Tuomi 13 Oct '17

13 Oct '17

try with 2.2.33.1 ---Aki TuomiDovecot oy -------- Original message --------From: Odhiambo Washington <odhiambo(a)gmail.com> Date: 13/10/2017 10:42 (GMT+02:00) To: Dovecot Mailing List <dovecot(a)dovecot.org> Cc: dovecot-news(a)dovecot.org Subject: Re: v2.2.33 released On 10 October 2017 at 18:28, Timo Sirainen <tss(a)iki.fi> wrote: > https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz > https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz.sig > > We're getting close to the last v2.2.x releases. Hopefully we'll have the > first v2.3 beta releases out soon. > Something is wrong with 2.2.33, but I haven't found time to catch it. I have been running 2.2.32 without issues. I use dovecot-lda with Exim. The moment I installed 2.2.33, it was all failures - mail somehow gets delivered, but a failure too is generated. I have backed off from 2.2.33 for now. Maybe I will find time to debug later. Maybe someone already found a way around, but I missed the post? -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254 7 3200 0004/+254 7 2274 3223 "Oh, the cruft."

2 3

v2.2.33 released
by Timo Sirainen 13 Oct '17

13 Oct '17

https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.33.tar.gz.sig We're getting close to the last v2.2.x releases. Hopefully we'll have the first v2.3 beta releases out soon. * doveadm director commands wait for the changes to be visible in the whole ring before they return. This is especially useful in testing. * Environments listed in import_environment setting are now set or preserved when executing standalone commands (e.g. doveadm) + doveadm proxy: Support proxying logs. Previously the logs were visible only in the backend's logs. + Added %{if}, see https://wiki2.dovecot.org/Variables#Conditionals + Added a new notify_status plugin, which can be used to update dict with current status of a mailbox when it changes. See https://wiki2.dovecot.org/Plugins/NotifyStatus + Mailbox list index can be disabled for a namespace by appending ":LISTINDEX=" to location setting. + dsync/imapc: Added dsync_hashed_headers setting to specify which headers are used to match emails. + pop3-migration: Add pop3_migration_ignore_extra_uidls=yes to ignore mails that are visible in POP3 but not IMAP. This could happen if new mails were delivered during the migration run. + pop3-migration: Further improvements to help with Zimbra + pop3-migration: Cache POP3 UIDLs in imapc's dovecot.index.cache if indexes are enabled. These are used to optimize incremental syncs. + cassandra, dict-sql: Use prepared statements if protocol version>3. + auth: Added %{ldap_dn} variable for passdb/userdb ldap - acl: The "create" (k) permission in global acl-file was sometimes ignored, allowing users to create mailboxes when they shouldn't have. - sdbox: Mails were always opened when expunging, unless mail_attachment_fs was explicitly set to empty. - lmtp/doveadm proxy: hostip passdb field was ignored, which caused unnecessary DNS lookups if host field wasn't an IP - lmtp proxy: Fix crash when receiving unexpected reply in RCPT TO - quota_clone: Update also when quota is unlimited (broken in v2.2.31) - mbox, zlib: Fix assert-crash when accessing compressed mbox - doveadm director kick -f parameter didn't work - doveadm director flush <host> resulted flushing all hosts, if <host> wasn't an IP address. - director: Various fixes to handling backend/director changes at abnormal times, especially while ring was unsynced. These could have resulted in crashes, non-optimal behavior or ignoring some of the changes. - director: Use less CPU in imap-login processes when moving/kicking many users. - lmtp: Session IDs were duplicated/confusing with multiple RCPT TOs when lmtp_rcpt_check_quota=yes - doveadm sync -1 fails when local mailboxes exist that do not exist remotely. This commonly happened when lazy_expunge mailbox was autocreated when incremental sync expunged mails. - pop3: rawlog_dir setting didn't work

2 1

Released Pigeonhole v0.4.21 for Dovecot v2.2.33.1.
by Stephan Bosch 12 Oct '17

12 Oct '17

Hello Dovecot users, Here's the definitive 0.4.21 release. There were no changes since the release candidate. Changelog v0.4.21: * redirect action: Always set the X-Sieve-Redirected-From header to sieve_user_email if configured. Before, it would use the envelope recipient instead if available, which makes no sense if the primary e-mail address is available. + vacation extension: Allow ignoring the envelope sender while composing the "To:" header for the reply. Normally, the "To:" header is composed from the address found in the "Sender", "Resent-From" or "From" headers that is equal to the envelope sender. If none is then found, the bare envelope sender is used. This change adds a new setting "sieve_vacation_to_header_ignore_envelope". With this setting enabled, the "To:" header is always composed from those headers in the source message. The new setting thus allows ignoring the envelope, which is useful e.g. when SRS is used. + vacation extension: Compose the "To:" header from the full sender address found in the first "Sender:", "From:" or "Resent-From:" header. Before, it would create a "To:" header without a phrase part. The new behavior is nicer, since the reply will be addressed to the sender by name if possible. - LDA Sieve plugin: Fixed sequential execution of LDAP-based scripts. A missing LDAP-based script could cause the script sequence to exit earlier. - sieve-filter: Removed the (now) duplicate utf8 to mutf7 mailbox name conversion. This caused problems with mailbox names containing UTF-8 characters. The Dovecot API was changed years ago, but apparently sieve-filter was never updated. The release is available as follows: https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.21.t… https://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.21.t… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Solr 7
by Ricardo Branco 12 Oct '17

12 Oct '17

Before I go down the route of upgrading our main Solr instance from 6 to 7, just checking if anyone is using Solr 7 with Dovecot.

4 4

Re: Mail Alias Stores in mySQL Not working - SOLVED
by jason hirsh 12 Oct '17

12 Oct '17

"You have the alias abuse(a)kasdivi.com <mailto:abuse@kasdivi.com> for the address admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> in your db and all mail to these aliases should go the the admin@ mailbox. Address mapping should be done in postfix so that the recipient address that gets used on the lmtp connection to dovecot is admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> You probably disabled address mapping in postfix. -- Christian Kivalo” You nailed that .. I had completely forgotten about that.. I am changing a system from hash to SQL I actually feel kind of stupid I knew Postfix was supposed to do the acceptance.. and it should have been common sense that it need to rewrite.. The logs kept reminding me I had the following line in master,cf -o receive_override_options=no_address_mappings,no_header_body_checks,no_unknown_recipient_checks changed to -o receive_override_options=no_header_body_checks,no_unknown_recipient_checks and system works great.. Thanls!!

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"So abuse(a)kasdivi.com <mailto:abuse@kasdivi.com> is an alias, not a user.? You can't login with an alias because your user_query is looking at the`mailbox` table. Have your tried logging in as: admin(a)theoceanwindow.com <mailto:admin@theoceanwindow.com> OR you could put an entry forabuse(a)kasdivi.com <mailto:forabuse@kasdivi.com> in your `mailbox` table. Bill” Bill Excuse me I must have some where mi-stated myself. Yes abuse(a)variousdoamns.com is an alias going back to my admin account The issue was iin my master.cf where I had at some time disabled remapping Fixed that and all is good Thanks for your time and effort.. You helped tremendously and actually had me discover some other issues Jason

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

3 2

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"In an earlier post you said your user_query was: user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active=?1' Last post you said: mail is stored at /var/mail/vhosts and: mail_location = maildir:/var/mail/vhosts/%d/%n These don't agree with your user_query.” Probably my mis-statement "Run a MySQL query: SELECT `username`, `domain`, `maildir` FROM `mailbox` LIMIT 5; Let's see the value of maildir” mysql> SELECT `username`, `domain`, `maildir` FROM `mailbox` LIMIT 5; +--------------------------+--------------------+---------------------------+ | username | domain | maildir | +--------------------------+--------------------+---------------------------+ | jason(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/jason/ | | admin(a)gcsbonaire.com | gcsbonaire.com | gcsbonaire.com/admin/ | | admin(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/admin/ | | test(a)theoceanwindow.com | theoceanwindow.com | theoceanwindow.com/test/ | | lin(a)grapestreet.com | grapestreet.com | grapestreet.com/lin/ | +--------------------------+--------------------+---------------------------+ 5 rows in set (0.00 sec) "Also, lets see the output of: ls -l /var/mail/vhosts/*” drwxrwxr-x 4 1003 vmail 512 Jun 25 2016 camantonewfashion.com drwxrwxr-x 4 1003 vmail 512 Sep 6 2016 filmusfamily.com drwxrwxr-x 8 1003 vmail 512 Oct 8 13:44 gcs-bonaire.com drwxrwxr-x 4 1003 vmail 512 Oct 5 07:40 gcsbonaire.com drwxrwxr-x 3 1003 vmail 512 Jun 25 2016 grapestreet.com drwxrwxr-x 5 1003 vmail 512 Jun 25 2016 grapestreetgen.com drwxrwxr-x 5 1003 vmail 512 Jun 25 2016 grapestreetvoice.com drwxrwxr-x 11 1003 vmail 512 Oct 11 13:37 kasdivi.com drwx------ 3 1003 vmail 512 Oct 11 13:25 test.com drwxrwxr-x 7 1003 vmail 512 Oct 11 13:42 theoceanwindow.com It seems that the correct information is stored in the correct place but i get dovecot: auth-worker(21961): sql(abuse(a)kasdivi.com): unknown user Its seems like there is a simple config thing I am not getting right Jason

2 1

v2.2.33.1 released
by Timo Sirainen 12 Oct '17

12 Oct '17

https://dovecot.org/releases/2.2/dovecot-2.2.33.1.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.33.1.tar.gz.sig Oops, one a bit too bad bug was left in the release, so fixing it here. - dovecot-lda was logging to stderr instead of to the log file.

2 1

Connection closed reason
by Miloslav Hůla 12 Oct '17

12 Oct '17

Hi, we have one user using the old Alpine client with IMAP. Time to time (3 times per day or 3 times per week) he get error: "MAIL FOLDER INBOX CLOSED DUE TO ACCESS ERROR" and he complains, that inbox stops to refresh with new emails. I don't know Alpine but I can imagine, that Alpine creates TCP connection to IMAPS and uses IDLE. I read wiki page about Timeouts [1] and it seems OK. Alpine is connected 5 or more hours without interrupt. But I found 'Connection closed' at approximate times of user reports in mail.log. Am'I undestand it correctly, that 'Connection closed' is some kind of incorrect connection end? I can find 'Logged out' messages which seems to me as correct ones. I can imagine that such situations may happend for moving clients, such a smartphone with losing signal. But mentioned user is on local network connected by cable. I'm interested, what exactly 'Connection closed' in mail log means. We have following lines in log: dovecot: imap(username): Connection closed in=63 out=288442 dovecot: imap(username): Connection closed (IDLE running for 0.001 + waiting input for 0.001 secs, 2 B in + 10+0 B out, state=wait-input) in=9668 out=17375 imap(username): Connection closed: read(size=3751) failed: Connection reset by peer in=4441 out=51431 dovecot: imap(username): Connection closed (UID fetch running for 0.008 + waiting input for 0.001 secs, 0.001 in locks, 101 B in + 202+202 B out, state=wait-input) in=3330 out=436043 Could it be problem in our network or Dovecot configuration issue? Can I somehow debug all connections for single client? Thank you, Milo [1] https://wiki.dovecot.org/Timeouts

2 2

Re: Connection closed reason
by Joseph Tam 12 Oct '17

12 Oct '17

Miloslav H?la <miloslav.hula(a)gmail.com> > we have one user using the old Alpine client with IMAP. Time to time (3 > times per day or 3 times per week) he get error: "MAIL FOLDER INBOX > CLOSED DUE TO ACCESS ERROR" and he complains, that inbox stops to > refresh with new emails. Hmm, I see when using direct file access, but not when using IMAP, but I don't often connect this way with alpine). > Am'I undestand it correctly, that 'Connection closed' is some kind of > incorrect connection end? I can find 'Logged out' messages which seems > to me as correct ones. > ... > dovecot: imap(username): Connection closed in=63 out=288442 > dovecot: imap(username): Connection closed (IDLE running for 0.001 + > waiting input for 0.001 secs, 2 B in + 10+0 B out, state=wait-input) > in=9668 out=17375 I was able to simulate this using netcat -- this log message comes when the client closes the connection during IDLE. > imap(username): Connection closed: read(size=3751) failed: Connection > reset by peer in=4441 out=51431 I couldn't recreate this, but this happens when the client sends an immediate TCP RST connection teardown packet, rather than the usual FIN/ACK/RST orderly shutdown. I don't know what would cause this -- maybe some firewall state session timeout? Joseph Tam <jtam.home(a)gmail.com>

2 1

How to map email addresses to usernames?
by Andreas Born 12 Oct '17

12 Oct '17

Hello, I have a general question about userdb and passdb lookups, in my case related to driver=sql. The documentation and most examples in the internet seem to assume that a user's login username to access a mailbox is identical to his email-address, or at least to the local-part of this email-address. This setup works fine. But I don't understand how to setup dovecot, when login username and email adresses differ. Or to say it in other words, how to map email-adresses to mailbox users. I need a sql password_query for passdb to validate the password for a given login name during SMTP or SASL authentication. Lets say the credentials are "user-1"/"anypassword", then the query is similar to "select password from mailboxes where username='%u'". The next step, user_query for userdb is executed to get storage information for user "user-1". This query must also search for the username "user-1", not for an email-adress: "select home, mail from mailboxes where username='%u'". So far, so good. But: For incoming mails via LMTP, my user_query from userdb is being executed with the email-address as search parameter (instead of the login name), so it fails. I miss a third query that maps one user to each email address for delivery, prior to the userdb lookup. For Example: bob(a)example.org => user-1 eve(a)example.org => user-1 ted(a)example.org => user-2 @catchall.org => user-3 "select username from addr_maps where addr='%n@%d'". What is the correct setup for this szenario? I've found two solutions that seem to work, but i'm not sure if they are really failsafe. I) I use driver=prefetch as a first userdb, so for authentication, only the password_query from passdb is relevant and returns all mailbox details. A second userdb does a user_query lookup against email-addresses and is only called for incoming mails. passdb { driver = sql args = /etc/dovecot/sql-check-user.conf } userdb { driver = prefetch } userdb { driver = sql args = /etc/dovecot/sql-check-addr.conf } II) The second userdb performs lookups against usernames (as in the passwd query), but I place a third userdb {} within the lmtp's protocol section, which does a address lookup instead of a username lookup: protocol lmtp { userdb { driver = sql args = /etc/dovecot/sql-check-addr.conf } } passdb { driver = sql args = /etc/dovecot/sql-check-user.conf } userdb { driver = sql args = /etc/dovecot/sql-check-user.conf } What do you think, is there a better solution? - greetings Andreas Dovecot Version: 2.2.27 (c0f36b0)

2 1

Newbie question...
by Michael Segel 12 Oct '17

12 Oct '17

Hi, I’ve downloaded and built dovecot from the source. Now I’ve run in to a couple of issues. Like namespaces. Is there an example of the namespaces settings? Nothing fancy, just the basics… These are private mailboxes, but still need to know what I have to do to set this correctly. Thanks In Advance, -Mike

2 1

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Aki Tuomi 12 Oct '17

12 Oct '17

can you provide bt full output from core? ---Aki TuomiDovecot oy -------- Original message --------From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 12/10/2017 06:22 (GMT+02:00) To: Aki Tuomi <aki.tuomi(a)dovecot.fi>, dovecot(a)dovecot.org Subject: Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) Hi, Just to confirm this is still a major problem for me with the 2.2.33.1 release (did not exist in previous releases). Reuben On 8/10/2017 6:30 AM, Aki Tuomi wrote: Thanks! We'll look into it. --- Aki Tuomi Dovecot oy -------- Original message -------- From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 07/10/2017 13:08 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}}

1 0

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Reuben Farrelly 12 Oct '17

12 Oct '17

Hi, Just to confirm this is still a major problem for me with the 2.2.33.1 release (did not exist in previous releases). Reuben On 8/10/2017 6:30 AM, Aki Tuomi wrote: > Thanks! We'll look into it. > > > > --- > Aki Tuomi > Dovecot oy > > -------- Original message -------- > From: Reuben Farrelly <reuben-dovecot(a)reub.net> > Date: 07/10/2017 13:08 (GMT+02:00) > To: dovecot(a)dovecot.org > Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) > > This appears to be breaking dsync at the moment and is caused by > something committed in the last week or so. This is with the current > -git of dovecot-2.2 (eaf276b33). > > The crash happens all the time - the logs are full of this message. > > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O > leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file > ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != > NULL) > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw > backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] > -> /usr/lib64/dovecot/li > bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> > /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 > 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) > [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) > [0x7f8bb65815f8] -> /usr/lib64/dovec > ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> > /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] > -> /usr/lib64/dovecot/libssl_iost > ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> > /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) > [0x7f8bb12da52e] -> / > usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] > -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) > [0x7f8bb657e765] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] > -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> > /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] > -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) > [0x7f8bb657e93f] -> > /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] > -> dovecot/doveadm-server() [0x444a35] -> > /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) > [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> > dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() > [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) > [0x7f8bb656d241] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) > [0x7f8bb656fe58] -> > /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) > [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) > [0x7f8bb656d345] > Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: > service(doveadm): child 27186 killed with signal 6 (core dumped) > > > thunderstorm reuben # file core > core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, > from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: > 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', > platform: 'x86_64' > > thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core > GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 > Copyright (C) 2017 Free Software Foundation, Inc. > License GPLv3+: GNU GPL version 3 or later > <http://gnu.org/licenses/gpl.html> > This is free software: you are free to change and redistribute it. > There is NO WARRANTY, to the extent permitted by law. Type "show copying" > and "show warranty" for details. > This GDB was configured as "x86_64-pc-linux-gnu". > Type "show configuration" for configuration details. > For bug reporting instructions, please see: > <https://bugs.gentoo.org/>. > Find the GDB manual and other documentation resources online at: > <http://www.gnu.org/software/gdb/documentation/>. > For help, type "help". > Type "apropos word" to search for commands related to "word"... > Reading symbols from /usr/libexec/dovecot/doveadm-server...done. > [New LWP 27186] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib64/libthread_db.so.1". > Core was generated by `dovecot/doveadm-server'. > Program terminated with signal SIGABRT, Aborted. > #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 > (gdb) bt full > #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 > No symbol table info available. > #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 > No symbol table info available. > #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, > status=0) at failures.c:201 > backtrace = 0x228e4d8 > "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> > /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> > /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... > #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, > format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", > args=0x7ffef81daa70) > at failures.c:670 > status = 0 > #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line > %d (%s): assertion failed: (%s)") at failures.c:275 > ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, > timestamp_usecs = 0} > args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = > 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}}

1 0

Re: Mail Alias Stores in mySQL Not working
by jason hirsh 12 Oct '17

12 Oct '17

"With that query, it appears everyone is sharing the same mail directory.? It, of course, depends on the value of `maildir`.? It doesn't look right.” stored by domain or at least it was until i started messing with mysql "Have you checked your MySQL log file to see the actual query?” hmm found out i had never enabled that log…. another tangent I need to follow "We don't know your mailbox format.? Post your 'doveconf -n’.” My bad # OS: FreeBSD 11.0-RELEASE-p9 amd64 ufs auth_debug = yes auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no mail_location = maildir:/var/mail/vhosts/%d/%n mail_privileged_group = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } pop3_uidl_format = %v.%u postmaster_address = postmaster(a)theoceanwindow.com service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service director { unix_listener director-userdb { mode = 0600 } } service imap-login { inet_listener imaps { port = 993 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service pop3-login { inet_listener pop3s { port = 995 ssl = yes } } ssl_ca = </usr/local/etc/keys/certs/ca.crt ssl_cert = </usr/local/etc/keys/certs/domain.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol imap { mail_max_userip_connections = 30 } We don't know what your table layout looks like.? Post your 'SHOW COLUMNS FROM `mailbox`’. +------------+--------------+------+-----+---------------------+-------+ | Field | Type | Null | Key | Default | Extra | +------------+--------------+------+-----+---------------------+-------+ | username | varchar(255) | NO | PRI | NULL | | | password | varchar(255) | NO | | NULL | | | name | varchar(255) | NO | | NULL | | | maildir | varchar(255) | NO | | NULL | | | quota | bigint(20) | NO | | 0 | | | local_part | varchar(255) | NO | | NULL | | | domain | varchar(255) | NO | MUL | NULL | | | created | datetime | NO | | 2000-01-01 00:00:00 | | | modified | datetime | NO | | 2000-01-01 00:00:00 | | | active | tinyint(1) | NO | | 1 | | +------------+--------------+------+-----+---------------------+-------+ What is the on-disk directory layout for mail? mail is stored at /var/mail/vhosts

2 1

Aborted dsync backup and resulting fallout
by Andreas Thienemann 11 Oct '17

11 Oct '17

Hi, I am in the middle of setting up a dovecot imap server to replace an aging cyrus imapd. The new server is using mdbox storage for better filesystem performance and is running dovecot-2.2.32. To migrate email over and keep UIDs etc. intact I used the backup feature of doveadm. During testing this generally worked fine. So thanks for that functionality, it really makes migration much easier. I did another sync yesterday which was unintentionally aborted in the middle which left some corrupted files around. Not a problem generally, that's what doveadm force-resync should fix. It did move a m.2 to m.2.broken mailbox file, so that is good. But it seemed to have issues with the m.3 file, which was an empty file of 0 bytes. Even running force-resync a repeatedly always showed the same message: # doveadm force-resync -u cd INBOX doveadm(cd): Warning: fscking index file /var/spool/imap/user/cd/storage/dovecot.map.index doveadm(cd): Warning: mdbox /var/spool/imap/user/cd/storage: rebuilding indexes doveadm(cd): Error: Corrupted dbox file /var/spool/imap/user/cd/storage/m.3 (around offset=0): EOF while reading file header doveadm(cd): Error: mdbox rebuild: Failed to fix file /var/spool/imap/user/cd/storage/m.3 This looks like incorrect behavior. If the file header on a file expected to be a mailbox header is absent, I would expect it to be either best-effort parsed and the header added or at least be moved out of the way as e.g. m.3.broken. After fixing the m.3 storage manually I encountered another kind of error running dsync again: dsync(cd): Error: lucene index /var/spool/imap/user/cd/lucene-indexes: IndexReader::open() failed (#1): IndexInput read past EOF Lucene index broken should be easily fixed by running doveadm fts rescan. Is that correct? The other error thought had to do with the single instance store for attachments. There were a bunch of errors about a broken pipe and three errors stating success instead: dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/c3/0c/hashes/c30cb535927c8bcecb0d45d374624942d0f4e56e: Broken pipe dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/0f/0b/hashes/0f0b5351e09ebb487660f23c9b617568093b93d1: Broken pipe dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/10/f9/hashes/10f9a4ffd14a5c31f9938c9d8a3ce3f2095fab36: Success dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/9b/9a/hashes/9b9a449477882dfca86e80157616cadbb21bb3b8: Success dsync(cd): Error: fs-sis: Couldn't read hash file /var/spool/imap/attachments/df/69/hashes/df698a8bda301a7a474ae2b11414c6f532f4461e: Broken pipe As with the m.3 storage file, all these files had 0 byte size. What is the best way of fixing these up? Delete and be done? Thanks, Andreas

1 0

FTS Dealing badly with Tika failures
by Andreas Thienemann 11 Oct '17

11 Oct '17

Hi, I've seen that latest Dovecot has the ability to use the Apache Tika Server to extract metadata from attachments. That is a pretty useful feature and looks to be an improvement over piping the attachment through a shellscript as done with fts_decoder. Having this feature enabled though I sometimes do see the situation that the tika service does not reply in time and it looks like the whole FTS transaction gets aborted: dovecot: indexer-worker(eggs@localhost): Error: fts_tika: PUT http://localhost:9998/tika/ failed: Request timed out (Request queued 60.145 secs ago, 1 attempts in 60.134 secs, 60.034 in http ioloop, 0.000 in other ioloops, connected 1739.235 secs ago) dovecot: indexer-worker(eggs@localhost): Error: Mailbox INBOX.junk: Mail search failed: Internal error occurred. Refer to server log for more information. [2017-10-09 03:46:09] dovecot: indexer-worker(eggs(a)bawue.de): Error: Mailbox INBOX.junk: Transaction commit failed: FTS transaction commit failed: transaction context (attempted to index 12084 messages (UIDs 2..17850)) Is that actually sensible behavior? I would consider attachment metadata to be nice to have, but not necessarily mandatory. So if the attachment indexing fails, I would hope that at least the mailtext got indexed. But it seems like we abort the whole transaction. Am I reading the error log correctly? cheers, Andreas

1 0

dovecot-2.2.33 bug report
by David Binderman 11 Oct '17

11 Oct '17

Hello there, dovecot-2.2.33/src/lib/str-find.c:86]: (warning) Calling 'sizeof' on 'sizeof' Source code is ctx = p_malloc(pool, MALLOC_ADD(sizeof(struct str_find_context), MALLOC_MULTIPLY(sizeof(ctx->goodtab[0]), key_len))); Regards David Binderman

2 1

Re: My sub-folder with Outlook work-around to date - update 201710111315 - Final
by David.M.Clark 11 Oct '17

11 Oct '17

Hi All, After over a week of stuffing around in /etc/dovecot/conf.d files and lots of trial and error, I now have a controlled setup to migrate one user at a time to Maildir without affecting the other mbox based users. For the sake of not posting an essay, if you go to this web page: http://dmc1961.id.au/howto_17101101.php you will see what I have done (moderators please let me know if this is the correct or allowable practice to post links rather than massive e-mails to the group?). My sincere thanks to all who contributed and helped steer me in the right direction - I got a little lost on-line for a while but eventually got back to the right setup (our beloved Linux does have a few different file locations and setup based on the releases out there, so these were a little confusing). Working well now on my test environment and on a test user on the client's box we need to convert, so if there are any more gotchas I will add them to the how-to web page and update you all. Was a battle at times but it was a war worth winning. -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) =--------------------------------------------------------------------------= Davrom Consulting Pty Ltd Mobile: 0418763124 PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com ABN: 81 096 990 804 E-mail (Priv): dmc1961(a)dmc1961.id.au Website: http://davrom.com Skype: dmc1961 Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------= Please note: Any e-mail communication bearing this signature is for the exclusive purpose of the sender and is not for publication without the expressed permission of the sender or respective sender's organisation. =--------------------------------------------------------------------------=

1 0

Issue with mailbox conversion using dsync in v2.2.32 (maildir <-> mdbox)
by Jason Kiniry 10 Oct '17

10 Oct '17

Hi all, I've run into an issue with in-place mailbox format conversions between mdbox and maildir and wondered if someone could assist. When using dsync to convert a mailbox, the conversion loses a mailbox GUID and produces a warning. This behavior seems to have been introduced between version 2.2.31 and 2.2.32. See below for the full debug output from both versions followed by the dovecot configuration used for both attempts. When I run the following: /usr/bin/dsync -f -D -o mail_location=mdbox:/home/blahmail/mail -u _mainaccount(a)blahmail.tld -v mirror maildir:/home/blahmail/mail On version 2.2.32, I get the following with the warning included on the last line of the output: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount(a)blahmail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_gid=1081 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/blahmail/mail doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/blahmail/mail/dovecot-quota doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_uid=1137 doveadm(_mainaccount(a)blahmail.tld): Debug: Added userdb setting: plugin/userdb_user=blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Effective uid=1137, gid=1081, home=/home/blahmail doveadm(_mainaccount(a)blahmail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount(a)blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount(a)blahmail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount(a)blahmail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount(a)blahmail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount(a)blahmail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/blahmail/mail doveadm(_mainaccount(a)blahmail.tld): Debug: fs: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount(a)blahmail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)blahmail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount(a)blahmail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount(a)blahmail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/INBOX doesn't exist yet, using default permissions doveadm(_mainaccount(a)blahmail.tld): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: Effective uid=1137, gid=1081, home=/home/blahmail dsync(blahmail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(blahmail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(blahmail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(blahmail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(blahmail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(blahmail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/blahmail/mail dsync(blahmail): Debug: maildir++: root=/home/blahmail/mail, index=, indexpvt=, control=, inbox=/home/blahmail/mail, alt= dsync(blahmail): Debug: fs quota add mailbox dir = /home/blahmail/mail dsync(blahmail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(blahmail): Debug: fs quota mount point = / dsync(blahmail): Debug: fs quota mount type = xfs dsync(blahmail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(blahmail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(blahmail): Debug: fts: Indexes disabled for namespace '' dsync(blahmail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(blahmail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: brain M: Local mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX guid=e6191d3644fddb59e2040000a19766e2 uid_validity=1507589413 uid_next=2 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=61f6d91a25fddb5983040000a19766e2 uid_validity=1507589414 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=62f6d91a25fddb5983040000a19766e2 uid_validity=1507589415 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=63f6d91a25fddb5983040000a19766e2 uid_validity=1507589416 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=64f6d91a25fddb5983040000a19766e2 uid_validity=1507589417 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain M: Mailbox INBOX: local=60f6d91a25fddb5983040000a19766e2/0/1, remote=e6191d3644fddb59e2040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=61f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=62f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=63f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=64f6d91a25fddb5983040000a19766e2/0/1: mailbox not selectable yet dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: Namespace INBOX.: /home/blahmail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(blahmail): Debug: Namespace INBOX.: Using permissions from /home/blahmail/mail: mode=0751 gid=default dsync(blahmail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(blahmail): Debug: brain S: Remote mailbox tree: INBOX guid=60f6d91a25fddb5983040000a19766e2 uid_validity=1507589418 uid_next=1 subs=no last_change=0 last_subs=0 dsync(blahmail): Debug: brain S: Mailbox INBOX: local=e6191d3644fddb59e2040000a19766e2/0/1, remote=60f6d91a25fddb5983040000a19766e2/0/1: GUIDs conflict - will be merged later dsync(blahmail): Debug: brain S: Mailbox INBOX.Drafts: local=61f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Junk: local=62f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Sent: local=63f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Mailbox INBOX.Trash: local=64f6d91a25fddb5983040000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(blahmail): Debug: brain S: Change during sync: Mailbox GUID e6191d3644fddb59e2040000a19766e2 was lost dsync(blahmail): Debug: brain S: We don't have mailbox e6191d3644fddb59e2040000a19766e2 dsync(blahmail): Debug: brain M: Change during sync: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(blahmail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(blahmail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(blahmail): Warning: Mailbox changes caused a desync. You may want to run dsync again: Remote lost mailbox GUID e6191d3644fddb59e2040000a19766e2 (maybe it was just deleted?) -------------------------------------------------------------------------------------------------------------------------------------------- Previously, on 2.2.31 I ran: /usr/bin/dsync -f -D -o mail_location=mdbox:/home/mymail/mail -u _mainaccount(a)mymail.tld -v mirror maildir:/home/mymail/mail And got the following successful conversion output: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_fts_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_quota_clone_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib21_fts_solr_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(_mainaccount(a)mymail.tld): Debug: Ignoring overridden (-o) userdb setting: mail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/password=<hidden> doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota2=fs:cPanel Account doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/quota_vsizes=yes doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_gid=1077 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_home=/home/mymail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_mail=maildir:/home/mymail/mail doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_password=<hidden> doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota=maildir:Mailbox:ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota2=fs:cPanel Account doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_clone_dict=file:/home/mymail/mail/dovecot-quota doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule=*:messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_rule2=INBOX.Trash:ignore doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_status_overquota=552 5.2.2 Mailbox is full / Blocks limit exceeded / Inode limit exceeded doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_quota_vsizes=yes doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_uid=1134 doveadm(_mainaccount(a)mymail.tld): Debug: Added userdb setting: plugin/userdb_user=mymail doveadm(_mainaccount(a)mymail.tld): Debug: Effective uid=1134, gid=1077, home=/home/mymail doveadm(_mainaccount(a)mymail.tld): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. doveadm(_mainaccount(a)mymail.tld): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 doveadm(_mainaccount(a)mymail.tld): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored doveadm(_mainaccount(a)mymail.tld): Debug: Quota grace: root=Mailbox bytes=0 (10%) doveadm(_mainaccount(a)mymail.tld): Debug: Quota root: name=cPanel Account backend=fs args= doveadm(_mainaccount(a)mymail.tld): Debug: Quota grace: root=cPanel Account bytes=0 (10%) doveadm(_mainaccount(a)mymail.tld): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/home/mymail/mail doveadm(_mainaccount(a)mymail.tld): Debug: fs: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)mymail.tld): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default doveadm(_mainaccount(a)mymail.tld): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none doveadm(_mainaccount(a)mymail.tld): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= doveadm(_mainaccount(a)mymail.tld): Debug: fts: Indexes disabled for namespace '' doveadm(_mainaccount(a)mymail.tld): Debug: quota: quota_over_flag check: quota_over_script unset - skipping doveadm(_mainaccount(a)mymail.tld): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Effective uid=1134, gid=1077, home=/home/mymail dsync(mymail): Debug: Quota root: name=Mailbox backend=maildir args=ns=INBOX. dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=* bytes=0 messages=2147483647 dsync(mymail): Debug: Quota rule: root=Mailbox mailbox=INBOX.Trash ignored dsync(mymail): Debug: Quota grace: root=Mailbox bytes=0 (10%) dsync(mymail): Debug: Quota root: name=cPanel Account backend=fs args= dsync(mymail): Debug: Quota grace: root=cPanel Account bytes=0 (10%) dsync(mymail): Debug: Namespace inbox: type=private, prefix=INBOX., sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/mymail/mail dsync(mymail): Debug: maildir++: root=/home/mymail/mail, index=, indexpvt=, control=, inbox=/home/mymail/mail, alt= dsync(mymail): Debug: fs quota add mailbox dir = /home/mymail/mail dsync(mymail): Debug: fs quota block device = /dev/mapper/centos_centos--7--clone-root dsync(mymail): Debug: fs quota mount point = / dsync(mymail): Debug: fs quota mount type = xfs dsync(mymail): Debug: Namespace : type=private, prefix=, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=fail::LAYOUT=none dsync(mymail): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= dsync(mymail): Debug: fts: Indexes disabled for namespace '' dsync(mymail): Debug: quota: quota_over_flag check: quota_over_script unset - skipping dsync(mymail): Debug: quota: quota_over_flag check: quota2_over_script unset - skipping dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: brain M: Local mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX guid=a884611c1cf3db5999530000a19766e2 uid_validity=1507586844 uid_next=2 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Drafts guid=a984611c1cf3db5999530000a19766e2 uid_validity=1507586845 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Junk guid=aa84611c1cf3db5999530000a19766e2 uid_validity=1507586846 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Sent guid=ab84611c1cf3db5999530000a19766e2 uid_validity=1507586847 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Local mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Remote mailbox tree: INBOX.Trash guid=ac84611c1cf3db5999530000a19766e2 uid_validity=1507586848 uid_next=1 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain M: Mailbox INBOX: local=00000000000000000000000000000000/0/0, remote=a884611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Drafts: local=00000000000000000000000000000000/0/0, remote=a984611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Junk: local=00000000000000000000000000000000/0/0, remote=aa84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Sent: local=00000000000000000000000000000000/0/0, remote=ab84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: brain M: Mailbox INBOX.Trash: local=00000000000000000000000000000000/0/0, remote=ac84611c1cf3db5999530000a19766e2/0/1: mailbox not selectable yet dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/INBOX doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Drafts doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Junk doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Sent doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: Namespace INBOX.: /home/mymail/mail/mailboxes/Trash doesn't exist yet, using default permissions dsync(mymail): Debug: Namespace INBOX.: Using permissions from /home/mymail/mail: mode=0751 gid=default dsync(mymail): Debug: INBOX: Mailbox opened because: copy caching decisions dsync(mymail): Debug: brain S: Remote mailbox tree: INBOX guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(mymail): Debug: brain S: Mailbox INBOX: local=a884611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Drafts: local=a984611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Junk: local=aa84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Sent: local=ab84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Mailbox INBOX.Trash: local=ac84611c1cf3db5999530000a19766e2/0/1, remote=00000000000000000000000000000000/0/0: mailbox not selectable yet dsync(mymail): Debug: brain S: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX: Import change type=save GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=1 hdr_hash= result=Mail's UID is above local UIDNEXT - No more local mails found dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: prefetch dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: access dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain M: import mail uid 0 guid 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 dsync(mymail): Debug: brain M: Import INBOX: Import mail body for GUID= 1507586844.M476153P21401.jason64.dev.cpanel.net,S=46659,W=46886 UID=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: copying dsync(mymail): Debug: /home/mymail/mail/mailboxes/INBOX/dbox-Mails/dovecot.index.cache: Compressed, file_seq changed 0 -> 1507586868, size=32, max_uid=0 dsync(mymail): Debug: Mailbox INBOX: Opened mail UID=1 because: mail stream dsync(mymail): Debug: brain S: Import INBOX: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Warning: quota: Namespace 'INBOX.' is not Maildir, skipping for Maildir++ quota dsync(mymail): Debug: brain M: Import INBOX: Saved UIDs: 1 dsync(mymail): Debug: brain M: Import INBOX: Finish update: min_next_uid=2 min_first_recent_uid=1 min_highest_modseq=2 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Drafts: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Drafts: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Drafts: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Junk: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Junk: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Junk: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Sent: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Sent: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Sent: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain S: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain M: Import INBOX.Trash: Last common UID=0. Delayed expunges= dsync(mymail): Debug: brain S: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain S: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 dsync(mymail): Debug: brain M: Import INBOX.Trash: Saved UIDs: dsync(mymail): Debug: brain M: Import INBOX.Trash: Finish update: min_next_uid=1 min_first_recent_uid=1 min_highest_modseq=1 min_highest_pvt_modseq=0 -------------------------------------------------------------------------------------------------------------------------------------------- dovecot -n # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.6.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) auth_cache_size = 819 M auth_mechanisms = plain login auth_policy_hash_mech = sha512 auth_policy_hash_nonce = 85979662 auth_policy_hash_truncate = 64 auth_policy_request_attributes = auth_database=mail database=mail service=dovecot username=%{orig_user} authtoken_hash=$0$0$%{hashed_password} local_host=%{real_lip} local_port=%{real_lport} remote_host=%{real_rip} remote_port=%{real_rport} auth_policy_server_api_header = X-API-Key:dovecot:4FR0BN8IWTpSnB42 auth_policy_server_timeout_msecs = 3000 auth_policy_server_url = http://127.0.0.1:579/dovecot-auth-policy auth_username_chars = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789!#$-=?^_{}~./@+%" disable_plaintext_auth = no first_valid_uid = 201 lda_mailbox_autocreate = yes lmtp_save_to_detail_mailbox = yes lmtp_user_concurrency_limit = 4 mail_access_groups = dovecot mail_plugins = quota quota_clone zlib fts fts_solr mail_prefetch_count = 20 mailbox_list_index = yes maildir_very_dirty_syncs = yes namespace inbox { inbox = yes location = mailbox Archive { auto = create special_use = \Archive } mailbox Archives { auto = no special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = create special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } mailbox spam { auto = create special_use = \Junk } prefix = INBOX. separator = . type = private } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } passdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict-domain_owner_mail_pass.conf driver = dict result_failure = return-fail skip = authenticated } passdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword skip = authenticated } plugin { acl = vfile:cache_secs=86400 fts = solr fts_solr = url= http://WVJMEK57hc3cg712:9v9W13cT8fTYaXkQ@127.0.0.1:8984/solr/dovecot/ quota_exceeded_message = Mailbox is full / Blocks limit exceeded / Inode limit exceeded } protocols = lmtp imap pop3 service auth { unix_listener auth-client { mode = 0666 } } service config { vsz_limit = 2 G } service dict { unix_listener dict { group = dovecot mode = 0660 } } service imap-login { client_limit = 500 inet_listener imap { address = *,:: } inet_listener imaps { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service imap { process_limit = 512 vsz_limit = 512 M } service lmtp { client_limit = 1 process_limit = 565 unix_listener lmtp { group = mail mode = 0660 user = mailnull } vsz_limit = 512 M } service managesieve-login { client_limit = 500 process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service managesieve { process_limit = 512 vsz_limit = 512 M } service pop3-login { client_limit = 500 inet_listener pop3 { address = *,:: } inet_listener pop3s { address = *,:: } process_limit = 50 process_min_avail = 2 service_count = 0 vsz_limit = 128 M } service pop3 { process_limit = 512 vsz_limit = 512 M } service quota-status { executable = quota-status -p postfix unix_listener quota-status { mode = 0666 } } ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_cipher_list = ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA:ECDHE-RSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-RSA-AES256-SHA256:DHE-RSA-AES256-SHA:ECDHE-ECDSA-DES-CBC3-SHA:ECDHE-RSA-DES-CBC3-SHA:EDH-RSA-DES-CBC3-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:DES-CBC3-SHA:!DSS ssl_key = # hidden, use -P to show it ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /usr/local/cpanel/etc/dovecot/cpauthd-dict.conf driver = dict } userdb { args = /usr/local/cpanel/bin/dovecot-wrap driver = checkpassword } protocol imap { imap_capability = +NAMESPACE imap_idle_notify_interval = 24 mins imap_logout_format = in=%i, out=%o, bytes=%i/%o mail_max_userip_connections = 20 mail_plugins = acl quota imap_quota zlib imap_zlib quota_clone virtual fts fts_solr namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } } protocol pop3 { mail_max_userip_connections = 3 mail_plugins = quota quota quota_clone virtual zlib namespace sent { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/sent:INDEX=~/mail/virtual/%u prefix = sent separator = . } namespace spam { hidden = yes list = no location = virtual:/usr/local/cpanel/etc/dovecot/virtual/spam:INDEX=~/mail/virtual/%u prefix = spam separator = . } pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s, bytes=%i/%o pop3_uidl_format = UID%u-%v } protocol lmtp { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } protocol lda { mail_plugins = quota quota_clone zlib postmaster_address = root quota_full_tempfail = no } local_name jason64.dev.cpanel.net { ssl_cert = </etc/dovecot/ssl/dovecot.crt ssl_key = # hidden, use -P to show it } local_name adomain.tld www.adomain.tld mail.adomain.tld webmail.adomain.tld cpanel.adomain.tld autodiscover.adomain.tld webdisk.adomain.tld { ssl_cert = </var/cpanel/ssl/domain_tls/adomain.tld/combined ssl_key = # hidden, use -P to show it } local_name argon.tld www.argon.tld mail.argon.tld xenon.tld carbon.tld helium.tld oxygen.tld chlorine.tld hydrogen.tld www.xenon.tld www.carbon.tld www.helium.tld www.oxygen.tld www.chlorine.tld www.hydrogen.tld mail.xenon.tld mail.carbon.tld mail.helium.tld mail.oxygen.tld mail.chlorine.tld mail.hydrogen.tld webmail.argon.tld cpanel.argon.tld autodiscover.argon.tld webdisk.argon.tld www.mail.argon.tld { ssl_cert = </var/cpanel/ssl/domain_tls/argon.tld/combined ssl_key = # hidden, use -P to show it } -------------------------------------------------------------------------------------------------------------------------------------------- I'm starting to narrow down on which commit introduced the problem, but that'll take some time. If anyone knows which commit caused this or knows of a fix, please let me know. Thank you very much! Regards, Jason

2 2

Parallel build problems with dovecot 2.2.32
by Craig Leres 10 Oct '17

10 Oct '17

I use dovecot under FreeBSD 10.3 and build using poudriere. My build server has 12 cores builds typically happen in parallel and I find software that is not parallel make friendly will fail once every month or so. Attached is a build log from this afternoon that failed because doveadm-util.o had not finished building when the attempt to link test-doveadm-util happened. Looking in src/doveadm/Makefile* in the build tree the only place I see doveadm-util.o is in a make variable: test_doveadm_util_LDADD = doveadm-util.o $(test_libs) $(MODULE_LIBS) This is only used in the test-doveadm-util rule: test-doveadm-util$(EXEEXT): $(test_doveadm_util_OBJECTS) $(test_doveadm_util_DEPENDENCIES) $(EXTRA_test_doveadm_util_DEPENDENCIES) @rm -f test-doveadm-util$(EXEEXT) $(AM_V_CCLD)$(LINK) $(test_doveadm_util_OBJECTS) $(test_doveadm_util_LDADD) $(LIBS) So the problem is that doveadm-util.o needs to be an explicit dependency for test-doveadm-util. I believe one possible fix would be to add doveadm-util.o to test_doveadm_util_DEPENDENCIES: test_doveadm_util_DEPENDENCIES = $(test_deps) bug this isn't something that can easily tested. Craig

2 2

Mail Alias Stores in mySQL Not working
by jason hirsh 10 Oct '17

10 Oct '17

First of all excuse.. I am having an issue getting maillist responses so I may be responding to this worng No on topic I commented out the first user_quesry The second query was not copied correctly , reads user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid, CONCAT('*:bytes=', quota) AS quota_rule FROM mailbox WHERE username = '%u' AND active=‘1' still have the same error I did a comparison between the data contained in the sql file and my mail directory and found that they are not consistent Apparently postfixadmin, which I have been using, does not update the maildir I am surprised I am getting any mail at all. I think I have to take this back to ground zero "I see two problems: 1) you have two user_querys, there should only be one 2) your 2nd user_query is not limiting the SQL search with a WHERE clause"

3 2

Sieve rules not processing
by Stephan Herker 10 Oct '17

10 Oct '17

I'm new to dovecot altogether and I have a working dovecot system. I'm trying to setup sieve for mail filtering. If I run the debug program sieve-test I get a positive result that it would have sorted the mail appropriately, but the logs for lmtp don't appear to be processing the rule. Below is output of dovecot -n. Any help is appreciated. Thanks # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login first_valid_uid = 2000 last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve } postmaster_address = administrator(a)keagaming.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = uid=vmail gid=vmail home=/home/vmail/%d/%n driver = static } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota autocreate sieve quota" postmaster_address = postmaster(a)keagaming.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota quota" }

2 3

Trash quota issue
by Stephan Herker 10 Oct '17

10 Oct '17

I have quotas setup on a test domain to try everything out before I move my domains email over to dovecot. I have a trash quota rule that should have added 100M to trash folder specifically, but mail was denied due to quota being full even though the only mail in the test account was in trash. Below are debug log lines and dovecot -n output. Oct 07 17:16:03 lmtp(26801): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 07 17:16:03 lmtp(26801): Info: Connect from local Oct 07 17:16:03 lmtp(26801): Debug: Loading modules from directory: /usr/lib64/dovecot Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib20_autocreate_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Oct 07 17:16:03 lmtp(26801): Debug: auth input: 123(a)testdo.com home=/home/vmail/testdo.com/123 mail=maildir:/home/vmail/testdo.com/123 uid=2000 gid=2000 quota_rule=*:storage=20000 Oct 07 17:16:03 lmtp(26801): Debug: Added userdb setting: mail=maildir:/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801): Debug: Added userdb setting: plugin/quota_rule=*:storage=20000 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Effective uid=2000, gid=2000, home=/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota root: name=User quota backend=dict args=:proxy::quotadict Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=* bytes=20480000 messages=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Quota grace: root=User quota bytes=2048000 (10%) Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: dict quota: user=123(a)testdo.com, uri=proxy::quotadict, noenforcing=0 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/testdo.com/123 Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: maildir++: root=/home/vmail/testdo.com/123, index=, indexpvt=, control=, inbox=/home/vmail/testdo.com/123, alt= Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: sieve: Pigeonhole version 0.4.2 initializing Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: using the following location for user's Sieve script: /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: loading script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: script binary /home/vmail/testdo.com/123/.dovecot.svbin is not up-to-date Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: script `main script' from /home/vmail/testdo.com/123/.dovecot.sieve;name=main script successfully compiled Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Debug: OFqmG0Nu2VmxaAAAobcTNA: sieve: executing script from /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:16:03 lmtp(26801, 123(a)testdo.com) Info: OFqmG0Nu2VmxaAAAobcTNA: sieve: msgid=<3a1e5ba2-f0a7-4cec-e7fb-bf5202c2152d(a)keagaming.com>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } first_valid_uid = 2000 hostname = testdo.com last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota trash expire" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quotadict quota_grace = 10%% quota_rule2 = Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = administrator(a)testdo.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota trash expire autocreate sieve quota" postmaster_address = postmaster(a)testdo.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota trash expire imap_quota notify quota" } protocol pop3 { mail_plugins = " quota trash expire quota" } Any help is appreciated, thanks.

1 0

Mail Alias Stores in mySQL Not working
by jason hirsh 10 Oct '17

10 Oct '17

This apparently was a problem that i was not aware since i redid my mail server configuration to make use of Postfixadmin. I have update the conf files using the postfix document fromthe down load. The download document seems to be fpr an early version of dovecot (I am using 2.2.4) as it focuse of dovecot.conf which is now broken into file in the conf.d subdirectory I get "dovecot: auth-worker(30555): sql(abuse(a)examplei.com): unknown user " I imagine this is a conf problem and deals with reading the sql daya I have confirmed the dayta is there The major file apperas to be dovecot-sql.conf.ext Mine reads as follows driver = mysql connect = host=127.0.0.1 dbname=postfix user=postfix password=postfixadmin password_query = SELECT username, password FROM mailbox WHERE username='%u' and active =" default_pass_scheme = MD5-CRYPT user_query = SELECT maildir, 5000 AS uid, 5000 AS gid FROM mailbox WHERE username = '%u' user_query = SELECT CONCAT('/var/vmail/mail/', maildir) AS home, 5000 AS uid, 5000 AS gid Since normal mail is habdled by dovecoy It would see somthing is wrong wihh the first user_query since it appears to be the one that should fine the alias user Any hellp or suggestions would be appreciate

2 1

Error: file_preallocate in logs
by Ricardo Branco 10 Oct '17

10 Oct '17

I am getting lots of these messages in my imapd.log or while I am doing mailbox operations on the terminal. All my mailboxes are stored on NFS and ive set the nfs locking params in the config, only one mailserver accessing this share. Any ideas why this would be happening? doveadm(ops): Error: file_preallocate(/var/vmail/ops/mdbox/storage/.temp.1507551663.P21424Q109M878872.posti2.dc1.wenn.com) failed: Operation not supported

2 3

Re: ACL permission: give permission to move email into different folder
by Davide Marchi 09 Oct '17

09 Oct '17

On 06.10.2017 12:42:22, Aki Tuomi wrote: [..] >> >> Maybe it is not possible with Dovecot? >> >> Many Thanks >> >> Davide > > Just give the relevant permissions to the user, and it also requires > that the target directory is writable by source user. > > Aki Oh, excuse me for the (most probably) silly question, but where I could give to my *virtual user* the directory write permission, if not from the Dovecot ACL? Actually on /etc/dovecot/dovecot.acl: * user=foo(a)mydomain.com lrwsip * user=info(a)mydomain.com lrwsip Many thanks Aki for you help! :-) Davide

2 3

Re: My sub-folder with Outlook work-around to date - update 201710091046
by David.M.Clark 09 Oct '17

09 Oct '17

Hi Mike, I haven't seen your messages come through the feed so something is not working for your e-mail address there? No I am not using Sieve - the server has a third party handling spam etc so the Linux box is very basic SendMail, Dovecot and RoundCube setup (along with my own procmail based web interface for e-mail forwarding and away message responses). I struggle on. On 09/10/17 12:30, Mike wrote: > > Mr. Clark, > > I would post this question to the maillist, but for some unknown reason, > it will not post my messages. > > Are you currently using Sieve with your mbox setup? > > If so, would you be willing to share your configuration of that? > > If not, I guess I'll just convert to maildir like you are doing. > > I'd be willing to help in any way you feel needed. > > Thanks. > > Mike Barsalou > > Quoting "David.M.Clark" <david(a)davrom.com>: > >> Hi All, >> >> Will start using an "update" tag in my subject just to not cause >> confusion (mainly for yours truly). >> >> Pursuant to my victory in finding Maildir and mbox being used if >> either exist (and if both still seems to favour Maildir - a mistake my >> end: "rmdir -f mail" fixed it), I have found one issue with not >> declaring the mailbox location: it won't import your new e-mail from >> your Inbox (/var/spool/mail/user in my case). If I run the conversion >> script mb2md with a '-m', I get duplicate entries in Outlook's Inbox - >> I understand why, just a shame it doesn't sync with what 'isn't' >> already there. >> >> So yesterday and today I have done additional testing as the customer >> uses RoundCube and mobile devices - so attacking the same Linux server >> I have Thunderbird and a couple of Android e-mail clients. Outlook is >> the only stick in the mud with needing to manually subscribe to >> folders when I create them on other devices - again could be me as I >> don't use Outlook. (Thunderbird and other e-mail clients, all good >> with immediate auto-sync). >> >> I looked at the wiki to try and run both mail_location settings with >> the wiki suggested: >> >> ##namespace { >> ## separator = / >> ## prefix = "#mbox/" >> ## location = mbox:~/mail:INBOX=/var/mail/%u >> ## inbox = yes >> ## hidden = yes >> ## list = no >> ##} >> ##namespace { >> ## separator = / >> ## prefix = "Maildir/" >> ## location = maildir:~/Maildir >> ## list = yes >> ##} >> >> in 10-mail.conf but as you can see, I have commented it out now as it >> introduced some more layers of errors which I have to get back to - >> "Duplicate namespace prefix" was one issue. >> >> The goal is to run the server with the existing mbox users blissfully >> unaware they are being converted one-by-one so it looks like I 'can' >> run both formats but just need to get the configs right. Was hoping >> the mb2md would just sync new stuff so I could cron script the Inbox >> check for the users that are converted to Maildir until I can throw >> the switch and be done with the cut-over..... or I could be dangerous >> and remove and import each time.... but that could lead to more dramas >> at the user end. >> >> Looks like more R&D is needed so will persevere - annoying to get so >> close though, might see if I can just sync in the Inbox items that are >> 'new' - that means I am ready to roll on the customer site...... >> >> On 09/10/17 00:12, David.M.Clark wrote: >>> Wow excellent feedback Joseph, Philon and Aki, >>> >>> You have all pointed me in the right direction. Tonight I have tested >>> Dovecot with just the minor configs I do for Dovecot setup and I have >>> commented out the mbox/Maildir lines in 10-mail.conf from my testing: >>> >>> #mail_location = >>> #mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u >>> #mail_location = maildir:~/Maildir >>> >>> I had run up some test files (folders) under mbox using >>> "/u/home/user/mail_test" and then renamed this to 'mail' (so >>> /u/home/user/mail). >>> Ran some tests with sends/receives, created folders - all good. >>> Created mbox text folders. >>> >>> Then had my initial test 'Maildir_test' populated with test folders >>> which I renamed to /u/home/user/Maildir - and each time I restarted >>> Outlook it was obeying the folder 'format' based on whether I had >>> 'mail' or 'Maildir' in place. >>> >>> I did see in the posts and docs on-line somewhere that someone >>> mentioned the later implementations of Dovecot, without hard-setting >>> either mbox or Maildir in the 10-mail.conf file, Dovecot, based on >>> the presence of the particular directory in the user's $HOME >>> directory obeys the rules based on mbox/Maildir respectively. >>> >>> I haven't needed to touch the namespace rules as per: >>> >>> https://wiki2.dovecot.org/Namespaces >>> >>> so the only files that bear any changes from the installed config in >>> conf.d are: >>> >>> -rw-r--r-- 1 root root 14531 Oct 8 23:28 10-mail.conf >>> -rw-r--r-- 1 root root 2965 Oct 7 08:49 10-master.conf >>> -rw-r--r-- 1 root root 1728 Oct 7 08:52 10-ssl.conf >>> >>> This will make migration so much easier with converting one user at a >>> time and then getting them to start Outlook and re-sync things again. >>> >>> This will save a massive job from being just that and can be done in >>> batches of users to suit time constraints. >>> >>> I will post here once again to let you all know how I fare but just >>> proves to me over and over again the power of the Linux e-mail server >>> with Dovecot for IMAP and being able to keep with the older SendMail >>> MTA (been working with Sendmail since 1996 so....). >>> >>> Thank you all so much for taking time to respond. >>> >>> On 08/10/17 20:32, Aki Tuomi wrote: >>>> You can give mail location and home directory from userdb or passdb. >>>> >>>> For userdb, return mail=something:~/something and for home use >>>> home=/path/to/home >>>> >>>> For passdb, you can return userdb_mail and userdb_home >>>> >>>> Aki >>>> >>>>> On October 8, 2017 at 1:14 PM Philon <bytesplit(a)gmail.com> wrote: >>>>> >>>>> >>>>> Hi David, >>>>> >>>>> I somehow remember that there is a way to get the mail_location >>>>> from per-user-settings. I had this once when migrating from maildir >>>>> to mdbox. >>>>> >>>>> You might want to use Google and the mailing list archives for the >>>>> details but in summary it went like this: >>>>> >>>>> - set Dovecot to grab the mail_location from user-settings (I think >>>>> we used MySQL db field - or check docs for auto:) >>>>> - have login script which converts maildir from setup A to B and >>>>> update the user setting >>>>> - kick the user once again to apply the setting (I’m not sure about >>>>> this) >>>>> >>>>> This then automates the conversion process to happen on next user >>>>> login. >>>>> >>>>> Be warned though that today with all the idle phones, probably many >>>>> users will re-login after you restart the server. Perhaps the >>>>> scripting could handle a timer which randomizes this a little. >>>>> >>>>> >>>>> Philon >>>>> >>>>> >>>>>> Am 07.10.2017 um 02:22 schrieb David.M.Clark <david(a)davrom.com>: >>>>>> >>>>>> Hi All, >>>>>> >>>>>> Thanks to MJ for the suggestion as my only hope, and I have tested >>>>>> this with Outlook 2016 and Thunderbird today - seamless creation >>>>>> of folders. >>>>>> >>>>>> Now the mammoth task of converting customers with masses of mbox >>>>>> folders to MailDir format using the on-line perl script: >>>>>> mb2md-3.20.pl >>>>>> >>>>>> Works nicely and will be what gets us out of trouble. My only >>>>>> sadness is that Outlook then has to be 're-subscribed' to the >>>>>> folders again.... which makes sense or maybe I didn't give it long >>>>>> enough - its IMAP folder syncs are extremely slow compared to >>>>>> Thunderbird which I also tested in parallel. Thunderbird didn't >>>>>> need any re-sync, it just found the new subscription setup and was >>>>>> ready to go. But in all fairness, Outlook is still really only an >>>>>> Exchange compatible product for the most part. >>>>>> >>>>>> Would be great to run both mbox and MailDir at the same time so we >>>>>> can do the slow user-by-user process rather than having them all >>>>>> down at some point completely - might look at running Dovecot on a >>>>>> different port maybe with a different ".conf" but thinking this >>>>>> may not work anyway or cause issues.... back to my server tests to >>>>>> see :-) >>>>>> >>>>>> I use additional ports to 143 for external IMAP restrictions >>>>>> anyway so might be able to do this method somehow. >>>>>> >>>>>> Anyway, for those interested in where I got to in my testing so >>>>>> far... >>>>>> >>>>>> 1. Download perl script "mb2md-3.20.pl" from: >>>>>> >>>>>> http://batleth.sapienti-sat.org/projects/mb2md >>>>>> >>>>>> 2. Changed Dovecot /etc/dovecot/conf.d/10-mail.conf mbox entry to >>>>>> MailDir: >>>>>> >>>>>> #mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u >>>>>> mail_location = maildir:~/Maildir >>>>>> >>>>>> 3. Restarted Dovecot >>>>>> >>>>>> 4. su as user and in their home (/u/home/user on my setup): >>>>>> >>>>>> /u/packages/mb2md-3.20.pl -m >>>>>> >>>>>> then: >>>>>> >>>>>> mv mail mail_old >>>>>> >>>>>> then: >>>>>> >>>>>> /u/packages/mb2md-3.20.pl -s mail_old -R >>>>>> >>>>>> then: >>>>>> >>>>>> Login with Outlook and subscribe to IMAP folders again. >>>>>> >>>>>> Not a big fan of gazillions of little eml based text mail files in >>>>>> directories but hey, if it fixes our issues, maybe I need to stop >>>>>> wambulancing about it all and do as I am told :-) >>>>>> >>>>>> Hope this helps - will keep this e-mail updated on findings if >>>>>> anything else comes to light. >>> >> >> -- >> >> As always, I remain at your service. >> >> Kindest Regards, >> David.M.Clark (Director - Senior Linux/UNIX Consultant) >> =--------------------------------------------------------------------------= >> >> Davrom Consulting Pty Ltd Mobile: 0418763124 >> PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com >> ABN: 81 096 990 804 E-mail (Priv): >> dmc1961(a)dmc1961.id.au >> Website: http://davrom.com Skype: dmc1961 >> Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com >> =--------------------------------------------------------------------------= >> >> Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, >> Networking/Internet, E-mail/Web Technologies >> =--------------------------------------------------------------------------= >> >> Please note: Any e-mail communication bearing this signature is for >> the exclusive purpose of the sender and is not for publication >> without the expressed permission of the sender or respective >> sender's organisation. >> =--------------------------------------------------------------------------= >> > > -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) =--------------------------------------------------------------------------= Davrom Consulting Pty Ltd Mobile: 0418763124 PO Box 1644, Sunnybank Hills, 4109 E-mail (Work): david(a)davrom.com ABN: 81 096 990 804 E-mail (Priv): dmc1961(a)dmc1961.id.au Website: http://davrom.com Skype: dmc1961 Podcast: http://ldup.com.au Google: dmc1961(a)gmail.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------= Please note: Any e-mail communication bearing this signature is for the exclusive purpose of the sender and is not for publication without the expressed permission of the sender or respective sender's organisation. =--------------------------------------------------------------------------=

1 0

My sub-folder with Outlook work-around to date
by David.M.Clark 09 Oct '17

09 Oct '17

Hi All, please be kind, this is my first e-mail to the list :-) I actively support CentOS based e-mail servers running Dovecot, Sendmail, Spammassassin and 3 x SOGo based setups. Dovecot is my goto IMAP server and have used it and modifications to it to net excellent results for years. Then we have people who insist on only using Outlook (and in some instances the MS Live Messenger thingy). Some shenanigans in recent years have arose with using sub-folders in the Outlook clients (2013 and 2016). Traditionally, placing a "/" after the name of a newly desired e-mail folder has netted the result of something like: "Rentals/" creating: /u/home/someuser/mail/Rentals/ Under which users then create actual e-mail folders under the "Rentals" Linux directory as such. With Outlook 2013 and 2016 this seems to have stopped working and so I implemented a work-around where the user creates a normal folder, example "Rentals++", and I have written a cron script that trawls the $HOMEs each minute and if it finds a folder with a "++" at the end, it creates the folder as a directory, so: /u/home/someuser/mail/Rentals++ becomes: /u/home/someuser/mail/Rentals/ and adds this new subscription to their .subscription folder. It also sends an e-mail to the user advising that the new folder is created and they can proceed to use the "Rentals" folder for adding sub-folders (as in real text based mail folders). The script was a quick work-around one weekend in a mad flurry to get things working and to date works but is not 'user-proof'. So I am now looking at developing an internal web interface to do the same thing and hoping with more controls, has no or far less margin for user error. Long times of Outlook folder refreshes don't help and users sometimes end up with issues that require my Linux command line help. I have been trawling e-mail forums for some time now and have not seen any other work-arounds (or perhaps I am living under a rock) but before I embark on this web interface adventure, I just wanted to make sure I had not missed some fundamental 'bit' that I should be observing. All servers are either CentOS 6.9 (or slightly less) and CentOS 7 with the latest updates and for things like Thunderbird and Roundcube and SOGo, work well. I need to experiment with the whole "/" for these but I am currently driven by the enforced Outlook chains. Any input from you guys on whether this is my best approach or 'hey mate, just do this', would be much appreciated. I am happy to share my travels script/web-wise if this is the only option to date. -- As always, I remain at your service. Kindest Regards, David.M.Clark (Director - Senior Linux/UNIX Consultant) E-mail: david(a)davrom.com =--------------------------------------------------------------------------= Specialising in: Linux (Fedora/RedHat/CentOS), UNIX, SCO, MikroTik, Networking/Internet, E-mail/Web Technologies =--------------------------------------------------------------------------=

4 7

Released Pigeonhole v0.4.21.rc1 for Dovecot v2.2.33.rc1.
by Stephan Bosch 09 Oct '17

09 Oct '17

Hello Dovecot users, Here is the Pigeonhole hole release candidate that goes with the Dovecot release candidate. Nothing really special going on, just a few changes and fixes that accumulated over the last few months. Changelog v0.4.21: * redirect action: Always set the X-Sieve-Redirected-From header to sieve_user_email if configured. Before, it would use the envelope recipient instead if available, which makes no sense if the primary e-mail address is available. + vacation extension: Allow ignoring the envelope sender while composing the "To:" header for the reply. Normally, the "To:" header is composed from the address found in the "Sender", "Resent-From" or "From" headers that is equal to the envelope sender. If none is then found, the bare envelope sender is used. This change adds a new setting "sieve_vacation_to_header_ignore_envelope". With this setting enabled, the "To:" header is always composed from those headers in the source message. The new setting thus allows ignoring the envelope, which is useful e.g. when SRS is used. + vacation extension: Compose the "To:" header from the full sender address found in the first "Sender:", "From:" or "Resent-From:" header. Before, it would create a "To:" header without a phrase part. The new behavior is nicer, since the reply will be addressed to the sender by name if possible. - LDA Sieve plugin: Fixed sequential execution of LDAP-based scripts. A missing LDAP-based script could cause the script sequence to exit earlier. - sieve-filter: Removed the (now) duplicate utf8 to mutf7 mailbox name conversion. This caused problems with mailbox names containing UTF-8 characters. The Dovecot API was changed years ago, but apparently sieve-filter was never updated. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.21… http://pigeonhole.dovecot.org/releases/2.2/rc/dovecot-2.2-pigeonhole-0.4.21… Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release candidate and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan(a)rename-it.nl

1 0

Permission denied error on private key...
by SH Development 08 Oct '17

08 Oct '17

I have a working dovecot/postfix/mysql server running and was trying to set up another one for replication purposes. If I copy my certificates from the working server, everything works fine. However, I purchased another updated certificate for the replication server, and I cannot get dovecot to start up. Keep getting: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 31: ssl_key: Can't open file /etc/pki/dovecot/private/mailserver.crt: Permission denied Different permissions on the mailserver.crt have no effect on the error. Maybe something I did in creating the file? I’m a little fuzzy when it comes to how you’re supposed to create the whole thing. Here are the steps I took: openssl genrsa -out mailserverkey.crt 2048 I then took the CSR, submitted it to Comodo, a certificate was generated and emailed back to me. I placed the certs in the appropriately referenced places on the server… And that is where I’m at. I’ve spent quite a bit of time comparing my working server’s configuration files to the new server and cannot find any differences in the SSL configuration, OTHER than the certs themselves. Is dovecot looking for something I didn’t do correctly in the creation maybe? Jeff J. Starion Technologies, LLC 816-331-0030

2 4

Re: My sub-folder with Outlook work-around to date
by Joseph Tam 07 Oct '17

07 Oct '17

"David.M.Clark" <david(a)davrom.com> writes: > Would be great to run both mbox and MailDir at the same time so we can > do the slow user-by-user process rather than having them all down at > some point completely ... - might look at running Dovecot on a different I believe you can do this by using a userdb that can accommodate extra fields. In particular, supplying a mail field will overwrite the global mail_location. You can iterate through your users, convert them one at a time, then update the mail field as you go. At the end, update mail_location to your new default and remove the extra fields. https://wiki.dovecot.org/UserDatabase/ExtraFields Joseph Tam <jtam.home(a)gmail.com>

1 0

Re: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Aki Tuomi 07 Oct '17

07 Oct '17

Thanks! We'll look into it. ---Aki TuomiDovecot oy -------- Original message --------From: Reuben Farrelly <reuben-dovecot(a)reub.net> Date: 07/10/2017 13:08 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33) This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}} #5 0x00007f8bb656bcb0 in io_remove_full (_io=0x220a100, closed=false) at ioloop.c:126 io = 0x22694a0 __FUNCTION__ = "io_remove_full" #6 0x00007f8bb656be31 in io_remove (io=0x220a100) at ioloop.c:169 No locals. #7 0x00007f8bb65815f8 in o_stream_file_cork (stream=0x220a010, set=true) at ostream-file.c:342 fstream = 0x220a010 ret = 32766 __FUNCTION__ = "o_stream_file_cork" #8 0x00007f8bb657e289 in o_stream_cork (stream=0x220a0a0) at ostream.c:146 _stream = 0x220a010 #9 0x00007f8bb12d6406 in openssl_iostream_bio_output (ssl_io=0x220aa00) at iostream-openssl.c:325 bytes = 140238036407941 max_bytes = 18446742978492891135 sent = 35692560 buffer = "\027\003\003\000\001\000\000\000\020\240 \002\000\000\000\000\200\254\035\370\376\177\000\000\022\343W\266\213\177\000\000`\214\033\002\000\000\000\000\240\240 \002\000\000\000\000`\214\033\002\000\000\000\000\020\240 \002\000\000\000\000\320\314\035\370\376\177\000\000\236f-\261\213\177\000\000\025\071\260fK\247\000\000\000\252 \002\000\000\000\000`\214\033", '\000' <repeats 14 times>, "\315\035\370\376\177\000\000\236f-\261\213\177\000\000\225\305^\001?\236,,\000\252 \002\000\000\000\000=$h\000\272Å«\033\000\000\000\000\000\000\000\000\221\371Í¦f\237\035\224\335-\365\214l\333\347|\005\310\345\035/\200r\242\222}\313I\226G\313*\223\364\312\310\313j\263\260/\245"... bytes_sent = false ret = 32766 __FUNCTION__ = "openssl_iostream_bio_output" #10 0x00007f8bb12d6af6 in openssl_iostream_bio_sync (ssl_io=0x220aa00) at iostream-openssl.c:459 ret = false #11 0x00007f8bb12da52e in o_stream_ssl_flush_buffer (sstream=0x220aca0) at ostream-openssl.c:110 pos = 6 ret = 6 #12 0x00007f8bb12da6ef in o_stream_ssl_sendv (stream=0x220aca0, iov=0x7ffef81dcd70, iov_count=1) at ostream-openssl.c:155 sstream = 0x220aca0 bytes_sent = 6 #13 0x00007f8bb657e765 in o_stream_sendv (stream=0x220ad30, iov=0x7ffef81dcd70, iov_count=1) at ostream.c:260 _stream = 0x220aca0 i = 1 total_size = 6 ret = 35771392 __FUNCTION__ = "o_stream_sendv" #14 0x00007f8bb657e688 in o_stream_send (stream=0x220ad30, data=0x2308850, size=6) at ostream.c:239 iov = {iov_base = 0x2308850, iov_len = 6} #15 0x00007f8bb6583c2c in o_stream_multiplex_sendv (mstream=0x221d270) at ostream-multiplex.c:90 channel = 0x0 ret = 0 #16 0x00007f8bb6583dd4 in o_stream_multiplex_ochannel_sendv (stream=0x221d720, iov=0x7ffef81dcef0, iov_count=1) at ostream-multiplex.c:124 channel = 0x221d720 ret = 7354428521 total = 1 #17 0x00007f8bb657e765 in o_stream_sendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:260 _stream = 0x221d720 i = 1 total_size = 1 ret = 36233296 __FUNCTION__ = "o_stream_sendv" #18 0x00007f8bb657e93f in o_stream_nsendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:295 No locals. #19 0x00007f8bb657e8d3 in o_stream_nsend (stream=0x221d7b0, data=0x7ffef81dcf42, size=1) at ostream.c:287 iov = {iov_base = 0x7ffef81dcf42, iov_len = 1} #20 0x0000000000444a35 in doveadm_server_log_handler (ctx=0x7f8bb6805bd0 <failure_ctx_warning>, format=0x7f8bb65bac69 "Raw backtrace for leaks: %s", args=0x7ffef81dcfb0) at client-connection.c:64 c = 3 '\003' corked = false str = 0x228e050 ptr = 0x0 start = 0x228e088 "Raw backtrace for leaks: /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-ser"... va = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} _data_stack_cur_id = 4 #21 0x00007f8bb654afdc in i_warning (format=0x7f8bb65bac69 "Raw backtrace for leaks: %s") at failures.c:325 old_errno = 0 args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} #22 0x00007f8bb656d8cd in io_loop_destroy (_ioloop=0x7ffef81dd138) at ioloop.c:766 backtrace = 0x228dc38 "/usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/"... ioloop = 0x221ddc0 to_idx = 0x221dfe0 item = 0x0 leaks = true __FUNCTION__ = "io_loop_destroy" #23 0x00000000004454d1 in doveadm_cmd_handle (conn=0x22059d8, cmd_name=0x21b8c20 "dsync-server", argc=3, argv=0x21b8c50, cctx=0x7ffef81dd1b0) at client-connection.c:337 ioloop = 0x0 prev_ioloop = 0x21bfc40 cmd = 0x0 mail_cmd = 0x21c65e8 mctx = 0x221d9f8 cmd_ver2 = 0x0 #24 0x0000000000445793 in client_handle_command (conn=0x22059d8, args=0x21b8c40) at client-connection.c:399 cctx = {cmd = 0x0, argc = 0, argv = 0x0, username = 0x21b8c19 "reuben", cli = false, tcp_server = true, local_ip = {family = 10, u = {ip6 = {__in6_u = { ---Type <return> to continue, or q <return> to quit--- Reuben

1 0

Core Dumps with dovecot-2.2 -git as of 2.2.devel (eaf276b33)
by Reuben Farrelly 07 Oct '17

07 Oct '17

This appears to be breaking dsync at the moment and is caused by something committed in the last week or so. This is with the current -git of dovecot-2.2 (eaf276b33). The crash happens all the time - the logs are full of this message. Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Warning: I/O leak: 0x7f8bb6581b4c (ostream-file.c:350, fd 14) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Panic: file ioloop.c: line 126 (io_remove_full): assertion failed: (io->callback != NULL) Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/li bdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf5cb0) [0x7f8bb6 56bcb0] -> /usr/lib64/dovecot/libdovecot.so.0(io_remove+0x1d) [0x7f8bb656be31] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10b5f8) [0x7f8bb65815f8] -> /usr/lib64/dovec ot/libdovecot.so.0(o_stream_cork+0x5a) [0x7f8bb657e289] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x6406) [0x7f8bb12d6406] -> /usr/lib64/dovecot/libssl_iost ream_openssl.so(openssl_iostream_bio_sync+0x18) [0x7f8bb12d6af6] -> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa52e) [0x7f8bb12da52e] -> / usr/lib64/dovecot/libssl_iostream_openssl.so(+0xa6ef) [0x7f8bb12da6ef] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_send+0x61) [0x7f8bb657e688] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10dc2c) [0x7f8bb6583c2c] -> /usr/lib64/dovecot/libdovecot.so.0(+0x10ddd4) [0x7f8bb6583dd4] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_sendv+0xc7) [0x7f8bb657e765] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsendv+0x55) [0x7f8bb657e93f] -> /usr/lib64/dovecot/libdovecot.so.0(o_stream_nsend+0x61) [0x7f8bb657e8d3] -> dovecot/doveadm-server() [0x444a35] -> /usr/lib64/dovecot/libdovecot.so.0(i_warning+0xce) [0x7f8bb654afdc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ca) [0x7f8bb656d8cd] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0xd6) [0x7f8bb656d241] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x225) [0x7f8bb656fe58] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3e) [0x7f8bb656d422] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0xbe) [0x7f8bb656d345] Oct 7 20:31:24 thunderstorm.reub.net dovecot: doveadm: Fatal: master: service(doveadm): child 27186 killed with signal 6 (core dumped) thunderstorm reuben # file core core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'dovecot/doveadm-server', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/libexec/dovecot/doveadm-server', platform: 'x86_64' thunderstorm reuben # gdb /usr/libexec/dovecot/doveadm-server core GNU gdb (Gentoo 8.0.1 vanilla) 8.0.1 Copyright (C) 2017 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://bugs.gentoo.org/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/libexec/dovecot/doveadm-server...done. [New LWP 27186] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `dovecot/doveadm-server'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 (gdb) bt full #0 0x00007f8bb60e7f70 in raise () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8bb60e9aa7 in abort () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8bb654a8f5 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x228e4d8 "/usr/lib64/dovecot/libdovecot.so.0(+0xd48a6) [0x7f8bb654a8a6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xd5e26) [0x7f8bb654be26] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f8bb654ac39] -> /usr"... #3 0x00007f8bb654be26 in i_internal_fatal_handler (ctx=0x7ffef81daa50, format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffef81daa70) at failures.c:670 status = 0 #4 0x00007f8bb654ac39 in i_panic (format=0x7f8bb65ba898 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffef81dab50, reg_save_area = 0x7ffef81daa90}} #5 0x00007f8bb656bcb0 in io_remove_full (_io=0x220a100, closed=false) at ioloop.c:126 io = 0x22694a0 __FUNCTION__ = "io_remove_full" #6 0x00007f8bb656be31 in io_remove (io=0x220a100) at ioloop.c:169 No locals. #7 0x00007f8bb65815f8 in o_stream_file_cork (stream=0x220a010, set=true) at ostream-file.c:342 fstream = 0x220a010 ret = 32766 __FUNCTION__ = "o_stream_file_cork" #8 0x00007f8bb657e289 in o_stream_cork (stream=0x220a0a0) at ostream.c:146 _stream = 0x220a010 #9 0x00007f8bb12d6406 in openssl_iostream_bio_output (ssl_io=0x220aa00) at iostream-openssl.c:325 bytes = 140238036407941 max_bytes = 18446742978492891135 sent = 35692560 buffer = "\027\003\003\000\001\000\000\000\020\240 \002\000\000\000\000\200\254\035\370\376\177\000\000\022\343W\266\213\177\000\000`\214\033\002\000\000\000\000\240\240 \002\000\000\000\000`\214\033\002\000\000\000\000\020\240 \002\000\000\000\000\320\314\035\370\376\177\000\000\236f-\261\213\177\000\000\025\071\260fK\247\000\000\000\252 \002\000\000\000\000`\214\033", '\000' <repeats 14 times>, "\315\035\370\376\177\000\000\236f-\261\213\177\000\000\225\305^\001?\236,,\000\252 \002\000\000\000\000=$h\000\272Å«\033\000\000\000\000\000\000\000\000\221\371Í¦f\237\035\224\335-\365\214l\333\347|\005\310\345\035/\200r\242\222}\313I\226G\313*\223\364\312\310\313j\263\260/\245"... bytes_sent = false ret = 32766 __FUNCTION__ = "openssl_iostream_bio_output" #10 0x00007f8bb12d6af6 in openssl_iostream_bio_sync (ssl_io=0x220aa00) at iostream-openssl.c:459 ret = false #11 0x00007f8bb12da52e in o_stream_ssl_flush_buffer (sstream=0x220aca0) at ostream-openssl.c:110 pos = 6 ret = 6 #12 0x00007f8bb12da6ef in o_stream_ssl_sendv (stream=0x220aca0, iov=0x7ffef81dcd70, iov_count=1) at ostream-openssl.c:155 sstream = 0x220aca0 bytes_sent = 6 #13 0x00007f8bb657e765 in o_stream_sendv (stream=0x220ad30, iov=0x7ffef81dcd70, iov_count=1) at ostream.c:260 _stream = 0x220aca0 i = 1 total_size = 6 ret = 35771392 __FUNCTION__ = "o_stream_sendv" #14 0x00007f8bb657e688 in o_stream_send (stream=0x220ad30, data=0x2308850, size=6) at ostream.c:239 iov = {iov_base = 0x2308850, iov_len = 6} #15 0x00007f8bb6583c2c in o_stream_multiplex_sendv (mstream=0x221d270) at ostream-multiplex.c:90 channel = 0x0 ret = 0 #16 0x00007f8bb6583dd4 in o_stream_multiplex_ochannel_sendv (stream=0x221d720, iov=0x7ffef81dcef0, iov_count=1) at ostream-multiplex.c:124 channel = 0x221d720 ret = 7354428521 total = 1 #17 0x00007f8bb657e765 in o_stream_sendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:260 _stream = 0x221d720 i = 1 total_size = 1 ret = 36233296 __FUNCTION__ = "o_stream_sendv" #18 0x00007f8bb657e93f in o_stream_nsendv (stream=0x221d7b0, iov=0x7ffef81dcef0, iov_count=1) at ostream.c:295 No locals. #19 0x00007f8bb657e8d3 in o_stream_nsend (stream=0x221d7b0, data=0x7ffef81dcf42, size=1) at ostream.c:287 iov = {iov_base = 0x7ffef81dcf42, iov_len = 1} #20 0x0000000000444a35 in doveadm_server_log_handler (ctx=0x7f8bb6805bd0 <failure_ctx_warning>, format=0x7f8bb65bac69 "Raw backtrace for leaks: %s", args=0x7ffef81dcfb0) at client-connection.c:64 c = 3 '\003' corked = false str = 0x228e050 ptr = 0x0 start = 0x228e088 "Raw backtrace for leaks: /usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-ser"... va = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} _data_stack_cur_id = 4 #21 0x00007f8bb654afdc in i_warning (format=0x7f8bb65bac69 "Raw backtrace for leaks: %s") at failures.c:325 old_errno = 0 args = {{gp_offset = 8, fp_offset = 48, overflow_arg_area = 0x7ffef81dd090, reg_save_area = 0x7ffef81dcfd0}} #22 0x00007f8bb656d8cd in io_loop_destroy (_ioloop=0x7ffef81dd138) at ioloop.c:766 backtrace = 0x228dc38 "/usr/lib64/dovecot/libdovecot.so.0(io_loop_destroy+0x2ae) [0x7f8bb656d8b1] -> dovecot/doveadm-server() [0x4454d1] -> dovecot/doveadm-server() [0x445793] -> dovecot/doveadm-server() [0x445dd6] -> /usr/"... ioloop = 0x221ddc0 to_idx = 0x221dfe0 item = 0x0 leaks = true __FUNCTION__ = "io_loop_destroy" #23 0x00000000004454d1 in doveadm_cmd_handle (conn=0x22059d8, cmd_name=0x21b8c20 "dsync-server", argc=3, argv=0x21b8c50, cctx=0x7ffef81dd1b0) at client-connection.c:337 ioloop = 0x0 prev_ioloop = 0x21bfc40 cmd = 0x0 mail_cmd = 0x21c65e8 mctx = 0x221d9f8 cmd_ver2 = 0x0 #24 0x0000000000445793 in client_handle_command (conn=0x22059d8, args=0x21b8c40) at client-connection.c:399 cctx = {cmd = 0x0, argc = 0, argv = 0x0, username = 0x21b8c19 "reuben", cli = false, tcp_server = true, local_ip = {family = 10, u = {ip6 = {__in6_u = { ---Type <return> to continue, or q <return> to quit--- Reuben

1 0

dovecot: master: Warning: Sent SIGKILL to 100 imap-login processes
by absolutely_free＠libero.it 06 Oct '17

06 Oct '17

Hi, I am using Dovecot 2.2.32 (dfbe293d4) I noticed lots of messages like: dovecot: master: Warning: Sent SIGKILL to 100 imap-login processes in /var/log/maillog I commented out "process_limit" service imap { # Most of the memory goes to mmap()ing files. You may need to increase this # limit if you have huge mailboxes. #vsz_limit = $default_vsz_limit # Max. number of IMAP processes (connections) process_limit = 1024 } but it seems that value doesn't change (still 100). Any suggestions? Thank you very much!

2 2

Re: moving from mysql to pgsql
by Joseph Tam 06 Oct '17

06 Oct '17

mws(a)alpenjodel.de writes: > 1) select digest('testing123','sha512'); > result: > ?\x4120117b3190ba5e24044732b0b09aa9ed50eb1567705abcbfa78431a4e0a96b1152ed7f4925966b1c82325e186a8100e692e6d2fcb6702572765820d25c7e9e > login fails I think 2 problems here: 1) the encoding should be some modified base64; and 2) this appears to compute the SHA512 hash, *not* the SHA512-Crypt hash, which is different. It involves adding a salt and doing many iterations of SHA512. A totally different algorithm. Perusing the PostgreSQL man pages, I think you need something like crypt(password,gen_salt('sha512')) I made the 'sha512' up -- I can't find PostgresSQL docs stating whether it supports this value. The docs I found support the older SHA1 ($5$) crypt hashes. If your version doesn't support creating SHA512 ($6$) salts, you can create your own by replacing gen_salt() with "$6$" + base64(long random value), and feed that to crypt(). Just as long as PostgreSQL uses the system crypt() and not its own implementation, it should produce a usable hash. Joseph Tam <jtam.home(a)gmail.com>

1 0

How to require client SSL certificate, except for local connections
by Evan Martin 06 Oct '17

06 Oct '17

Is there any way to make Dovecot 2.2.22 not require a client SSL certificate for a local IMAP connection, but require it for any remote IMAP connection? My server is configured to require client certificates: ssl = required ... auth_ssl_require_client_cert = yes I tried adding the following to create an exception for localhost: remote 127.0.0.1 { ssl = no auth_ssl_require_client_cert = no disable_plaintext_auth = no } But Dovecot fails to start with: doveconf: Fatal: Error in configuration file /etc/dovecot/dovecot.conf line 81: Auth settings not supported inside local/remote blocks: Is there any other way to do this? I don't need to override any other auth settings, just that one. I could probably use a Unix socket, if that would help. Thanks, Evan

1 0

Director DNS
by Travis Dolan 06 Oct '17

06 Oct '17

Hello, I am currently running 2.2.31. I have a cluster of dovecot instances running in AWS. - Two instances running Director/Proxy - Two instances running Dovecot. -- Storage for the Dovecot instances is EFS. My setup works, requests for 143 hit my Director cluster and are proxied to an appropriate dovecot backend. My question is how often if at all the Director service looks up the addresses for the following setting... *director_servers = mailproxy.internal* I have created a Lambda to continually update the values for the A records found in the *.internal* zone since EC2 instances can come and go for a variety of reasons. If those values changes will the Director service "notice" or will a "service dovecot restart" be needed? Thank in advance.

2 1

Re: ACL permission: give permission to move email into different folder
by Davide Marchi 06 Oct '17

06 Oct '17

> I've set ACL for two user (two primary email address, no alias), where > these users must not be able to delete email from imap server. > Now I would like to add (from the client) the ability to move any > incoming mail into different directory, if possible into an existing > directory chosen by me. Maybe it is not possible with Dovecot? Many Thanks Davide

2 1

seccomp filter for dovecot
by Phoenix Krypt 06 Oct '17

06 Oct '17

Hi, I would like to contribute to dovecot by adding seccomp system call filtering. Is this something you would like to merge into the dovecot codebase? If so, I can put up a PR on github once I complete it. Thanks, Archana

2 2

Dovecot Performance Issues on VMWARE Esxi
by Holger 06 Oct '17

06 Oct '17

Hello, I'm new to dovcot, but have serious issues with dovecot and IMAP. I'm struggling with low IMAP performance but have no glue, where to start my search. It is a small office setup. 10 Mailaccounts. Mine is the biggest with 4GB in size. But searching for mail takes several seconds... Zu switch to specific folder also takes some seconds. To long in my opinion. I use esxi 6.0 with local datastorage lenovo megaraid raid5 3x2TB SAS 7.2K. On the dovecot appliance i see high iowait. Some issues dovecot or the VM config? Any help i would appreciate... -- Sent from: http://dovecot.2317879.n4.nabble.com/

3 2

moving from mysql to pgsql
by Magnus 06 Oct '17

06 Oct '17

Hello, I hope that this mailing list is "alive", since I am looking for a solution for my problem for a long time. I would like to migrate my existing dovecot installation from mysql to pgsql. But I have problems with the passwords when using pgsql. The existing and working mysql-based installation looks like this: dovecot-sql.conf.ext: driver = mysql default_pass_scheme = SHA512-CRYPT Users are created like this: INSERT INTO mls_user (idx,domain,password,email) VALUES (1,99,ENCRYPT('Test'),'mws(a)alpenjodel.de'); This setup is working, which I can verify like this: $ telnet localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login mws(a)alpenjodel.de Test OK Now let's take a look at the pgsql version of the setup: dovecot-sql.conf.ext: driver = pgsql default_pass_scheme = SHA512-CRYPT Users are created like this: INSERT INTO mls_user (idx,domain,password,email) VALUES (1,99,crypt('Test',gen_salt('des')),'mws(a)alpenjodel.de'); This setup is not working: $ telnet localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH=DIGEST-MD5 AUTH=CRAM-MD5] Dovecot ready. a login mws(a)alpenjodel.de Test a NO [AUTHENTICATIONFAILED] Authentication failed. Assumptions: - I believe that the mysql encrypt function uses the crypt system call, which in turn uses the DES algorithm with a random salt. - I believe that the same is done with the pgsql function call crypt('Test',gen_salt('des')). But obviously some of these assumptions must be wrong. Besides that, the variable "default_pass_scheme" is set to "SHA512-CRYPT" in both cases. But obviously, not SHA but DES is used by the working mysql-based setup. I don't understand that. Could someone please explain the relationship between the default_pass_scheme variable and the encryption/hashing algorithm used to store the user passwords? And finally: What can I do to migrate to pgsql? Thank you Magnus

4 3

v2.2.33 release candidate released
by Timo Sirainen 05 Oct '17

05 Oct '17

https://dovecot.org/releases/2.2/rc/dovecot-2.2.33.rc1.tar.gz https://dovecot.org/releases/2.2/rc/dovecot-2.2.33.rc1.tar.gz.sig There are a couple more small changes still coming, but this should be very close to the final release. I'm especially interested in hearing if there are any problems with doveadm log proxying or with director. We've improved our automated director tests quite a lot now, and fixed some rarely occurring bugs. * doveadm director commands wait for the changes to be visible in the whole ring before they return. This is especially useful in testing. * Environments listed in import_environment setting are now set or preserved when executing standalone commands (e.g. doveadm) + doveadm proxy: Support proxying logs. Previously the logs were visible only in the backend's logs. + Added %{if}, see https://wiki2.dovecot.org/Variables#Conditionals + Added a new notify_status plugin, which can be used to update dict with current status of a mailbox when it changes. See https://wiki2.dovecot.org/Plugins/NotifyStatus + Mailbox list index can be disabled for a namespace by appending ":LISTINDEX=" to location setting. + dsync/imapc: Added dsync_hashed_headers setting to specify which headers are used to match emails. + pop3-migration: Add pop3_migration_ignore_extra_uidls=yes to ignore mails that are visible in POP3 but not IMAP. This could happen if new mails were delivered during the migration run. + pop3-migration: Further improvements to help with Zimbra + pop3-migration: Cache POP3 UIDLs in imapc's dovecot.index.cache if indexes are enabled. These are used to optimize incremental syncs. + cassandra, dict-sql: Use prepared statements if protocol version>3. - sdbox: Mails were always opened when expunging, unless mail_attachment_fs was explicitly set to empty. - lmtp/doveadm proxy: hostip passdb field was ignored, which caused unnecessary DNS lookups if host field wasn't an IP - lmtp proxy: Fix crash when receiving unexpected reply in RCPT TO - quota_clone: Update also when quota is unlimited (broken in v2.2.31) - mbox, zlib: Fix assert-crash when accessing compressed mbox - doveadm director kick -f parameter didn't work - doveadm director flush <host> resulted flushing all hosts, if <host> wasn't an IP address. - director: Various fixes to handling backend/director changes at abnormal times, especially while ring was unsynced. These could have resulted in crashes, non-optimal behavior or ignoring some of the changes. - director: Use less CPU in imap-login processes when moving/kicking many users. - lmtp: Session IDs were duplicated/confusing with multiple RCPT TOs when lmtp_rcpt_check_quota=yes - doveadm sync -1 fails when local mailboxes exist that do not exist remotely. This commonly happened when lazy_expunge mailbox was autocreated when incremental sync expunged mails.

1 0

Issue with imap folder structure
by absolutely_free＠libero.it 05 Oct '17

05 Oct '17

Hi, I use Dovecot 2.2.32 I just migrated spool from another server (by copying filesystem, I use maildir), this is an example of mailbox's content: drwx------ 20 postfix postfix 30 Oct 4 18:38 . drwx------ 3 postfix postfix 3 Nov 16 2012 .. drwx------ 5 postfix postfix 11 Jun 19 18:22 .Deleted Items drwx------ 5 postfix postfix 11 Sep 29 09:27 .Drafts drwx------ 5 postfix postfix 9 Oct 4 10:18 .INBOX.Drafts drwx------ 5 postfix postfix 9 Oct 4 10:18 .INBOX.Sent drwx------ 5 postfix postfix 9 Oct 3 18:01 .INBOX.Trash drwx------ 5 postfix postfix 12 Sep 29 09:27 .Junk drwx------ 5 postfix postfix 8 Dec 9 2014 .Junk E-mail drwx------ 5 postfix postfix 8 Nov 11 2015 .Archive drwx------ 5 postfix postfix 9 Oct 2 14:18 .Posta indesiderata drwx------ 5 postfix postfix 9 Jun 19 18:22 .Posta inviata drwx------ 5 postfix postfix 10 Oct 4 12:27 .Sent drwx------ 5 postfix postfix 10 Oct 4 18:01 .Trash drwx------ 2 postfix postfix 215 Oct 4 18:00 cur -rw------- 1 postfix postfix 53 Feb 16 2017 dovecot-keywords -rw------- 1 postfix postfix 13963 Oct 4 16:45 dovecot-uidlist -rw------- 1 postfix postfix 8 Oct 3 18:01 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Nov 27 2015 dovecot-uidvalidity.5658162a -r--r--r-- 1 postfix postfix 0 Sep 27 18:18 dovecot-uidvalidity.59cbcf5c -rw------- 1 postfix postfix 7200 Sep 29 01:19 dovecot.index -rw------- 1 postfix postfix 63336 Oct 4 18:00 dovecot.index.cache -rw------- 1 postfix postfix 6436 Oct 4 18:38 dovecot.index.log -rw------- 1 postfix postfix 216 Oct 3 18:01 dovecot.mailbox.log drwx------ 2 postfix postfix 2 Oct 4 16:45 new -rw------- 1 postfix postfix 96 Oct 3 18:01 subscriptions drwx------ 2 postfix postfix 2 Oct 4 16:12 tmp and this is my Dovecot's conf: auth_mechanisms = plain login digest-md5 cram-md5 disable_plaintext_auth = no first_valid_gid = 125 first_valid_uid = 125 mail_gid = 1003 mail_location = maildir:/var/spool/virtual/domains mail_privileged_group = postfix mail_uid = 1003 namespace { inbox = yes location = prefix = INBOX. separator = . type = private } namespace inbox { location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-crypt.conf.ext driver = sql } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl_cert = </etc/ssl/wildcard.domain.net_bundle.crt ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql It seems I have duplicate folder (for example during webmail access, I use Roundcube). What is wrong with my setup? Thank you

3 4

STAT command error
by Andrew Charnley 04 Oct '17

04 Oct '17

Hi, Unsure if my previous message made it through as didn't see it on a digest. I'm using Claws Email and 3 of 4 email accounts keep giving; [10:50:45] POP< +OK Dovecot ready. [10:50:45] POP> USER sales [10:50:45] POP< +OK [10:50:45] POP> PASS ******** [10:50:45] POP< +OK Logged in. [10:50:45] POP> STAT [10:50:45] POP< -ERR Unknown command: *** error occurred on POP session *** Error occurred while processing mail. I've turned on as much logging as I can find in Dovecot but nothing useful is coming out, it honestly does believe STAT is invalid - I can see the connection close rather than disconnect. It's strange how it works for one account but not others, the settings are identical - I went through them with a fine tooth comb. Any suggestions appreciated. Regards, Andrew

2 1

ACL permission: give permission to move email into different folder
by Davide Marchi 03 Oct '17

03 Oct '17

Hi friends, I've set ACL for two user (two primary email address, no alias), where these users must not be able to delete email from imap server. Now I would like to add (from the client) the ability to move any incoming mail into different directory, if possible into an existing directory chosen by me. These are the settings on /etc/dovecot/dovecot.acl: * user=foo(a)mydomain.com lrwsip * user=info(a)mydomain.com lrwsip is it possible? I've read https://wiki2.dovecot.org/ACL but I've not found a solution. many many thanks! Davide

1 0

Postfix + saslauthd SASL With Kerberos (FreeIPA) unable to send mail
by Anvar Kuchkartaev 03 Oct '17

03 Oct '17

Hello I just finished setting up FreeIPA with Dovecot + Postfix + Saslauthd. I can easily access to mails using imap via dovecot with gssapi authentication and postfix also delivering mails very well. But I cannot send email from postfix using gssapi authentication (plain and login authentication working fine) because saslauthd is not specifying realm when requesting service from freeipa domain. warning: SASL authentication failure: GSSAPI Error: Unspecified GSS failure. Minor code may provide more information (No key table entry found matching smtp/mx0.aegisnet.eu@) right form of request is smtp/mx0.aegisnet.eu(a)AEGISNET.EU I googled alot but couldn't find any solution to solve this problem. How to configure saslauthd well that it will use realm to contact with freeipa. Best Regards...

2 3

file-solr
by Siarhei Chystsiakou 02 Oct '17

02 Oct '17

Hi, I have installed dovecot 2.2.31 and settings fts-solr, when I run command doveadm -v index -A "*" sometimes in logs I see information: doveadm(user(a)domain.com): Warning: fts-solr(user(a)domain.com): Mailbox INBOX UID=2028 header size is huge, truncating Does it influence the work of plugin and its functions?

1 0

dovecot listening imaps external interface
by David Mehler 02 Oct '17

02 Oct '17

Hello, I'm trying to get dovecot to listen on specific interfaces. On the server itself I've got webmail going so am needing imap on 143. I do not want this on the external server interface, so I am wanting imaps port 993 external only. The configuration looks right, but Dovecot isn't showing anything listening on port 993 at all. Unrelated, my public and shared folders are not working. Can anyone suggest fixes for either of these issues? Thanks. Dave. # 2.2.32 (dfbe293d4): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: FreeBSD 10.3-RELEASE-p20 amd64 auth_default_realm = domain.com auth_mechanisms = plain login auth_realms = domain.com domain2.com dict { acl = mysql:/usr/local/etc/dovecot/shared-folders.conf sqlquota = mysql:/usr/local/etc/dovecot/quota.conf } first_valid_gid = 999 first_valid_uid = 999 hostname = mail.domain.com imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags last_valid_gid = 999 last_valid_uid = 999 lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 127.0.0.1 xxx.xxx.xxx.xxx lmtp_rcpt_check_quota = yes mail_access_groups = vmail mail_fsync = never mail_gid = vmail mail_home = /home/vmail/%d/%n mail_location = maildir:~/mail/:LAYOUT=fs:INDEX=~/mail/ mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib mail_server_admin = mailto:postmaster@domain.com mail_uid = vmail mailbox_list_index = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext imapflags notify imapsieve vnd.dovecot.imapsieve namespace { hidden = no list = yes location = maildir:/home/vmail/public/:LAYOUT=fs:CONTROL=~/mail/public:INDEXPVT=~/mail/public:INDEX=~/mail/public mailbox TestFolder { auto = subscribe comment = Public Folder for message sharing } prefix = public/ separator = / subscriptions = yes type = public } namespace { list = yes location = maildir:~/mail/:INDEX=~/mail/shared/%%Ld/%%Ln prefix = shared/%%u/ separator = / subscriptions = yes type = shared } namespace { location = virtual:/usr/local/etc/dovecot/virtual mailbox All { auto = subscribe comment = All my messages special_use = \All } prefix = virtual/ separator = / } namespace inbox { inbox = yes location = mailbox Archive { auto = no special_use = \Archive } mailbox Archives { auto = subscribe special_use = \Archive } mailbox "Deleted Messages" { auto = no autoexpunge = 30 days special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = no autoexpunge = 30 days special_use = \Junk } mailbox "Junk E-mail" { auto = no autoexpunge = 30 days special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = no special_use = \Sent } mailbox "Sent Messages" { auto = no special_use = \Sent } mailbox Spam { auto = subscribe autoexpunge = 30 days special_use = \Junk } mailbox Trash { auto = subscribe autoexpunge = 30 days special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { acl = vfile:/usr/local/etc/dovecot/global-acls:cache_secs=300 acl_anyone = allow acl_shared_dict = proxy::acl imapsieve_mailbox1_before = file:/usr/local/lib/dovecot/sieve/report-spam.sieve imapsieve_mailbox1_causes = COPY imapsieve_mailbox1_name = Spam imapsieve_mailbox2_before = file:/usr/local/lib/dovecot/sieve/report-ham.sieve imapsieve_mailbox2_causes = COPY imapsieve_mailbox2_from = Spam imapsieve_mailbox2_name = * mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = count:User quota quota_clone_dict = proxy::sqlquota quota_exceeded_message = Storage quota for this account has been exceeded, please try again later. quota_grace = 10%% quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO quota_vsizes = true quota_warning = storage=100%% quota-exceeded 100 %u quota_warning2 = storage=95%% quota-warning 95 %u quota_warning3 = storage=90%% quota-warning 90 %u quota_warning4 = storage=85%% quota-warning 85 %u quota_warning5 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /home/vmail/sieve/before.d sieve_default = /home/vmail/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags sieve_global_dir = /home/vmail/sieve sieve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.execute sieve_max_redirects = 30 sieve_max_script_size = 1M sieve_pipe_bin_dir = /usr/local/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms sieve_user_log = /home/vmail/sieve/sieve_error.log trash = /usr/local/etc/dovecot/trash.conf welcome_script = welcome %u welcome_wait = yes } postmaster_address = postmaster(a)domain.com protocols = imap lmtp sieve sendmail_path = /usr/local/sbin/sendmail service auth-worker { user = $default_internal_user } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 } inet_listener imaps { address = xxx.xxx.xxx.xxx port = 993 ssl = yes } } service imap-postlogin { executable = script-login /usr/local/etc/dovecot/last_login_imap.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user = postfix } } service managesieve-login { inet_listener sieve { address = 127.0.0.1 port = 4190 } } service quota-status { client_limit = 1 executable = quota-status -p postfix unix_listener /var/spool/postfix/private/dovecot-quota { group = postfix mode = 0660 user = postfix } } service quota-warning { executable = script /usr/local/etc/dovecot/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0660 user = vmail } user = vmail } service welcome { executable = script /usr/local/etc/dovecot/welcome.sh unix_listener welcome { user = vmail } user = vmail } ssl = no ssl_cert = </usr/local/etc/ssl/acme/domain.com/fullchain.pem ssl_cipher_list = ECDHE-ECDSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-CHACHA20-POLY1305:ECDHE-RSA-CHACHA20-POLY1305:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA256@STRENGTH ssl_dh_parameters_length = 2048 ssl_key = # hidden, use -P to show it ssl_options = no_compression ssl_prefer_server_ciphers = yes ssl_protocols = !SSLv2 !SSLv3 !TLSv1 !TLSv1.1 userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib quota sieve } protocol lda { mail_fsync = optimized mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib sieve } protocol imap { mail_plugins = acl mail_log notify quota quota_clone trash virtual welcome zlib imap_acl imap_quota imap_sieve imap_zlib last_login }

2 1

Quota - frustrated trying to configure ...
by Garry Glendown 02 Oct '17

02 Oct '17

Hi, after fighting Dovecot almost every step of the way, I have finally gotten most of the functions configured on a customer box (used Cyrus on a previous install, but it was dropped from SLES 12 ...) The mail server setup uses LDAP for user authentication, has a central maildir tree (.../dovecot/maildir/<USER>/...) that is used for all users' mail, sieve is also running well. The users themselves are just virtual users, they do not have a local home directory or anything. I was now trying to get Quota to work ... Looking at the Wiki more or less showed the same "spotty" results of the rest of the Wiki. Fine for anybody that needs the documentation just as a reference, but somewhat lacking for someone that does not have experience in setting up Dovecot. I tried following the wiki, as well as checking on other web pages I came across. In order to keep the setup simple, and not have to jump through hoops to set up any SQL backup etc., I tried using a file-based storage of the quota entries, as in: dict { quota = file:/data/dovecot/db/quota.db } I also added quota entries in the other places I believe are necessary, and set up a rule like this: plugin { quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M } I got through dovecot restart without errors, and IMAP still answers. But attempting to do a recalculation of the current quota usage ends up with this error: doveadm(root): Error: chdir(/root/) failed: Permission denied (euid=479(dovecot) egid=478(dovecot) missing +x perm: /root, dir owned by 0:0 mode=0700) doveadm(root): Error: chdir(/root) failed: Permission denied It looks like dovecot doesn't actually attempt to look at the central maildir, but instead seems to attempt to enter the current user's homedir (which, in this case, is root). What am I (possibly) missing here? Is this way of setting it up even viable? While I need a general per-user-quota, I also need the ability to overwrite each user's default quota ... is there any recommendable more detailed documentation on how to set up quota? Thanks, -garry

3 6

[PATCH] lib-mail: Set missing invalid_syntax to TRUE
by Pali Rohár 02 Oct '17

02 Oct '17

route is already set to "INVALID_ROUTE" when fill_missing is true, but setting invalid_syntax was not done yet. --- src/lib-mail/message-address.c | 1 + 1 file changed, 1 insertion(+) diff --git a/src/lib-mail/message-address.c b/src/lib-mail/message-address.c index 29cac2b..96584e2 100644 --- a/src/lib-mail/message-address.c +++ b/src/lib-mail/message-address.c @@ -153,6 +153,7 @@ static int parse_angle_addr(struct message_address_parser_context *ctx) if (parse_domain_list(ctx) <= 0 || *ctx->parser.data != ':') { if (ctx->fill_missing) ctx->addr.route = "INVALID_ROUTE"; + ctx->addr.invalid_syntax = TRUE; if (ctx->parser.data == ctx->parser.end) return -1; /* try to continue anyway */ -- 1.7.9.5

1 1

[PLUGIN] Virtual keywords (aka Gmail-like labels)
by Daniele Ricci 02 Oct '17

02 Oct '17

Hello list, I'm new here and since I've been working on a plugin lately I though I'd post it here. It's GPL licensed, hosted on GitHub: https://github.com/daniele-athome/dovecot-virtual-keywords-plugin I've been trying to find a replacement for Gmail and I already have my own mailserver. What I'm missing very much is labels. Since folders don't really match labels, I had to implement something that at least resembles them. I decided to use IMAP keywords since it's probably the closest thing to labels. The README in the repository pretty much describes what this plugin do, but basically it creates virtual mailboxes with predefined rules to match for labeled messages. E.g. if you set a "Urgent" keyword on any message, the plugin will create a "Virtual/Urgent" virtual mailbox that will have the message you just labeled. I'm a bit out of practice on C but I believe I managed. I've tested the plugin locally but I've not deployed it on my production mail server yet. I'd like to hear your opinions (reviews and comments are very welcome) and possibly find other people interested in this approach to discuss about it. Thanks! -- Daniele

2 6

sieve script not executed?
by Roberto Nunnari 02 Oct '17

02 Oct '17

Hello. I'm trying to set up a vacation autoresponder but up to now, no success. I'm using dovecot managedsieve to set up the new filter and to my understanding it works correctly and it creates in the user's home the link .dovecot.sieve that points to sieve/managesieve.sieve ~$ cat .dovecot.sieve require ["date","relational","vacation"]; # rule:[Vacanza] if allof (currentdate :zone "+0200" :value "ge" "date" "2017-09-29", currentdate :zone "+0200" :value "le" "date" "2017-10-09") { vacation :days 7 :addresses ["robi@hidden1","robi@hiden2"] "eccoci a dopo"; } Problem is that apparently this filter is completely ignored.. that is, when a new email is delivered to those addresses, no autoresponse is sent back to the sender. I also, followed the troubleshooting guide here: https://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting and everything works as expected. What is the problem? What am I missing? Thank you and best regards. Roberto # dovecot --version 2.2.22 (fe789d2) # dovecot -n # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.4.0-96-generic x86_64 Ubuntu 16.04.3 LTS mail_location = mbox:~/mail:INBOX=/var/mail/%u mail_privileged_group = mail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = " imap sieve pop3 sieve" ssl_cert = </etc/dovecot/dovecot.pem ssl_key = </etc/dovecot/private/dovecot.key userdb { driver = passwd } protocol sieve { mail_debug = yes }

2 1

POP3 STAT command broken (race condition?)
by Andrew Charnley 01 Oct '17

01 Oct '17

Hi, 4x POP3 over SSL. I login manually using SSL client and issue STAT command - all work. Claws-mail works for one account persistently, the other three always fail. There are no differences between the accounts other than username/pass so I have been unable to determine why this occurs. Also, Evolution works as it uses LIST not STAT. Claws reports: [12:30:40] POP< +OK [12:30:40] POP> PASS ******** [12:30:40] POP< +OK Logged in. [12:30:40] POP> STAT [12:30:40] POP< -ERR Unknown command: *** error occurred on POP session *** Error occurred while processing mail. Perhaps there's a race between logging in and issuing commands? Andrew

2 1

Doveadm / dsync: mirror?
by Larry Rosenman 01 Oct '17

01 Oct '17

On https://wiki.dovecot.org/Migration/MailFormat we see: mbox -> maildir migration. Set mail_location=maildir:~/Maildir and run dsync -u username mirror mbox:~/mail:INBOX=/var/mail/username but NOWHERE that I can find is the “mirror” command documented on the wiki. What are ALL the options here? (and it’s interesting to note that dsync is a symlink to doveadm). Thanks! -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: larryrtx(a)gmail.com US Mail: 5708 Sabbia Drive, Round Rock, TX 78665-2106

1 0

imapc and masteruser
by Computerisms Corporation 29 Sep '17

29 Sep '17

Hi, My end goal is to set up shared mailboxes on a cluster as per: https://wiki.dovecot.org/SharedMailboxes/ClusterSetup I was having very little luck with it, so I had been trying to break down into pieces and get individual components working. So I have things setup on a single server, with a working dovecot instance. I have no director or any thing else running yet, and I am just trying to get the imapc portion of things working. Eventually I came across a post from Sven Hartge: https://www.dovecot.org/list/dovecot/2012-November/087046.html This is from several years ago, but I set up a separate dovecot instance on port 9993 specifically to run the shared folders as he describes, and copied his configuration suggestions pretty much verbatim. The only signficant difference is that I needed to not configure the imapc_user as he had done, and instead as the wiki suggests remove that config option entirely. With this, the imapc connection is being made from the primary instance on port 993 to the shared instance on port 9993. My problem is that it doesn't appear that the imapc_master_user is being fully acknowledged. The imapc connection must be made with the original user logging in as the master user to the shared user's account, else the ACLs can't do what they are supposed to do. It does appear the original user is being used to authenticate, maybe, at the very least it is being offered in the imapc connection, but not as a master user. To illustrate, I have two snippets of logs below. The first is from the shared folders instance on port 9993 after logging into the primary server on port 993, which triggers the imapc connection. This shows the user bob.test, who is the imapc_master_user as defined by %u, being acknowledged and then having the username changed to that of my shared user, in this case authapps. Further down, we can see that the auth_user is bob.test, but there is no master user, and the acl username at the bottom of the snipped remains that of my shared user. Below that, I have the same snippet of log, as obtained by connecting with openssl s_client to the shared instance on port 9993, with the string: a login authapps*bob.test XXXXXXX In order to get this working, I need to add to the shared instance's config file a static userdb like so: userdb { driver = static } this snippet shows the masteruser working as expected, and the acl username being that of the master user. Unfortunately, it has no apparent effect on the imapc login. So it seems master user logins work, just not through imapc. I note at the top of the first snippet, before the change in username, it appears the imapc connection is being directed to the static passdb, which I think is triggering the username change, where as the second snippet, the connection is starting with the ldap passdb. but no amount of playing "configuration file options" chairs has led me to a working solution. I am hoping someone can provide some insight as to what I am missing here. doveconf -n for both instances are pasted below the log snippets. If you are still reading, you have my gratitude for your attention this far... 2017-09-27 13:20:13.725943500 Sep 27 13:20:13 auth: Debug: static(bob.test,192.168.120.70,<y0vvhDFaYqDAqHhG>): lookup 2017-09-27 13:20:13.725960500 Sep 27 13:20:13 auth: Debug: static(bob.test,192.168.120.70,<y0vvhDFaYqDAqHhG>): username changed bob.test -> authapps 2017-09-27 13:20:13.726011500 Sep 27 13:20:13 auth: Debug: client passdb out: OK 1 user=authapps original_user=bob.test 2017-09-27 13:20:13.728299500 Sep 27 13:20:13 auth: Debug: master in: REQUEST 2523398145 13259 1 ba830ae1c199401e5dbee28e31025ac1 session_pid=13335 request_auth_token 2017-09-27 13:20:13.728344500 Sep 27 13:20:13 auth: Debug: master userdb out: USER 2523398145 authapps uid=509 gid=509 home=/CTFN/SharedMailboxes/CTFN/ auth_token=5e3d02714e82441cbbb3de8ff80f35bc3dc4b291 auth_user=bob.test 2017-09-27 13:20:13.728459500 Sep 27 13:20:13 imap-login: Info: Login: user=<authapps>, method=PLAIN, rip=192.168.120.70, lip=192.168.120.70, mpid=13335, TLS, session=<y0vvhDFaYqDAqHhG> 2017-09-27 13:20:13.729092500 Sep 27 13:20:13 imap(authapps): Debug: Loading modules from directory: /usr/local/lib/dovecot 2017-09-27 13:20:13.729781500 Sep 27 13:20:13 imap(authapps): Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so 2017-09-27 13:20:13.729841500 Sep 27 13:20:13 imap(authapps): Debug: Module loaded: /usr/local/lib/dovecot/lib02_imap_acl_plugin.so 2017-09-27 13:20:13.730026500 Sep 27 13:20:13 imap(authapps): Debug: Effective uid=509, gid=509, home=/CTFN/SharedMailboxes/CTFN/ 2017-09-27 13:20:13.732014500 Sep 27 13:20:13 imap(authapps): Debug: Namespace CTFN: type=public, prefix=CTFN/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/CTFN/SharedMailboxes/ 2017-09-27 13:20:13.732050500 Sep 27 13:20:13 imap(authapps): Debug: maildir++: root=/CTFN/SharedMailboxes, index=, indexpvt=, control=, inbox=/CTFN/SharedMailboxes, alt= 2017-09-27 13:20:13.732053500 Sep 27 13:20:13 imap(authapps): Debug: acl: initializing backend with data: vfile 2017-09-27 13:20:13.732055500 Sep 27 13:20:13 imap(authapps): Debug: acl: acl username = authapps 2017-09-27 18:33:37.008636500 Sep 27 18:33:37 auth: Debug: ldap(bob.test,192.168.120.50,master,<y56y5TVaAYHAqHgy>): Master user lookup for login: authapps 2017-09-27 18:33:37.021400500 Sep 27 18:33:37 auth: Info: ldap(bob.test,192.168.120.50,master,<y56y5TVaAYHAqHgy>): Master user logging in as authapps 2017-09-27 18:33:37.021425500 Sep 27 18:33:37 auth: Debug: client passdb out: OK 1 user=authapps original_user=bob.test auth_user=bob.test 2017-09-27 18:33:37.023658500 Sep 27 18:33:37 auth: Debug: master in: REQUEST 2776498177 9162 1 2d247ac65c17769575edb6c9db86fdee session_pid=27552 request_auth_token 2017-09-27 18:33:37.023703500 Sep 27 18:33:37 auth: Debug: ldap(authapps,192.168.120.50,<y56y5TVaAYHAqHgy>): user search: base=CN=Users,dn=ctfn,dn=ca scope=onelevel filter=(&(sAMAccountName=authapps)) fields=homeDirectory,uidNumber,gidNumber 2017-09-27 18:33:37.026953500 Sep 27 18:33:37 auth: Error: ldap(authapps,192.168.120.50,<y56y5TVaAYHAqHgy>): ldap_search(base=CN=Users,dn=ctfn,dn=ca filter=(&(sAMAccountName=authapps))) failed: Operations error 2017-09-27 18:33:37.026984500 Sep 27 18:33:37 auth: Debug: master userdb out: USER 2776498177 authapps uid=509 gid=509 home=/CTFN/SharedMailboxes/CTFN/ master_user=bob.test auth_token=12961a562e9ef0698b363714d758d95cea9ff3f2 auth_user=bob.test 2017-09-27 18:33:37.027163500 Sep 27 18:33:37 imap-login: Info: Login: user=<authapps>, method=PLAIN, rip=192.168.120.50, lip=192.168.120.70, mpid=27552, TLS, session=<y56y5TVaAYHAqHgy> 2017-09-27 18:33:37.027826500 Sep 27 18:33:37 imap(authapps): Debug: Loading modules from directory: /usr/local/lib/dovecot 2017-09-27 18:33:37.028479500 Sep 27 18:33:37 imap(authapps): Debug: Module loaded: /usr/local/lib/dovecot/lib01_acl_plugin.so 2017-09-27 18:33:37.028561500 Sep 27 18:33:37 imap(authapps): Debug: Module loaded: /usr/local/lib/dovecot/lib02_imap_acl_plugin.so 2017-09-27 18:33:37.028607500 Sep 27 18:33:37 imap(authapps): Debug: Added userdb setting: plugin/master_user=bob.test 2017-09-27 18:33:37.028685500 Sep 27 18:33:37 imap(authapps): Debug: Effective uid=509, gid=509, home=/CTFN/SharedMailboxes/CTFN/ 2017-09-27 18:33:37.030993500 Sep 27 18:33:37 imap(authapps): Debug: Namespace CTFN: type=public, prefix=CTFN/, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/CTFN/SharedMailboxes/CTFN 2017-09-27 18:33:37.031019500 Sep 27 18:33:37 imap(authapps): Debug: maildir++: root=/CTFN/SharedMailboxes/CTFN, index=, indexpvt=, control=, inbox=/CTFN/SharedMailboxes/CTFN, alt= 2017-09-27 18:33:37.031040500 Sep 27 18:33:37 imap(authapps): Debug: acl: initializing backend with data: vfile 2017-09-27 18:33:37.031047500 Sep 27 18:33:37 imap(authapps): Debug: acl: acl username = bob.test PRIMARY SERVER ON PORT 993: doveconf -i dovecotserver -n # 2.2.31 (65cde28): /usr/local/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.19 (e5c7051) # OS: Linux 4.9.0-3-amd64 x86_64 Debian 9.1 auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose_passwords = plain hostname = imap.ctfn.ca imapc_host = masterchieflian.ctfn.ca imapc_master_user = %u imapc_password = # hidden, use -P to show it imapc_port = 9993 imapc_ssl = imaps instance_name = dovecotserver lda_mailbox_autocreate = yes lda_mailbox_autosubscribe = yes listen = 192.168.120.70 log_path = /dev/stderr login_greeting = CTFN IMAP server mail_debug = yes mail_fsync = always mail_location = maildir:~/Maildir mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = stats quota managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds mmap_disable = yes namespace CTFN { list = yes location = imapc:/CTFN/mail/CTFN:INDEXPVT=/CTFN/mail/%n/Maildir/CTFN prefix = CTFN/ separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox Archives { auto = subscribe special_use = \Archive } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox LearnAsSpam { auto = subscribe } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap master = yes } plugin { acl_shared_dict = fs:posix:prefix=/CTFN/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject flags sieve = ~/.dovecot.sieve sieve_default = /usr/local/lib/dovecot/default.sieve sieve_dir = ~/sieve sieve_extensions = +vacation +vacation-seconds sieve_max_actions = 92 sieve_max_redirects = 24 sieve_max_script_size = 10M sieve_quota_max_scripts = 20 sieve_quota_max_storage = 200000 } protocols = imap sieve service auth { client_limit = 1024 unix_listener auth-userdb { group = vmail mode = 0660 user = dovecot } } service doveadm { inet_listener { address = 192.168.120.70 port = 9092 } } service imap-login { inet_listener imap { address = 127.0.0.1 port = 143 ssl = no } inet_listener imaps { address = 192.168.120.70 port = 993 ssl = yes } process_min_avail = 5 service_count = 0 } service managesieve-login { inet_listener sieve-local { address = 127.0.0.1 port = 4190 } inet_listener sieve { address = 192.168.120.70 port = 4190 } process_min_avail = 5 service_count = 1 vsz_limit = 64 M } ssl = required ssl_ca = /var/CA/ctfn.ca/RapidSSLWildcard/2017/geotrust.intermediate.pem ssl_cert = <//var/CA/ctfn.ca/RapidSSLWildcard/2017/ctfn.ca.pem ssl_client_ca_dir = /etc/ssl/certs ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext default_fields = uid=vmail gid=vmail imapc_password=%w home=/CTFN/mail/%Ln driver = ldap } userdb { args = uid=vmail gid=vmail home=/CTFN/mail/%n driver = static } verbose_proctitle = yes protocol imap { imap_id_log = * } protocol lda { mail_plugins = stats quota sieve submission_host = 127.0.0.1:25 } protocol sieve { mail_max_userip_connections = 10 mail_plugins = managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 5 managesieve_max_line_length = 65536 managesieve_notify_capability = managesieve_sieve_capability = } SHARED SERVER ON PORT 9993 doveconf -i dovshare -n # 2.2.31 (65cde28): /usr/local/etc/dovecot/dovshare.conf # Pigeonhole version 0.4.19 (e5c7051) # OS: Linux 4.9.0-3-amd64 x86_64 Debian 9.1 auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_verbose_passwords = plain base_dir = /usr/local/var/run/dovshare/ hostname = imapshare.ctfn.ca instance_name = dovshare listen = 192.168.120.70 log_path = /dev/stderr login_greeting = CTFN IMAP Shared Mailboxes mail_debug = yes mail_fsync = always mail_gid = vmail mail_location = maildir:~ mail_nfs_index = yes mail_nfs_storage = yes mail_plugins = stats quota acl mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mmap_disable = yes namespace CTFN { inbox = yes location = maildir:/CTFN/SharedMailboxes/CTFN prefix = CTFN/ separator = / type = public } passdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap master = yes } passdb { args = user=authapps password=XXXXXXXXXX driver = static } plugin { acl = vfile acl_shared_dict = fs:posix:prefix=/CTFN/Config/dovecot/dovecot.acls/ mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size vsize from subject flags } protocols = imap service auth { client_limit = 1024 unix_listener auth-userdb { group = vmail mode = 0660 user = dovecot } } service imap-login { inet_listener imaps { address = 192.168.120.70 port = 9993 ssl = yes } process_min_avail = 5 service_count = 0 } ssl = required ssl_ca = </var/CA/ctfn.ca/RapidSSLWildcard/2017/geotrust.intermediate.pem ssl_cert = <//var/CA/ctfn.ca/RapidSSLWildcard/2017/ctfn.ca.pem ssl_client_ca_file = </var/CA/ctfn.ca/RapidSSLWildcard/2017/geotrust.intermediate.pem ssl_key = # hidden, use -P to show it userdb { args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext driver = ldap } userdb { driver = static } verbose_proctitle = yes protocol imap { imap_id_log = * mail_plugins = acl imap_acl } -- Bob Miller Cell: 867-334-7117 Office: 867-633-3760 www.computerisms.ca

2 4

2.2.32 'doveadm replicator replicate -f' segfault
by Robert Giles 29 Sep '17

29 Sep '17

Very minor bug; not specifying the user mask with 'doveadm replicator replicate -f' causes a segfault: server:~# doveadm replicator replicate -f Segmentation fault server:~# doveadm replicator replicate -f '*' 123 users updated server:~# gdb /usr/bin/doveadm core.2418 GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-100.el7 This GDB was configured as "x86_64-redhat-linux-gnu". Reading symbols from /usr/bin/doveadm...Reading symbols from /usr/lib/debug/usr/bin/doveadm.debug...done. done. [New LWP 2418] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `doveadm replicator replicate -f'. Program terminated with signal 11, Segmentation fault. #0 0x00007fd2c059f921 in __strlen_sse2_pminub () from /lib64/libc.so.6 Missing separate debuginfos, use: debuginfo-install bzip2-libs-1.0.6-13.el7.x86_64 glibc-2.17-196.el7.x86_64 nss-softokn-freebl-3.28.3-8.el7_4.x86_64 xz-libs-5.2.2-1.el7.x86_64 zlib-1.2.7-17.el7.x86_64 (gdb) bt full #0 0x00007fd2c059f921 in __strlen_sse2_pminub () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fd2c08c68f4 in str_append_tabescaped (dest=dest@entry=0x5578cd69f668, src=0x0) at strescape.c:136 No locals. #2 0x00005578cb5a2731 in cmd_replicator_replicate (argc=1, argv=0x5578cd6a75f8) at doveadm-replicator.c:245 ctx = 0x5578cd69f608 str = 0x5578cd69f668 line = <optimized out> #3 0x00005578cb5999d8 in doveadm_try_run (argv=0x5578cd6a75f0, argc=2, cmd_name=0x5578cd6a7610 "replicator") at doveadm.c:223 cmd = <optimized out> #4 main (argc=3, argv=0x5578cd6a75e8) at doveadm.c:383 cctx = {cmd = 0x0, argc = 0, argv = 0x0, username = 0x5578cd6a77cf "root", cli = true, tcp_server = false, local_ip = { family = 0, u = {ip6 = {__in6_u = {__u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, remote_ip = {family = 0, u = {ip6 = {__in6_u = { __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, ip4 = {s_addr = 0}}}, local_port = 0, remote_port = 0, conn = 0x0} cmd_name = 0x5578cd6a7610 "replicator" quick_init = false c = <optimized out> (gdb) frame 4 #4 main (argc=3, argv=0x5578cd6a75e8) at doveadm.c:383 383 !doveadm_try_run(cmd_name, argc, (const char **)argv) && dovecot -n: --------------------- # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 3.10.0-693.2.2.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) auth_master_user_separator = * auth_username_format = %Ln auth_verbose = yes disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it first_valid_uid = 30000 imapc_features = rfc822.size fetch-headers imapc_host = some-imap-server imapc_user = %u last_valid_uid = 30000 mail_location = mdbox:~/mdbox mail_plugins = " zlib acl notify replication" mail_prefetch_count = 20 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus vnd.dovecot.duplicate mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /master-file driver = passwd-file master = yes } passdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcp:server2:1109 sieve = ~/.dovecot.sieve sieve_before = /some-path/global.sieve sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +vnd.dovecot.duplicate sieve_spamtest_max_value = 100 sieve_spamtest_status_header = X-PerlMx-Spam: Gauge=[[:alnum:]]+, Probability=(-?[[:digit:]]+)%.* sieve_spamtest_status_type = score zlib_save = gz zlib_save_level = 6 } protocols = imap lmtp sieve replication_max_conns = 30 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service doveadm { inet_listener { port = 1109 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 24 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 user = vmail } } userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = " zlib acl notify replication sieve" } protocol lda { mail_plugins = " zlib acl notify replication sieve" }

2 1

Securing postfix to dovecot (SASL) auth
by Raymond Sellars 29 Sep '17

29 Sep '17

Hi Is it possible to secure the Dovecot SASL auth provider for postfix? https://wiki2.dovecot.org/HowTo/PostfixAndDovecotSASL I'm currently using the inet option to provide SASL auth to postfix for dovecot. Both installs are on different hosts hence the use of inet rather than unix socket. I'm looking for the best way to secure this channel (rather than just assuming the VLAN is secure ) ,e.g. TLS. It would seem even the latest versions of dovecot/postfix3 don't support encrypting this channel? Has anyone managed to implement a secure internal approach they can share? I'm wondering if Postfix with Cyrus against IMAP using STARTTLS is my best alternative. Thanks Raymond

5 8

Conditionally disabling auth policy
by Mark Moseley 29 Sep '17

29 Sep '17

I've been digging into the auth policy stuff with weakforced lately. There are cases (IP ranges, so could be wrapped up in remote {} blocks) where it'd be nice to skip the auth policy (internal hosts that I can trust, but that are hitting the same servers as the outside world). Is there any way to disable auth policy, possibly inside a remote{}? auth_policy_server_url complains that it can't be used inside a remote block, so no dice there. Anything I'm missing?

3 7

doveadm backup panic, dsync-ibc.c, dsync_ibc_send_mailbox_tree_node, assertion failed: (*name != NULL)
by Robert Giles 28 Sep '17

28 Sep '17

Hi folks, Not sure how much extra information I'll be able to provide on this, but I'm experiencing a consistent, reproducible dsync backup error with a single, specific account I'm trying to migrate from UW-IMAP / Panda (mix mailbox) to a Dovecot 2.2.32 cluster. Didn't spot any core files laying around. Doveadm backup output, dovecot --version and dovecot -n below: server:~# doveadm -Dv -o imapc_user=username-dc -o imapc_password=password backup -R -u username -x .mailboxlist -x .procmailrc -x vacation.msg -x .bash_history -x .Xauthority -x remote_pinerc imapc: Debug: Loading modules from directory: /usr/lib64/dovecot Debug: Module loaded: /usr/lib64/dovecot/lib01_acl_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_replication_plugin.so Debug: Module loaded: /usr/lib64/dovecot/lib20_zlib_plugin.so Debug: Loading modules from directory: /usr/lib64/dovecot/doveadm Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib64/dovecot/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(username): Debug: Effective uid=35000, gid=35000, home=/storagedisk/username doveadm(username): Debug: acl: No acl setting - ACLs are disabled doveadm(username): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:~/mdbox doveadm(username): Debug: fs: root=/storagedisk/username/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(username): Debug: Namespace : Using permissions from /storagedisk/username/mdbox: mode=0700 gid=default dsync(username): Debug: Effective uid=35000, gid=35000, home=/storagedisk/username dsync(username): Debug: acl: No acl setting - ACLs are disabled dsync(username): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Created new connection dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Looking up IP address (reconnect_ok=true, last_connect=1506608870) dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Connecting to 192.168.0.100:143 dsync(username): Info: imapc(panda-imap-server.contoso.com:143): Connected to 192.168.0.100:143 (local 192.168.0.200:33630) dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Server capabilities: IMAP4REV1 I18NLEVEL=1 LITERAL+ SASL-IR LOGIN-REFERRALS STARTTLS dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Authenticating as username-dc dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Server capabilities: IMAP4REV1 I18NLEVEL=1 LITERAL+ IDLE UIDPLUS NAMESPACE CHILDREN MAILBOX-REFERRALS BINARY UNSELECT WITHIN SORT THREAD=REFERENCES THREAD=ORDEREDSUBJECT MULTIAPPEND SCAN dsync(username): Debug: imapc(panda-imap-server.contoso.com:143): Authenticated successfully dsync(username): Debug: imapc: root=, index=, indexpvt=, control=, inbox=, alt= dsync(username): Debug: brain S: Local mailbox tree: guid=00000000000000000000000000000000 uid_validity=0 uid_next=0 subs=no last_change=0 last_subs=0 dsync(username): Panic: file dsync-ibc.c: line 72 (dsync_ibc_send_mailbox_tree_node): assertion failed: (*name != NULL) dsync(username): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x9edee) [0x7f7d4fbfcdee] -> /usr/lib64/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f7d4fbfce5a] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f7d4fb8e2cc] -> doveadm(+0x5332b) [0x563357a0032b] -> doveadm(dsync_brain_send_mailbox_tree+0x6e) [0x5633579f12be] -> doveadm(dsync_brain_run+0x49d) [0x5633579ee56d] -> doveadm(+0x290dc) [0x5633579d60dc] -> doveadm(+0x2b21c) [0x5633579d821c] -> doveadm(+0x2be1a) [0x5633579d8e1a] -> doveadm(doveadm_mail_try_run+0x215) [0x5633579d9775] -> doveadm(main+0x46a) [0x5633579c8a9a] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f7d4f7bcc05] -> doveadm(+0x1bc05) [0x5633579c8c05] Aborted dovecot --version 2.2.32 (dfbe293d4) dovecot -n: ----------------------------------------------- # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 3.10.0-693.2.2.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.4 (Maipo) auth_master_user_separator = * auth_username_format = %Ln disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it first_valid_uid = 35000 imapc_features = rfc822.size fetch-headers imapc_host = panda-imap-server.contoso.com imapc_user = %u last_valid_uid = 35000 mail_location = mdbox:~/mdbox mail_plugins = " zlib acl notify replication" mail_prefetch_count = 20 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext spamtest spamtestplus vnd.dovecot.duplicate mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } plugin { mail_replica = tcp:otherserver.contoso.com:1109 sieve = ~/.dovecot.sieve sieve_before = /etc/sieve.before sieve_dir = ~/sieve sieve_extensions = +spamtest +spamtestplus +vnd.dovecot.duplicate sieve_spamtest_max_value = 100 sieve_spamtest_status_header = X-PerlMx-Spam: Gauge=[[:alnum:]]+, Probability=(-?[[:digit:]]+)%.* sieve_spamtest_status_type = score zlib_save = gz zlib_save_level = 6 } protocols = imap lmtp sieve service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service doveadm { inet_listener { port = 1109 } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service lmtp { inet_listener lmtp { port = 24 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = vmail mode = 0660 user = vmail } } userdb { args = /etc/dovecot/conf.d/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = " zlib acl notify replication sieve" } protocol lda { mail_plugins = " zlib acl notify replication sieve" }

1 1

questions about maildir to mdbox migration
by Dave McGuire 28 Sep '17

28 Sep '17

Hi folks! I converted some of the spools on my mail server from maildir to mdbox. It went smoothly and the performance has been great. However, I have two questions regarding the process. First, I failed to notice the fairly low default mdbox_rotate_size, and I changed it in dovecot.conf after the migration. Is it possible to somehow make that change retroactive, to coalesce the couple thousand "storage/m.*" files that are anywhere from a few hundred bytes up to a few megabytes, into a smaller number of larger files, without re-doing the migration? Second, I'd like to delete the old maildir files and directories to reclaim the space in the filesystem, but it's not clear to me which ones I can safely delete, i.e. ones upon which my new mdbox-based spools no longer depend. I know maildir uses new, tmp, and cur directories, but in the spool directory there are also files like dovecot-uidlist, dovecot-uidvalidity, dovecot.index.cache, dovecot.index.log, dovecot.mailbox.log, as well as separate directories for each of my mail folders containing their own new, tmp, and cur directories and their own dovecot* files. Can someone offer some guidance regarding which ones I can safely remove? Thanks, -Dave -- Dave McGuire, AK4HZ New Kensington, PA

2 2

Panic
by Matthijs Kooijman 28 Sep '17

28 Sep '17

(I'm not subscribed, please keep me CC'd) Hi, since a few months I'm experiencing repeated dovecot crashes. I mostly see them in the logs, I haven't had any users complain, so I haven't looked closely until now. I was originally using an older version fro mDebian and hoped that a newer future version would already fix this, but I just upgraded to version 1:2.2.32-2 from Debian testing, and the problem persists. This crash sometimes happens occasionally, but often happens repeatedly for some time (presumably a client keeps retrying) but can also be gone for hours or days (presumably the client no longer connects). I haven't been able to definitively figure out what client causes this, but based on the user ID I suspect it is Mail.app on OSX. I managed to get a core dump, which gave me the stacktrace below. I've also attached my config file. If any other details are relevant, just ask and I can squeeze them out of the core dump (but I'd rather not publicly share the file). I can probably set up rawlog to capture the actual IMAP session if needed, though I have no time for that right now. Gr. Matthijs 51 ../sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #1 0x00007fc5eed9c3fa in __GI_abort () at abort.c:89 #2 0x00007fc5ef1a609a in default_fatal_finish (type=LOG_TYPE_PANIC, status=status@entry=0) at failures.c:201 #3 0x00007fc5ef1a619a in i_internal_fatal_handler (ctx=0x7ffc553b38d0, format=<optimized out>, args=<optimized out>) at failures.c:670 #4 0x00007fc5ef136cf8 in i_panic (format=format@entry=0x7fc5ef52e880 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 #5 0x00007fc5ef47f998 in mailbox_copy_int (_ctx=_ctx@entry=0x7ffc553b3ab0, mail=<optimized out>) at mail-storage.c:2473 #6 0x00007fc5ef47f9ff in mailbox_copy (_ctx=_ctx@entry=0x7ffc553b3ab0, mail=<optimized out>) at mail-storage.c:2489 #7 0x000055bae72a2f5f in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7ffc553b3a88, t=<optimized out>, move=<optimized out>, cmd=0x55bae816d5e8) at cmd-copy.c:72 #8 cmd_copy_full (cmd=0x55bae816d5e8, move=false) at cmd-copy.c:139 #9 0x000055bae72afd9c in command_exec (cmd=cmd@entry=0x55bae816d5e8) at imap-commands.c:200 #10 0x000055bae72ae322 in client_command_input (cmd=<optimized out>, cmd@entry=0x55bae816d5e8) at imap-client.c:1088 #11 0x000055bae72ae3bc in client_command_input (cmd=<optimized out>) at imap-client.c:1148 #12 0x000055bae72ae77d in client_handle_next_command (remove_io_r=<synthetic pointer>, client=0x55bae816bcf8) at imap-client.c:1190 #13 client_handle_input (client=0x55bae816bcf8) at imap-client.c:1202 #14 0x000055bae72aeccc in client_input (client=0x55bae816bcf8) at imap-client.c:1249 #15 0x00007fc5ef1bb742 in io_loop_call_io (io=0x55bae816d4e0) at ioloop.c:599 #16 0x00007fc5ef1bcd8e in io_loop_handler_run_internal (ioloop=ioloop@entry=0x55bae8153990) at ioloop-epoll.c:223 #17 0x00007fc5ef1bb7d6 in io_loop_handler_run (ioloop=ioloop@entry=0x55bae8153990) at ioloop.c:648 #18 0x00007fc5ef1bb988 in io_loop_run (ioloop=0x55bae8153990) at ioloop.c:623 #19 0x00007fc5ef141353 in master_service_run (service=0x55bae8153830, callback=<optimized out>) at master-service.c:666 #20 0x000055bae72a1139 in main (argc=<optimized out>, argv=<optimized out>) at main.c:491 (gdb) up 9 #9 0x000055bae72afd9c in command_exec (cmd=cmd@entry=0x55bae816d5e8) at imap-commands.c:200 200 finished = cmd->func(cmd); (gdb) p *cmd $14 = {prev = 0x0, next = 0x0, client = 0x55bae816bcf8, pool = 0x55bae816d5c0, tag = 0x55bae816d750 "7.119309", name = 0x55bae816d760 "UID COPY", args = 0x55bae816d770 "20004 INBOX", human_args = 0x55bae816d780 "20004 INBOX", cmd_flags = COMMAND_FLAG_BREAKS_SEQS, tagline_reply = 0x0, func = 0x55bae72a33e0 <cmd_copy>, context = 0x0, module_contexts = {arr = {buffer = 0x55bae816d6e8, element_size = 8}, v = 0x55bae816d6e8, v_modifiable = 0x55bae816d6e8}, parser = 0x55bae8157aa0, state = CLIENT_COMMAND_STATE_WAIT_INPUT, stats = {start_time = {tv_sec = 1506507612, tv_usec = 777163}, last_run_timeval = {tv_sec = 1506507612, tv_usec = 777163}, start_ioloop_wait_usecs = 46340, running_usecs = 0, lock_wait_usecs = 0, bytes_in = 0, bytes_out = 0}, stats_start = {timeval = { tv_sec = 1506507612, tv_usec = 777241}, lock_wait_usecs = 0, bytes_in = 91, bytes_out = 852}, sync = 0x0, uid = 1, cancel = 0, param_error = 0, search_save_result = 0, search_save_result_used = 0, temp_executed = 0, tagline_sent = 0, executing = 1} (gdb) down #8 cmd_copy_full (cmd=0x55bae816d5e8, move=false) at cmd-copy.c:139 139 ret = fetch_and_copy(cmd, move, t, &src_trans, search_args, (gdb) #7 0x000055bae72a2f5f in fetch_and_copy (copy_count_r=<synthetic pointer>, src_uidset_r=<synthetic pointer>, search_args=<optimized out>, src_trans_r=0x7ffc553b3a88, t=<optimized out>, move=<optimized out>, cmd=0x55bae816d5e8) at cmd-copy.c:72 72 if (mailbox_copy(&save_ctx, mail) < 0) (gdb) #6 0x00007fc5ef47f9ff in mailbox_copy (_ctx=_ctx@entry=0x7ffc553b3ab0, mail=<optimized out>) at mail-storage.c:2489 2489 return mailbox_copy_int(_ctx, mail); (gdb) #5 0x00007fc5ef47f998 in mailbox_copy_int (_ctx=_ctx@entry=0x7ffc553b3ab0, mail=<optimized out>) at mail-storage.c:2473 2473 i_assert(!ctx->unfinished); (gdb) #4 0x00007fc5ef136cf8 in i_panic (format=format@entry=0x7fc5ef52e880 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 275 fatal_handler(&ctx, format, args);

3 7

Dovecot and Self-signed issue
by Michael A. Peters 28 Sep '17

28 Sep '17

I use dovecot on several servers. One of them uses a self-signed cert, it's just me. It worked fine until yesterday when I upgraded my desktop (NOT the server) to CentOS 7.4 Now thunderbird complains when it starts up, and won't let me confirm the security exception. On the server the following error occurs in the log: Sep 25 20:17:49 librelamp dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=2600:1010:b064:f260:e83e:562d:2316:18df, lip=2600:3c01::f03c:91ff:fee4:310c, TLS handshaking: SSL_accept() failed: error:14094418:SSL routines:SSL3_READ_BYTES:tlsv1 alert unknown ca: SSL alert number 48, session=<u7agQAlasK8mABAQsGTyYOg+Vi0jFhjf> I believe this is a client issue, as it worked just fine in CentOS 7.3 client, but I am hoping this has been seen and fixed before.

3 6

dsync: assert panic on mbox // no INBOX sync on hybrid mbox/maildir
by David Gardner 27 Sep '17

27 Sep '17

Hi, This (hopefully!) might be a case of user error, as I'm new to dovecot... Alternatively it might be some confusion in an index, since I've been mucking about trying different things in my configuration files and had frequent crashes. I'm trying to sync 2 (LAN) hosts, ideally to have full automatic replication happening. They both have hybrid mbox INBOX and maildir++ folders, using namespaces, as suggested in the wiki. I might have deviated the config from the wiki version, in trying to get things working. Both hosts communicate perfectly with an external IMAP client (thunderbird). Replication is working, but only partially - it is syncing the folders but not INBOX. I've thus been trying various things to try to get the INBOX to sync. The crash is only happening one of the 2 hosts which I've named crashhost for this report. The process crashes no matter which host starts the sync. With a second user, the crash happens on the other host crashhost: Ubuntu 16.04, x86_64, laptop, Dovecot 2.2.22, and Dovecot 2.2.32 (from debian sid package, locally compiled) otherhost: Ubuntu 16.04, x86_64, desktop, Dovecot 2.2.22, and Dovecot 2.2.32 (from debian sid package, locally compiled) RESULTS: 1) doveadm sync -f -u david tcp:otherhost synchronises the folders, but does not touch INBOXes. 2) doveadm sync -f -m INBOX -u david tcp:otherhost Does not touch INBOXes 3) doveadm sync -n '#mbox/' -f -u david tcp:otherhost dsync-local(david): Panic: file mbox-lock.c: line 800 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) I added some debug code, the assertion failure is being triggered by a call to mbox-lock() with: locktype=F_WRCLK mbox->mbox_lock_type=F_RDLCK, mbox->external_transactions=1 The config files on the 2 hosts only differ by the hostnames they're supposed to be syncing to. $ dovecot -n # 2.2.32 (dfbe293d4): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.20 (7cd71ba) # OS: Linux 4.10.0-35-generic x86_64 Ubuntu 16.04.3 LTS doveadm_password = # hidden, use -P to show it doveadm_port = 12346 imapc_host = crashhost imapc_password = # hidden, use -P to show it imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no imapc_user = %u mail_location = maildir:~/mail mail_plugins = " notify replication" mail_privileged_group = mail namespace { inbox = no list = yes location = prefix = separator = / subscriptions = yes } namespace inbox { hidden = yes inbox = yes list = no location = mbox:~/nomail:INBOX=/var/mail/%u:INDEX=/var/spool/mailindex/%u mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = "#mbox/" separator = / type = private } passdb { args = scheme=CRYPT username_format=%u /etc/dovecot/users driver = passwd-file } plugin { mail_replica = tcp:otherhost:12346 } protocols = " imap" service aggregator { fifo_listener replication-notify-fifo { mode = 0666 user = vmail } unix_listener replication-notify { mode = 0666 user = vmail } } service config { unix_listener config { user = vmail } } service doveadm { inet_listener { port = 12346 } user = root } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = required ssl_cert = </etc/dovecot/dovecot.pem ssl_client_ca_dir = /etc/ssl ssl_key = # hidden, use -P to show it userdb { args = username_format=%u /etc/dovecot/users driver = passwd-file } gdb) bt #0 0x00007f37f426e428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54 #1 0x00007f37f427002a in __GI_abort () at abort.c:89 #2 0x00007f37f469f7aa in ?? () from /usr/lib/dovecot/libdovecot.so.0 #3 0x00007f37f469f829 in default_fatal_handler () from /usr/lib/dovecot/libdovecot.so.0 #4 0x00007f37f46302a1 in i_panic () from /usr/lib/dovecot/libdovecot.so.0 #5 0x00007f37f49ac235 in mbox_lock () from /usr/lib/dovecot/libdovecot-storage.so.0 #6 0x00007f37f49adb11 in mbox_save_begin () from /usr/lib/dovecot/libdovecot-storage.so.0 #7 0x00007f37f49769a1 in mailbox_save_begin () from /usr/lib/dovecot/libdovecot-storage.so.0 #8 0x00007f37f496a2e8 in mail_storage_copy () from /usr/lib/dovecot/libdovecot-storage.so.0 #9 0x00007f37f3e332a5 in ?? () from /usr/lib/dovecot/modules/lib15_notify_plugin.so #10 0x00007f37f4976b73 in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #11 0x00007f37f4976d89 in mailbox_move () from /usr/lib/dovecot/libdovecot-storage.so.0 #12 0x000055b45f0da448 in ?? () #13 0x000055b45f0db35a in ?? () #14 0x000055b45f0ddbc0 in dsync_mailbox_import_changes_finish () #15 0x000055b45f0d8645 in dsync_brain_sync_mails () #16 0x000055b45f0d3df8 in dsync_brain_run () #17 0x000055b45f0d4140 in ?? () #18 0x000055b45f0ea3ff in ?? () #19 0x00007f37f46b4c82 in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 #20 0x00007f37f46b6309 in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 #21 0x00007f37f46b4d1c in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 #22 0x00007f37f46b4ec8 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 #23 0x000055b45f0bb4c2 in ?? () #24 0x000055b45f0bd91c in ?? () #25 0x000055b45f0be5aa in ?? () #26 0x000055b45f0beeda in doveadm_mail_try_run () #27 0x000055b45f0ae47c in main ()

3 3

Quota-status service on Director
by Michael Kliewe 27 Sep '17

27 Sep '17

Hello, I'm trying to configure the quota-status service, but it seems I'm not successful with my director setup (2.2.9). I activate the quota-status service like this on my director server: $ cat 91-quota-status.conf ## ## Quota-Status configuration. ## # Load Module quota-status and listen on TCP/IP Port for connections. service quota-status { executable = quota-status -p postfix inet_listener { address = 10.0.1.44 port = 12340 } client_limit = 1 } # Plugin configuration. # Return messages for requests by quota status: success, nouser and overquota. plugin { quota_status_success = DUNNO quota_status_nouser = DUNNO quota_status_overquota = "552 5.2.2 Mailbox is over quota" } After restarting the director service I try to query the quota status service: printf "recipient=user(a)domain.de\nsize=100000\n\n" | nc 10.0.1.44 12340 The output is: action=DEFER_IF_PERMIT Invalid user settings. Refer to server log for more information. In the debug log of the director I see this: Feb 23 03:03:09 director01 dovecot: auth: Debug: userdb out: USER 1 user(a)domain.de mail=mdbox:/mnt/data01/domain.de/user/maildir home=/mnt/data01/domain.de/user proxy=Y master=<hidden> pass=<hidden> uid=5000 gid=1 quota_rule=*:storage=60593 quota_rule2=*:messages=100000 Feb 23 03:03:09 director01 dovecot: quota-status(user(a)domain.de): Error: user user(a)domain.de: Initialization failed: Namespace '': mkdir(/mnt/data01/domain.de/user/maildir/mailboxes) failed: Permission denied (euid=5000(vmail) egid=1(daemon) missing +w perm: /mnt, dir owned by 0:0 mode=0755) So the quota status service tries to access the mailbox of the user ON THE DIRECTOR. But the director has not mounted the mailboxes of the users, that's what the backend dovecots are for (proxy=Y). So the quota-status query is not proxied to the dovecot backend server I would assume. Does that mean I have to start the quota-status service on the dovecot backend servers and access it from the Postfix server directly? Currently the Postfixes can only reach the directors, not the backend servers. Is it possible to use the quota-status service on the director? Thanks for any hints and help Michael

3 4