October 2017 - dovecot

Replication between different versions of dovecot
by Dmitry Nezhevenko 18 Oct '17

18 Oct '17

Hi, Can't find any notes about this in documentation. Is replication supposed to work between different versions of dovecot? I've just found that dovecot 2.2.33.1 was uploaded to debian unstable and it crashes on every replication with older dovecot 2.2.27. (version 2.2.32.1 was probably ok) Summary: - 2.2.33.1 crashes when replicating from/to 2.2.27 - 2.2.32.1 probably ok when replicating from/to 2.2.27 I was able to capture backtrace of crashed doveadm-server: Program terminated with signal SIGSEGV, Segmentation fault. #0 i_stream_next_line (stream=stream@entry=0x0) at istream.c:428 428 istream.c: No such file or directory. (gdb) bt #0 i_stream_next_line (stream=stream@entry=0x0) at istream.c:428 #1 0x00007f60244306df in i_stream_read_next_line (stream=0x0) at istream.c:449 #2 0x0000560304f22e79 in server_connection_print_log (conn=0x560305e930f8) at server-connection.c:305 #3 0x0000560304f238af in server_connection_input_one (conn=<optimized out>) at server-connection.c:405 #4 server_connection_input (conn=<optimized out>) at server-connection.c:390 #5 0x00007f602443a572 in io_loop_call_io (io=0x560305e81e30) at ioloop.c:600 #6 0x00007f602443bc1e in io_loop_handler_run_internal (ioloop=ioloop@entry=0x560305e59ad0) at ioloop-epoll.c:223 #7 0x00007f602443a606 in io_loop_handler_run (ioloop=ioloop@entry=0x560305e59ad0) at ioloop.c:649 #8 0x00007f602443a7b8 in io_loop_run (ioloop=0x560305e59ad0) at ioloop.c:624 #9 0x0000560304f0de5a in dsync_connect_tcp (ctx=ctx@entry=0x560305e7e9e8, mail_set=mail_set@entry=0x560305e8ad50, target=0x560305e8b94c "inhex.vpn.local:9993", ssl=ssl@entry=false, error_r=error_r@entry=0x7fff8e40b9e8) at doveadm-dsync.c:850 #10 0x0000560304f0fbe3 in parse_location (error_r=0x7fff8e40b9e8, remote_cmd_args_r=0x7fff8e40b858, location=<optimized out>, mail_set=0x560305e8ad50, ctx=0x560305e7e9e8) at doveadm-dsync.c:875 #11 cmd_dsync_prerun (_ctx=0x560305e7e9e8, service_user=<optimized out>, error_r=0x7fff8e40b9e8) at doveadm-dsync.c:947 #12 0x0000560304f10891 in doveadm_mail_next_user (ctx=ctx@entry=0x560305e7e9e8, cctx=cctx@entry=0x7fff8e40b9f0, error_r=error_r@entry=0x7fff8e40b9e8) at doveadm-mail.c:414 #13 0x0000560304f11473 in doveadm_mail_single_user (ctx=ctx@entry=0x560305e7e9e8, cctx=cctx@entry=0x7fff8e40b9f0, error_r=error_r@entry=0x7fff8e40b9e8) at doveadm-mail.c:460 #14 0x0000560304f262fb in doveadm_mail_cmd_server_run (cctx=0x7fff8e40b9f0, mctx=0x560305e7e9e8, conn=0x560305e7a878) at client-connection.c:246 #15 doveadm_cmd_handle (cctx=0x7fff8e40b9f0, argv=<optimized out>, argc=<optimized out>, cmd_name=<optimized out>, conn=0x560305e7a878) at client-connection.c:329 #16 client_handle_command (args=<optimized out>, conn=0x560305e7a878) at client-connection.c:399 #17 client_connection_input (conn=<optimized out>) at client-connection.c:541 #18 0x00007f602443a572 in io_loop_call_io (io=0x560305e58c40) at ioloop.c:600 #19 0x00007f602443bc1e in io_loop_handler_run_internal (ioloop=ioloop@entry=0x560305e529a0) at ioloop-epoll.c:223 #20 0x00007f602443a606 in io_loop_handler_run (ioloop=ioloop@entry=0x560305e529a0) at ioloop.c:649 #21 0x00007f602443a7b8 in io_loop_run (ioloop=0x560305e529a0) at ioloop.c:624 #22 0x00007f60243bf893 in master_service_run (service=0x560305e52840, callback=<optimized out>) at master-service.c:719 #23 0x0000560304f011d5 in main (argc=<optimized out>, argv=<optimized out>) at main.c:143 -- WBR, Dmitry

2 4

Re: Limit the nuumber of mails POPped at a time
by Joseph Tam 18 Oct '17

18 Oct '17

> I have a piece of software with a mailclient that has problems when it > POP's large amounts of mail. Unfortunately the system can't be updated > or fixed.So I'm trying to figure out if I can limit the number of mails > that can be seen via Dovecot. > ... > So it would be a question of always presenting a maximum of 300 mails > via the POP3.Is it doable? You're probably solving the wrong problem -- the mail client really ought to be able to process 300+ messages. It may be a better use of time to fix that than to torture dovecot to give you what you want. You can try using a plugin to define a virtual INBOX https://wiki.dovecot.org/Plugins/Virtual with search/selection criteria to limit the number of messages. You can also try some LDA script (e.g. procmail) hackery to create INBOX volumes of 300 messages, then do some shuffling around when the INBOX gets emptied. Joseph Tam <jtam.home(a)gmail.com>

1 0

mdbox + director + nfs
by Raymond Sellars 17 Oct '17

17 Oct '17

Hi Matt We've been running this configuration for the past couple of years. Not noticed any locking issues. As I understand it that's the objective of using Director. As Aki notes make sure you have the appropriate NFS settings. Other lessons we encountered. Important to ensure NFS is NTP sync'd and aligned with your hosts, we hit some issues with file timestamps leading to problems. Replication, e.g. for perhaps a backup or DR site. Seems to work but we've had the odd occasion of the indexes drifting. Never tracked the reason down and believe its unrelated to the NFS. Just something to monitor. Regards Raymond ------------------------------ Message: 5 Date: Tue, 17 Oct 2017 08:50:18 +0300 From: Aki Tuomi <aki.tuomi(a)dovecot.fi> To: dovecot(a)dovecot.org Subject: Re: mdbox + director + nfs Message-ID: <70b54e75-14fe-2caa-eccb-1ffc05c2a1e5(a)dovecot.fi> Content-Type: text/plain; charset=utf-8 NFS with mdbox should work just fine, locking should not be an issue, but please read https://wiki.dovecot.org/NFS Aki On 17.10.2017 02:32, Matt Bryant wrote: > Anyone had any experience they can share using a director setup with > NFS and using the mdbox format instead of maildir. Is locking an issue > on index files ?? > > rgds > > Matt

1 0

Dovecot 2.2.31 Incorrect Search
by Siarhei Chystsiakou 17 Oct '17

17 Oct '17

Hi. I have installed dovecot 2.2.31 and fts plugin with Apache Solr 6.6.1. I have found that imap search is not correct in my dovecot. For example, I want to find email from user s.chistiakov(a)example.com. I run IMAP command "SEARCH FROM s.chi" and result is null. But if I run IMAP command "SEARCH FROM s.chistiakov" I get list of emails from this user. Why does this happen and how to fix it? Help me please ) Thanks. Result of my actions in telnet: https://hastebin.com/fewanacafu.md Dovecot config: https://hastebin.com/noqehimaxu.makefile

2 2

Re: Disable PAM
by Aki Tuomi 17 Oct '17

17 Oct '17

Yep. Just remove any passdb/userdb pam blocks ---Aki TuomiDovecot oy -------- Original message --------From: Travis Dolan <travis.dolan(a)gmail.com> Date: 17/10/2017 17:40 (GMT+02:00) To: dovecot(a)dovecot.org Subject: Disable PAM Can I disable PAM auth if all my username/password lookups are via a database connection? I would love to get rid of the following lines in my logs... Oct 17 14:32:14 auth-worker(7809): Info: pam(xxx-xxx-xxx,111.111.111.111,<sdfhgsdfgsd>): pam_authenticate() failed: Authentication failure (password mismatch?) Cheers.

1 0

Disable PAM
by Travis Dolan 17 Oct '17

17 Oct '17

Can I disable PAM auth if all my username/password lookups are via a database connection? I would love to get rid of the following lines in my logs... Oct 17 14:32:14 auth-worker(7809): Info: pam(xxx-xxx-xxx,111.111.111.111,<sdfhgsdfgsd>): pam_authenticate() failed: Authentication failure (password mismatch?) Cheers.

1 0

Limit the nuumber of mails POPped at a time
by K F 17 Oct '17

17 Oct '17

Hi All I'm completely new to the world of Dovecot, so please bear with me if this is a simple noob question (which I fer it is :-) ) I have a postfix/dovecot setup for handling specific mails for clients. I have a piece of software with a mailclient that has problems when it POP's large amounts of mail. Unfortunately the system can't be updated or fixed.So I'm trying to figure out if I can limit the number of mails that can be seen via Dovecot. The procedure would be likeThe client connects. Dovecot limits the number of mails to 300. The client fetches and deletes the POPped mails immediately after retreivel.Next time it POPs it has the next batch. So it would be a question of always presenting a maximum of 300 mails via the POP3.Is it doable? Dovecot is version 2.2.10Server is a CentOS 7. Best regardsK

1 0

Fast replication
by ＠4OS 17 Oct '17

17 Oct '17

Hi, I'm trying to get replication to work with a 2 machines setup. So far full replication is happening at the specified interval (24hrs) without problem but fast sync is not happening. The fast sync counter is always equal to full sync unless i exec dsync manually. doveadm replicator status '*' username priority fast sync full sync success sync failed johndoe(a)oricom.dmz none 00:06:33 00:06:33 00:21:33 - johndoe2(a)oricom.dmz none 00:06:34 00:06:34 00:06:34 - johndoe3(a)oricom.dmz none 00:06:34 00:06:34 00:06:34 - The fast replication part is not clear and i cannot find much about it. There is nothing related with dovecot -a and the documentation does not say much about it. How the fast replication is triggered? Manually or it is supposed to be automatic through some type of config. Some light over this would help me understand the way it work and how to get it setup right. yves

2 2

mdbox + director + nfs
by Matt Bryant 17 Oct '17

17 Oct '17

Anyone had any experience they can share using a director setup with NFS and using the mdbox format instead of maildir. Is locking an issue on index files ?? rgds Matt -- <https://www.postbox-inc.com/?utm_source=email&utm_medium=siglink&utm_campai…>

3 2

Trash plugin unexpected results
by Stephan Herker 16 Oct '17

16 Oct '17

I have the trash plugin enabled and testing it out I had an account with a 30MB quota. In the accounts trash it had an email with a large attachment. I sent the same email again to the account expecting the trash plugin to purge the message from trash to make space for the new message in the inbox. However I got an error saying it couldn't remove enough trash to make space. This behavior seems unexpected because it seems like the trash plugin didn't account for the quota and size available. Debug logs and dovecot -n output below. Oct 07 17:33:13 lmtp(31543): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Oct 07 17:33:13 lmtp(31543): Info: Connect from local Oct 07 17:33:13 lmtp(31543): Debug: Loading modules from directory: /usr/lib64/dovecot Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib10_quota_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib11_trash_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib20_autocreate_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: Module loaded: /usr/lib64/dovecot/lib90_sieve_plugin.so Oct 07 17:33:13 lmtp(31543): Debug: auth input: 123(a)testdo.com home=/home/vmail/testdo.com/123 mail=maildir:/home/vmail/testdo.com/123 uid=2000 gid=2000 quota_rule=*:storage=30000 Oct 07 17:33:13 lmtp(31543): Debug: Added userdb setting: mail=maildir:/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543): Debug: Added userdb setting: plugin/quota_rule=*:storage=30000 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Effective uid=2000, gid=2000, home=/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota root: name=User quota backend=dict args=:proxy::quotadict Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=* bytes=30720000 messages=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota rule: root=User quota mailbox=Trash bytes=+104857600 messages=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Quota grace: root=User quota bytes=3072000 (10%) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: dict quota: user=123(a)testdo.com, uri=proxy::quotadict, noenforcing=0 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vmail/testdo.com/123 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: maildir++: root=/home/vmail/testdo.com/123, index=, indexpvt=, control=, inbox=/home/vmail/testdo.com/123, alt= Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Added 'Spam' with priority 1 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Added 'Trash' with priority 2 Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: sieve: Pigeonhole version 0.4.2 initializing Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: using the following location for user's Sieve script: /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: loading script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: script binary /home/vmail/testdo.com/123/.dovecot.svbin successfully loaded Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: binary save: not saving binary /home/vmail/testdo.com/123/.dovecot.svbin, because it is already stored Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: uFHMBEly2Vk3ewAAobcTNA: sieve: executing script from /home/vmail/testdo.com/123/.dovecot.svbin Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Debug: trash plugin: Failed to remove enough messages (needed 17035766 bytes, expunged only 16803594 bytes) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Info: uFHMBEly2Vk3ewAAobcTNA: sieve: msgid=<c5189e27-b2e3-bcc2-b34f-ecffa9d614cc(a)keagaming.com>: failed to store into mailbox 'INBOX': Quota exceeded (mailbox for user is full) Oct 07 17:33:13 lmtp(31543, 123(a)testdo.com) Info: uFHMBEly2Vk3ewAAobcTNA: sieve: execution of script /home/vmail/testdo.com/123/.dovecot.sieve;name=main script failed with unsuccessful implicit keep (user logfile /home/vmail/testdo.com/123/.dovecot.sieve.log may reveal additional details) Oct 07 17:33:13 lmtp(31543): Info: Disconnect from local: Successful quit # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-514.26.2.el7.x86_64 x86_64 CentOS Linux release 7.4.1708 (Core) xfs auth_mechanisms = plain login dict { quotadict = mysql:/etc/dovecot/dovecot-dict-quota.conf } first_valid_uid = 2000 hostname = testdo.com last_valid_uid = 2000 log_path = /var/log/dovecot.log mail_debug = yes mail_gid = vmail mail_location = maildir:/home/vmail/%d/%n mail_plugins = " quota trash expire" mail_privileged_group = mail mail_uid = vmail managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox Junk { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota = dict:User quota::proxy::quotadict quota_grace = 10%% quota_rule2 = Trash:storage=+100M quota_status_nouser = DUNNO quota_status_overquota = 552 5.2.2 Mailbox is full quota_status_success = DUNNO sieve_dir = ~/sieve sieve_global_dir = /etc/dovecot/sieve/global/ sieve_global_path = /etc/dovecot/sieve/default.sieve trash = /etc/dovecot/dovecot-trash.conf.ext } postmaster_address = administrator(a)testdo.com protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-client { group = postfix mode = 0660 user = postfix } unix_listener auth-master { group = vmail mode = 0660 user = vmail } unix_listener auth-userdb { mode = 0600 user = vmail } user = dovecot } service dict { unix_listener dict { group = vmail mode = 0600 user = vmail } } service imap-login { inet_listener imap { port = 143 } } service lmtp { executable = lmtp -L unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } } ssl_cert = </etc/pki/dovecot/certs/dovecot.pem ssl_key = </etc/pki/dovecot/private/dovecot.pem userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocol lmtp { info_log_path = /var/log/dovecot-lmtp.log log_path = /var/log/dovecot-lmtp-errors.log mail_plugins = " quota trash expire autocreate sieve quota" postmaster_address = postmaster(a)testdo.com } protocol sieve { info_log_path = /var/log/dovecot-sieve.log log_path = /var/log/dovecot-sieve-errors.log managesieve_implementation_string = dovecot managesieve_max_line_length = 65536 } protocol imap { mail_plugins = " quota trash expire imap_quota notify quota" } protocol pop3 { mail_plugins = " quota trash expire quota" } Any help is appreciated, thanks.

3 5