- dovecot - dovecot.org

Re: 2.2.25 dumps core with "Panic: file imap-client.c: line 837 (client_check_command_hangs): assertion failed: (client->io != NULL)"
by Piper Andreas 15 Sep '16

15 Sep '16

Hello Timo, from the maintainer of the OpenCSW package I got the below answer. As the newly build package yields another different commit hash (which I cannot find on GitHub too), I would ask, if you are sure that the commit hash-output in 'doveconf -n' is generated correctly? The headline of 'doveconf -n' with the newly build package is # 2.2.25 (68082dc): /etc/opt/csw/dovecot/dovecot.conf Many thanks for your help, Andreas -------- Weitergeleitete Nachricht -------- Betreff: Re: OpenCSW question about package CSWdovecot Datum: Tue, 30 Aug 2016 08:56:44 -0700 Von: jgoerzen <jgoerzen(a)opencsw.org> An: piper(a)hrz.uni-marburg.de Hello Andreas, The OpenCSW dovecot package was built using the 2.2.25 version release tarball. No code changes or patches have been applied. I'm not sure what happened. I will respin new packages and then check to see if the git-commit hash is correct. When the packages are done building I'll put them in the experimental catalog: http://buildfarm.opencsw.org/experimental.html#jgoerzen Thanks, Jake On 08/29/2016 11:59 PM, piper(a)hrz.uni-marburg.de wrote: > Hello, > > with your newest dovecot-package 2.2.25,REV=2016.07.01, I sometimes get core-dumps as documented in my bug-report at the dovecot-mailing-list: http://dovecot.org/list/dovecot/2016-August/105321.html > In reaction to my bug-report, Timo Sirainen asks, which git-commit of the dovecot-sources was used for this package: http://dovecot.org/list/dovecot/2016-August/105332.html > > Could you shed some light on this? > > Thanks a lot, > Andreas

3 8

No Autoindex?
by Larry Rosenman 14 Sep '16

14 Sep '16

I used to get my mail auto-indexed, but something(tm) changed recently, but I'm not sure what. I do have fts_autoindex = yes in my dovecot config, and if I do a doveadm index \* it does the index. Ideas? doveconf -n attached -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: larryrtx(a)gmail.com US Mail: 17716 Limpia Crk, Round Rock, TX 78664-7281

1 0

How to obtain a "non-stripped" executable for producing a usable core-dump
by Ben Johnson 14 Sep '16

14 Sep '16

Hello, I'm attempting to capture a core-dump file, and gdb reports warning: core file may not match specified executable file. And only after installing "dovecot-dbg" on my system (Ubuntu 16.04 LTS) does gdb report further warning: the debug information found in "/lib64/ld-2.23.so" does not match "/lib64/ld-linux-x86-64.so.2" (CRC mismatch). It took some searching the internet to realize that both messages are likely the result of having a "stripped" executable: # file /usr/lib/dovecot/dovecot-lda /usr/lib/dovecot/dovecot-lda: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux 2.6.32, BuildID[sha1]=49c9c607c304a5c853c05a4ccb9e4b995f185ac4, stripped So, how best I am I to obtain a "non-stripped" dovecot-lda executable? Must I forego my distro's repositories and download the dovecot source, compiling every executable and all plugins "from scratch", in order to obtain a useful core-dump file? Perhaps the bug report instructions at http://www.dovecot.org/bugreport.html should mention "stripped" executables and how to avoid them. Perhaps I am simply ignorant, but if that is the case, there is little to no hope for the "average user" where submitting bug reports is concerned. Any guidance would be most appreciated. Thanks in advance, -Ben

3 5

Limit replication to one user
by Arne Hoffmann 14 Sep '16

14 Sep '16

Hello, we have a setup here where the main (and only important) feature of the IMAP server is the public folder. Two Dovecot instances are running in a active/passive cluster and mailstorage should be replicated between the two. Since there is a race condition when using public namespaces (locking on user level and not on mailbox level) I had the intention of limiting the replication to one user. I read somewhere that dsync is replicating all the users the command "doveadm user '*'" shows. And the command only shows *one* user because I have modified the iterate_query: ,----[/etc/dovecot/mysql.conf] | iterate_query = SELECT username AS user FROM mailbox WHERE username = 'data_replication(a)example.com' `---- root [~]# doveadm user '*' data_replication(a)example.com root [~]# So, why does Dovecot still replicate mails from other users inboxes? And why does doveadm replicator still show other users? root [~]# doveadm replicator status '*' username priority fast sync full sync success sync failed data_replication(a)example.com none 00:57:14 01:13:21 00:57:12 - arne.hoffmann(a)example.com none 00:20:04 00:31:40 00:20:02 - root [~]# [I removed some whitespace to keep line length in check] Any explanation of this behavior would be just awesome. Hints to possible solution even more! :) root [~]# doveconf -n # 2.2.24 (a82c823): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 3.16.0-4-amd64 x86_64 Debian 8.5 ext4 debug_log_path = /var/log/mail.debug disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it mail_debug = yes mail_location = maildir:/var/mail/vmail/%d/%n/Maildir:INBOX=/var/mail/vmail/%d/%n/Maildir mail_plugins = " listescape notify replication" mail_privileged_group = vmail namespace { location = maildir:/var/mail/vmail/Öffentliche Ordner:INDEXPVT=~/Maildir/Öffentliche Ordner mailbox "Gelöschte Elemente" { auto = subscribe special_use = \Trash } mailbox XYZ-Projekt { auto = subscribe } prefix = Öffentliche Ordner/ separator = / subscriptions = no type = public } namespace inbox { inbox = yes location = mailbox "Gelöschte Elemente" { auto = subscribe special_use = \Trash } prefix = separator = / type = private } passdb { args = /etc/dovecot/mysql.conf driver = sql } plugin { mail_replica = tcps:10.162.70.70:22001 } protocols = imap replication_max_conns = 1 service aggregator { fifo_listener replication-notify-fifo { user = vmail } unix_listener replication-notify { user = vmail } } service doveadm { inet_listener { port = 22001 ssl = yes } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0660 user = vmail } } ssl = required ssl_ca = </etc/ssl/os/ca-cert.pem ssl_cert = </etc/ssl/os/cert-10-162-70-71.pem ssl_client_ca_file = /etc/ssl/os/cert-all.pem ssl_client_cert = </etc/ssl/os/cert-10-162-70-71.pem ssl_client_key = </etc/ssl/os/key-10-162-70-71.pem ssl_key = </etc/ssl/os/key-10-162-70-71.pem ssl_require_crl = no userdb { args = /etc/dovecot/mysql.conf driver = sql } local 10.162.70.72 { protocol imap { ssl_ca = </etc/ssl/os/ca-cert.pem ssl_cert = </etc/ssl/os/cert-10-162-70-72.pem ssl_client_ca_file = /etc/ssl/os/cert-all.pem ssl_client_cert = </etc/ssl/os/cert-10-162-70-72.pem ssl_client_key = </etc/ssl/os/key-10-162-70-72.pem ssl_key = </etc/ssl/os/key-10-162-70-72.pem } } root [~]# Regards, Arne

1 0

Dovecot con Autentication Checkpassword error signal 111
by zerocool＠modemsoft.it 13 Sep '16

13 Sep '16

Good morning, It is the first time I write in this mailing list and I apologize in advance for possible nonsense that i can write. I have a mail server with qmail + courier imap and I would "Migrate" to dovecot. I installed the package and configured the components necessary to me using as system autentication checkpassword. I have verified the checkpassword operation without the processor usage of Dovecot and is functioning. When you perform the tests with dovecot from the logs out these errors: auth: Error: checkpassword(plutos,127.0.0.1,<WLcLPkg8esF/AAAB>): Child 15375 died with signal 11 auth: Error: checkpassword(plutos,127.0.0.1,<WLcLPkg8esF/AAAB>): Child 15376 died with signal 11 imap-login: Info: Disconnected (auth failed, 2 attempts in 8 secs): user=<plutos>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured master: Warning: Killed with signal 15 (by pid=15479 uid=0 code=kill) or : auth: Error: checkpassword(plutos,192.168.1.113,<zzV561I8IuDAqAFx>): Child 15851 died with signal 11 auth: Error: checkpassword(plutos,192.168.1.113,<zzV561I8IuDAqAFx>): Child 15852 died with signal 11 imap-login: Info: Disconnected (auth failed, 2 attempts in 8 secs): user=<plutos>, method=PLAIN, rip=192.168.1.113, lip=192.168.1.113, secured imap-login: Info: Disconnected: Too many invalid commands (no auth attempts in 102 secs): user=<>, rip=192.168.1.235, lip=192.168.1.113 auth: Error: checkpassword(plutos,192.168.1.235,<7pLd+FI81uXAqAHr>): Child 15870 died with signal 11 It is already a long time that we slam but I can not figure out where to make the mistake. Who will help me to solve this problem. Thanks in advance for your support. Regards

2 1

Lmtp proxy (director) destination port.
by Aleksey Tsvetkov 13 Sep '16

13 Sep '16

Hello, If in extra fields "port" isn't set, then lmtp proxy doesn't work: Error: lmtp client: connect(mail.example.com, 0) failed: Can't assign requested address If to set "port", then imap, doveadm proxy don't work. How it is possible to set "port" only for lmtp proxy? -- Best regards, Aleksey Tsvetkov Leading System Administrator Company Grand Vision tel. +7(495)937-70-02

1 0

Capturing dovecot core dump and debugging with gdb: ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
by Ben Johnson 13 Sep '16

13 Sep '16

Hello, I'm experiencing a segfault, so I've followed the steps at http://www.dovecot.org/bugreport.html in an effort to capture the information necessary to submit a bug report. Full "doveconf -n" output is at the end of this message. Dovecot does seem to dump a core file, but when I attempt to parse it, I get this: # apt install dovecot-dbg lib64stdc++6-4.9-dbg # gdb /usr/lib/dovecot/deliver /var/vmail/tmp/core-deliver-6-5000-5000-29125-1473732949 # Generic gdb GNU disclaimers and such here... Reading symbols from /usr/lib/dovecot/deliver...Reading symbols from /usr/lib/debug/.build-id/49/c9c607c304a5c853c05a4ccb9e4b995f185ac4.debug...done. done. warning: core file may not match specified executable file. [New LWP 29125] warning: the debug information found in "/lib64/ld-2.23.so" does not match "/lib64/ld-linux-x86-64.so.2" (CRC mismatch). Core was generated by `/usr/lib/dovecot/deliver -d sa-training(a)example.com -m Training.HAM -p'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f7712e77418 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54 54 ../sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) The obvious question is why the "core file may not match specified executable file". What am I doing wrong here? Any help would be greatly appreciated. Thanks in advance! --Ben # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (7b14904) # OS: Linux 4.4.0-36-generic x86_64 Ubuntu 16.04.1 LTS auth_mechanisms = plain login disable_plaintext_auth = no listen = *,[::] log_timestamp = "%Y-%m-%d %H:%M:%S " mail_max_userip_connections = 100 mail_plugins = " quota" mail_privileged_group = vmail passdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } plugin { antispam_backend = pipe antispam_debug_target = syslog antispam_pipe_program = /bin/bash antispam_pipe_program_args = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_notspam_arg = --ham antispam_pipe_program_spam_arg = --spam antispam_pipe_tmpdir = /tmp antispam_spam_pattern_ignorecase = SPAM;JUNK antispam_trash_pattern_ignorecase = trash;Deleted * antispam_verbose_debug = 1 quota = dict:user::file:/var/vmail/%d/%n/.quotausage quota_rule2 = Trash:storage=+100M quota_rule3 = Junk:ignore quota_rule4 = INBOX:storage=+100M quota_warning = storage=100%% quota-reached 100 %u %d quota_warning2 = storage=95%% quota-warning 95 %u %d quota_warning3 = storage=80%% quota-warning 80 %u %d quota_warning4 = -storage=100%% quota-below below %u %d sieve = /var/vmail/%d/%n/.sieve sieve_max_redirects = 25 } postmaster_address = postmaster@example protocols = imap pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0600 user = vmail } user = root } service config { unix_listener config { group = vmail mode = 0600 user = vmail } } service imap-login { client_limit = 1000 process_limit = 512 } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service quota-below { executable = script /usr/local/bin/quota-below.sh unix_listener quota-below { group = vmail mode = 0666 user = vmail } user = vmail } service quota-reached { executable = script /usr/local/bin/quota-reached.sh unix_listener quota-reached { group = vmail mode = 0666 user = vmail } user = vmail } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { group = vmail mode = 0666 user = vmail } user = vmail } ssl_cert = </etc/postfix/smtpd.cert ssl_key = </etc/postfix/smtpd.key ssl_protocols = !SSLv2 !SSLv3 userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf driver = sql } protocol imap { mail_plugins = quota imap_quota antispam } protocol pop3 { mail_plugins = quota pop3_uidl_format = %08Xu%08Xv } protocol lda { mail_plugins = sieve quota } protocol lmtp { mail_plugins = quota sieve postmaster_address = webmaster@localhost }

1 0

Re: Use of obox2 and AWS S3
by Raymond Sellars 13 Sep '16

13 Sep '16

Thanks Karol My challenge with AWS EFS is waiting for it to be HIPAA/BAA certified. But good to know it's a satisfactory option. I like the aspect of not worrying about total storage space, in part why I was looking at obox and S3 for the elastic scale. ------------------------------ Message: 5 Date: Sat, 10 Sep 2016 22:27:52 +0100 From: Karol Augustin <karol(a)augustin.pl> To: dovecot(a)dovecot.org Subject: Re: Use of obox2 and AWS S3 Message-ID: <1fbb9ac24386c29a92a320d2d1a399bd(a)augustin.pl> Content-Type: text/plain; charset=US-ASCII On 2016-09-01 2:59, Raymond Sellars wrote: > Any one running a dovecot solution within AWS in general? Interested > in best practice for the storage layer. Although NFS is possible its > not really optimised for elastic cloud type hosting. > > Thanks > Raymond Hi Raymond, I am using dovecot on EC2 instance with EFS storage backend. As the initial performance is bad it scales pretty quickly with space used. So it handles maildir storage very well. The latency is a little high but with indexes there is no problem. It works as NFS storage with unlimited space (8EB) and you pay for what you use. So it turns out to be very cost effective as you do not have to worry about reserving space. For better performance you can keep indexes on ephermal storage or EBS, which both have much lower access times. As for 'elastic cloud type hosting' EFS store can be used by thousands of instances in multiple AWS AZs at the same time, so it looks like it is somehow optimized. Best, Karol -- Karol Augustin karol(a)augustin.pl http://karolaugustin.pl/ +353 85 775 5312

1 0

Sieve filtering SPAM and redirect
by Andre Luiz Paiz 12 Sep '16

12 Sep '16

Hi every body. I'm having difficulties to setup my filters correctly and I really need some help. This is my environment: Mail that is received on the system passes through a sieve_before script that checks the message header for SPAM tag and store it into the "Junk" folder. If no spam tag is found, mail goes to inbox. My horde webmail is integrated with sieve, so this allow users to create their own scripts to store mail in other folders or forward them to external accounts. And this are the problems I'm having: 1 - When users create a forward filter to redirect to external mail, mail that is stored inside the Junk folder are not forwarded; 2 - If I insert a "keep" parameter inside the sieve_before script to keep processing the rules, the mail is forwarded, but becomes duplicated and stored inside the inbox or other folders, if the user has more filters. 3 - If I move my sieve_before script to sieve_after, the same thing happened, one copy is stored on the user selected folder (inbox or filtered), including mail marked as SPAM. My needs are: I need to separate SPAM and HAM e-mail before users intervention (so I need sieve_before). But this SPAM e-mail has to be forwarded if a forward filter is created. Is it possible to use a sieve_after script that moves (instead of copy) the user mail marked as SPAM to the Junk folder even if it was stored in a different folder? Is that possible? Thanks a lot. Here is my config: sieve_after content: require "fileinto"; if header :contains "X-Spam-Flag" "YES" { fileinto "Junk"; } dovecot --version 2.2.10 # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-327.28.2.el7.x86_64 x86_64 CentOS Linux release 7.2.1511 (Core) auth_cache_negative_ttl = 0 auth_cache_size = 10 M auth_mechanisms = plain login auth_username_format = %Ln default_client_limit = 1024 default_process_limit = 1024 default_vsz_limit = 1 G mail_location = maildir:~/Maildir:INDEX=/var/indexes/dovecot/%u mail_plugins = " mail_log notify quota" mail_temp_dir = /var/tmp managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave imapflags notify mbox_write_locks = fcntl mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } plugin { mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename mail_log_fields = uid box msgid size quota = maildir quota_exceeded_message = Cota de armazenamento de e-mails excedida. Quota exceeded for mail store. quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=85%% quota-warning 85 %u quota_warning3 = storage=75%% quota-warning 75 %u sieve = ~/.dovecot.sieve sieve_before = /var/lib/dovecot/sieve/default.sieve sieve_default = /var/lib/dovecot/sieve/default.sieve sieve_dir = ~/sieve sieve_extensions = +notify +imapflags } protocols = imap pop3 lmtp sieve service anvil { client_limit = 14100 process_limit = 1 } service auth-worker { client_limit = 1 process_limit = 50 service_count = 1 } service auth { client_limit = 15100 process_limit = 1 } service dict { client_limit = 1 } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } process_limit = 6000 process_min_avail = 10 service_count = 1 vsz_limit = 256 M } service imap { process_limit = 3000 vsz_limit = 1 G } service lmtp { client_limit = 1 inet_listener lmtp { port = 24 } unix_listener lmtp { mode = 0666 } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } process_limit = 6000 process_min_avail = 10 service_count = 1 } service pop3 { process_limit = 3000 } service quota-warning { executable = script /usr/local/bin/quota-warning.sh unix_listener quota-warning { mode = 0666 user = dovecot } user = root } ssl = required ssl_cert = ************** ssl_key = ************** userdb { driver = passwd } userdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocol lmtp { mail_plugins = " mail_log notify quota sieve quota" } protocol imap { mail_plugins = " mail_log notify quota imap_quota" } Atenciosamente André Luiz Paiz Administração de Redes Instituto de Química – Unicamp andre.paiz(a)iqm.unicamp.br Telefone: (19)3521-0197

4 8

Use of obox2 and AWS S3
by Raymond Sellars 11 Sep '16

11 Sep '16

Hi Has anyone used or is using dovecot obox and S3 storage? I see very little chatter or documentation on it. Interested in how mature it is and technical items such as high availability and region replication. I'm guessing that multiple updates to a S3 mailbox is mitigated via the standard dovecot pattern of Director pointing multiple user sessions to a single/common dovecot node. And for disaster recovery - that's out of scope of dovecot and more reliant on S3 replication? Any one running a dovecot solution within AWS in general? Interested in best practice for the storage layer. Although NFS is possible its not really optimised for elastic cloud type hosting. Thanks Raymond

3 2