From nerijus at users.sourceforge.net Fri Apr 1 00:44:16 2016 From: nerijus at users.sourceforge.net (Nerijus Baliunas) Date: Fri, 1 Apr 2016 03:44:16 +0300 Subject: default namespace In-Reply-To: References: Message-ID: It works with 2.2.23. On Fri, 1 Apr 2016 02:12:17 +0300 Nerijus Baliunas wrote: > Hello, > > With no namespace settings and dovecot 2.0.9 I get the following listing: > > a LIST "" "*" > * LIST (\HasNoChildren) "." "Trash" > * LIST (\HasNoChildren) "." "Sent" > * LIST (\HasNoChildren) "." "INBOX" > a OK List completed. > > Then I add the namespaces: > > namespace inbox { > separator = . > prefix = > inbox = yes > hidden = no > list = yes > subscriptions = yes > } > > namespace compat { > separator = . > prefix = INBOX. > inbox = no > hidden = yes > list = no > alias_for = > } > > Then list output changes: > > a LIST "" "*" > * LIST (\HasNoChildren) "." "Trash" > * LIST (\HasNoChildren) "." "Sent" > * LIST (\HasChildren) "." "INBOX" > a OK List completed. > > INBOX now has \HasChildren, while before it had \HasNoChildren. > How can I make it \HasNoChildren? > > Regards, > Nerijus From patrickdk at patrickdk.com Fri Apr 1 03:42:04 2016 From: patrickdk at patrickdk.com (Patrick Domack) Date: Thu, 31 Mar 2016 23:42:04 -0400 Subject: multiple recipient_delimiter In-Reply-To: <56FD8560.1020003@backschues.de> Message-ID: <20160331234204.Horde.o7122bVubxclp-3DtFIpaso@mail.patrickdk.com> No, my patch still applies to make this happen though. It's just a one word/line patch. Quoting J?rg Backschues : > Hello, > > does the recipient_delimiter option accepts multiple delimiter by now? > > -- > Regards > J?rg Backschues From gedalya at gedalya.net Fri Apr 1 04:36:50 2016 From: gedalya at gedalya.net (Gedalya) Date: Fri, 1 Apr 2016 00:36:50 -0400 Subject: multiple recipient_delimiter In-Reply-To: <20160331234204.Horde.o7122bVubxclp-3DtFIpaso@mail.patrickdk.com> References: <20160331234204.Horde.o7122bVubxclp-3DtFIpaso@mail.patrickdk.com> Message-ID: <56FDFAE2.10709@gedalya.net> Would be useful to me as well, if this gets merged. On 03/31/2016 11:42 PM, Patrick Domack wrote: > No, my patch still applies to make this happen though. It's just a one word/line patch. > > > Quoting J?rg Backschues : > >> Hello, >> >> does the recipient_delimiter option accepts multiple delimiter by now? >> >> -- >> Regards >> J?rg Backschues From jcea at jcea.es Fri Apr 1 11:44:45 2016 From: jcea at jcea.es (Jesus Cea) Date: Fri, 1 Apr 2016 13:44:45 +0200 Subject: SIS deduplication fails to create intermediate directories and funny permissions Message-ID: <56FE5F2D.2020106@jcea.es> I have configured my system to use SIS, sharing the same same storage for all users, and offline deduplication. I have this in my "root" cron: """ 53 1 * * * /usr/local/bin/doveadm purge -A 16 * * * * /usr/local/bin/doveadm sis deduplicate /home/dovecot/buzones/attachments /home/dovecot/buzones/attachments/queue """ Yes, it is launched as "root" but I would expect doveadm drop privileges as soon as possible. This is working great, but from time to time I get this error message: """ Your "cron" job on babylon5 /usr/local/bin/doveadm sis deduplicate /home/dovecot/buzones/attachments /home/dovecot/buzones/attachments/queue produced the following output: Error: mkdir(/home/dovecot/buzones/attachments/dc/62/hashes) failed: No such file or directory """ Looks like doveadm is trying to create the "hashes" directory but the parent "62" doesn't exits yet. If I create that directory by hand and set permissions correctly, everything (seems to) work. Talking about this, I see something strange wit the permissions. All files and directories in SIS are created with "dovemail" user and group EXCEPT the "hashes" directory inside the newly created directory. That is: When I get the error message, I have this: """ drwx------ 7 dovemail dovemail 7 Apr 1 13:28 . drwx------ 237 dovemail dovemail 237 Mar 24 20:09 .. drwx------ 3 dovemail dovemail 3 Feb 29 02:30 1d drwx------ 3 dovemail dovemail 3 Mar 9 01:53 7f drwx------ 3 dovemail dovemail 3 Feb 29 02:30 88 drwx------ 3 dovemail dovemail 3 Feb 29 02:30 8d """ I create the missing directory by hand and change permissions. Now I have: """ drwx------ 7 dovemail dovemail 7 Apr 1 13:28 . drwx------ 237 dovemail dovemail 237 Mar 24 20:09 .. drwx------ 3 dovemail dovemail 3 Feb 29 02:30 1d drwx------ 3 dovemail dovemail 3 Apr 1 13:30 62 drwx------ 3 dovemail dovemail 3 Mar 9 01:53 7f drwx------ 3 dovemail dovemail 3 Feb 29 02:30 88 drwx------ 3 dovemail dovemail 3 Feb 29 02:30 8d """ I run the deduplicator again (as root) and it creates a "hashes" directory inside the "62" directory... with user/group root/root. """ drwx------ 2 root root 2 Apr 1 13:30 hashes """ -- Jes?s Cea Avi?n _/_/ _/_/_/ _/_/_/ jcea at jcea.es - http://www.jcea.es/ _/_/ _/_/ _/_/ _/_/ _/_/ Twitter: @jcea _/_/ _/_/ _/_/_/_/_/ jabber / xmpp:jcea at jabber.org _/_/ _/_/ _/_/ _/_/ _/_/ "Things are not so easy" _/_/ _/_/ _/_/ _/_/ _/_/ _/_/ "My name is Dump, Core Dump" _/_/_/ _/_/_/ _/_/ _/_/ "El amor es poner tu felicidad en la felicidad de otro" - Leibniz -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: OpenPGP digital signature URL: From useexperience at gmail.com Fri Apr 1 12:26:13 2016 From: useexperience at gmail.com (use experience) Date: Fri, 1 Apr 2016 17:56:13 +0530 Subject: Save UID & metadata of mail in mysql table Message-ID: Team, I would like to save UID and metadata of mail in mysql table. I am trying to achieve this using dovecot plugin mail-filter. Also would like to do in the process of mail store (using Dovecot LDA). How can I get UID & metadata through script. From daniel.colchete at gmail.com Fri Apr 1 18:15:09 2016 From: daniel.colchete at gmail.com (Daniel van Ham Colchete) Date: Fri, 1 Apr 2016 15:15:09 -0300 Subject: "Lost" e-mail after alternate partition offline Message-ID: Hey guys! I've got a problem here and I wish you could help me. A drive failed here and went offline for some time. This was a alternate storage drive so it took a while (hours) for us to notice. There was a problem with DRBD also, so it didn't move to the redundancy, it just went offline. I was able to recover all the files there, but a few of my users still don't see their old e-mails, the ones that are supposed to be on the alternate storage. >From what I could troubleshoot here file are there, vmail user can access them, so it's not a permission issue, but a doveadm dump on the index file of each mail folder, won't show the e-mail at the alternate storage drive. So, they are there (at the filesystem), but they aren't (from a imap client). Is there a way to rebuild the dovecot.index file, re-adding everything back to each folder? Best, Daniel Colchete From useexperience at gmail.com Fri Apr 1 19:09:15 2016 From: useexperience at gmail.com (use experience) Date: Sat, 2 Apr 2016 00:39:15 +0530 Subject: Save UID & metadata of mail in mysql table In-Reply-To: References: Message-ID: UID means unique identification number used to store mail. Any help is appreciated?. On Fri, Apr 1, 2016 at 5:56 PM, use experience wrote: > Team, > > I would like to save UID and metadata of mail in mysql table. I am trying > to achieve this using dovecot plugin mail-filter. Also would like to do in > the process of mail store (using Dovecot LDA). How can I get UID & metadata > through script. > From useexperience at gmail.com Sat Apr 2 04:53:40 2016 From: useexperience at gmail.com (use experience) Date: Sat, 2 Apr 2016 10:23:40 +0530 Subject: Dovecot rest api Message-ID: Team, Need more information on dovecot rest api. Any detailed information about list of dovecot rest apis other than http://www.dovecot.fi/dovecot-launches-a-gmail-api-compatible-rest-api-to-enable-third-party-developers-to-join-its-global-email-ecosystem/ will really helpful. From andrew.mcglashan at affinityvision.com.au Sat Apr 2 05:50:19 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Sat, 2 Apr 2016 16:50:19 +1100 Subject: Save UID & metadata of mail in mysql table In-Reply-To: References: Message-ID: <56FF5D9B.3040507@affinityvision.com.au> On 2/04/2016 6:09 AM, use experience wrote: > UID means unique identification number used to store mail. Any help is > appreciated?. There are UIDs and there are UIDs..... I think that you will find a unique ID in the email header, if you are processing other metadata from the header, this will be there too. The UID in the dovecot-uidlist file may or may not be useful; but the ID in the email header should be. Cheers AndrewM From useexperience at gmail.com Sat Apr 2 09:04:02 2016 From: useexperience at gmail.com (use experience) Date: Sat, 2 Apr 2016 14:34:02 +0530 Subject: Save UID & metadata of mail in mysql table In-Reply-To: References: Message-ID: Thanks AndrewM for your help. Mail UID (unique number for each mail) is the one I am trying to figure out. MailLog filter able to read mail-iid, metadata, etc. In the same way I want to extract mail-uid and metadata using some plugin or script whatever. Can you please guide me how can I get this?. On Sat, Apr 2, 2016 at 12:39 AM, use experience wrote: > UID means unique identification number used to store mail. Any help is > appreciated?. > > On Fri, Apr 1, 2016 at 5:56 PM, use experience > wrote: > >> Team, >> >> I would like to save UID and metadata of mail in mysql table. I am trying >> to achieve this using dovecot plugin mail-filter. Also would like to do in >> the process of mail store (using Dovecot LDA). How can I get UID & metadata >> through script. >> > > From lucabert at lucabert.de Sat Apr 2 11:23:33 2016 From: lucabert at lucabert.de (Luca Bertoncello) Date: Sat, 2 Apr 2016 13:23:33 +0200 Subject: Dovecot with LDAP/AD has problem with uid/gid Message-ID: <20160402132333.63c0996c@frodo.lucabert.intra> Hi list! I have a Server connected to an AD and I need to configure Dovecot to authenticate the users against the AD (with password and GSSAPI). Now I'm trying to connect Dovecot to the AD with password. The authentication works, but I always got this error: Apr 2 13:03:49 mail dovecot: pop3-login: Login: user=, method=PLAIN, rip=192.168.50.1, lip=192.168.50.3, mpid=3508, session= Apr 2 13:03:49 mail dovecot: pop3(lucabert): Error: stat(/var/spool/mail/lucabert/tmp) failed: Permission denied (euid=10001(lucabert) egid=10000(domain users) missing +x perm: /var/spool/mail/lucabert, dir owned by 1005:8 mode=0700) Apr 2 13:03:49 mail dovecot: pop3(lucabert): Error: Couldn't open INBOX: Internal error occurred. Refer to server log for more information. [2016-04-02 13:03:49] My configuration: # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-83-generic x86_64 Ubuntu 14.04.4 LTS nfs auth_gssapi_hostname = mail.cch.intra auth_mechanisms = plain login cram-md5 gssapi auth_use_winbind = yes auth_username_chars = disable_plaintext_auth = no login_greeting = mail.cch.intra ready. mail_fsync = always mail_gid = 8 mail_location = maildir:/var/spool/mail/%Ln mail_nfs_index = yes mail_uid = 1005 mmap_disable = yes namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } passdb { args = /etc/dovecot/dovecot-ldap.conf.ext driver = ldap } protocols = " imap pop3" ssl_cert = References: <20160402132333.63c0996c@frodo.lucabert.intra> Message-ID: <20160402134328.59640ffe@frodo.lucabert.intra> Luca Bertoncello schrieb: > But it seems that all these settings for uid/gid will be > ignored/overwritten... Of course the Mailboxes have user 1005 and group 8. Well, I got it... I had in my 10-auth.conf (installation from Ubuntu-package) !include auth-system.conf.ext and it was the problem... Now I have another problem: I can just login with password and not with GSSAPI... If I try to use GSSAPI I got in the log: Apr 2 13:43:00 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 2 13:43:00 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 2 13:43:00 mail dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libmech_gssapi.so Apr 2 13:43:00 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 2 13:43:00 mail dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Apr 2 13:43:00 mail dovecot: auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Apr 2 13:43:00 mail dovecot: auth: Debug: auth client connected (pid=4018) Apr 2 13:43:00 mail dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=192.168.50.54, lip=192.168.50.3, TLS, session= Any idea? Thanks Luca Bertoncello (lucabert at lucabert.de) From phil at dunlop-lello.uk Sat Apr 2 12:30:41 2016 From: phil at dunlop-lello.uk (Phil Lello) Date: Sat, 2 Apr 2016 13:30:41 +0100 Subject: Dovecot rest api In-Reply-To: References: Message-ID: +1 - me too. In my case, I'm looking for a way to do webmail without imap since the web interface wants external auth via SAML. On 2 Apr 2016 05:54, "use experience" wrote: > Team, > > Need more information on dovecot rest api. Any detailed information about > list of dovecot rest apis other than > > http://www.dovecot.fi/dovecot-launches-a-gmail-api-compatible-rest-api-to-enable-third-party-developers-to-join-its-global-email-ecosystem/ > will > really helpful. > From pali.rohar at gmail.com Sat Apr 2 15:58:40 2016 From: pali.rohar at gmail.com (=?UTF-8?q?Pali=20Roh=C3=A1r?=) Date: Sat, 2 Apr 2016 17:58:40 +0200 Subject: [PATCH 0/7] Fixes for lib-mail message-address Message-ID: <1459612727-13399-1-git-send-email-pali.rohar@gmail.com> Hello, I borrowed dovecot parser for email addresses and going to use it in new perl module as replacement for Email::Address. During implementation and testing I found bugs in dovecot parser & generator. So I'm sending my patches together with tests. Pali Roh?r (7): lib-mail: message_address_write: Fix generating empty group list lib-mail: message_address_write: Fix generating group list with empty name lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if last_comment is not NULL lib-mail: parse_addr_spec: Email address without local-part is invalid lib-mail: parse_mailbox: Set display name instead mailbox when parsing failed lib-mail: message_address_write: Quote and escape strings if needed lib-mail: Update tests for message address src/lib-mail/message-address.c | 99 +++++++++++++++++++++++++++++++---- src/lib-mail/test-message-address.c | 11 +++- 2 files changed, 98 insertions(+), 12 deletions(-) -- 1.7.9.5 From pruimj at gmail.com Sat Apr 2 21:11:44 2016 From: pruimj at gmail.com (Jason Pruim) Date: Sat, 2 Apr 2016 17:11:44 -0400 Subject: Still muddling through with broken auth... Message-ID: Hey Everyone, I?m still muddling through my first install? Followed the tutorials on workaround.org which were very helpful! but don?t include much info if things don?t work 100%? and so far I haven?t been able to pin down where the error is. When I try: telnet localhost 143 this is what shows up in the maillot: Apr 2 21:06:57 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' Apr 2 21:06:57 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs Apr 2 21:06:57 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session=<+lw34IYvVgB/AAAB> With the failed driver for the database, I tried mysql and sql both of which produce the same error? I have a few other issues but I think those are related farther upstream? Not being able to sign into round cube for webmail, because of it being unable to connect to the storage container? But I think that?s a round cube issue? I want to get postfix and dovecot playing nicely before I worry too much about things like webmail access? Here is my postconf -n: [ec2-user at ip-172-31-24-2 dovecot]$ postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix debug_peer_level = 2 html_directory = no inet_interfaces = localhost inet_protocols = all mail_owner = postfix mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man mydestination = $myhostname, localhost.$mydomain, localhost newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES sample_directory = /usr/share/doc/postfix-2.6.6/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop unknown_local_recipient_reject_code = 550 virtual_mailbox_domains = hash:/etc/postfix/virtual_mailbox_domains virtual_mailbox_maps = hash:/etc/postfix/virtual_mailbox_users virtual_transport = dovecot [ec2-user at ip-172-31-24-2 dovecot]$ What else can I provide? Thanks! Jason Pruim pruimj at gmail.com 352.234.3175 From edgar at pettijohn-web.com Sat Apr 2 21:54:59 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sat, 2 Apr 2016 16:54:59 -0500 Subject: Still muddling through with broken auth... In-Reply-To: References: Message-ID: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> Sent from my iPhone > On Apr 2, 2016, at 4:11 PM, Jason Pruim wrote: > > Hey Everyone, > > I?m still muddling through my first install? Followed the tutorials on workaround.org which were very helpful! but don?t include much info if things don?t work 100%? and so far I haven?t been able to pin down where the error is. When I try: telnet localhost 143 this is what shows up in the maillot: > > Apr 2 21:06:57 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' > Apr 2 21:06:57 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs > Apr 2 21:06:57 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session=<+lw34IYvVgB/AAAB> > > With the failed driver for the database, I tried mysql and sql both of which produce the same error? I have a few other issues but I think those are related farther upstream? Not being able to sign into round cube for webmail, because of it being unable to connect to the storage container? But I think that?s a round cube issue? I want to get postfix and dovecot playing nicely before I worry too much about things like webmail access? > > Here is my postconf -n: > > [ec2-user at ip-172-31-24-2 dovecot]$ postconf -n > alias_database = hash:/etc/aliases > alias_maps = hash:/etc/aliases > command_directory = /usr/sbin > config_directory = /etc/postfix > daemon_directory = /usr/libexec/postfix > data_directory = /var/lib/postfix > debug_peer_level = 2 > html_directory = no > inet_interfaces = localhost > inet_protocols = all > mail_owner = postfix > mailq_path = /usr/bin/mailq.postfix > manpage_directory = /usr/share/man > mydestination = $myhostname, localhost.$mydomain, localhost > newaliases_path = /usr/bin/newaliases.postfix > queue_directory = /var/spool/postfix > readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES > sample_directory = /usr/share/doc/postfix-2.6.6/samples > sendmail_path = /usr/sbin/sendmail.postfix > setgid_group = postdrop > unknown_local_recipient_reject_code = 550 > virtual_mailbox_domains = hash:/etc/postfix/virtual_mailbox_domains > virtual_mailbox_maps = hash:/etc/postfix/virtual_mailbox_users > virtual_transport = dovecot > [ec2-user at ip-172-31-24-2 dovecot]$ I don't use postfix, but I'm guessing the above hash:/etc/ should probably be some form of mysql:/etc/... > > What else can I provide? > > Thanks! > > > > Jason Pruim > pruimj at gmail.com > 352.234.3175 From pruimj at gmail.com Sat Apr 2 22:26:59 2016 From: pruimj at gmail.com (Jason Pruim) Date: Sat, 2 Apr 2016 18:26:59 -0400 Subject: Still muddling through with broken auth... In-Reply-To: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> Message-ID: <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> Hey Edgar, Thanks for catching that! Missed it earlier! Got it changed but I?m still having the same error updated postconf -n: [ec2-user at ip-172-31-24-2 conf.d]$ postconf -n alias_database = hash:/etc/aliases alias_maps = hash:/etc/aliases command_directory = /usr/sbin config_directory = /etc/postfix daemon_directory = /usr/libexec/postfix data_directory = /var/lib/postfix debug_peer_level = 2 html_directory = no inet_interfaces = localhost inet_protocols = all mail_owner = postfix mailq_path = /usr/bin/mailq.postfix manpage_directory = /usr/share/man mydestination = $myhostname, localhost.$mydomain, localhost newaliases_path = /usr/bin/newaliases.postfix queue_directory = /var/spool/postfix readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES sample_directory = /usr/share/doc/postfix-2.6.6/samples sendmail_path = /usr/sbin/sendmail.postfix setgid_group = postdrop unknown_local_recipient_reject_code = 550 virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf virtual_transport = dovecot [ec2-user at ip-172-31-24-2 conf.d]$ Here is the same error: Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= I feel like I?m missing something simple but can?t see the forest through the trees? Jason Pruim pruimj at gmail.com 352.234.3175 > On Apr 2, 2016, at 5:54 PM, Edgar Pettijohn wrote: > > > > Sent from my iPhone > >> On Apr 2, 2016, at 4:11 PM, Jason Pruim wrote: >> >> Hey Everyone, >> >> I?m still muddling through my first install? Followed the tutorials on workaround.org which were very helpful! but don?t include much info if things don?t work 100%? and so far I haven?t been able to pin down where the error is. When I try: telnet localhost 143 this is what shows up in the maillot: >> >> Apr 2 21:06:57 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' >> Apr 2 21:06:57 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 2 secs >> Apr 2 21:06:57 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session=<+lw34IYvVgB/AAAB> >> >> With the failed driver for the database, I tried mysql and sql both of which produce the same error? I have a few other issues but I think those are related farther upstream? Not being able to sign into round cube for webmail, because of it being unable to connect to the storage container? But I think that?s a round cube issue? I want to get postfix and dovecot playing nicely before I worry too much about things like webmail access? >> >> Here is my postconf -n: >> >> [ec2-user at ip-172-31-24-2 dovecot]$ postconf -n >> alias_database = hash:/etc/aliases >> alias_maps = hash:/etc/aliases >> command_directory = /usr/sbin >> config_directory = /etc/postfix >> daemon_directory = /usr/libexec/postfix >> data_directory = /var/lib/postfix >> debug_peer_level = 2 >> html_directory = no >> inet_interfaces = localhost >> inet_protocols = all >> mail_owner = postfix >> mailq_path = /usr/bin/mailq.postfix >> manpage_directory = /usr/share/man >> mydestination = $myhostname, localhost.$mydomain, localhost >> newaliases_path = /usr/bin/newaliases.postfix >> queue_directory = /var/spool/postfix >> readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES >> sample_directory = /usr/share/doc/postfix-2.6.6/samples >> sendmail_path = /usr/sbin/sendmail.postfix >> setgid_group = postdrop >> unknown_local_recipient_reject_code = 550 >> virtual_mailbox_domains = hash:/etc/postfix/virtual_mailbox_domains >> virtual_mailbox_maps = hash:/etc/postfix/virtual_mailbox_users >> virtual_transport = dovecot >> [ec2-user at ip-172-31-24-2 dovecot]$ > > > I don't use postfix, but I'm guessing the above hash:/etc/ should probably be some form of mysql:/etc/... > >> >> What else can I provide? >> >> Thanks! >> >> >> >> Jason Pruim >> pruimj at gmail.com >> 352.234.3175 From ad+lists at uni-x.org Sat Apr 2 22:42:30 2016 From: ad+lists at uni-x.org (Alexander Dalloz) Date: Sun, 3 Apr 2016 00:42:30 +0200 Subject: Still muddling through with broken auth... In-Reply-To: <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> Message-ID: <57004AD6.3030505@uni-x.org> Am 03.04.2016 um 00:26 schrieb Jason Pruim: > Hey Edgar, > > Thanks for catching that! Missed it earlier! Got it changed but I?m still having the same error updated postconf -n: Why do you provide the Postfix configuration? Absolutely unrelated to the shown dovecot error. > [ec2-user at ip-172-31-24-2 conf.d]$ postconf -n > alias_database = hash:/etc/aliases > alias_maps = hash:/etc/aliases > command_directory = /usr/sbin > config_directory = /etc/postfix > daemon_directory = /usr/libexec/postfix > data_directory = /var/lib/postfix > debug_peer_level = 2 > html_directory = no > inet_interfaces = localhost > inet_protocols = all > mail_owner = postfix > mailq_path = /usr/bin/mailq.postfix > manpage_directory = /usr/share/man > mydestination = $myhostname, localhost.$mydomain, localhost > newaliases_path = /usr/bin/newaliases.postfix > queue_directory = /var/spool/postfix > readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES > sample_directory = /usr/share/doc/postfix-2.6.6/samples > sendmail_path = /usr/sbin/sendmail.postfix > setgid_group = postdrop > unknown_local_recipient_reject_code = 550 > virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf > virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf > virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf > virtual_transport = dovecot > [ec2-user at ip-172-31-24-2 conf.d]$ While being at Postfix: You have zero SASL configuration, unless it is defined in master.cf for the submission transport. > Here is the same error: > > Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' > Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs > Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= Please provide the output of "doveconf -n". You have a severe configuration error so that the auth process fails. > I feel like I?m missing something simple but can?t see the forest through the trees? > > > Jason Pruim > pruimj at gmail.com > 352.234.3175 Alexander From edgar at pettijohn-web.com Sat Apr 2 22:54:02 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sat, 2 Apr 2016 17:54:02 -0500 Subject: Still muddling through with broken auth... In-Reply-To: <57004AD6.3030505@uni-x.org> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> <57004AD6.3030505@uni-x.org> Message-ID: <5A82D0E9-72E8-4466-A5D7-0DCA1D592798@pettijohn-web.com> Sent from my iPhone > On Apr 2, 2016, at 5:42 PM, Alexander Dalloz wrote: > >> Am 03.04.2016 um 00:26 schrieb Jason Pruim: >> Hey Edgar, >> >> Thanks for catching that! Missed it earlier! Got it changed but I?m still having the same error updated postconf -n: > > Why do you provide the Postfix configuration? Absolutely unrelated to the shown dovecot error. > >> [ec2-user at ip-172-31-24-2 conf.d]$ postconf -n >> alias_database = hash:/etc/aliases >> alias_maps = hash:/etc/aliases >> command_directory = /usr/sbin >> config_directory = /etc/postfix >> daemon_directory = /usr/libexec/postfix >> data_directory = /var/lib/postfix >> debug_peer_level = 2 >> html_directory = no >> inet_interfaces = localhost >> inet_protocols = all >> mail_owner = postfix >> mailq_path = /usr/bin/mailq.postfix >> manpage_directory = /usr/share/man >> mydestination = $myhostname, localhost.$mydomain, localhost >> newaliases_path = /usr/bin/newaliases.postfix >> queue_directory = /var/spool/postfix >> readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES >> sample_directory = /usr/share/doc/postfix-2.6.6/samples >> sendmail_path = /usr/sbin/sendmail.postfix >> setgid_group = postdrop >> unknown_local_recipient_reject_code = 550 >> virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf >> virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf >> virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf >> virtual_transport = dovecot >> [ec2-user at ip-172-31-24-2 conf.d]$ > > While being at Postfix: You have zero SASL configuration, unless it is defined in master.cf for the submission transport. > >> Here is the same error: >> >> Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' >> Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs >> Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= > > Please provide the output of "doveconf -n". You have a severe configuration error so that the auth process fails. > >> I feel like I?m missing something simple but can?t see the forest through the trees? >> >> >> Jason Pruim >> pruimj at gmail.com >> 352.234.3175 > > Alexander doveadm-auth may be your friend here. From pruimj at gmail.com Sat Apr 2 23:04:26 2016 From: pruimj at gmail.com (Jason Pruim) Date: Sat, 2 Apr 2016 19:04:26 -0400 Subject: Still muddling through with broken auth... In-Reply-To: <57004AD6.3030505@uni-x.org> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> <57004AD6.3030505@uni-x.org> Message-ID: Jason Pruim pruimj at gmail.com 352.234.3175 > On Apr 2, 2016, at 6:42 PM, Alexander Dalloz wrote: > > Am 03.04.2016 um 00:26 schrieb Jason Pruim: >> Hey Edgar, >> >> Thanks for catching that! Missed it earlier! Got it changed but I?m still having the same error updated postconf -n: > > Why do you provide the Postfix configuration? Absolutely unrelated to the shown dovecot error. I provide what I know how to provide :) > >> [ec2-user at ip-172-31-24-2 conf.d]$ postconf -n >> alias_database = hash:/etc/aliases >> alias_maps = hash:/etc/aliases >> command_directory = /usr/sbin >> config_directory = /etc/postfix >> daemon_directory = /usr/libexec/postfix >> data_directory = /var/lib/postfix >> debug_peer_level = 2 >> html_directory = no >> inet_interfaces = localhost >> inet_protocols = all >> mail_owner = postfix >> mailq_path = /usr/bin/mailq.postfix >> manpage_directory = /usr/share/man >> mydestination = $myhostname, localhost.$mydomain, localhost >> newaliases_path = /usr/bin/newaliases.postfix >> queue_directory = /var/spool/postfix >> readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES >> sample_directory = /usr/share/doc/postfix-2.6.6/samples >> sendmail_path = /usr/sbin/sendmail.postfix >> setgid_group = postdrop >> unknown_local_recipient_reject_code = 550 >> virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf >> virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf >> virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf >> virtual_transport = dovecot >> [ec2-user at ip-172-31-24-2 conf.d]$ > > While being at Postfix: You have zero SASL configuration, unless it is defined in master.cf for the submission transport. Lets do 1 problem at a time? Unless SASL is needed for sending email? > >> Here is the same error: >> >> Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' >> Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs >> Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= > > Please provide the output of "doveconf -n". You have a severe configuration error so that the auth process fails. Here is the output: [ec2-user at ip-172-31-24-2 conf.d]$ dovecot -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 4.1.17-22.30.amzn1.x86_64 x86_64 ext4 auth_mechanisms = plain login mail_location = maildir:/var/vmail/%d/%n/Maildir mbox_write_locks = fcntl namespace inbox { inbox = yes location = prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = postfix mode = 0600 user = postfix } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = no ssl_cert = References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> <57004AD6.3030505@uni-x.org> Message-ID: <57005D6D.5080300@uni-x.org> Am 03.04.2016 um 01:04 schrieb Jason Pruim: > > Jason Pruim > pruimj at gmail.com > 352.234.3175 > > >> On Apr 2, 2016, at 6:42 PM, Alexander Dalloz wrote: >> >> Am 03.04.2016 um 00:26 schrieb Jason Pruim: >>> Hey Edgar, >>> >>> Thanks for catching that! Missed it earlier! Got it changed but I?m still having the same error updated postconf -n: >> >> Why do you provide the Postfix configuration? Absolutely unrelated to the shown dovecot error. > > I provide what I know how to provide :) >> >>> [ec2-user at ip-172-31-24-2 conf.d]$ postconf -n >>> alias_database = hash:/etc/aliases >>> alias_maps = hash:/etc/aliases >>> command_directory = /usr/sbin >>> config_directory = /etc/postfix >>> daemon_directory = /usr/libexec/postfix >>> data_directory = /var/lib/postfix >>> debug_peer_level = 2 >>> html_directory = no >>> inet_interfaces = localhost >>> inet_protocols = all >>> mail_owner = postfix >>> mailq_path = /usr/bin/mailq.postfix >>> manpage_directory = /usr/share/man >>> mydestination = $myhostname, localhost.$mydomain, localhost >>> newaliases_path = /usr/bin/newaliases.postfix >>> queue_directory = /var/spool/postfix >>> readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES >>> sample_directory = /usr/share/doc/postfix-2.6.6/samples >>> sendmail_path = /usr/sbin/sendmail.postfix >>> setgid_group = postdrop >>> unknown_local_recipient_reject_code = 550 >>> virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf >>> virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf >>> virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf >>> virtual_transport = dovecot >>> [ec2-user at ip-172-31-24-2 conf.d]$ >> >> While being at Postfix: You have zero SASL configuration, unless it is defined in master.cf for the submission transport. > > Lets do 1 problem at a time? Unless SASL is needed for sending email? Right, 1 problem at a time. Yes, SASL is needed for your MTA to permit relaying based on authentication. >>> Here is the same error: >>> >>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' >>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs >>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= >> >> Please provide the output of "doveconf -n". You have a severe configuration error so that the auth process fails. > > Here is the output: > > [ec2-user at ip-172-31-24-2 conf.d]$ dovecot -n > # 2.2.10: /etc/dovecot/dovecot.conf Where did you get that dovecot version from? The Postfix version seems to indicate a RHEL/CentOS base of major release 6. That one does not ship a dovecot 2.2.x version. > # OS: Linux 4.1.17-22.30.amzn1.x86_64 x86_64 ext4 > auth_mechanisms = plain login > mail_location = maildir:/var/vmail/%d/%n/Maildir > mbox_write_locks = fcntl > namespace inbox { > inbox = yes > location = > prefix = > separator = . > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext What specified in the dovecot-sql.conf.ext file? Make sure the driver in there is set as "mysql" and not "sql". Not sure whether your dovecot is packaged in a way that you need a another package to provide the SQL driver functionality. Btw. there is no need to run any SQL based backend, neither for dovecot nor Postfix, while I see a lot of beginners to think it would be. Keep it simple, even most simple while your are doing your first steps. > driver = sql > } > protocols = imap lmtp > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = postfix > mode = 0600 > user = postfix > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > ssl = no > ssl_cert = ssl_key = ssl_protocols = !SSLv2 !SSLv3 > userdb { > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > driver = static > } > protocol lmtp { > mail_plugins = " sieve" > } > protocol lda { > mail_plugins = " sieve" > } > [ec2-user at ip-172-31-24-2 conf.d]$ > > > It?s been awhile since I?ve run a mail server, and never to this extent? Always through hosting companies except for about 15 years ago when I did it for fun! :) > > Thanks for all your help! Regards Alexander From pruimj at gmail.com Sun Apr 3 00:07:33 2016 From: pruimj at gmail.com (Jason Pruim) Date: Sat, 2 Apr 2016 20:07:33 -0400 Subject: Still muddling through with broken auth... In-Reply-To: <57005D6D.5080300@uni-x.org> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> <57004AD6.3030505@uni-x.org> <57005D6D.5080300@uni-x.org> Message-ID: <0F712B9D-16AD-4985-94F8-07D1B3FACC02@gmail.com> Jason Pruim pruimj at gmail.com 352.234.3175 > On Apr 2, 2016, at 8:01 PM, Alexander Dalloz wrote: > > Am 03.04.2016 um 01:04 schrieb Jason Pruim: >> >> Jason Pruim >> pruimj at gmail.com >> 352.234.3175 >> >> >>> On Apr 2, 2016, at 6:42 PM, Alexander Dalloz wrote: >>> >>> Am 03.04.2016 um 00:26 schrieb Jason Pruim: >>>> Hey Edgar, >>>> >>>> Thanks for catching that! Missed it earlier! Got it changed but I?m still having the same error updated postconf -n: >>> >>> Why do you provide the Postfix configuration? Absolutely unrelated to the shown dovecot error. >> >> I provide what I know how to provide :) >>> >>>> [ec2-user at ip-172-31-24-2 conf.d]$ postconf -n >>>> alias_database = hash:/etc/aliases >>>> alias_maps = hash:/etc/aliases >>>> command_directory = /usr/sbin >>>> config_directory = /etc/postfix >>>> daemon_directory = /usr/libexec/postfix >>>> data_directory = /var/lib/postfix >>>> debug_peer_level = 2 >>>> html_directory = no >>>> inet_interfaces = localhost >>>> inet_protocols = all >>>> mail_owner = postfix >>>> mailq_path = /usr/bin/mailq.postfix >>>> manpage_directory = /usr/share/man >>>> mydestination = $myhostname, localhost.$mydomain, localhost >>>> newaliases_path = /usr/bin/newaliases.postfix >>>> queue_directory = /var/spool/postfix >>>> readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES >>>> sample_directory = /usr/share/doc/postfix-2.6.6/samples >>>> sendmail_path = /usr/sbin/sendmail.postfix >>>> setgid_group = postdrop >>>> unknown_local_recipient_reject_code = 550 >>>> virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf >>>> virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf >>>> virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf >>>> virtual_transport = dovecot >>>> [ec2-user at ip-172-31-24-2 conf.d]$ >>> >>> While being at Postfix: You have zero SASL configuration, unless it is defined in master.cf for the submission transport. >> >> Lets do 1 problem at a time? Unless SASL is needed for sending email? > > Right, 1 problem at a time. > > Yes, SASL is needed for your MTA to permit relaying based on authentication. Okay, I?ll look at that as soon as I get my server allowing me to login! :) > >>>> Here is the same error: >>>> >>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' >>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs >>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= >>> >>> Please provide the output of "doveconf -n". You have a severe configuration error so that the auth process fails. >> >> Here is the output: >> >> [ec2-user at ip-172-31-24-2 conf.d]$ dovecot -n >> # 2.2.10: /etc/dovecot/dovecot.conf > > Where did you get that dovecot version from? The Postfix version seems to indicate a RHEL/CentOS base of major release 6. That one does not ship a dovecot 2.2.x version. postfix and dovecot were both downloaded from a simple: yum install postfix dovecot command on my amazon linux server > >> # OS: Linux 4.1.17-22.30.amzn1.x86_64 x86_64 ext4 >> auth_mechanisms = plain login >> mail_location = maildir:/var/vmail/%d/%n/Maildir >> mbox_write_locks = fcntl >> namespace inbox { >> inbox = yes >> location = >> prefix = >> separator = . >> } >> passdb { >> args = /etc/dovecot/dovecot-sql.conf.ext > > What specified in the dovecot-sql.conf.ext file? Make sure the driver in there is set as "mysql" and not "sql". Not sure whether your dovecot is packaged in a way that you need a another package to provide the SQL driver functionality. driver = mysql connect = host=127.0.0.1 dbname=mailserver user=validsqluser password=validsqlpassword default_pass_scheme = PLAIN-MD5 password_query = SELECT email as user, password FROM virtual_users WHERE email='%u?; > > Btw. there is no need to run any SQL based backend, neither for dovecot nor Postfix, while I see a lot of beginners to think it would be. Keep it simple, even most simple while your are doing your first steps. The tutorial I found on workaround.org had it hooking up to sql so with me trying to learn more about all of linux, I thought why the heck not? :) For hosting multiple domains would it make a difference? I?m planning on hosting 2 from here for starters. > >> driver = sql >> } >> protocols = imap lmtp >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0660 >> user = postfix >> } >> unix_listener auth-userdb { >> group = postfix >> mode = 0600 >> user = postfix >> } >> user = dovecot >> } >> service imap-login { >> inet_listener imap { >> port = 143 >> } >> inet_listener imaps { >> port = 993 >> } >> } >> service lmtp { >> unix_listener /var/spool/postfix/private/dovecot-lmtp { >> group = postfix >> mode = 0600 >> user = postfix >> } >> } >> ssl = no >> ssl_cert = > ssl_key = > ssl_protocols = !SSLv2 !SSLv3 >> userdb { >> args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n >> driver = static >> } >> protocol lmtp { >> mail_plugins = " sieve" >> } >> protocol lda { >> mail_plugins = " sieve" >> } >> [ec2-user at ip-172-31-24-2 conf.d]$ >> >> >> It?s been awhile since I?ve run a mail server, and never to this extent? Always through hosting companies except for about 15 years ago when I did it for fun! :) >> >> Thanks for all your help! > > Regards > > Alexander Thanks Alexander! From edgar at pettijohn-web.com Sun Apr 3 00:39:11 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Sat, 2 Apr 2016 19:39:11 -0500 Subject: Still muddling through with broken auth... In-Reply-To: <0F712B9D-16AD-4985-94F8-07D1B3FACC02@gmail.com> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> <57004AD6.3030505@uni-x.org> <57005D6D.5080300@uni-x.org> <0F712B9D-16AD-4985-94F8-07D1B3FACC02@gmail.com> Message-ID: <101437F4-473A-4DB0-8049-1F37C11A8C06@pettijohn-web.com> Sent from my iPhone > On Apr 2, 2016, at 7:07 PM, Jason Pruim wrote: > > > Jason Pruim > pruimj at gmail.com > 352.234.3175 > > >> On Apr 2, 2016, at 8:01 PM, Alexander Dalloz wrote: >> >> Am 03.04.2016 um 01:04 schrieb Jason Pruim: >>> >>> Jason Pruim >>> pruimj at gmail.com >>> 352.234.3175 >>> >>> >>>> On Apr 2, 2016, at 6:42 PM, Alexander Dalloz wrote: >>>> >>>> Am 03.04.2016 um 00:26 schrieb Jason Pruim: >>>>> Hey Edgar, >>>>> >>>>> Thanks for catching that! Missed it earlier! Got it changed but I?m still having the same error updated postconf -n: >>>> >>>> Why do you provide the Postfix configuration? Absolutely unrelated to the shown dovecot error. >>> >>> I provide what I know how to provide :) >>>> >>>>> [ec2-user at ip-172-31-24-2 conf.d]$ postconf -n >>>>> alias_database = hash:/etc/aliases >>>>> alias_maps = hash:/etc/aliases >>>>> command_directory = /usr/sbin >>>>> config_directory = /etc/postfix >>>>> daemon_directory = /usr/libexec/postfix >>>>> data_directory = /var/lib/postfix >>>>> debug_peer_level = 2 >>>>> html_directory = no >>>>> inet_interfaces = localhost >>>>> inet_protocols = all >>>>> mail_owner = postfix >>>>> mailq_path = /usr/bin/mailq.postfix >>>>> manpage_directory = /usr/share/man >>>>> mydestination = $myhostname, localhost.$mydomain, localhost >>>>> newaliases_path = /usr/bin/newaliases.postfix >>>>> queue_directory = /var/spool/postfix >>>>> readme_directory = /usr/share/doc/postfix-2.6.6/README_FILES >>>>> sample_directory = /usr/share/doc/postfix-2.6.6/samples >>>>> sendmail_path = /usr/sbin/sendmail.postfix >>>>> setgid_group = postdrop >>>>> unknown_local_recipient_reject_code = 550 >>>>> virtual_alias_maps = mysql:/etc/postfix/mysql-virtual-alias-maps.cf >>>>> virtual_mailbox_domains = mysql:/etc/postfix/mysql-virtual-mailbox-domains.cf >>>>> virtual_mailbox_maps = mysql:/etc/postfix/mysql-virtual-mailbox-maps.cf >>>>> virtual_transport = dovecot >>>>> [ec2-user at ip-172-31-24-2 conf.d]$ >>>> >>>> While being at Postfix: You have zero SASL configuration, unless it is defined in master.cf for the submission transport. >>> >>> Lets do 1 problem at a time? Unless SASL is needed for sending email? >> >> Right, 1 problem at a time. >> >> Yes, SASL is needed for your MTA to permit relaying based on authentication. > > Okay, I?ll look at that as soon as I get my server allowing me to login! :) > >> >>>>> Here is the same error: >>>>> >>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' >>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs >>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= >>>> >>>> Please provide the output of "doveconf -n". You have a severe configuration error so that the auth process fails. >>> >>> Here is the output: >>> >>> [ec2-user at ip-172-31-24-2 conf.d]$ dovecot -n >>> # 2.2.10: /etc/dovecot/dovecot.conf >> >> Where did you get that dovecot version from? The Postfix version seems to indicate a RHEL/CentOS base of major release 6. That one does not ship a dovecot 2.2.x version. > > postfix and dovecot were both downloaded from a simple: yum install postfix dovecot command on my amazon linux server >> >>> # OS: Linux 4.1.17-22.30.amzn1.x86_64 x86_64 ext4 >>> auth_mechanisms = plain login >>> mail_location = maildir:/var/vmail/%d/%n/Maildir >>> mbox_write_locks = fcntl >>> namespace inbox { >>> inbox = yes >>> location = >>> prefix = >>> separator = . >>> } >>> passdb { >>> args = /etc/dovecot/dovecot-sql.conf.ext >> >> What specified in the dovecot-sql.conf.ext file? Make sure the driver in there is set as "mysql" and not "sql". Not sure whether your dovecot is packaged in a way that you need a another package to provide the SQL driver functionality. > > driver = mysql > connect = host=127.0.0.1 dbname=mailserver user=validsqluser password=validsqlpassword > > default_pass_scheme = PLAIN-MD5 > password_query = SELECT email as user, password FROM virtual_users WHERE email='%u?; > >> >> Btw. there is no need to run any SQL based backend, neither for dovecot nor Postfix, while I see a lot of beginners to think it would be. Keep it simple, even most simple while your are doing your first steps. > > The tutorial I found on workaround.org had it hooking up to sql so with me trying to learn more about all of linux, I thought why the heck not? :) For hosting multiple domains would it make a difference? I?m planning on hosting 2 from here for starters. > > > > >> >>> driver = sql >>> } >>> protocols = imap lmtp >>> service auth { >>> unix_listener /var/spool/postfix/private/auth { >>> group = postfix >>> mode = 0660 >>> user = postfix >>> } >>> unix_listener auth-userdb { >>> group = postfix >>> mode = 0600 >>> user = postfix >>> } >>> user = dovecot >>> } >>> service imap-login { >>> inet_listener imap { >>> port = 143 >>> } >>> inet_listener imaps { >>> port = 993 >>> } >>> } >>> service lmtp { >>> unix_listener /var/spool/postfix/private/dovecot-lmtp { >>> group = postfix >>> mode = 0600 >>> user = postfix >>> } >>> } >>> ssl = no >>> ssl_cert = >> ssl_key = >> ssl_protocols = !SSLv2 !SSLv3 >>> userdb { >>> args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n >>> driver = static >>> } >>> protocol lmtp { >>> mail_plugins = " sieve" >>> } >>> protocol lda { >>> mail_plugins = " sieve" >>> } >>> [ec2-user at ip-172-31-24-2 conf.d]$ >>> >>> >>> It?s been awhile since I?ve run a mail server, and never to this extent? Always through hosting companies except for about 15 years ago when I did it for fun! :) >>> >>> Thanks for all your help! >> >> Regards >> >> Alexander > > > Thanks Alexander! Make sure MySQL is running and configured correctly as well. From pruimj at gmail.com Sun Apr 3 00:54:51 2016 From: pruimj at gmail.com (Jason Pruim) Date: Sat, 2 Apr 2016 20:54:51 -0400 Subject: Still muddling through with broken auth... In-Reply-To: <101437F4-473A-4DB0-8049-1F37C11A8C06@pettijohn-web.com> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> <57004AD6.3030505@uni-x.org> <57005D6D.5080300@uni-x.org> <0F712B9D-16AD-4985-94F8-07D1B3FACC02@gmail.com> <101437F4-473A-4DB0-8049-1F37C11A8C06@pettijohn-web.com> Message-ID: >> >>> >>>> driver = sql >>>> } >>>> protocols = imap lmtp >>>> service auth { >>>> unix_listener /var/spool/postfix/private/auth { >>>> group = postfix >>>> mode = 0660 >>>> user = postfix >>>> } >>>> unix_listener auth-userdb { >>>> group = postfix >>>> mode = 0600 >>>> user = postfix >>>> } >>>> user = dovecot >>>> } >>>> service imap-login { >>>> inet_listener imap { >>>> port = 143 >>>> } >>>> inet_listener imaps { >>>> port = 993 >>>> } >>>> } >>>> service lmtp { >>>> unix_listener /var/spool/postfix/private/dovecot-lmtp { >>>> group = postfix >>>> mode = 0600 >>>> user = postfix >>>> } >>>> } >>>> ssl = no >>>> ssl_cert = >>> ssl_key = >>> ssl_protocols = !SSLv2 !SSLv3 >>>> userdb { >>>> args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n >>>> driver = static >>>> } >>>> protocol lmtp { >>>> mail_plugins = " sieve" >>>> } >>>> protocol lda { >>>> mail_plugins = " sieve" >>>> } >>>> [ec2-user at ip-172-31-24-2 conf.d]$ >>>> >>>> >>>> It?s been awhile since I?ve run a mail server, and never to this extent? Always through hosting companies except for about 15 years ago when I did it for fun! :) >>>> >>>> Thanks for all your help! >>> >>> Regards >>> >>> Alexander >> >> >> Thanks Alexander! > > Make sure MySQL is running and configured correctly as well. Logged in as the same user and was able to run the 3 sql commands that are in the config files?. Best as I can tell it?s up and running properly. From ad+lists at uni-x.org Sun Apr 3 01:06:55 2016 From: ad+lists at uni-x.org (Alexander Dalloz) Date: Sun, 3 Apr 2016 03:06:55 +0200 Subject: Still muddling through with broken auth... In-Reply-To: <0F712B9D-16AD-4985-94F8-07D1B3FACC02@gmail.com> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> <57004AD6.3030505@uni-x.org> <57005D6D.5080300@uni-x.org> <0F712B9D-16AD-4985-94F8-07D1B3FACC02@gmail.com> Message-ID: <57006CAF.3020404@uni-x.org> Am 03.04.2016 um 02:07 schrieb Jason Pruim: > > Jason Pruim > pruimj at gmail.com > 352.234.3175 Please answer just to the mailing list and omit to copy your replies to my personal address too. Thanks. >>>>> Here is the same error: >>>>> >>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' >>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs >>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= rpm -qlv dovecot | grep libdovecot-sql That should print out something like lrwxrwxrwx 1 root root 23 Apr 1 03:29 /usr/lib64/dovecot/libdovecot-sql.so.0 -> libdovecot-sql.so.0.0.0 -rwxr-xr-x 1 root root 95058 Apr 1 03:29 /usr/lib64/dovecot/libdovecot-sql.so.0.0.0 If no libdovecot-sql.so is included, then SQL support is missing in that dovecot package. Alexander From pruimj at gmail.com Sun Apr 3 01:32:08 2016 From: pruimj at gmail.com (Jason Pruim) Date: Sat, 2 Apr 2016 21:32:08 -0400 Subject: Still muddling through with broken auth... In-Reply-To: <57006CAF.3020404@uni-x.org> References: <47A7AE6C-1A97-4717-B9CE-85801E7A2173@pettijohn-web.com> <4BF89028-7BE3-4C7A-A0B4-C4C485EB1C68@gmail.com> <57004AD6.3030505@uni-x.org> <57005D6D.5080300@uni-x.org> <0F712B9D-16AD-4985-94F8-07D1B3FACC02@gmail.com> <57006CAF.3020404@uni-x.org> Message-ID: <85B66B6F-989E-4BF4-8D0D-7D37DBF6CE93@gmail.com> Jason Pruim pruimj at gmail.com 352.234.3175 > On Apr 2, 2016, at 9:06 PM, Alexander Dalloz wrote: > > Am 03.04.2016 um 02:07 schrieb Jason Pruim: >> >> Jason Pruim >> pruimj at gmail.com >> 352.234.3175 > > Please answer just to the mailing list and omit to copy your replies to my personal address too. Thanks. My apologies, I had been hitting reply all. > >>>>>> Here is the same error: >>>>>> >>>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: auth: Fatal: Unknown database driver 'sql' >>>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: master: Error: service(auth): command startup failed, throttling for 60 secs >>>>>> Apr 2 22:25:50 ip-172-31-24-2 dovecot: imap-login: Disconnected: Auth process broken (disconnected before auth was ready, waited 9 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= > > rpm -qlv dovecot | grep libdovecot-sql > > That should print out something like > > lrwxrwxrwx 1 root root 23 Apr 1 03:29 /usr/lib64/dovecot/libdovecot-sql.so.0 -> libdovecot-sql.so.0.0.0 > -rwxr-xr-x 1 root root 95058 Apr 1 03:29 /usr/lib64/dovecot/libdovecot-sql.so.0.0.0 > > If no libdovecot-sql.so is included, then SQL support is missing in that dovecot package. > > Alexander I started going back over the same tutorial and reran the commands including this one: postconf -e virtual_alias_maps=mysql:/etc/postfix/mysql-virtual-alias-maps.cf,mysql:/etc/postfix/mysql-email2email.cf and as soon as that one hit I was able to login! Now I just need to get it accepting email and sending email! Thank you for your help and for putting up with my lack of knowledge! From pruimj at gmail.com Sun Apr 3 04:38:04 2016 From: pruimj at gmail.com (Jason Pruim) Date: Sun, 3 Apr 2016 00:38:04 -0400 Subject: 1 last error Message-ID: Hey Everyone, I?m down to 1 last error that I know I created on my own but I can?t figure out how to fix it? Here is the error that I?m getting: Apr 3 04:29:37 ip-172-31-24-2 postfix/qmgr[20458]: EFE01423E2: from=, size=359, nrcpt=1 (queue active) Apr 3 04:29:37 ip-172-31-24-2 dovecot: lda(beth at primelashdiva.info): Fatal: setresgid(89(postfix),89(postfix),97(dovecot)) failed with euid=97(dovecot): Operation not permitted Apr 3 04:29:37 ip-172-31-24-2 postfix/pipe[20745]: EFE01423E2: to=, relay=dovecot, delay=22, delays=22/0.01/0/0.01, dsn=4.3.0, status=deferred (temporary failure) So I figure that I messed up the permissions on /etc/dovecot/conf.d I tried to fix it even by setting it way open: drwxrwxrwx 2 dovecot dovecot 4096 Mar 30 00:56 conf.d And it still doesn?t work! doveconf -n: $ doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 4.1.17-22.30.amzn1.x86_64 x86_64 ext4 auth_mechanisms = plain login first_valid_uid = 89 hostname = mail.primelashdiva.info mail_location = maildir:/var/vmail/%d/%n/Maildir mail_privileged_group = dovecot mbox_write_locks = fcntl namespace inbox { inbox = yes location = prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } postmaster_address = postmaster at primelashdiva.info protocols = imap lmtp service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = dovecot mode = 0666 user = dovecot } user = dovecot } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } ssl = no ssl_cert = References: Message-ID: Sent from my iPhone > On Apr 2, 2016, at 11:38 PM, Jason Pruim wrote: > > Hey Everyone, > > I?m down to 1 last error that I know I created on my own but I can?t figure out how to fix it? Here is the error that I?m getting: > > Apr 3 04:29:37 ip-172-31-24-2 postfix/qmgr[20458]: EFE01423E2: from=, size=359, nrcpt=1 (queue active) > Apr 3 04:29:37 ip-172-31-24-2 dovecot: lda(beth at primelashdiva.info): Fatal: setresgid(89(postfix),89(postfix),97(dovecot)) failed with euid=97(dovecot): Operation not permitted > Apr 3 04:29:37 ip-172-31-24-2 postfix/pipe[20745]: EFE01423E2: to=, relay=dovecot, delay=22, delays=22/0.01/0/0.01, dsn=4.3.0, status=deferred (temporary failure) > > So I figure that I messed up the permissions on /etc/dovecot/conf.d I tried to fix it even by setting it way open: > Double check /etc/postfix/master.cf Also try wrapping with sudo. I think you have a permissions problem due to naming the wrong group somewhere. http://wiki.dovecot.org/LDA#multipleuids > drwxrwxrwx 2 dovecot dovecot 4096 Mar 30 00:56 conf.d > > > And it still doesn?t work! > > doveconf -n: > > $ doveconf -n > # 2.2.10: /etc/dovecot/dovecot.conf > # OS: Linux 4.1.17-22.30.amzn1.x86_64 x86_64 ext4 > auth_mechanisms = plain login > first_valid_uid = 89 > hostname = mail.primelashdiva.info > mail_location = maildir:/var/vmail/%d/%n/Maildir > mail_privileged_group = dovecot > mbox_write_locks = fcntl > namespace inbox { > inbox = yes > location = > prefix = > separator = . > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > postmaster_address = postmaster at primelashdiva.info > protocols = imap lmtp > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0660 > user = postfix > } > unix_listener auth-userdb { > group = dovecot > mode = 0666 > user = dovecot > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > ssl = no > ssl_cert = ssl_key = ssl_protocols = !SSLv2 !SSLv3 > userdb { > args = uid=postfix gid=postfix home=/var/mail/vhosts/%d/%n > driver = static > } > protocol lmtp { > mail_plugins = " sieve" > } > protocol lda { > mail_plugins = > } > [ec2-user at ip-172-31-24-2 dovecot]$ > > It might be too late for me to concentrate enough to figure it, but my googling isn?t bringing up any info? Any pointers? > > Thanks Everyone! > > > > Jason Pruim > pruimj at gmail.com > 352.234.3175 From hawk_chen at itsnow.com Sun Apr 3 05:14:36 2016 From: hawk_chen at itsnow.com (Hawk Chen) Date: Sun, 3 Apr 2016 13:14:36 +0800 Subject: managesieve proxying not working Message-ID: <2016040313143543089320@itsnow.com> Hi, I'm setting up the directors for proxying pop3/imap/lmtp/sieve. pop3/imap/lmtp proxying work fine, but sieve not working. The error messages in maillog look not using proxying but local passdb. Error message: Apr 03 12:09:25 managesieve-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=10.1.1.4, lip=10.1.1.201, session=<+SIcx4wvRQAKAQEE> sql in /etc/dovecot/dovecot-sql.conf.ext: password_query = SELECT NULL as password, host, 'Y' as nopassword, 'Y' as proxy FROM mailbox WHERE username = '%u' AND active='1' doveconf -n output is as follows, # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-327.10.1.el7.x86_64 x86_64 CentOS Linux release 7.2.1511 (Core) director_mail_servers = 10.1.4.5 10.1.4.6 director_servers = 10.1.1.1 10.1.1.2 lmtp_proxy = yes log_path = /var/log/dovecot.log login_greeting = DNT Mail Server managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 lmtp sieve service director { fifo_listener login/proxy-notify { mode = 0666 } inet_listener { port = 9090 } unix_listener director-userdb { mode = 0600 } unix_listener login/director { mode = 0666 } } service imap-login { executable = imap-login director service_count = 0 } service lmtp { inet_listener lmtp { port = 24 } } service managesieve-login { executable = managesieve-login director service_count = 0 } service pop3-login { executable = pop3-login director service_count = 0 } ssl = required ssl_cert = Hi list! I'm really puzzled... I have a Mailserver with Dovecot 2.2.9 (installed from Ubuntu 14.04-Repositories) and it works well with LDAP-Authentication agains the Active Directory. Now I want to use GSSAPI to allow the clients (with Thunderbird 38.7.1) to read E-Mails without giving a password. I configured Dovecot using these HowTos: http://mindref.blogspot.de/2011/02/dovecot-kerberos.html http://wiki.dovecot.org/Authentication/Kerberos But it does not work... In mail.log I can just see: Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 3 09:52:26 mail dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libmech_gssapi.so Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 3 09:52:26 mail dovecot: auth: Debug: Module loaded: /usr/lib/dovecot/modules/auth/libauthdb_ldap.so Apr 3 09:52:26 mail dovecot: auth: Debug: Read auth token secret from /var/run/dovecot/auth-token-secret.dat Apr 3 09:52:26 mail dovecot: auth: Debug: auth client connected (pid=2300) Apr 3 09:52:26 mail dovecot: imap-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=192.168.50.54, lip=192.168.50.3, session= and Thunderbird says that the Ticket was not accepted and I have to check if I'm logged into the Kerberos/GSSAPI subsystem. I checked with tcpdump and I see that Thunderbird does NOT send at all any request. Could someone help me? Thanks a lot! Luca Bertoncello (lucabert at lucabert.de) From lists.zxinn at otaking.se Sun Apr 3 10:13:12 2016 From: lists.zxinn at otaking.se (Tobias) Date: Sun, 3 Apr 2016 12:13:12 +0200 Subject: Found 4 bugs in latest SquirrelMail related to IMAP and SMTP STARTTLS, Dovecot capabilities Message-ID: <5700ECB8.10105@otaking.se> This is a cross-post from the squirrelmail-devel list. It may be of interest if you want to run SquirrelMail and connect to Dovecot (and Postfix, possibly other servers) on a remote host using STARTTLS. BR Tobias -------- Forwarded Message -------- Subject: [SM-DEVEL] 4 bugs, IMAP and SMTP STARTTLS, Dovecot capabilities Date: Sun, 3 Apr 2016 04:27:56 +0200 From: Tobias Reply-To: Squirrelmail Developers Mailing List To: squirrelmail-devel at lists.sourceforge.net Hello! I've looked for and have not seen any similar issues reported related to STARTTLS. Sourceforge wouldn't let me create an account or else I could have submitted bug reports directly. I'm using SquirrelMail 1.4.23 installed from latest FreeBSD Ports, together with PHP 5.6. I'm attempting to connect using STARTTLS to Dovecot 2.2.22 and Postfix 3.1.0. I've verified the code is not fixed for any of these four issues in the latest 1.5.2 SVN. Issue 2 is not as much of a problem in 1.5.2 as it is in 1.4.23 when using 'login' authentication. I connect to the IMAP and SMTP servers using their IP, but need to override the 'peer_name' to validate the certificate properly. New in PHP 5.6 is also that verify_peer defaults to TRUE, which means I need to either be able to set the peer_name, or disable verify_peer. I've found three issues in functions/imap_general.php, related to STARTTLS and Dovecot IMAP server, as well as one STARTTLS issue in class/deliver/Deliver_SMTP.class.php, class class Deliver_SMTP, function initStream. Issue 1: Stream options ($imap_stream_options) are not used with STARTTLS ($use_imap_tls = 2) in function sqimap_create_stream. The stream options are only used for $use_imap_tls = 1. How to fix: Add something like this: // set context options to allow for SSL option overrides @stream_context_set_option($imap_stream,$stream_options); Before trying to initiate the TLS session here: functions/imap_general.php :: function sqimap_create_stream 826: // start crypto on connection. suppress function errors. 827: if (@stream_socket_enable_crypto($imap_stream,true,STREAM_CRYPTO_METHOD_TLS_CLIENT)) { Issue 2: IMAP capabilities are only read once in function sqimap_create_stream (and subsequently used in sqimap_login to determine certain login options), however the capability list for Dovecot is not the same before and after STARTTLS. From Dovecot, before STARTTLS (telnet 143): * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS LOGINDISABLED] Dovecot ready. From Dovecot, after successful STARTTLS (openssl s_client -starttls imap -connect :143): --- . OK Pre-login capabilities listed, post-login capabilities have more. a capability * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN a OK Pre-login capabilities listed, post-login capabilities have more. How to fix: Issue "capability" command after successful STARTTLS to re-read the capabilities. Either as part of function sqimap_create_stream, or after call to sqimap_create_stream and before login options are checked in function sqimap_login. SquirrelMail 1.4.23 uses the return value with capabilities from function sqimap_create_stream to determine if 'login' is a viable option. Dovecot reports LOGINDISABLED prior to STARTTLS. (1.5.2 does not have this check for 'login'.) Issue 3: Multi-line response from the server to the AUTHENTICATE PLAIN (and likely cram/digest md5, possibly even login) are not accepted. The IMAP protocol allows the server to prefix responses which are incomplete with "*", and Dovecot uses this to report capabilities after successful login, but this is not handled by SquirrelMail's sqimap_login function. SquirrelMail reports: Unknown error: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SEARCH=FUZZY SPECIAL-USE QUOTA The full output from Dovecot is: * CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE SEARCH=FUZZY SPECIAL-USE QUOTA A003 OK Logged in How to fix: Check if '*' is the first token in a response, and read another line from the stream. Possibly something similar to this: while (substr($read,0,1) == '*') { // OK so far.. $read = sqimap_fgets($imap_stream); } Issue 4: Identical to issue 1 but for SMTP. $use_smtp_tls = 2 and STARTTLS in class/deliver/Deliver_SMTP.class.php, class class Deliver_SMTP, function initStream, does not honor stream options. BR Tobias ----- squirrelmail-devel mailing list Posting guidelines:http://squirrelmail.org/postingguidelines List address:squirrelmail-devel at lists.sourceforge.net List archives:http://news.gmane.org/gmane.mail.squirrelmail.devel List info (subscribe/unsubscribe/change options):https://lists.sourceforge.net/lists/listinfo/squirrelmail-devel From aki.tuomi at dovecot.fi Sun Apr 3 10:45:23 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 3 Apr 2016 13:45:23 +0300 (EEST) Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <1459612727-13399-1-git-send-email-pali.rohar@gmail.com> References: <1459612727-13399-1-git-send-email-pali.rohar@gmail.com> Message-ID: <337464484.11277.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> > On April 2, 2016 at 6:58 PM Pali Roh?r wrote: > > > Hello, > > I borrowed dovecot parser for email addresses and going to use it in new > perl module as replacement for Email::Address. During implementation and > testing I found bugs in dovecot parser & generator. So I'm sending my > patches together with tests. > > Pali Roh?r (7): > lib-mail: message_address_write: Fix generating empty group list > lib-mail: message_address_write: Fix generating group list with empty > name > lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if > last_comment is not NULL > lib-mail: parse_addr_spec: Email address without local-part is > invalid > lib-mail: parse_mailbox: Set display name instead mailbox when > parsing failed > lib-mail: message_address_write: Quote and escape strings if needed > lib-mail: Update tests for message address > > src/lib-mail/message-address.c | 99 > +++++++++++++++++++++++++++++++---- > src/lib-mail/test-message-address.c | 11 +++- > 2 files changed, 98 insertions(+), 12 deletions(-) > > -- > 1.7.9.5 Hi! Did you post the patches somewhere as they do not seem to have made it thru. Aki Tuomi Dovecot Oy From aki.tuomi at dovecot.fi Sun Apr 3 10:48:06 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 3 Apr 2016 13:48:06 +0300 (EEST) Subject: Dovecot rest api In-Reply-To: References: Message-ID: <231246824.11279.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> > On April 2, 2016 at 3:30 PM Phil Lello wrote: > > > +1 - me too. In my case, I'm looking for a way to do webmail without imap > since the web interface wants external auth via SAML. > On 2 Apr 2016 05:54, "use experience" wrote: > > > Team, > > > > Need more information on dovecot rest api. Any detailed information about > > list of dovecot rest apis other than > > > > http://www.dovecot.fi/dovecot-launches-a-gmail-api-compatible-rest-api-to-enable-third-party-developers-to-join-its-global-email-ecosystem/ > > will > > really helpful. > > There is a management API for Dovecot in community version these days, http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP and we are also going to provide http://jmap.io based HTTP API for accessing emails in future community release. Aki Tuomi Dovecot Oy From aki.tuomi at dovecot.fi Sun Apr 3 10:49:48 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 3 Apr 2016 13:49:48 +0300 (EEST) Subject: 1 last error In-Reply-To: References: Message-ID: <444448262.11281.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> > On April 3, 2016 at 7:38 AM Jason Pruim wrote: > > > Hey Everyone, > > I?m down to 1 last error that I know I created on my own but I can?t figure > out how to fix it? Here is the error that I?m getting: > > Apr 3 04:29:37 ip-172-31-24-2 postfix/qmgr[20458]: EFE01423E2: > from=, size=359, nrcpt=1 (queue active) > Apr 3 04:29:37 ip-172-31-24-2 dovecot: lda(beth at primelashdiva.info): Fatal: > setresgid(89(postfix),89(postfix),97(dovecot)) failed with euid=97(dovecot): > Operation not permitted This means that dovecot is not permitted to use group 89. Is dovecot user member of this group? > Jason Pruim > pruimj at gmail.com > 352.234.3175 Aki Tuomi Dovecot Oy From pali.rohar at gmail.com Sun Apr 3 10:54:34 2016 From: pali.rohar at gmail.com (Pali =?utf-8?q?Roh=C3=A1r?=) Date: Sun, 3 Apr 2016 12:54:34 +0200 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <337464484.11277.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> References: <1459612727-13399-1-git-send-email-pali.rohar@gmail.com> <337464484.11277.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> Message-ID: <201604031254.34483@pali> On Sunday 03 April 2016 12:45:23 aki.tuomi at dovecot.fi wrote: > > On April 2, 2016 at 6:58 PM Pali Roh?r > > wrote: > > > > > > Hello, > > > > I borrowed dovecot parser for email addresses and going to use it > > in new perl module as replacement for Email::Address. During > > implementation and testing I found bugs in dovecot parser & > > generator. So I'm sending my patches together with tests. > > > > Pali Roh?r (7): > > lib-mail: message_address_write: Fix generating empty group list > > lib-mail: message_address_write: Fix generating group list with > > empty > > > > name > > > > lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if > > > > last_comment is not NULL > > > > lib-mail: parse_addr_spec: Email address without local-part is > > > > invalid > > > > lib-mail: parse_mailbox: Set display name instead mailbox when > > > > parsing failed > > > > lib-mail: message_address_write: Quote and escape strings if > > needed lib-mail: Update tests for message address > > > > src/lib-mail/message-address.c | 99 > > > > +++++++++++++++++++++++++++++++---- > > > > src/lib-mail/test-message-address.c | 11 +++- > > 2 files changed, 98 insertions(+), 12 deletions(-) > > Hi! > > Did you post the patches somewhere as they do not seem to have made > it thru. > > Aki Tuomi > Dovecot Oy Hi! I sent all patches to ML, but dovecot server refused them. I already contacted dovecot-owner@ about this problem, but without response yet. -- Pali Roh?r pali.rohar at gmail.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. URL: From aki.tuomi at dovecot.fi Sun Apr 3 10:54:41 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 3 Apr 2016 13:54:41 +0300 (EEST) Subject: Problem with GSSAPI In-Reply-To: <20160403095717.0d3360c3@frodo.lucabert.intra> References: <20160403095717.0d3360c3@frodo.lucabert.intra> Message-ID: <1497917163.11283.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> > On April 3, 2016 at 10:57 AM Luca Bertoncello wrote: > > > Hi list! > > I'm really puzzled... > I have a Mailserver with Dovecot 2.2.9 (installed from Ubuntu > 14.04-Repositories) and it works well with LDAP-Authentication agains the > Active Directory. > > Now I want to use GSSAPI to allow the clients (with Thunderbird 38.7.1) to > read E-Mails without giving a password. > > I configured Dovecot using these HowTos: > > http://mindref.blogspot.de/2011/02/dovecot-kerberos.html > http://wiki.dovecot.org/Authentication/Kerberos > > But it does not work... > In mail.log I can just see: > > Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: > /usr/lib/dovecot/modules/auth > Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: > /usr/lib/dovecot/modules/auth > Apr 3 09:52:26 mail dovecot: auth: Debug: Module loaded: > /usr/lib/dovecot/modules/auth/libmech_gssapi.so > Apr 3 09:52:26 mail dovecot: auth: Debug: Loading modules from directory: > /usr/lib/dovecot/modules/auth > Apr 3 09:52:26 mail dovecot: auth: Debug: Module loaded: > /usr/lib/dovecot/modules/auth/libauthdb_ldap.so > Apr 3 09:52:26 mail dovecot: auth: Debug: Read auth token secret from > /var/run/dovecot/auth-token-secret.dat > Apr 3 09:52:26 mail dovecot: auth: Debug: auth client connected (pid=2300) > Apr 3 09:52:26 mail dovecot: imap-login: Disconnected (no auth attempts in 0 > secs): user=<>, rip=192.168.50.54, lip=192.168.50.3, > session= > > and Thunderbird says that the Ticket was not accepted and I have to check > if I'm logged into the Kerberos/GSSAPI subsystem. > I checked with tcpdump and I see that Thunderbird does NOT send at all any > request. > > Could someone help me? > > Thanks a lot! > Luca Bertoncello > (lucabert at lucabert.de) Make sure you have a keytab entry for IMAP/hostname, and host/hostname. Kerberos is pretty name oriented so DNS names much match, also reverse entries for optimal performance. Also make sure your client has acquired some principal such as username at YOURDOMAIN. These are usually checked with klist command or klist -k, depending if you are looking at credentials cache or keytab file. Also, make sure that GSSAPI is provided as mechanism by dovecot, this is easy to check with telnet hostname 14 and see what LOGIN mechanisms are provided. If it does not list capabilities, use a01 CAPABILITY to list them. Aki Tuomi Dovecot Oy From lucabert at lucabert.de Sun Apr 3 10:58:39 2016 From: lucabert at lucabert.de (Luca Bertoncello) Date: Sun, 3 Apr 2016 12:58:39 +0200 Subject: Problem with GSSAPI In-Reply-To: <1497917163.11283.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> References: <20160403095717.0d3360c3@frodo.lucabert.intra> <1497917163.11283.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> Message-ID: <20160403125839.17715986@frodo.lucabert.intra> aki.tuomi at dovecot.fi schrieb: > Make sure you have a keytab entry for IMAP/hostname, and host/hostname. > Kerberos is pretty name oriented so DNS names much match, also reverse > entries for optimal performance. Finally I found the problem... It was NOT by Dovecot, but by Thunderbird... I tried with SeaMonkey and it works. My solution: delete Thunderbird and use SeaMonkey... Thanks Luca Bertoncello (lucabert at lucabert.de) From chris.laif at googlemail.com Sun Apr 3 12:39:49 2016 From: chris.laif at googlemail.com (Chris Laif) Date: Sun, 3 Apr 2016 14:39:49 +0200 Subject: fts_solr: Lookup failed: 400 Bad Request / GET null null Message-ID: Hi, the log file shows suspicious entries as follows: Apr 3 09:14:49 xxx dovecot: imap(user at domain): Error: fts_solr: Lookup failed: 400 Bad Request The tomcat7 log shows for this request: 10.0.0.234 - - [03/Apr/2016:09:14:49 +0200] "GET null null" 400 - Dovecot is latest 2.2.23 with a pretty standard FTS config copied from the wiki: mail_plugins = " acl fts fts_solr" fts = solr fts_solr = break-imap-search url=http://10.0.0.123:8080/solr/ Unfortunately I do not know (yet) which client action produces these log lines. "GET null null" seems not to be a sensible request in any case. Anyone seeing the same effect? Chris From stephan at rename-it.nl Sun Apr 3 14:14:44 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 3 Apr 2016 16:14:44 +0200 Subject: managesieve proxying not working In-Reply-To: <2016040313143543089320@itsnow.com> References: <2016040313143543089320@itsnow.com> Message-ID: <57012554.1070000@rename-it.nl> Op 3-4-2016 om 7:14 schreef Hawk Chen: > Hi, > > I'm setting up the directors for proxying pop3/imap/lmtp/sieve. pop3/imap/lmtp proxying work fine, but sieve not working. The error messages in maillog look not using proxying but local passdb. > > Error message: > Apr 03 12:09:25 managesieve-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=10.1.1.4, lip=10.1.1.201, session=<+SIcx4wvRQAKAQEE> > > sql in /etc/dovecot/dovecot-sql.conf.ext: > password_query = SELECT NULL as password, host, 'Y' as nopassword, 'Y' as proxy FROM mailbox WHERE username = '%u' AND active='1' You can turn on auth_debug and show what it logs. Do you see any differences with imap/pop? Regards, Stephan. From stephan at rename-it.nl Sun Apr 3 14:19:56 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 3 Apr 2016 16:19:56 +0200 Subject: fts_solr: Lookup failed: 400 Bad Request / GET null null In-Reply-To: References: Message-ID: <5701268C.703@rename-it.nl> Op 3-4-2016 om 14:39 schreef Chris Laif: > Hi, > > the log file shows suspicious entries as follows: > > Apr 3 09:14:49 xxx dovecot: imap(user at domain): Error: fts_solr: > Lookup failed: 400 Bad Request > > The tomcat7 log shows for this request: > > 10.0.0.234 - - [03/Apr/2016:09:14:49 +0200] "GET null null" 400 - > > Dovecot is latest 2.2.23 with a pretty standard FTS config copied from the wiki: > > mail_plugins = " acl fts fts_solr" > fts = solr > fts_solr = break-imap-search url=http://10.0.0.123:8080/solr/ > > Unfortunately I do not know (yet) which client action produces these > log lines. "GET null null" seems not to be a sensible request in any > case. > > Anyone seeing the same effect? Did this happen only after upgrade to 2.2.23 or is this a fresh install? Can you make a dump of what messages are exchanged on 10.0.0.123:8080 using ngrep or wireshark? Regards, Stephan. From hawk_chen at itsnow.com Sun Apr 3 14:32:41 2016 From: hawk_chen at itsnow.com (Hawk Chen) Date: Sun, 3 Apr 2016 22:32:41 +0800 Subject: =?GB2312?B?u9i4tDogUmU6IG1hbmFnZXNpZXZlIHByb3h5aW5nIG5vdCB3b3JraW5n?= References: <2016040313143543089320@itsnow.com>, <57012554.1070000@rename-it.nl> Message-ID: <2016040322324096562925@itsnow.com> Stephan, Imap/pop shows proxying in mail log, but managesieve differs. Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): started proxying to 10.1.4.6:110: user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): disconnecting 218.82.239.224 (Disconnected by server): user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= Regards, Hawk ???? Stephan Bosch ????? 2016-04-03 22:14 ???? Hawk Chen; dovecot ??? Re: managesieve proxying not working Op 3-4-2016 om 7:14 schreef Hawk Chen: > Hi, > > I'm setting up the directors for proxying pop3/imap/lmtp/sieve. pop3/imap/lmtp proxying work fine, but sieve not working. The error messages in maillog look not using proxying but local passdb. > > Error message: > Apr 03 12:09:25 managesieve-login: Info: Aborted login (no auth attempts in 0 secs): user=<>, rip=10.1.1.4, lip=10.1.1.201, session=<+SIcx4wvRQAKAQEE> > > sql in /etc/dovecot/dovecot-sql.conf.ext: > password_query = SELECT NULL as password, host, 'Y' as nopassword, 'Y' as proxy FROM mailbox WHERE username = '%u' AND active='1' You can turn on auth_debug and show what it logs. Do you see any differences with imap/pop? Regards, Stephan. From stephan at rename-it.nl Sun Apr 3 14:50:35 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Sun, 3 Apr 2016 16:50:35 +0200 Subject: =?UTF-8?Q?Re:_=e5=9b=9e=e5=a4=8d:_Re:_managesieve_proxying_not_work?= =?UTF-8?Q?ing?= In-Reply-To: <2016040322324096562925@itsnow.com> References: <2016040313143543089320@itsnow.com> <57012554.1070000@rename-it.nl> <2016040322324096562925@itsnow.com> Message-ID: <57012DBB.4080203@rename-it.nl> Op 3-4-2016 om 16:32 schreef Hawk Chen: > Stephan, > > Imap/pop shows proxying in mail log, but managesieve differs. > > Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): started proxying to 10.1.4.6:110: user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= > Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): disconnecting 218.82.239.224 (Disconnected by server): user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= What Sieve client are you using? It looks as though it never even tries to authenticate. You try this manually: http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting Regards, Stephan > Regards, > Hawk > > *????* Stephan Bosch > *?????* 2016-04-03 22:14 > *????* Hawk Chen ; dovecot > > *???* Re: managesieve proxying not working > Op 3-4-2016 om 7:14 schreef Hawk Chen: > > Hi, > > > > I'm setting up the directors for proxying pop3/imap/lmtp/sieve. > pop3/imap/lmtp proxying work fine, but sieve not working. The > error messages in maillog look not using proxying but local passdb. > > > > Error message: > > Apr 03 12:09:25 managesieve-login: Info: Aborted login (no auth > attempts in 0 secs): user=<>, rip=10.1.1.4, lip=10.1.1.201, > session=<+SIcx4wvRQAKAQEE> > > > > sql in /etc/dovecot/dovecot-sql.conf.ext: > > password_query = SELECT NULL as password, host, 'Y' as > nopassword, 'Y' as proxy FROM mailbox WHERE username = '%u' AND > active='1' > You can turn on auth_debug and show what it logs. Do you see any > differences with imap/pop? > Regards, > Stephan. > From hawk_chen at itsnow.com Sun Apr 3 15:13:27 2016 From: hawk_chen at itsnow.com (Hawk Chen) Date: Sun, 3 Apr 2016 23:13:27 +0800 Subject: managesieve proxying not working References: <2016040313143543089320@itsnow.com>, <57012554.1070000@rename-it.nl>, <2016040322324096562925@itsnow.com>, <57012DBB.4080203@rename-it.nl> Message-ID: <2016040323132626647431@itsnow.com> I'm using roundcube webmail managesieve plugin. Webmail can login managesieve to a specific mailstore successfully without proxying. Because I have mutiple mailstores, I have to use proxying to redirect the correct mailstores just as imap/pop3. ???? Stephan Bosch ????? 2016-04-03 22:50 ???? Hawk Chen; dovecot ??? Re: ??: Re: managesieve proxying not working Op 3-4-2016 om 16:32 schreef Hawk Chen: > Stephan, > > Imap/pop shows proxying in mail log, but managesieve differs. > > Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): started proxying to 10.1.4.6:110: user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= > Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): disconnecting 218.82.239.224 (Disconnected by server): user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= What Sieve client are you using? It looks as though it never even tries to authenticate. You try this manually: http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting Regards, Stephan > Regards, > Hawk > > *????* Stephan Bosch > *?????* 2016-04-03 22:14 > *????* Hawk Chen ; dovecot > > *???* Re: managesieve proxying not working > Op 3-4-2016 om 7:14 schreef Hawk Chen: > > Hi, > > > > I'm setting up the directors for proxying pop3/imap/lmtp/sieve. > pop3/imap/lmtp proxying work fine, but sieve not working. The > error messages in maillog look not using proxying but local passdb. > > > > Error message: > > Apr 03 12:09:25 managesieve-login: Info: Aborted login (no auth > attempts in 0 secs): user=<>, rip=10.1.1.4, lip=10.1.1.201, > session=<+SIcx4wvRQAKAQEE> > > > > sql in /etc/dovecot/dovecot-sql.conf.ext: > > password_query = SELECT NULL as password, host, 'Y' as > nopassword, 'Y' as proxy FROM mailbox WHERE username = '%u' AND > active='1' > You can turn on auth_debug and show what it logs. Do you see any > differences with imap/pop? > Regards, > Stephan. > From pruimj at gmail.com Sun Apr 3 19:05:09 2016 From: pruimj at gmail.com (Jason Pruim) Date: Sun, 3 Apr 2016 15:05:09 -0400 Subject: 1 last error In-Reply-To: <444448262.11281.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> References: <444448262.11281.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> Message-ID: <57C2BDD6-A2FD-4621-8C4A-08F6254A4E4B@gmail.com> Jason Pruim pruimj at gmail.com 352.234.3175 > On Apr 3, 2016, at 6:49 AM, aki.tuomi at dovecot.fi wrote: > > >> On April 3, 2016 at 7:38 AM Jason Pruim wrote: >> >> >> Hey Everyone, >> >> I?m down to 1 last error that I know I created on my own but I can?t figure >> out how to fix it? Here is the error that I?m getting: >> >> Apr 3 04:29:37 ip-172-31-24-2 postfix/qmgr[20458]: EFE01423E2: >> from=, size=359, nrcpt=1 (queue active) >> Apr 3 04:29:37 ip-172-31-24-2 dovecot: lda(beth at primelashdiva.info): Fatal: >> setresgid(89(postfix),89(postfix),97(dovecot)) failed with euid=97(dovecot): >> Operation not permitted > > This means that dovecot is not permitted to use group 89. Is dovecot user member > of this group? Yes it is. still getting the same error? > >> Jason Pruim >> pruimj at gmail.com >> 352.234.3175 > > Aki Tuomi > Dovecot Oy From pernovana-dovecot at yahoo.com Mon Apr 4 01:44:09 2016 From: pernovana-dovecot at yahoo.com (Hamy) Date: Mon, 4 Apr 2016 01:44:09 +0000 (UTC) Subject: How to make quota_status policy to apply to postfix virtual aliases as well? References: <491123784.2192282.1459734249922.JavaMail.yahoo.ref@mail.yahoo.com> Message-ID: <491123784.2192282.1459734249922.JavaMail.yahoo@mail.yahoo.com> HelloI am setting up a postfix+dovecot setup and using quota-status service to reject mails for full mailboxes on smtp session, according to this: https://sys4.de/en/blog/2013/04/08/postfix-dovecot-mailbox-quota/ This is working fine and without any apparent issues. however, Postfix doesn't seem to consult the policy when you're using virtual alias addresses. a virtual alias, is the one that you usually define with?virtual_alias_maps . what happens is that Postfix only verifies there is a corresponding value for the given email address and blindly accept it. And it seems?smtpd_recipient_restrictions , only applies to the original email address and postfix does not consult that after applying virtual alias. Does any one have any idea how to solve this? is there a setting that i'm missing? or is there a better way to setup email aliases that solve this issue? Best Regards, From hendrik00 at gmail.com Mon Apr 4 06:47:33 2016 From: hendrik00 at gmail.com (Hendrik Velloen) Date: Mon, 4 Apr 2016 08:47:33 +0200 Subject: No subject Message-ID: Hi I am new to the mailing List, and was hoping to get some assistance migrating from an Old Cucipop + Sendmail server (running on a old Redhat v 7) to a new Dovecot setup. My new installation is Dovecot + Postfix. All is setup and working, however I want to trasnsfer the contents of the mailboxes from my old server to this new Dovecot setup. Please let me know what information will be required to transfer the mailboxes - I have tried a number of things, but with no luck. I think the correct method is the one below, but I am getting UIDL errors and AUTH errors and not sure if this is the right approach ---- PLEASE HELP dsync -u mirror mbox:~/mail:INBOX= ~# dsync -u hendrikv at tcmvpn.co.za mirror mbox:~/mail:INBOX=/var/mail/User_mbox/hendrikv dsync(hendrikv at tcmvpn.co.za): Error: pop3c(196.26.136.162): AUTH PLAIN failed: -ERR Invalid command, try one of: USER name, PASS string, APOP name digest, QUIT dsync(hendrikv at tcmvpn.co.za): Error: pop3c: Disconnected from remote server dsync(hendrikv at tcmvpn.co.za): Error: pop3_migration: Couldn't sync mailbox POP3-MIGRATION-NS/INBOX: Internal error occurred. Refer to server log for more information. [2016-04-04 08:27:01] dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=ddbe5c71e58919cfe2a40905bced091d (UID=3054) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=64087a4c7bf960114cf17ba044047900 (UID=374) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=fd28baf9e91aedaf06c6e979ca76e96f (UID=2982) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=607087e611559d2df02c0684de87e10d (UID=991) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=c6a9aebd1f535f0cd82ed612a42bae77 (UID=1541) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=4c56ffcfb600c8b216b2f1603383dc13 (UID=1007) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=96ce5556fab323206f51deb03625be8a (UID=2357) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=cda74cb161321b7c99973cc65e80a591 (UID=1401) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=b735acf7ef69b39be157a97223878cdc (UID=642) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=6d9baedf21198be32152461f96737a1a (UID=481) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=19f36b934b74ce11f1eda95e32a0b112 (UID=1998) dsync(hendrikv at tcmvpn.co.za): Error: Exporting mailbox INBOX failed: Can't lookup pop3-uidl for UID=1: POP3 UIDLs couldn't be synce -- Kind Regards Hendrik From hendrik00 at gmail.com Mon Apr 4 06:49:58 2016 From: hendrik00 at gmail.com (Hendrik Velloen) Date: Mon, 4 Apr 2016 08:49:58 +0200 Subject: Migrating from Olde server to Dovecot Message-ID: Hi I am new to the mailing List, and was hoping to get some assistance migrating from an Old Cucipop + Sendmail server (running on a old Redhat v 7) to a new Dovecot setup. My new installation is Dovecot + Postfix. All is setup and working, however I want to trasnsfer the contents of the mailboxes from my old server to this new Dovecot setup. Please let me know what information will be required to transfer the mailboxes - I have tried a number of things, but with no luck. I think the correct method is the one below, but I am getting UIDL errors and AUTH errors and not sure if this is the right approach ---- PLEASE HELP dsync -u mirror mbox:~/mail:INBOX= ~# dsync -u hendrikv at tcmvpn.co.za mirror mbox:~/mail:INBOX=/var/mail/User_mbox/hendrikv dsync(hendrikv at tcmvpn.co.za): Error: pop3c(196.26.136.162): AUTH PLAIN failed: -ERR Invalid command, try one of: USER name, PASS string, APOP name digest, QUIT dsync(hendrikv at tcmvpn.co.za): Error: pop3c: Disconnected from remote server dsync(hendrikv at tcmvpn.co.za): Error: pop3_migration: Couldn't sync mailbox POP3-MIGRATION-NS/INBOX: Internal error occurred. Refer to server log for more information. [2016-04-04 08:27:01] dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=ddbe5c71e58919cfe2a40905bced091d (UID=3054) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=64087a4c7bf960114cf17ba044047900 (UID=374) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=fd28baf9e91aedaf06c6e979ca76e96f (UID=2982) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=607087e611559d2df02c0684de87e10d (UID=991) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=c6a9aebd1f535f0cd82ed612a42bae77 (UID=1541) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=4c56ffcfb600c8b216b2f1603383dc13 (UID=1007) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=96ce5556fab323206f51deb03625be8a (UID=2357) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=cda74cb161321b7c99973cc65e80a591 (UID=1401) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=b735acf7ef69b39be157a97223878cdc (UID=642) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=6d9baedf21198be32152461f96737a1a (UID=481) dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send mail GUID=19f36b934b74ce11f1eda95e32a0b112 (UID=1998) dsync(hendrikv at tcmvpn.co.za): Error: Exporting mailbox INBOX failed: Can't lookup pop3-uidl for UID=1: POP3 UIDLs couldn't be synce -- Kind Regards Hendrik From teemu.huovila at dovecot.fi Mon Apr 4 08:02:46 2016 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Mon, 4 Apr 2016 11:02:46 +0300 Subject: v2.2.23 released In-Reply-To: <56FD238E.8010805@spg.tu-darmstadt.de> References: <56FD238E.8010805@spg.tu-darmstadt.de> Message-ID: <57021FA6.5050600@dovecot.fi> On 31.03.2016 16:18, Hauke Fath wrote: > On 03/30/16 14:48, Timo Sirainen wrote: >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz >> http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig >> >> This is a bugfix-only release with various important fixes on top of v2.2.22. > > ... the build breaks on NetBSD with The build should work with https://github.com/dovecot/core/commit/4adefdb40c7ffcac3d8f8279cdf52d9f72d39636. Please report back, if it does not. > > [...] > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-test -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -std=gnu99 -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT quota-fs.lo -MD -MP -MF .deps/quota-fs.Tpo -c quota-fs.c -fPIC -DPIC -o .libs/quota-fs.o > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-test -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -std=gnu99 -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT rquota_xdr.lo -MD -MP -MF .deps/rquota_xdr.Tpo -c rquota_xdr.c -fPIC -DPIC -o .libs/rquota_xdr.o > libtool: link: ar cru .libs/lib10_doveadm_quota_plugin.a doveadm-quota.o > libtool: link: ranlib .libs/lib10_doveadm_quota_plugin.a > libtool: link: ( cd ".libs" && rm -f "lib10_doveadm_quota_plugin.la" && ln -s "../lib10_doveadm_quota_plugin.la" "lib10_doveadm_quota_plugin.la" ) > quota-fs.c: In function 'fs_quota_get_netbsd': > quota-fs.c:695:7: error: 'i' undeclared (first use in this function) > quota-fs.c:695:7: note: each undeclared identifier is reported only once for each function it appears in > Makefile:726: recipe for target 'quota-fs.lo' failed > gmake[4]: *** [quota-fs.lo] Error 1 > gmake[4]: *** Waiting for unfinished jobs.... > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../../.. -I../../../src/lib -I../../../src/lib-test -I../../../src/lib-master -I../../../src/lib-dict -I../../../src/lib-index -I../../../src/lib-mail -I../../../src/lib-storage -I../../../src/lib-storage/index -I../../../src/lib-storage/index/maildir -I../../../src/doveadm -std=gnu99 -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime -Wstrict-aliasing=2 -MT rquota_xdr.lo -MD -MP -MF .deps/rquota_xdr.Tpo -c rquota_xdr.c -o rquota_xdr.o >/dev/null 2>&1 > mv -f .deps/quota-storage.Tpo .deps/quota-storage.Plo > mv -f .deps/rquota_xdr.Tpo .deps/rquota_xdr.Plo > gmake[4]: Leaving directory '/var/obj/pkgsrc/mail/dovecot2/work/dovecot-2.2.23/src/plugins/quota' > Makefile:456: recipe for target 'all-recursive' failed > gmake[3]: *** [all-recursive] Error 1 > > > Cheerio, > hauke > From it at niemail.de Mon Apr 4 09:39:23 2016 From: it at niemail.de (Tim Evers) Date: Mon, 4 Apr 2016 11:39:23 +0200 Subject: Environment Variable Expansion Message-ID: <5702364B.2090802@niemail.de> System: Debian Jessie I'm trying to put an environment variable in the sql config like: password_query = SELECT userid AS user, crypt AS password, maildir as userdb_home, 500 as userdb_uid, 500 as userdb_gid FROM local_account WHERE userid = '%u' and mbox_host = '%{env:CLUSTERNAME}' \ and ( ( imap_aktiv='1' and '%s'='imap' ) or ( pop_aktiv='1' and '%s'='pop3' ) or ( sieve_aktiv='1' and '%s'='sieve' ) ) \ and aktiv_abruf='1' My variable is %{env:CLUSTERNAME} CLUSTERNAME is set through /etc/default/dovecot. I tried setting the import_environment config variable to TZ CLUSTERNAME but that changed nothing. When I execute this through a login attempt, I see the following in the tcpflow output: SELECT userid AS user, crypt AS password, maildir as userdb_home, 508 as userdb_uid, 503 as userdb_gid FROM local_account WHERE userid = 'te' and mbox_host = 'env:CLUSTERNAME}' and ( ( imap_aktiv='1' and 'pop3'='imap' ) or ( pop_aktiv='1' and 'pop3'='pop3' ) or ( sieve_aktiv='1' and 'pop3'='sieve' ) ) and aktiv_abruf='1' So %{env:CLUSTERNAME} was parsed to env:CLUSTERNAME} which is not what the doc (http://wiki.dovecot.org/Variables) says, and it also seems like the parser somehow sees this as a short variable (removing %+{). Any hints what might be happening here / how I can make it work. Regards, Tim From mick.crane at gmail.com Mon Apr 4 10:26:43 2016 From: mick.crane at gmail.com (mick crane) Date: Mon, 04 Apr 2016 11:26:43 +0100 Subject: Migrating from Olde server to Dovecot In-Reply-To: References: Message-ID: <97839eee0a8cd3d189020a6bd2964ccd@rapunzel.local> On 2016-04-04 07:49, Hendrik Velloen wrote: > Hi > > I am new to the mailing List, and was hoping to get some assistance > migrating from an Old Cucipop + Sendmail server (running on a old > Redhat v > 7) to a new Dovecot setup. > My new installation is Dovecot + Postfix. All is setup and working, > however > I want to trasnsfer the contents of the mailboxes from my old server to > this new Dovecot setup. > > Please let me know what information will be required to transfer the > mailboxes - I have tried a number of things, but with no luck. > > I think the correct method is the one below, but I am getting UIDL > errors > and AUTH errors and not sure if this is the right approach ---- PLEASE > HELP > > dsync -u mirror > mbox:~/mail:INBOX= > > ~# dsync -u hendrikv at tcmvpn.co.za mirror > mbox:~/mail:INBOX=/var/mail/User_mbox/hendrikv > > dsync(hendrikv at tcmvpn.co.za): Error: pop3c(196.26.136.162): AUTH PLAIN > failed: -ERR Invalid command, try one of: USER name, PASS string, APOP > name > digest, QUIT > dsync(hendrikv at tcmvpn.co.za): Error: pop3c: Disconnected from remote > server > dsync(hendrikv at tcmvpn.co.za): Error: pop3_migration: Couldn't sync > mailbox > POP3-MIGRATION-NS/INBOX: Internal error occurred. Refer to server log > for > more information. [2016-04-04 08:27:01] > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=ddbe5c71e58919cfe2a40905bced091d (UID=3054) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=64087a4c7bf960114cf17ba044047900 (UID=374) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=fd28baf9e91aedaf06c6e979ca76e96f (UID=2982) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=607087e611559d2df02c0684de87e10d (UID=991) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=c6a9aebd1f535f0cd82ed612a42bae77 (UID=1541) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=4c56ffcfb600c8b216b2f1603383dc13 (UID=1007) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=96ce5556fab323206f51deb03625be8a (UID=2357) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=cda74cb161321b7c99973cc65e80a591 (UID=1401) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=b735acf7ef69b39be157a97223878cdc (UID=642) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=6d9baedf21198be32152461f96737a1a (UID=481) > dsync(hendrikv at tcmvpn.co.za): Error: Mailbox INBOX: Remote didn't send > mail > GUID=19f36b934b74ce11f1eda95e32a0b112 (UID=1998) > dsync(hendrikv at tcmvpn.co.za): Error: Exporting mailbox INBOX failed: > Can't > lookup pop3-uidl for UID=1: POP3 UIDLs couldn't be synce the descriptions here are for moving between formats. http://wiki.dovecot.org/Migration/MailFormat Isn't mbox one big file that you can copy across ? I have just made a new server with Maildir format. Probably it is not the thing to do but I copied the old ~/Maildir/cur contents to new ~/Maildir/new (or cur I forget which) seems to work except they all get the same date. mick -- key ID: 0x4BFEBB31 From abi at oleane.net Mon Apr 4 10:28:27 2016 From: abi at oleane.net (abi at oleane.net) Date: Mon, 4 Apr 2016 12:28:27 +0200 Subject: enable/disable shared namespace in passdb Message-ID: <570241CB.3010005@oleane.net> hello all i'm currently using passdb to enable and disable various namespaces conditionally : for example the following work namespace/inbox/inbox=no namespace/legacy_pfso/disabled=no namespace/legacy_pfso/inbox=no namespace/local_storage/disabled=no namespace/comboINBOX_local_pfso/disabled=no namespace/comboINBOX_local_pfso/inbox=yes but i can't get things like the following to work namespace/shared/disabled=yes -- the shared namespace is configured as shown below namespace shared { type = shared list = yes # children disabled = yes separator = / prefix = shared/%%u/ location = imapc:~/dovemail/shared/%%u/ } imapc_host = localhost imapc_port = 143 imapc_password = superpassword # either super or a dummy imapc_master_user = %u -- it seems the shared namespaces do not have names any more so they can't be modified dynamically is there a way to circumvent ? something i missed ? i'm running 2.2.22 but i can switch easily to 2.2.9 or any other version providing master_user or one of the variables that can let me know if a master login was performed is available in passdb the reason i'm doing this is so i can prevent long chains/loops from occuring : then accessed by imapc: , the passdb should disable the shared namespace so it does not produce (an)other imapc connection(s) thanks for your help alexis From aki.tuomi at dovecot.fi Mon Apr 4 10:48:16 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Mon, 4 Apr 2016 13:48:16 +0300 (EEST) Subject: Migrating from Olde server to Dovecot In-Reply-To: <97839eee0a8cd3d189020a6bd2964ccd@rapunzel.local> References: <97839eee0a8cd3d189020a6bd2964ccd@rapunzel.local> Message-ID: <518071783.3261.1459766897252@appsuite-dev.open-xchange.com> > the descriptions here are for moving between formats. > http://wiki.dovecot.org/Migration/MailFormat > Isn't mbox one big file that you can copy across ? > I have just made a new server with Maildir format. > Probably it is not the thing to do but I copied the old ~/Maildir/cur > contents to new ~/Maildir/new (or cur I forget which) seems to work > except they all get the same date. > > > mick > Hi! mdbox is pretty good mix between maildir and mbox. Copying those files should work if you use option in copy to preserve timestamps. > -- > key ID: 0x4BFEBB31 Aki Tuomi Dovecot Oy From mail at tomsommer.dk Mon Apr 4 14:18:54 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Mon, 04 Apr 2016 16:18:54 +0200 Subject: New feature: HTTP API In-Reply-To: <289895264.13993.22ea9490-41a0-4846-81ec-d4706f3bbfc6.open-xchange@appsuite.open-xchange.com> References: <289895264.13993.22ea9490-41a0-4846-81ec-d4706f3bbfc6.open-xchange@appsuite.open-xchange.com> Message-ID: On 2016-02-20 17:09, aki.tuomi at dovecot.fi wrote: > To use the API, you can go to http://host:8080/doveadm. The documentation says http://host:8080/doveadm/v1 which is it? > GET request will print > out possible commands, along with their parameters. If you have set API > KEY, you > need to include it in the request as X-API-Key header. The documentation says X-Doveadm-API, which is it? A simple 1-line curl-example in the docs would do wonders :) http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP Thanks. // Tom From abi at oleane.net Mon Apr 4 15:15:54 2016 From: abi at oleane.net (abi at oleane.net) Date: Mon, 4 Apr 2016 17:15:54 +0200 Subject: enable/disable shared namespace in passdb In-Reply-To: <570241CB.3010005@oleane.net> References: <570241CB.3010005@oleane.net> Message-ID: <5702852A.2040002@oleane.net> > > hello all > > i'm currently using passdb to enable and disable various namespaces > conditionally : for example the following work > > namespace/inbox/inbox=no > namespace/legacy_pfso/disabled=no > namespace/legacy_pfso/inbox=no > namespace/local_storage/disabled=no > namespace/comboINBOX_local_pfso/disabled=no > namespace/comboINBOX_local_pfso/inbox=yes > > but i can't get things like the following to work > > namespace/shared/disabled=yes > > -- > > the shared namespace is configured as shown below > > namespace shared { > type = shared > list = yes # children > disabled = yes > separator = / > prefix = shared/%%u/ > location = imapc:~/dovemail/shared/%%u/ > } > > imapc_host = localhost > imapc_port = 143 > imapc_password = superpassword # either super or a dummy > imapc_master_user = %u > > -- > > it seems the shared namespaces do not have names any more so they can't > be modified dynamically > > is there a way to circumvent ? something i missed ? > > i'm running 2.2.22 but i can switch easily to 2.2.9 or any other version > providing master_user or one of the variables that can let me know if a > master login was performed is available in passdb > > the reason i'm doing this is so i can prevent long chains/loops from > occuring : then accessed by imapc: , the passdb should disable the > shared namespace so it does not produce (an)other imapc connection(s) > > thanks for your help > > alexis hi all bumping on my own... i've tried to declare the namespace inside the imap protocol and adding the following extra protocol and listner service imap-login-noshares { protocol = imapnoshares executable = imap-login inet_listener imapnoshares { address = port = 20143 reuse_port = no ssl = no } $login_process_common_stuff } protocol imapnoshares { # we need to clone imap stuff here... maybe not everything but at least quota and the likes } unfortunately it seems that the protocol is still 'imap' : the passdb and userdb queries still contain imap as the protocol name, the log displays imap(username), and it looks like the shared namespace is active. the namespace is now declared like this protocol imap { namespace shared { type = shared list = yes # children #disabled = yes separator = / prefix = shared/%%u/ location = imapc:~/dovemail/shared/%%u/ } } any ideas ? has anybody managed to get acls to work with imapc ? thanks for your time alexis From pali.rohar at gmail.com Mon Apr 4 17:12:56 2016 From: pali.rohar at gmail.com (=?UTF-8?q?Pali=20Roh=C3=A1r?=) Date: Mon, 4 Apr 2016 19:12:56 +0200 Subject: [PATCH 0/7] Fixes for lib-mail message-address Message-ID: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> Hello, I borrowed dovecot parser for email addresses and going to use it in new perl module as replacement for Email::Address. During implementation and testing I found bugs in dovecot parser & generator. So I'm sending my patches together with tests. Pali Roh?r (7): lib-mail: message_address_write: Fix generating empty group list lib-mail: message_address_write: Fix generating group list with empty name lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if last_comment is not NULL lib-mail: parse_addr_spec: Email address without local-part is invalid lib-mail: parse_mailbox: Set display name instead mailbox when parsing failed lib-mail: message_address_write: Quote and escape strings if needed lib-mail: Update tests for message address src/lib-mail/message-address.c | 99 +++++++++++++++++++++++++++++++---- src/lib-mail/test-message-address.c | 11 +++- 2 files changed, 98 insertions(+), 12 deletions(-) -- 1.7.9.5 From pali.rohar at gmail.com Mon Apr 4 17:18:11 2016 From: pali.rohar at gmail.com (Pali =?utf-8?B?Um9ow6Fy?=) Date: Mon, 4 Apr 2016 19:18:11 +0200 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> Message-ID: <20160404171811.GD8413@pali> On Monday 04 April 2016 19:12:56 Pali Roh?r wrote: > Hello, > > I borrowed dovecot parser for email addresses and going to use it in new > perl module as replacement for Email::Address. During implementation and > testing I found bugs in dovecot parser & generator. So I'm sending my > patches together with tests. > > Pali Roh?r (7): > lib-mail: message_address_write: Fix generating empty group list > lib-mail: message_address_write: Fix generating group list with empty > name > lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if > last_comment is not NULL > lib-mail: parse_addr_spec: Email address without local-part is > invalid > lib-mail: parse_mailbox: Set display name instead mailbox when > parsing failed > lib-mail: message_address_write: Quote and escape strings if needed > lib-mail: Update tests for message address > > src/lib-mail/message-address.c | 99 +++++++++++++++++++++++++++++++---- > src/lib-mail/test-message-address.c | 11 +++- > 2 files changed, 98 insertions(+), 12 deletions(-) > Again "Undelivered Mail Returned to Sender" :-( Cannot send them... -- Pali Roh?r pali.rohar at gmail.com From aki.tuomi at dovecot.fi Mon Apr 4 17:31:06 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Mon, 4 Apr 2016 20:31:06 +0300 (EEST) Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <20160404171811.GD8413@pali> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <20160404171811.GD8413@pali> Message-ID: <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> > On April 4, 2016 at 8:18 PM Pali Roh?r wrote: > > > On Monday 04 April 2016 19:12:56 Pali Roh?r wrote: > > Hello, > > > > I borrowed dovecot parser for email addresses and going to use it in new > > perl module as replacement for Email::Address. During implementation and > > testing I found bugs in dovecot parser & generator. So I'm sending my > > patches together with tests. > > > > Pali Roh?r (7): > > lib-mail: message_address_write: Fix generating empty group list > > lib-mail: message_address_write: Fix generating group list with empty > > name > > lib-mail: parse_addr_spec: Like in rfc822_skip_comment() check if > > last_comment is not NULL > > lib-mail: parse_addr_spec: Email address without local-part is > > invalid > > lib-mail: parse_mailbox: Set display name instead mailbox when > > parsing failed > > lib-mail: message_address_write: Quote and escape strings if needed > > lib-mail: Update tests for message address > > > > src/lib-mail/message-address.c | 99 > > +++++++++++++++++++++++++++++++---- > > src/lib-mail/test-message-address.c | 11 +++- > > 2 files changed, 98 insertions(+), 12 deletions(-) > > > > Again "Undelivered Mail Returned to Sender" :-( Cannot send them... > > -- > Pali Roh?r > pali.rohar at gmail.com Can you please send them directly to me, please? --- Aki Tuomi From pali.rohar at gmail.com Mon Apr 4 17:35:22 2016 From: pali.rohar at gmail.com (Pali =?utf-8?q?Roh=C3=A1r?=) Date: Mon, 4 Apr 2016 19:35:22 +0200 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <20160404171811.GD8413@pali> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> Message-ID: <201604041935.23571@pali> On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: > Can you please send them directly to me, please? > --- > Aki Tuomi Sent. -- Pali Roh?r pali.rohar at gmail.com From aki.tuomi at dovecot.fi Mon Apr 4 17:37:07 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Mon, 4 Apr 2016 20:37:07 +0300 (EEST) Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <201604041935.23571@pali> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <20160404171811.GD8413@pali> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <201604041935.23571@pali> Message-ID: <2130840829.16351.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> > On April 4, 2016 at 8:35 PM Pali Roh?r wrote: > > > On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: > > Can you please send them directly to me, please? > > --- > > Aki Tuomi > > Sent. > > -- > Pali Roh?r > pali.rohar at gmail.com Thanks. --- Aki Tuomi From aki.tuomi at dovecot.fi Mon Apr 4 18:22:12 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Mon, 4 Apr 2016 21:22:12 +0300 (EEST) Subject: New feature: HTTP API In-Reply-To: References: <289895264.13993.22ea9490-41a0-4846-81ec-d4706f3bbfc6.open-xchange@appsuite.open-xchange.com> Message-ID: <1988331466.16402.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> > On April 4, 2016 at 5:18 PM Tom Sommer wrote: > > > > On 2016-02-20 17:09, aki.tuomi at dovecot.fi wrote: > > > To use the API, you can go to http://host:8080/doveadm. > > The documentation says http://host:8080/doveadm/v1 which is it? > > > GET request will print > > out possible commands, along with their parameters. If you have set API > > KEY, you > > need to include it in the request as X-API-Key header. > > The documentation says X-Doveadm-API, which is it? > > A simple 1-line curl-example in the docs would do wonders :) > > http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP > > Thanks. > > // Tom Hi! Yes, you're right. I'll add this line to the docs as well, and also I discovered a bug in the code. It will be fixed in next release. The response indicates X-Dovecot-API, but the code uses X-Doveadm-API, this has been fixed to X-Dovecot-API. For now, if you want to use BASIC authentication, you set doveadm_password to something and use curl -H "Authorization: Basic " http://server:8080/ to get acceptable routes curl -H "Authorization: Basic " http://server:8080/doveadm/v1 to get acceptable commands and their parameters curl -H "Authorization: Basic " http://server:8080/doveadm/v1 an example command would be curl -H "Content-Type: application/json" -H "Authorization: Basic " -d '[["fetch",{"user":"username","field":["uid"],"query":["mailbox","INBOX"]},"c01"]]' http://server:8080/doveadm/v1 this should hopefully return something sensible, such as [["doveadmResponse",[{"uid":"1"}],"c01"]] Since the API is still a little beta, it will not return anything in case doveadm does not like the arguments (that is, calls i_fatal). Also, success is often indicated with 200 OK along with [["doveadmResponse",[],"c01"]]. We are going to improve the API in future release with v2, v1 is basically very analogous to using doveadm cli. Aki From ebroch at whitehorsetc.com Tue Apr 5 02:23:34 2016 From: ebroch at whitehorsetc.com (Eric) Date: Mon, 4 Apr 2016 20:23:34 -0600 Subject: namespace...mailbox doesn't exist Message-ID: <570321A6.8040803@whitehorsetc.com> Hello list, I have a namespace called 'projects' which when clicked in Thunderbird (nonexistent in eM Client) yields the following error: "The current operation on 'projects' did not succeed. The mail server for account user at domain.tld responded: mailbox doesn't exist: projects.projects (0.00 + 0.00 secs)." The namespace is configure as follows: # Shared namespace 'projects' namespace { location = maildir:/home/vpopmail/domains/domain.tld/shared/projects prefix = projects. separator = . type = public } This is the log: 1: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Effective uid=89, gid=89, home=/home/vpopmail/domains/domain.tld/postmaster 2: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota root: name=ignore=Trash backend=maildir args= 3: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota rule: root=ignore=Trash mailbox=? bytes=0 messages=0 4: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota grace: root=ignore=Trash bytes=0 (10%) 5: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Namespace : type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, subscriptions=yes location= 6: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: mdbox: access(/home/vpopmail/domains/domain.tld/postmaster/mdbox, rwx): failed: No such file or directory 7: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: mdbox: couldn't find root dir 8: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: sdbox: access(/home/vpopmail/domains/domain.tld/postmaster/sdbox, rwx): failed: No such file or directory 9: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: sdbox: couldn't find root dir 10: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir: root exists (/home/vpopmail/domains/domain.tld/postmaster/Maildir) 11: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir++: root=/home/vpopmail/domains/domain.tld/postmaster/Maildir, index=, indexpvt=, control=, inbox=/home/vpopmail/domains/domain.tld/postmaster/Maildir, alt= 12: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Namespace : type=public, prefix=projects., sep=., inbox=no, hidden=no, list=yes, subscriptions=yes location=maildir:/home/vpopmail/domains/domain.tld/shared/projects 13: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir++: root=/home/vpopmail/domains/domain.tld/shared/projects, index=, indexpvt=, control=, inbox=, alt= This did not happen with other versions of dovecot (I think) but just started happening with the upgrade. While it is not a serious problem and I can live with it, what would be causing it in the new dovecot iteration (2.2.23) ? And, could it be that I'm missing the necessary setting to mitigate this? Please let me know if any additional information is necessary. I'm thinking that the problem lies in lines 6/7 and 8/9 where Dovecot is looking for mdbox/sdbox. Eric From mail at tomsommer.dk Tue Apr 5 06:25:37 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Tue, 05 Apr 2016 08:25:37 +0200 Subject: New feature: HTTP API In-Reply-To: <1988331466.16402.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> References: <289895264.13993.22ea9490-41a0-4846-81ec-d4706f3bbfc6.open-xchange@appsuite.open-xchange.com> <1988331466.16402.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> Message-ID: <3f7462062448b047de766542b0dfbd43@tomsommer.dk> On 2016-04-04 20:22, aki.tuomi at dovecot.fi wrote: >> A simple 1-line curl-example in the docs would do wonders :) >> >> http://wiki2.dovecot.org/Design/DoveadmProtocol/HTTP > an example command would be > > curl -H "Content-Type: application/json" -H "Authorization: Basic > username:password>" -d > '[["fetch",{"user":"username","field":["uid"],"query":["mailbox","INBOX"]},"c01"]]' > http://server:8080/doveadm/v1 Awesome, I got it working with the API key. Thanks :) From skdovecot at smail.inf.fh-brs.de Tue Apr 5 06:43:24 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 5 Apr 2016 08:43:24 +0200 (CEST) Subject: namespace...mailbox doesn't exist In-Reply-To: <570321A6.8040803@whitehorsetc.com> References: <570321A6.8040803@whitehorsetc.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 4 Apr 2016, Eric wrote: > Date: Mon, 4 Apr 2016 20:23:34 -0600 > From: Eric > To: dovecot at dovecot.org > Subject: namespace...mailbox doesn't exist > > Hello list, > > I have a namespace called 'projects' which when clicked in Thunderbird > (nonexistent in eM Client) yields the following error: > > "The current operation on 'projects' did not succeed. The mail server for > account > user at domain.tld responded: mailbox doesn't exist: projects.projects (0.00 + > 0.00 secs)." > > The namespace is configure as follows: > > # Shared namespace 'projects' > namespace { ^^ IMHO first try to give that namespace a name, e.g. namespace projects { > location = maildir:/home/vpopmail/domains/domain.tld/shared/projects > prefix = projects. > separator = . > type = public > } > > This is the log: > 1: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Effective uid=89, > gid=89, home=/home/vpopmail/domains/domain.tld/postmaster > 2: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota root: > name=ignore=Trash backend=maildir args= > 3: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota rule: > root=ignore=Trash mailbox=? bytes=0 messages=0 > 4: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota grace: > root=ignore=Trash bytes=0 (10%) > 5: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Namespace : > type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, > subscriptions=yes location= > 6: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: mdbox: > access(/home/vpopmail/domains/domain.tld/postmaster/mdbox, rwx): failed: No > such file or directory > 7: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: mdbox: couldn't find > root dir > 8: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: sdbox: > access(/home/vpopmail/domains/domain.tld/postmaster/sdbox, rwx): failed: No > such file or directory > 9: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: sdbox: couldn't find > root dir > 10: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir: root exists > (/home/vpopmail/domains/domain.tld/postmaster/Maildir) > 11: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir++: > root=/home/vpopmail/domains/domain.tld/postmaster/Maildir, index=, indexpvt=, > control=, inbox=/home/vpopmail/domains/domain.tld/postmaster/Maildir, alt= > 12: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Namespace : > type=public, prefix=projects., sep=., inbox=no, hidden=no, list=yes, > subscriptions=yes > location=maildir:/home/vpopmail/domains/domain.tld/shared/projects > 13: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir++: > root=/home/vpopmail/domains/domain.tld/shared/projects, index=, indexpvt=, > control=, inbox=, alt= > > > This did not happen with other versions of dovecot (I think) but just started > happening with the upgrade. While it is not > a serious problem and I can live with it, what would be causing it in the new > dovecot iteration (2.2.23) ? And, could it be > that I'm missing the necessary setting to mitigate this? Please let me know > if any additional information is necessary. > > I'm thinking that the problem lies in lines 6/7 and 8/9 where Dovecot is > looking for mdbox/sdbox. > > Eric > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVwNejHz1H7kL/d9rAQJMKgf7B0B4mqfXCxYPx1mgimXgUZxUh1+OfMKs SFE2oKnpsg5lFsqeYXNHKVBToOaOEQCHVvcNg7iEe009X7CFTbzoOWm1PaX1ue+N LsPzPhSmoqU74D8+3OMK4noiFdWz3vZMPI2vt181q2HzQSHPdI8T73AVOhROQ/62 k2mIX9OxCH+wU9ZsLD6uUrG9jsNPIwdmLdSbDjTWgmyoZWRlL9rxYVcrU+laPu0F U0P29Vx9DmlEFdu42cua2BkCRKsFDg2BajF6UiCqyeKN3V8ZUJH8jVI2WFZ2jF6/ bytKdnFVTIDKbt/dkwWJjTDH1LMI8BpCFh/AGrJeoC9IfKMSs5F61Q== =XSh1 -----END PGP SIGNATURE----- From aki.tuomi at dovecot.fi Tue Apr 5 06:44:58 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Tue, 5 Apr 2016 09:44:58 +0300 (EEST) Subject: New feature: HTTP API In-Reply-To: References: <289895264.13993.22ea9490-41a0-4846-81ec-d4706f3bbfc6.open-xchange@appsuite.open-xchange.com> <1988331466.16402.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> Message-ID: <853408930.4781.1459838699525@appsuite-dev.open-xchange.com> > On April 5, 2016 at 9:27 AM Tom Sommer wrote: > > > On 2016-04-04 20:22, aki.tuomi at dovecot.fi wrote: > > > Since the API is still a little beta, it will not return anything in > > case > > doveadm does not like the arguments (that is, calls i_fatal). Also, > > success is > > often indicated with 200 OK along with [["doveadmResponse",[],"c01"]]. > > I don't see the "doveadm proxy kick" command in the list? Not all commands are included, unfortunately. Also, the list only shows commands that are available with doveadm as per configuration. Aki From mail at tomsommer.dk Tue Apr 5 06:57:50 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Tue, 05 Apr 2016 08:57:50 +0200 Subject: New feature: HTTP API In-Reply-To: <853408930.4781.1459838699525@appsuite-dev.open-xchange.com> References: <289895264.13993.22ea9490-41a0-4846-81ec-d4706f3bbfc6.open-xchange@appsuite.open-xchange.com> <1988331466.16402.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <853408930.4781.1459838699525@appsuite-dev.open-xchange.com> Message-ID: <868b534e29558c25035e536a604e7544@tomsommer.dk> On 2016-04-05 08:44, aki.tuomi at dovecot.fi wrote: >> On April 5, 2016 at 9:27 AM Tom Sommer wrote: >> >> >> On 2016-04-04 20:22, aki.tuomi at dovecot.fi wrote: >> >> > Since the API is still a little beta, it will not return anything in >> > case >> > doveadm does not like the arguments (that is, calls i_fatal). Also, >> > success is >> > often indicated with 200 OK along with [["doveadmResponse",[],"c01"]]. >> >> I don't see the "doveadm proxy kick" command in the list? > > Not all commands are included, unfortunately. Also, the list only > shows commands that are available with doveadm as per configuration. Hrmm, is it possible to add a non-http inet_listener to doveadm? And feed it commands directly? I really need a remote proxy kick for my director. From chris.laif at googlemail.com Tue Apr 5 08:33:11 2016 From: chris.laif at googlemail.com (Chris Laif) Date: Tue, 5 Apr 2016 10:33:11 +0200 Subject: fts_solr: Lookup failed: 400 Bad Request / GET null null In-Reply-To: <5701268C.703@rename-it.nl> References: <5701268C.703@rename-it.nl> Message-ID: On Sun, Apr 3, 2016 at 4:19 PM, Stephan Bosch wrote: >> Unfortunately I do not know (yet) which client action produces these >> log lines. "GET null null" seems not to be a sensible request in any >> case. >> >> Anyone seeing the same effect? > > > Did this happen only after upgrade to 2.2.23 or is this a fresh install? > This effect has been observed with 2.2.18 (initial install) and after upgrading to 2.2.23 as well. > Can you make a dump of what messages are exchanged on 10.0.0.123:8080 using > ngrep or wireshark? > I've captured some requests and they look like this (some parts changed due to privacy concerns): GET /solr/select?fl=uid,score&rows=439&sort=uid+asc&q={!lucene+q.op%3dAND}hdr:%3c56Fxxxx3A6.7080904 at domain.de%3e+OR+hdr:%3c664DCDxxxxx1A4FACD8B7922C495FEF at CZCHOWS1356.prg%5c-domain.com%3e+OR+hdr:%3c00cxxxxxde3$70ad7880$52 ... (many many more OR hdrs) &fq=%2Bbox:f696f93xxxxxx6e+%2Buser:user at domain.de HTTP/1.1 The total request size is 31708 bytes and it contains many (hundreds?) of 'OR hdrs' (side note: I wonder which client action triggers these kind of requests, maybe the user selected hundreds of mails for search?) I _think_ this is a problem of the URL length / max http header size. (Debian Jessie) Tomcat7 very likely does not accept more than 32kb data in a request. I wonder if Dovecot should limit SOLR requests to a specific size and deny long requests with an imap error (?) Chris From aki.tuomi at dovecot.fi Tue Apr 5 09:24:49 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Tue, 5 Apr 2016 12:24:49 +0300 (EEST) Subject: New feature: HTTP API In-Reply-To: <868b534e29558c25035e536a604e7544@tomsommer.dk> References: <289895264.13993.22ea9490-41a0-4846-81ec-d4706f3bbfc6.open-xchange@appsuite.open-xchange.com> <1988331466.16402.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <853408930.4781.1459838699525@appsuite-dev.open-xchange.com> <868b534e29558c25035e536a604e7544@tomsommer.dk> Message-ID: <173870327.5192.1459848290040@appsuite-dev.open-xchange.com> > On April 5, 2016 at 9:57 AM Tom Sommer wrote: > > > On 2016-04-05 08:44, aki.tuomi at dovecot.fi wrote: > >> On April 5, 2016 at 9:27 AM Tom Sommer wrote: > >> > >> > >> On 2016-04-04 20:22, aki.tuomi at dovecot.fi wrote: > >> > >> > Since the API is still a little beta, it will not return anything in > >> > case > >> > doveadm does not like the arguments (that is, calls i_fatal). Also, > >> > success is > >> > often indicated with 200 OK along with [["doveadmResponse",[],"c01"]]. > >> > >> I don't see the "doveadm proxy kick" command in the list? > > > > Not all commands are included, unfortunately. Also, the list only > > shows commands that are available with doveadm as per configuration. > > Hrmm, is it possible to add a non-http inet_listener to doveadm? And > feed it commands directly? > > I really need a remote proxy kick for my director. Unfortunately it's not possible with 2.2.23. It has been fixed internally and will eventually pop out to public repo and into some release. Aki From lkolbe at willert.de Tue Apr 5 10:49:39 2016 From: lkolbe at willert.de (Lukas Kolbe) Date: Tue, 5 Apr 2016 12:49:39 +0200 Subject: doveadm sync -1 -R Message-ID: <5F5A1A66-CA50-4F7D-8AA9-FDD580259299@willert.de> Hi, I?m migrating an old Zarafa-installation to a dovecot using mdbox and sis on Debian Jessie. To copy over the emails, I use doveadm backup on the new box - or more precisely: vmail# doveadm -v -o imapc_user=$user -o imapc_password=$pass -o imapc_host=$host -o imapc_features=rfc822.size -o imapc_port=993 -o mailbox_list_index=no -o imapc_ssl_verify=no backup -R -x "Public folders*" -x "Public folders/*" -u $user imapc: For each invoke of doveadm backup -R, the local (new) mailbox gets wiped and all mails are retransferred - so far, so good. I?d like to use "doveadm sync -1? as per the manpage to keep the downtime short, however sync doesn?t like the -R option: sync: invalid option -- 'R' doveadm sync [-u |-A] [-S ] [-1fPU] [-l ] [-r ] [-m ] [-g ] [-n | -N] [-x ] [-s ] -d| If I understand it correctly, without -R it would mean that doveadm sync would incorporate the changes from the local dovecot-mailbox into the remote imapc:-Mailbox, which is the opposite of what I want. Dovecot version is current head as of yesterday. Is what I?m trying to do even possible with doveadm sync? Kind regards, Lukas From hf at spg.tu-darmstadt.de Tue Apr 5 11:44:23 2016 From: hf at spg.tu-darmstadt.de (Hauke Fath) Date: Tue, 5 Apr 2016 13:44:23 +0200 Subject: v2.2.23 released In-Reply-To: <57021FA6.5050600@dovecot.fi> References: <56FD238E.8010805@spg.tu-darmstadt.de> <57021FA6.5050600@dovecot.fi> Message-ID: <20160405134423562407.250959b0@spg.tu-darmstadt.de> On Mon, 4 Apr 2016 11:02:46 +0300, Teemu Huovila wrote: >> >> ... the build breaks on NetBSD with [...] > > The build should work with > https://github.com/dovecot/core/commit/4adefdb40c7ffcac3d8f8279cdf52d9f72d39636. > Please report back, if it does not. It works indeed. Thanks for the fix! Cheerio, hauke -- The ASCII Ribbon Campaign Hauke Fath () No HTML/RTF in email Institut f?r Nachrichtentechnik /\ No Word docs in email TU Darmstadt Respect for open standards Ruf +49-6151-16-21344 From moiseev at mezonplus.ru Tue Apr 5 12:53:57 2016 From: moiseev at mezonplus.ru (Alexander Moisseev) Date: Tue, 5 Apr 2016 15:53:57 +0300 Subject: How to delete Dovecot users when using Single Instance Storage In-Reply-To: <56ED7698.6030209@jcea.es> References: <56ED7698.6030209@jcea.es> Message-ID: <1da019dc-bb97-f8bd-7cc6-956d20235979@mezonplus.ru> On 19.03.2016 18:56, Jesus Cea wrote: > In case somebody find this useful: > > https://blog.jcea.es/posts/20160211-delete_users_dovecot.html > "The expunge step" didn't work because "all" parameter was broken in 2.2.21. It's fixed now: https://github.com/dovecot/core/commit/6971937a6f3e93844dbd43bdbe903628e21a9422 Also as workaround you can replace 'all' with '1:*'. Here is a script that automates the procedure: https://github.com/moisseev/doveadm-tools/blob/master/bin/doveadm-mdboxrm From aki.tuomi at dovecot.fi Tue Apr 5 13:35:15 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Tue, 5 Apr 2016 16:35:15 +0300 (EEST) Subject: New feature: HTTP API In-Reply-To: <173870327.5192.1459848290040@appsuite-dev.open-xchange.com> References: <289895264.13993.22ea9490-41a0-4846-81ec-d4706f3bbfc6.open-xchange@appsuite.open-xchange.com> <1988331466.16402.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <853408930.4781.1459838699525@appsuite-dev.open-xchange.com> <868b534e29558c25035e536a604e7544@tomsommer.dk> <173870327.5192.1459848290040@appsuite-dev.open-xchange.com> Message-ID: <2143737481.6249.1459863315740@appsuite-dev.open-xchange.com> > On April 5, 2016 at 12:24 PM aki.tuomi at dovecot.fi wrote: > > > > > On April 5, 2016 at 9:57 AM Tom Sommer wrote: > > > > > > On 2016-04-05 08:44, aki.tuomi at dovecot.fi wrote: > > >> On April 5, 2016 at 9:27 AM Tom Sommer wrote: > > >> > > >> > > >> On 2016-04-04 20:22, aki.tuomi at dovecot.fi wrote: > > >> > > >> > Since the API is still a little beta, it will not return anything in > > >> > case > > >> > doveadm does not like the arguments (that is, calls i_fatal). Also, > > >> > success is > > >> > often indicated with 200 OK along with [["doveadmResponse",[],"c01"]]. > > >> > > >> I don't see the "doveadm proxy kick" command in the list? > > > > > > Not all commands are included, unfortunately. Also, the list only > > > shows commands that are available with doveadm as per configuration. > > > > Hrmm, is it possible to add a non-http inet_listener to doveadm? And > > feed it commands directly? > > > > I really need a remote proxy kick for my director. > > Unfortunately it's not possible with 2.2.23. It has been fixed internally and will eventually pop out to public repo and into some release. > > Aki Fixed hopefully in https://github.com/dovecot/core/commit/76537b1991e7815c7a867a997f7fa2b3c17412d4 Aki From gabriele.bulfon at sonicle.com Tue Apr 5 16:12:45 2016 From: gabriele.bulfon at sonicle.com (Gabriele Bulfon) Date: Tue, 5 Apr 2016 18:12:45 +0200 (CEST) Subject: dovecot squatter Message-ID: <23637329.53.1459872765302.JavaMail.sonicle@www> Hi, on cyrus installations we have the squatter utility that can index full message bodies and headers incrementally, allowing to run the squatter from time to time to arrange for index changes. Is there anything similar in Dovecot? This is expecially useful for full searches in body message. Thanks for any help Gabriele ---------------------------------------------------------------------------------------- Sonicle S.r.l. : http://www.sonicle.com Music: http://www.gabrielebulfon.com Quantum Mechanics : http://www.cdbaby.com/cd/gabrielebulfon From j.echter at echter-kuechen-elektro.de Tue Apr 5 17:00:36 2016 From: j.echter at echter-kuechen-elektro.de (J. Echter) Date: Tue, 5 Apr 2016 19:00:36 +0200 Subject: dovecot squatter In-Reply-To: <23637329.53.1459872765302.JavaMail.sonicle@www> References: <23637329.53.1459872765302.JavaMail.sonicle@www> Message-ID: <5703EF34.7020208@echter-kuechen-elektro.de> Am 05.04.2016 um 18:12 schrieb Gabriele Bulfon: > Hi, > on cyrus installations we have the squatter utility that can index full message bodies and headers incrementally, allowing to run > the squatter from time to time to arrange for index changes. > Is there anything similar in Dovecot? > This is expecially useful for full searches in body message. > Thanks for any help > Gabriele > ---------------------------------------------------------------------------------------- > Sonicle S.r.l. > : > http://www.sonicle.com > Music: > http://www.gabrielebulfon.com > Quantum Mechanics : > http://www.cdbaby.com/cd/gabrielebulfon > Hi Gabriele, something like this? http://wiki2.dovecot.org/Plugins/FTS/Lucene From tss at iki.fi Tue Apr 5 17:29:06 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 5 Apr 2016 20:29:06 +0300 Subject: Session ID separator change Message-ID: <03F67E7E-5FD1-4B32-8912-67A5ED45ECE2@iki.fi> LMTP is a but troublesome in that a single LMTP session can do multiple RCPT TOs, so the same session will end up delivering mails to multiple different users. This is causing trouble with stats process, because each delivery is using the same session ID for multiple different users, which causes errors about session ID duplication in stats process. So we'll need to make the session IDs unique, while still keeping it clear enough that they're part of the same original LMTP session (which is also visible in th Received: headers). I'm now thinking that the first recipient's delivery will have the original normal session ID (e.g. "ME3ZHCi+A1dUDQAAvAUe3g"), while the following recipients will have :2, :3, etc suffix (e.g. "ME3ZHCi+A1dUDQAAvAUe3g:2"). If somebody cares about parsing the original session ID from logs, they can just cut off the session ID from the first ':' character (because indexer-worker also adds its own :suffix). So now I'm mainly wondering if ':' is a good character? Has somebody already changed mail_log_prefix in a way that these additional ':' chars might break their log parsers (e.g. mail_log_prefix=%u:%s%{session}:%r). From ebroch at whitehorsetc.com Tue Apr 5 21:52:45 2016 From: ebroch at whitehorsetc.com (Eric) Date: Tue, 5 Apr 2016 15:52:45 -0600 Subject: namespace...mailbox doesn't exist In-Reply-To: References: <570321A6.8040803@whitehorsetc.com> Message-ID: <570433AD.7010204@whitehorsetc.com> I tried that and am sad to say it did not work. Hmmm... On 4/5/2016 12:43 AM, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Mon, 4 Apr 2016, Eric wrote: > >> Date: Mon, 4 Apr 2016 20:23:34 -0600 >> From: Eric >> To: dovecot at dovecot.org >> Subject: namespace...mailbox doesn't exist >> >> Hello list, >> >> I have a namespace called 'projects' which when clicked in >> Thunderbird (nonexistent in eM Client) yields the following error: >> >> "The current operation on 'projects' did not succeed. The mail server >> for account >> user at domain.tld responded: mailbox doesn't exist: projects.projects >> (0.00 + 0.00 secs)." >> >> The namespace is configure as follows: >> >> # Shared namespace 'projects' >> namespace { > > ^^ IMHO first try to give that namespace a name, e.g. > > namespace projects { > >> location = maildir:/home/vpopmail/domains/domain.tld/shared/projects >> prefix = projects. >> separator = . >> type = public >> } >> >> This is the log: >> 1: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Effective >> uid=89, gid=89, home=/home/vpopmail/domains/domain.tld/postmaster >> 2: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota root: >> name=ignore=Trash backend=maildir args= >> 3: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota rule: >> root=ignore=Trash mailbox=? bytes=0 messages=0 >> 4: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Quota grace: >> root=ignore=Trash bytes=0 (10%) >> 5: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Namespace : >> type=private, prefix=, sep=., inbox=yes, hidden=no, list=yes, >> subscriptions=yes location= >> 6: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: mdbox: >> access(/home/vpopmail/domains/domain.tld/postmaster/mdbox, rwx): >> failed: No such file or directory >> 7: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: mdbox: >> couldn't find root dir >> 8: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: sdbox: >> access(/home/vpopmail/domains/domain.tld/postmaster/sdbox, rwx): >> failed: No such file or directory >> 9: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: sdbox: >> couldn't find root dir >> 10: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir: root >> exists (/home/vpopmail/domains/domain.tld/postmaster/Maildir) >> 11: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir++: >> root=/home/vpopmail/domains/domain.tld/postmaster/Maildir, index=, >> indexpvt=, control=, >> inbox=/home/vpopmail/domains/domain.tld/postmaster/Maildir, alt= >> 12: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: Namespace : >> type=public, prefix=projects., sep=., inbox=no, hidden=no, list=yes, >> subscriptions=yes >> location=maildir:/home/vpopmail/domains/domain.tld/shared/projects >> 13: Apr 04 20:00:30 imap(postmaster at domain.tld): Debug: maildir++: >> root=/home/vpopmail/domains/domain.tld/shared/projects, index=, >> indexpvt=, control=, inbox=, alt= >> >> >> This did not happen with other versions of dovecot (I think) but just >> started happening with the upgrade. While it is not >> a serious problem and I can live with it, what would be causing it in >> the new dovecot iteration (2.2.23) ? And, could it be >> that I'm missing the necessary setting to mitigate this? Please let >> me know if any additional information is necessary. >> >> I'm thinking that the problem lies in lines 6/7 and 8/9 where Dovecot >> is looking for mdbox/sdbox. >> >> Eric >> > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVwNejHz1H7kL/d9rAQJMKgf7B0B4mqfXCxYPx1mgimXgUZxUh1+OfMKs > SFE2oKnpsg5lFsqeYXNHKVBToOaOEQCHVvcNg7iEe009X7CFTbzoOWm1PaX1ue+N > LsPzPhSmoqU74D8+3OMK4noiFdWz3vZMPI2vt181q2HzQSHPdI8T73AVOhROQ/62 > k2mIX9OxCH+wU9ZsLD6uUrG9jsNPIwdmLdSbDjTWgmyoZWRlL9rxYVcrU+laPu0F > U0P29Vx9DmlEFdu42cua2BkCRKsFDg2BajF6UiCqyeKN3V8ZUJH8jVI2WFZ2jF6/ > bytKdnFVTIDKbt/dkwWJjTDH1LMI8BpCFh/AGrJeoC9IfKMSs5F61Q== > =XSh1 > -----END PGP SIGNATURE----- From m at sys4.de Tue Apr 5 22:14:14 2016 From: m at sys4.de (Marc Schiffbauer) Date: Wed, 6 Apr 2016 00:14:14 +0200 Subject: Session ID separator change In-Reply-To: <03F67E7E-5FD1-4B32-8912-67A5ED45ECE2@iki.fi> References: <03F67E7E-5FD1-4B32-8912-67A5ED45ECE2@iki.fi> Message-ID: <20160405221414.GD4417@schiffbauer.net> * Timo Sirainen schrieb am 05.04.16 um 19:29 Uhr: [?] > So now I'm mainly wondering if ':' is a good character? Has somebody > already changed mail_log_prefix in a way that these additional ':' > chars might break their log parsers (e.g. > mail_log_prefix=%u:%s%{session}:%r). Why not use another '+'? -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From stephan at rename-it.nl Wed Apr 6 00:03:32 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 6 Apr 2016 02:03:32 +0200 Subject: Session ID separator change In-Reply-To: <20160405221414.GD4417@schiffbauer.net> References: <03F67E7E-5FD1-4B32-8912-67A5ED45ECE2@iki.fi> <20160405221414.GD4417@schiffbauer.net> Message-ID: <57045254.3000207@rename-it.nl> Op 4/6/2016 om 12:14 AM schreef Marc Schiffbauer: > * Timo Sirainen schrieb am 05.04.16 um 19:29 Uhr: > [?] >> So now I'm mainly wondering if ':' is a good character? Has somebody >> already changed mail_log_prefix in a way that these additional ':' >> chars might break their log parsers (e.g. >> mail_log_prefix=%u:%s%{session}:%r). > Why not use another '+'? > That '+' in the example is just part of the Base64 encoding, so it is not a separator. Regards, Stephan. From pruimj at gmail.com Wed Apr 6 01:06:45 2016 From: pruimj at gmail.com (Jason Pruim) Date: Tue, 5 Apr 2016 21:06:45 -0400 Subject: Unable to login with iPhone? Message-ID: Hey Everyone, So I have my dovecot install up and running! I can receive mail from the outside, still dealing with a small issue with sending email, but I think that's an issue off needing to setup a relay... Right now though... My biggest issue is it won't connect to my iPhone... I can login with mail on my computer, and through round cube for webmail... But it gets stuck on "verifying"... I tried addingcram-md5 and digest-md5 to the auth_mechanisms but that didn't work... Any idea what I'm missing? Here is my doveconf -n: [ec2-user at ip-172-31-28-46 postfix]$ doveconf -n # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 4.4.5-15.26.amzn1.x86_64 x86_64 ext4 auth_mechanisms = plain login cram-md5 digest-md5 mail_location = maildir:/var/vmail/%d/%n/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave mbox_write_locks = fcntl namespace inbox { inbox = yes location = prefix = separator = . } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } ssl = required ssl_cert = References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 5 Apr 2016, Jason Pruim wrote: > Right now though... My biggest issue is it won't connect to my iPhone... I > can login with mail on my computer, and through round cube for webmail... > But it gets stuck on "verifying"... I tried addingcram-md5 and digest-md5 > to the auth_mechanisms but that didn't work... Any idea what I'm missing? did you verified that the connection from the iPhone arrives at Dovecot at all? Then: http://wiki2.dovecot.org/Debugging/Authentication and visit the log files. > > Here is my doveconf -n: > > [ec2-user at ip-172-31-28-46 postfix]$ doveconf -n > > # 2.2.10: /etc/dovecot/dovecot.conf > > # OS: Linux 4.4.5-15.26.amzn1.x86_64 x86_64 ext4 > > auth_mechanisms = plain login cram-md5 digest-md5 > > mail_location = maildir:/var/vmail/%d/%n/Maildir > > managesieve_notify_capability = mailto > > managesieve_sieve_capability = fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex imap4flags > copy include variables body enotify environment mailbox date ihave > > mbox_write_locks = fcntl > > namespace inbox { > > inbox = yes > > location = > > prefix = > > separator = . > > } > > passdb { > > args = /etc/dovecot/dovecot-sql.conf.ext > > driver = sql > > } > > plugin { > > sieve = ~/.dovecot.sieve > > sieve_dir = ~/sieve > > } > > service auth { > > unix_listener /var/spool/postfix/private/auth { > > group = postfix > > mode = 0660 > > user = postfix > > } > > unix_listener auth-userdb { > > group = vmail > > mode = 0666 > > user = vmail > > } > > } > > service imap-login { > > inet_listener imap { > > port = 143 > > } > > inet_listener imaps { > > port = 993 > > ssl = yes > > } > > } > > ssl = required > > ssl_cert = > ssl_key = > ssl_protocols = !SSLv2 !SSLv3 > > userdb { > > args = uid=vmail gid=vmail home=/var/vmail/%d/%n > > driver = static > > } > > protocol lda { > > mail_plugins = " sieve" > > } > > [ec2-user at ip-172-31-28-46 postfix]$ > > > If I try to telnet to port 993 from my local computer it connects, but > won't let me login... Same on port 143... > > Any ideas? > > Thanks everyone for your help! I can't wait until I can actually help with > the questions instead of just asking them! > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVwShXnz1H7kL/d9rAQIBjAgAj3eonk5bthDHFLDh/+VfdpqGMJ4+32Ch kd5zueur30hMOJH379efDs/bSERRsgrC4T8GPlLYaKYzg1+OPVE11Jaz85LJ7K7r CtaujA9wIkLdnKm91jKZ5jtvlZ6awVKYI7422LBOB1TkYEYfUvWIaEhrjTZvKiGT WcbyUS0FqJrAZu/T5wwfBoZbNHukiZEonai77/yQzIPhzKnOTFav/goid9NjfBSC RkL83yZ7lahDAh0hu8KkH+tfg2nGJhhpZzlwHZAbmypmVjB73Dwa5vnkqc+ah+BJ YJSEfUI/nd7if9HQIoAyW6f57ljF0Cj91fG9e0bD22C0ZK1lLMK7UQ== =Zvca -----END PGP SIGNATURE----- From mick.crane at gmail.com Wed Apr 6 07:29:58 2016 From: mick.crane at gmail.com (mick crane) Date: Wed, 06 Apr 2016 08:29:58 +0100 Subject: Unable to login with iPhone? In-Reply-To: References: Message-ID: On 2016-04-06 02:06, Jason Pruim wrote: > If I try to telnet to port 993 from my local computer it connects, but > won't let me login... Same on port 143... > > Any ideas? are you going through this check list ? http://wiki.dovecot.org/TestInstallation and there is quite a bit here https://www.linode.com/docs/email/postfix/troubleshooting-problems-with-postfix-dovecot-and-mysql -- key ID: 0x4BFEBB31 From m at sys4.de Wed Apr 6 10:11:38 2016 From: m at sys4.de (Marc Schiffbauer) Date: Wed, 6 Apr 2016 12:11:38 +0200 Subject: Session ID separator change In-Reply-To: <57045254.3000207@rename-it.nl> References: <03F67E7E-5FD1-4B32-8912-67A5ED45ECE2@iki.fi> <20160405221414.GD4417@schiffbauer.net> <57045254.3000207@rename-it.nl> Message-ID: <20160406101138.GB3929@schiffbauer.net> * Stephan Bosch schrieb am 06.04.16 um 02:03 Uhr: > Op 4/6/2016 om 12:14 AM schreef Marc Schiffbauer: > > * Timo Sirainen schrieb am 05.04.16 um 19:29 Uhr: > > [?] > >> So now I'm mainly wondering if ':' is a good character? Has somebody > >> already changed mail_log_prefix in a way that these additional ':' > >> chars might break their log parsers (e.g. > >> mail_log_prefix=%u:%s%{session}:%r). > > Why not use another '+'? > > > > That '+' in the example is just part of the Base64 encoding, so it is > not a separator. Sure, but as long as you never want to decode this again it would be ok. By not introducing a new char you have a higher chance of not breaking existing setups. Or do we *want* a separator that is visible as such? -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From davide.marchi at gmail.com Wed Apr 6 10:36:40 2016 From: davide.marchi at gmail.com (davide marchi) Date: Wed, 6 Apr 2016 12:36:40 +0200 Subject: LMTP with alias addresses Message-ID: Hi, my problem is this: if i use lmtp for delivery and lookup for real_virtual_user at mydomain.com all function perfectly and mails are delivered correctly (quota and presence of user also) but if i send an email to real_alias_address at mydomain.com LMTP service (it's an alias containing several users) dosen't find user. How can i resolve this problem? for completeness my system users is based on vpopmail userdb From mail at tomsommer.dk Wed Apr 6 10:43:19 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Wed, 06 Apr 2016 12:43:19 +0200 Subject: Opportunistic quota recalc Message-ID: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> I'm switching quota backend to redis (from maildir++), so all my current usages are reset. I get that I can do "doveadm quota recalc -A", but it takes forever (and auth processes time out/crash). It would make much more sense to recalc the usage on login if the current usage is unset. Is there no way to do a recalc-quota-on-first-login? Thanks. -- Tom Sommer From tom at whyscream.net Wed Apr 6 11:09:20 2016 From: tom at whyscream.net (Tom Hendrikx) Date: Wed, 6 Apr 2016 13:09:20 +0200 Subject: LMTP with alias addresses In-Reply-To: References: Message-ID: <5704EE60.6080109@whyscream.net> On 06-04-16 12:36, davide marchi wrote: > Hi, my problem is this: > if i use lmtp for delivery and lookup for real_virtual_user at mydomain.com > all function perfectly and mails are delivered correctly (quota and > presence of user also) > > but if i send an email to real_alias_address at mydomain.com LMTP service > (it's an alias containing several users) dosen't find user. > How can i resolve this problem? for completeness my system users is based > on vpopmail userdb > The alias expansion should be done before querying the LMTP service. I guess your MTA should do that: the LMTP does not know, use or manage the aliases. Regards, Tom From wuweiwwd at sina.com Wed Apr 6 11:25:11 2016 From: wuweiwwd at sina.com (wuwei) Date: Wed, 6 Apr 2016 04:25:11 -0700 (PDT) Subject: [help]enotify "mail to" run fine edit via managesieve 0.4.4 complied failed Message-ID: <1459941911555-55752.post@n4.nabble.com> hi all edit via vi editor to change dovecot.sieve and enotify works fine.but when I telnet 4190 port via managesieve to edit it with the same code,the managesieve said "NO "Error in MANAGESIEVE command CHECKSCRIPT: "", find many topic in wiki and maillist but not solved. need you help!thanks!!dovecot version 2.2.15,pigonhole version 0.4.4 here are more infos below: *managesieve cmds:* "IMPLEMENTATION" "Dovecot Pigeonhole" "SIEVE" "fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vacation-seconds" "NOTIFY" "mailto" "SASL" "PLAIN LOGIN" "VERSION" "1.0" OK "Dovecot ready." listscripts NO "Error in MANAGESIEVE command received by server." AUTHENTICATE "PLAIN" "AGFuZ196aGFAdG9tLmNvbQAxMTExMTE=" OK "Logged in." listscripts "blackwhitelist" "rulefilter" ACTIVE OK "Listscripts completed." getscript "rulefilter" {471} require ["reject","fileinto","imap4flags","vacation","regex","encoded-character","include","copy","enotify","variables"]; if header :matches "Subject" "*" { set "Subject" "${1}"; } if header :matches "From" "*" { set "From" "${1}"; } if header :matches "Message-ID" "*" { set "msg_id" "${1}"; } if header :matches "To" "*" { set "To" "${1}"; } if header :matches "Date" "*" { set "Date" "${1}"; } notify "mailto:wuweiwwd at tom.com"; OK "Getscript completed." checkscript {471} require ["reject","fileinto","imap4flags","vacation","regex","encoded-character","include","copy","enotify","variables"]; if header :matches "Subject" "*" { set "Subject" "${1}"; } if header :matches "From" "*" { set "From" "${1}"; } if header :matches "Message-ID" "*" { set "msg_id" "${1}"; } if header :matches "To" "*" { set "To" "${1}"; } if header :matches "Date" "*" { set "Date" "${1}"; } notify "mailto:wuweiwwd at tom.com"; *NO "Error in MANAGESIEVE command CHECKSCRIPT: "* BYE "Disconnected for inactivity" Connection closed by foreign host. *sieve code:* require ["reject","fileinto","imap4flags","vacation","regex","encoded-character","include","copy","enotify","variables"]; if header :matches "Subject" "*" { set "Subject" "${1}"; } if header :matches "From" "*" { set "From" "${1}"; } if header :matches "Message-ID" "*" { set "msg_id" "${1}"; } if header :matches "To" "*" { set "To" "${1}"; } if header :matches "Date" "*" { set "Date" "${1}"; } notify "mailto:wuweiwwd at tom.com"; *dovecot.conf ./dovecot -n* # 2.2.15: /home/mail/dovecot/etc/dovecot/dovecot.conf doveconf: Warning: service auth { client_limit=80960 } is lower than required under max. load (300000) doveconf: Warning: service anvil { client_limit=60000 } is lower than required under max. load (240003) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.2 auth_cache_negative_ttl = 1 days auth_cache_size = 1000 k auth_cache_ttl = 1 days auth_debug = yes auth_debug_passwords = yes auth_master_user_separator = * auth_mechanisms = plain login debug_log_path = /home/mail/dovecot/logs/dovecot.log default_client_limit = 60000 default_internal_user = vmail default_login_user = dovecotauth default_process_limit = 60000 disable_plaintext_auth = no first_valid_gid = 1007 first_valid_uid = 1007 imapc_features = rfc822.size fetch-headers imapc_host = 172.24.173.212 imapc_password = tom123VipIMAP587 imapc_user = %u info_log_path = /home/mail/dovecot/logs/dovecot.log log_path = /home/mail/dovecot/logs/dovecot.log mail_debug = yes mail_fsync = never mail_plugins = fts fts_lucene mail_log notify quota zlib mail_prefetch_count = 20 maildir_very_dirty_syncs = yes managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date ihave duplicate vacation-seconds namespace inbox { inbox = yes location = mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox "Junk E-mail" { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } mailbox "Sent Items" { auto = subscribe special_use = \Sent } mailbox Trash { auto = subscribe special_use = \Trash } prefix = separator = . } passdb { args = /home/mail/dovecot/etc/dovecot/passwd.masterusers driver = passwd-file master = yes } passdb { args = /home/mail/dovecot/bin/CheckPassword driver = checkpassword } plugin { fts = lucene fts_lucene = whitespace_chars=@. mail_debug = yes mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename append mail_log_fields = uid box msgid size quota = dict:%u::redis:host=127.0.0.1:prefix=user_quota/ quota_rule2 = Trash:storage=+80%% quota_warning = storage=90%% quota-warning 90 %u quota_warning2 = storage=80%% quota-warning 80 %u quota_warning3 = storage=70%% quota-warning 70 %u quota_warning4 = storage=60%% quota-warning 60 %u sieve = ~/sieve/.dovecot.sieve sieve_dir = ~/sieve sieve_extensions = +vacation-seconds sieve_max_redirects = 10 sieve_redirect_envelope_from = orig_recipient sieve_vacation_default_period = 0 sieve_vacation_max_period = 0 sieve_vacation_min_period = 0 welcome_letter_path = /home/mail/dovecot/etc/welcome welcome_letter_url = http://202.108.252.162:8080/domainmail zlib_save = gz zlib_save_level = 6 } pop3_fast_size_lookups = yes pop3_no_flag_updates = yes postmaster_address = postmastar@%d protocols = imap pop3 sieve lmtp service auth-worker { user = dovecotauth } service auth { client_limit = 80960 unix_listener /home/mail/postfix/var/spool/postfix/private/auth-client { group = postfix mode = 0660 user = postfix } } service imap-login { inet_listener imap { port = 143 } service_count = 0 vsz_limit = 256 M } service imap { executable = imap postlogin process_limit = 60240 } service lmtp { inet_listener { port = 11000 } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 0 vsz_limit = 256 M } service managesieve { process_limit = 80960 } service pop { executable = imap postlogin process_limit = 60240 } service pop3-login { inet_listener pop3 { port = 110 } service_count = 0 vsz_limit = 256 M } service postlogin { executable = script-login -d rawlog -b -t } service quota-warning { executable = script /home/mail/dovecot/bin/quota-warning.sh unix_listener quota-warning { user = vmail } user = vmail } ssl = no submission_host = 172.24.140.52:26 userdb { driver = prefetch } userdb { args = /home/mail/dovecot/etc/dovecot/dovecot-dict-auth.conf.ext driver = dict } protocol imap { imap_logout_format = bytes=%i/%o mail_plugins = fts fts_lucene mail_log notify quota zlib imap_quota imap_zlib } protocol pop3 { pop3_logout_format = bytes=%i/%o, top=%t/%p, retr=%r/%b, del=%d/%m, size=%s } protocol lmtp { mail_plugins = fts fts_lucene mail_log notify quota zlib quota sieve } protocol sieve { mail_max_userip_connections = 1000 mail_plugins = fts fts_lucene mail_log notify quota zlib quota managesieve_implementation_string = Dovecot Pigeonhole managesieve_logout_format = bytes=%i/%o managesieve_max_compile_errors = 10 managesieve_max_line_length = 65536 } -- View this message in context: http://dovecot.2317879.n4.nabble.com/help-enotify-mail-to-run-fine-edit-via-managesieve-0-4-4-complied-failed-tp55752.html Sent from the Dovecot mailing list archive at Nabble.com. From mail at tomsommer.dk Wed Apr 6 13:54:41 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Wed, 06 Apr 2016 15:54:41 +0200 Subject: Internal quota calculation error (redis), double mail delivery Message-ID: <9038d859204bad0db3af82b42c60473b@tomsommer.dk> Sometimes my redis connection times out, both for pop3, imap and lmtp. I have no idea why, when I do a "doveadm quota recalc -u" it works just fine? I'm thinking the connection is lost somehow and not retried? Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: redis: Lookup timed out in 30.000 secs Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: Internal quota calculation error Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: Internal quota calculation error Apr 06 15:42:00 lmtp(xxx at xxx.com): Info: xxxx: msgid=: saved mail to INBOX Apr 06 15:49:23 lmtp(xxx at xxx.com): Info: xxxx: msgid=: saved mail to INBOX <-- Same mail This happens a lot, and it's really bad, because the mail is actually saved correctly, but the error is reported back to the Director, causing the delivery to be retried by the MTA - so the mail actually lands *twice* in the user's inbox. Thanks -- Tom From pali.rohar at gmail.com Wed Apr 6 14:29:43 2016 From: pali.rohar at gmail.com (Pali =?utf-8?q?Roh=C3=A1r?=) Date: Wed, 6 Apr 2016 16:29:43 +0200 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <201604041935.23571@pali> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <201604041935.23571@pali> Message-ID: <201604061629.43612@pali> On Monday 04 April 2016 19:35:22 Pali Roh?r wrote: > On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: > > Can you please send them directly to me, please? > > --- > > Aki Tuomi > > Sent. Received? Are patches OK now? -- Pali Roh?r pali.rohar at gmail.com -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. URL: From aki.tuomi at dovecot.fi Wed Apr 6 15:28:30 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Wed, 6 Apr 2016 18:28:30 +0300 (EEST) Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <201604061629.43612@pali> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <201604041935.23571@pali> <201604061629.43612@pali> Message-ID: <478882608.6336.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> > On April 6, 2016 at 5:29 PM Pali Roh?r wrote: > > > On Monday 04 April 2016 19:35:22 Pali Roh?r wrote: > > On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: > > > Can you please send them directly to me, please? > > > --- > > > Aki Tuomi > > > > Sent. > > Received? Are patches OK now? > > -- > Pali Roh?r > pali.rohar at gmail.com Hi! Patches came thru fine, they are currently being reviewed. Aki From tss at iki.fi Wed Apr 6 18:27:58 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 21:27:58 +0300 Subject: Internal quota calculation error (redis), double mail delivery In-Reply-To: <9038d859204bad0db3af82b42c60473b@tomsommer.dk> References: <9038d859204bad0db3af82b42c60473b@tomsommer.dk> Message-ID: <56C62867-B12E-4C7C-93EB-E1DD3993CE11@iki.fi> On 06 Apr 2016, at 16:54, Tom Sommer wrote: > > Sometimes my redis connection times out, both for pop3, imap and lmtp. I have no idea why, when I do a "doveadm quota recalc -u" it works just fine? > I'm thinking the connection is lost somehow and not retried? > > Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: redis: Lookup timed out in 30.000 secs > Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: Internal quota calculation error > Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: Internal quota calculation error > Apr 06 15:42:00 lmtp(xxx at xxx.com): Info: xxxx: msgid=: saved mail to INBOX > Apr 06 15:49:23 lmtp(xxx at xxx.com): Info: xxxx: msgid=: saved mail to INBOX <-- Same mail > > This happens a lot, and it's really bad, because the mail is actually saved correctly, but the error is reported back to the Director, causing the delivery to be retried by the MTA - so the mail actually lands *twice* in the user's inbox. 1) Shrink the timeout in Redis with timeout_msecs parameter. http://wiki2.dovecot.org/Dictionary 2) Actually it looks like the timeout handling code doesn't work at all. It simply keeps on logging timeouts until it succeeds or the connection gets disconnected. Do you see such repeated timeout logs, or does the connection also happen to get closed exactly at 30 seconds anyway? This fixes: https://github.com/dovecot/core/commit/2fb829dc7cc8c61dee925a15e51768a4b82e45da 3) Is there some firewall between Dovecot and Redis that closes idling connections and causes them to hang? Dovecot doesn't close idle Redis connections, although I suppose it would be useful too. The attached patch probably helps here by adding a new idle_timeout_msecs setting. I didn't finish testing it. -------------- next part -------------- A non-text attachment was scrubbed... Name: redis-idle-timeout.diff Type: application/octet-stream Size: 3197 bytes Desc: not available URL: -------------- next part -------------- From tss at iki.fi Wed Apr 6 18:38:13 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 21:38:13 +0300 Subject: Opportunistic quota recalc In-Reply-To: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> References: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> Message-ID: On 06 Apr 2016, at 13:43, Tom Sommer wrote: > > I'm switching quota backend to redis (from maildir++), so all my current usages are reset. > > I get that I can do "doveadm quota recalc -A", but it takes forever (and auth processes time out/crash). > > It would make much more sense to recalc the usage on login if the current usage is unset. Is there no way to do a recalc-quota-on-first-login? I'd actually recommend switching to "count" quota: http://wiki2.dovecot.org/Quota/Count Then if you also want to see the current quotas in Redis, you can use http://wiki2.dovecot.org/Plugins/QuotaClone Also, quota-dict is actually able to recalculate quota on missing keys, but specifically in Redis case its INCRBY command succeeds even if it didn't originally exist, so Dovecot doesn't detect it. And it would be pretty wasteful to do a GET every time before INCRBY. From tss at iki.fi Wed Apr 6 19:03:08 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 22:03:08 +0300 Subject: namespace...mailbox doesn't exist In-Reply-To: <570321A6.8040803@whitehorsetc.com> References: <570321A6.8040803@whitehorsetc.com> Message-ID: <354C43F2-4801-4983-A77E-005E0C736B8D@iki.fi> On 05 Apr 2016, at 05:23, Eric wrote: > > Hello list, > > I have a namespace called 'projects' which when clicked in Thunderbird (nonexistent in eM Client) yields the following error: > > "The current operation on 'projects' did not succeed. The mail server for account > user at domain.tld responded: mailbox doesn't exist: projects.projects (0.00 + 0.00 secs)." > > The namespace is configure as follows: > > # Shared namespace 'projects' > namespace { > location = maildir:/home/vpopmail/domains/domain.tld/shared/projects > prefix = projects. > separator = . > type = public > } Try talking IMAP protocol to see what's actually happening here: telnet localhost 143 a login user pass b list "" * Also what's actually supposed to exist under the projects? ls -a /home/vpopmail/domains/domain.tld/shared/projects ? From mail at tomsommer.dk Wed Apr 6 19:09:07 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Wed, 06 Apr 2016 21:09:07 +0200 Subject: Opportunistic quota recalc In-Reply-To: References: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> Message-ID: <37a6b68e75d99db0507399edf935f73b@tomsommer.dk> On 2016-04-06 20:38, Timo Sirainen wrote: > On 06 Apr 2016, at 13:43, Tom Sommer wrote: >> >> I'm switching quota backend to redis (from maildir++), so all my >> current usages are reset. >> >> I get that I can do "doveadm quota recalc -A", but it takes forever >> (and auth processes time out/crash). >> >> It would make much more sense to recalc the usage on login if the >> current usage is unset. Is there no way to do a >> recalc-quota-on-first-login? > > I'd actually recommend switching to "count" quota: > http://wiki2.dovecot.org/Quota/Count I tried count, but it crashes because of dotlocks :) There is another post about it :) > Then if you also want to see the current quotas in Redis, you can use > http://wiki2.dovecot.org/Plugins/QuotaClone > > Also, quota-dict is actually able to recalculate quota on missing > keys, but specifically in Redis case its INCRBY command succeeds even > if it didn't originally exist, so Dovecot doesn't detect it. And it > would be pretty wasteful to do a GET every time before INCRBY. Well, GET is cheap in redis, so - But I get what you are saying. -- Tom From mail at tomsommer.dk Wed Apr 6 19:14:03 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Wed, 06 Apr 2016 21:14:03 +0200 Subject: Internal quota calculation error (redis), double mail delivery In-Reply-To: <56C62867-B12E-4C7C-93EB-E1DD3993CE11@iki.fi> References: <9038d859204bad0db3af82b42c60473b@tomsommer.dk> <56C62867-B12E-4C7C-93EB-E1DD3993CE11@iki.fi> Message-ID: On 2016-04-06 20:27, Timo Sirainen wrote: > On 06 Apr 2016, at 16:54, Tom Sommer wrote: >> >> Sometimes my redis connection times out, both for pop3, imap and lmtp. >> I have no idea why, when I do a "doveadm quota recalc -u" it works >> just fine? >> I'm thinking the connection is lost somehow and not retried? >> >> Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: redis: Lookup timed out in >> 30.000 secs >> Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: Internal quota calculation >> error >> Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: Internal quota calculation >> error >> Apr 06 15:42:00 lmtp(xxx at xxx.com): Info: xxxx: msgid=: >> saved mail to INBOX >> Apr 06 15:49:23 lmtp(xxx at xxx.com): Info: xxxx: msgid=: >> saved mail to INBOX <-- Same mail >> >> This happens a lot, and it's really bad, because the mail is actually >> saved correctly, but the error is reported back to the Director, >> causing the delivery to be retried by the MTA - so the mail actually >> lands *twice* in the user's inbox. > > 1) Shrink the timeout in Redis with timeout_msecs parameter. > http://wiki2.dovecot.org/Dictionary Yea, but why is it taking 30 seconds anyway? I'll try and lower it, but I suspect I'll just get 10.000 secs errors instead? > 2) Actually it looks like the timeout handling code doesn't work at > all. It simply keeps on logging timeouts until it succeeds or the > connection gets disconnected. Do you see such repeated timeout logs, > or does the connection also happen to get closed exactly at 30 seconds > anyway? This fixes: > https://github.com/dovecot/core/commit/2fb829dc7cc8c61dee925a15e51768a4b82e45da I see a lot of them, but none repeated after eachother. It's more of a random pattern. > 3) Is there some firewall between Dovecot and Redis that closes idling > connections and causes them to hang? Dovecot doesn't close idle Redis > connections, although I suppose it would be useful too. The attached > patch probably helps here by adding a new idle_timeout_msecs setting. > I didn't finish testing it. No firewall at all. I'm unsure if redis closes idle connections, that could be the cause of it. What about the issue of lmtp saving the mail, but sending an error back to Director? Thanks :) -- Tom From tss at iki.fi Wed Apr 6 19:18:29 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 22:18:29 +0300 Subject: doveadm sync -1 -R In-Reply-To: <5F5A1A66-CA50-4F7D-8AA9-FDD580259299@willert.de> References: <5F5A1A66-CA50-4F7D-8AA9-FDD580259299@willert.de> Message-ID: <3B135B42-BD29-4BE1-A947-D5819DB23BAB@iki.fi> On 05 Apr 2016, at 13:49, Lukas Kolbe wrote: > > For each invoke of doveadm backup -R, the local (new) mailbox gets wiped and all mails are retransferred - so far, so good. I?d like to use "doveadm sync -1? as per the manpage to keep the downtime short, however sync doesn?t like the -R option: > > sync: invalid option -- 'R' > doveadm sync [-u |-A] [-S ] [-1fPU] [-l ] [-r ] [-m ] [-g ] [-n | -N] [-x ] [-s ] -d| > > If I understand it correctly, without -R it would mean that doveadm sync would incorporate the changes from the local dovecot-mailbox into the remote imapc:-Mailbox, which is the opposite of what I want. I completely forgot doveadm sync -1 when I removed -R :( Reverted original "fix": https://github.com/dovecot/core/commit/eba17ecf3a70c10010cd893f3c1a0c1ddd9c5bc0 This is what it should have been: https://github.com/dovecot/core/commit/53c42948d25b1593c1d16a71799c0ffe8d80aa79 From tss at iki.fi Wed Apr 6 19:22:53 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 22:22:53 +0300 Subject: Internal quota calculation error (redis), double mail delivery In-Reply-To: References: <9038d859204bad0db3af82b42c60473b@tomsommer.dk> <56C62867-B12E-4C7C-93EB-E1DD3993CE11@iki.fi> Message-ID: <68AAC6C2-A722-407B-BD5B-7F3DA11C37D3@iki.fi> On 06 Apr 2016, at 22:14, Tom Sommer wrote: > > > On 2016-04-06 20:27, Timo Sirainen wrote: >> On 06 Apr 2016, at 16:54, Tom Sommer wrote: >>> Sometimes my redis connection times out, both for pop3, imap and lmtp. I have no idea why, when I do a "doveadm quota recalc -u" it works just fine? >>> I'm thinking the connection is lost somehow and not retried? >>> Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: redis: Lookup timed out in 30.000 secs >>> Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: Internal quota calculation error >>> Apr 06 15:42:00 lmtp(xxx at xxx.com): Error: Internal quota calculation error >>> Apr 06 15:42:00 lmtp(xxx at xxx.com): Info: xxxx: msgid=: saved mail to INBOX >>> Apr 06 15:49:23 lmtp(xxx at xxx.com): Info: xxxx: msgid=: saved mail to INBOX <-- Same mail >>> This happens a lot, and it's really bad, because the mail is actually saved correctly, but the error is reported back to the Director, causing the delivery to be retried by the MTA - so the mail actually lands *twice* in the user's inbox. >> 1) Shrink the timeout in Redis with timeout_msecs parameter. >> http://wiki2.dovecot.org/Dictionary > > Yea, but why is it taking 30 seconds anyway? I'll try and lower it, but I suspect I'll just get 10.000 secs errors instead? I don't know. Possibly a hanging TCP connection. That's why I was asking about the firewall. If it's not that, I don't really know. And yes, just shrinking this without the below fix won't help anything. >> 2) Actually it looks like the timeout handling code doesn't work at >> all. It simply keeps on logging timeouts until it succeeds or the >> connection gets disconnected. Do you see such repeated timeout logs, >> or does the connection also happen to get closed exactly at 30 seconds >> anyway? This fixes: >> https://github.com/dovecot/core/commit/2fb829dc7cc8c61dee925a15e51768a4b82e45da > > I see a lot of them, but none repeated after eachother. It's more of a random pattern. Maybe something triggers after 30 seconds elsewhere that also aborts the lookup.. >> 3) Is there some firewall between Dovecot and Redis that closes idling >> connections and causes them to hang? Dovecot doesn't close idle Redis >> connections, although I suppose it would be useful too. The attached >> patch probably helps here by adding a new idle_timeout_msecs setting. >> I didn't finish testing it. > > No firewall at all. I'm unsure if redis closes idle connections, that could be the cause of it. Closing a connection is fine. That causes Dovecot to just reconnect. > What about the issue of lmtp saving the mail, but sending an error back to Director? I guess the LMTP proxy_timeout in director is 30 seconds or lower. If backend's timeouts are smaller than that, director won't have to disconnect LMTP due to timeout and there won't be duplicates. Or just increase the director's proxy_timeout to several minutes. From tss at iki.fi Wed Apr 6 19:27:44 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 22:27:44 +0300 Subject: fts_solr: Lookup failed: 400 Bad Request / GET null null In-Reply-To: References: <5701268C.703@rename-it.nl> Message-ID: <9DA7CE29-342A-4337-98B3-8D001D9EEFEA@iki.fi> On 05 Apr 2016, at 11:33, Chris Laif wrote: > > I've captured some requests and they look like this (some parts > changed due to privacy concerns): > > GET /solr/select?fl=uid,score&rows=439&sort=uid+asc&q={!lucene+q.op%3dAND}hdr:%3c56Fxxxx3A6.7080904 at domain.de%3e+OR+hdr:%3c664DCDxxxxx1A4FACD8B7922C495FEF at CZCHOWS1356.prg%5c-domain.com%3e+OR+hdr:%3c00cxxxxxde3$70ad7880$52 > ... (many many more OR hdrs) > &fq=%2Bbox:f696f93xxxxxx6e+%2Buser:user at domain.de HTTP/1.1 > > The total request size is 31708 bytes and it contains many (hundreds?) > of 'OR hdrs' (side note: I wonder which client action triggers these > kind of requests, maybe the user selected hundreds of mails for > search?) I bet this is the weird iOS client stupidity where they for some weird reason started issuing commands like: SEARCH OR HEADER Message-ID id1 OR HEADER Message-ID id2 OR HEADER Message-ID id3 ... With the entire command about ~32 kB. It does it for every single message in the folder. Why not simply FETCH 1:* HEADER.FIELDS[Message-ID] and do the matching itself.. > I _think_ this is a problem of the URL length / max http header size. > (Debian Jessie) Tomcat7 very likely does not accept more than 32kb > data in a request. > > I wonder if Dovecot should limit SOLR requests to a specific size and > deny long requests with an imap error (?) Or just issue multiple Solr requests.. In any case, troublesome.. Could those limits be just increased in Tomcat? From mail at tomsommer.dk Wed Apr 6 19:33:00 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Wed, 06 Apr 2016 21:33:00 +0200 Subject: Internal quota calculation error (redis), double mail delivery In-Reply-To: <68AAC6C2-A722-407B-BD5B-7F3DA11C37D3@iki.fi> References: <9038d859204bad0db3af82b42c60473b@tomsommer.dk> <56C62867-B12E-4C7C-93EB-E1DD3993CE11@iki.fi> <68AAC6C2-A722-407B-BD5B-7F3DA11C37D3@iki.fi> Message-ID: On 2016-04-06 21:22, Timo Sirainen wrote: >> Yea, but why is it taking 30 seconds anyway? I'll try and lower it, >> but I suspect I'll just get 10.000 secs errors instead? > > I don't know. Possibly a hanging TCP connection. That's why I was > asking about the firewall. If it's not that, I don't really know. And > yes, just shrinking this without the below fix won't help anything. Indeed. I have antivirus on the same server doing redis to the same redis-server, with no errors. >> What about the issue of lmtp saving the mail, but sending an error >> back to Director? > > I guess the LMTP proxy_timeout in director is 30 seconds or lower. If > backend's timeouts are smaller than that, director won't have to > disconnect LMTP due to timeout and there won't be duplicates. Or just > increase the director's proxy_timeout to several minutes. proxy_timeout is not set, I'm unsure of the default. I've raised it to 120 now. This is the log from director: Apr 06 15:42:00 lmtp(46187): Error: xxxx: Failed to send message to at xxx.xxx.com:24: 451 4.4.0 Remote server not answering (timeout while waiting for reply to DATA reply) <5vWKIVUIBVdrtAAA1VGibg> (1/1 at 30067 ms) So yea, guess the timeout was 30 there as well. From tss at iki.fi Wed Apr 6 19:36:23 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 22:36:23 +0300 Subject: Migrating from Olde server to Dovecot In-Reply-To: References: Message-ID: <985CCC46-9E3E-4799-9141-41C24DB06CFF@iki.fi> On 04 Apr 2016, at 09:49, Hendrik Velloen wrote: > > Hi > > dsync(hendrikv at tcmvpn.co.za): Error: pop3c(196.26.136.162): AUTH PLAIN > failed: -ERR Invalid command, try one of: USER name, PASS string, APOP name > digest, QUIT Dovecot tries to use AUTH PLAIN instead of the regular USER+PASS. I think you have set pop3c_master_user setting, which enables this behavior. From tss at iki.fi Wed Apr 6 19:41:56 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 22:41:56 +0300 Subject: enable/disable shared namespace in passdb In-Reply-To: <570241CB.3010005@oleane.net> References: <570241CB.3010005@oleane.net> Message-ID: On 04 Apr 2016, at 13:28, abi at oleane.net wrote: > > namespace shared { > type = shared > list = yes # children > disabled = yes > separator = / > prefix = shared/%%u/ > location = imapc:~/dovemail/shared/%%u/ > } Don't you get a warning with this? Warning: Obsolete setting in dovecot.conf:1: namespace shared {} has been replaced by namespace { type=shared } This is because of the v1.x dovecot.conf auto-conversion code. Try giving it a different name than "shared" and see if it works. From ebroch at whitehorsetc.com Wed Apr 6 19:43:39 2016 From: ebroch at whitehorsetc.com (Eric) Date: Wed, 6 Apr 2016 13:43:39 -0600 Subject: namespace...mailbox doesn't exist In-Reply-To: <354C43F2-4801-4983-A77E-005E0C736B8D@iki.fi> References: <570321A6.8040803@whitehorsetc.com> <354C43F2-4801-4983-A77E-005E0C736B8D@iki.fi> Message-ID: <570566EB.8040807@whitehorsetc.com> Timo, b list "" * . . . * LIST (\HasChildren) "." projects * LIST (\HasNoChildren) "." projects.xxx * LIST (\HasNoChildren) "." projects.yyy * LIST (\HasNoChildren) "." projects.zzz . . . . more projects children * OK List completed (0.00 + 0.00 secs). And ls -a /home/vpopmail/domains/domain.tld/shared/projects .xxx .yyy .zzz cur dovecot.index.cache dovecot.index.log dovecot.mailbox.log dovecot.mailbox.log.2 dovecot-uidlist dovecot-uidvalidity dovecot-uidvalidity.4d991164 new subscriptions tmp Eric On 4/6/2016 1:03 PM, Timo Sirainen wrote: > On 05 Apr 2016, at 05:23, Eric wrote: >> Hello list, >> >> I have a namespace called 'projects' which when clicked in Thunderbird (nonexistent in eM Client) yields the following error: >> >> "The current operation on 'projects' did not succeed. The mail server for account >> user at domain.tld responded: mailbox doesn't exist: projects.projects (0.00 + 0.00 secs)." >> >> The namespace is configure as follows: >> >> # Shared namespace 'projects' >> namespace { >> location = maildir:/home/vpopmail/domains/domain.tld/shared/projects >> prefix = projects. >> separator = . >> type = public >> } > Try talking IMAP protocol to see what's actually happening here: > > telnet localhost 143 > a login user pass > b list "" * > > Also what's actually supposed to exist under the projects? ls -a /home/vpopmail/domains/domain.tld/shared/projects ? From tss at iki.fi Wed Apr 6 20:23:46 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 6 Apr 2016 23:23:46 +0300 Subject: namespace...mailbox doesn't exist In-Reply-To: <570566EB.8040807@whitehorsetc.com> References: <570321A6.8040803@whitehorsetc.com> <354C43F2-4801-4983-A77E-005E0C736B8D@iki.fi> <570566EB.8040807@whitehorsetc.com> Message-ID: So there is no such folder as "projects.projects"? I don't know why Thunderbird would try to open it then. Maybe it wasn't Dovecot upgrade but Thunderbird upgrade that started breaking it? You could also see if LSUB "" * lists a "projects.projects". > On 06 Apr 2016, at 22:43, Eric wrote: > > Timo, > > b list "" * > > . > . > . > * LIST (\HasChildren) "." projects > * LIST (\HasNoChildren) "." projects.xxx > * LIST (\HasNoChildren) "." projects.yyy > * LIST (\HasNoChildren) "." projects.zzz > . > . > . > . > more projects children > * OK List completed (0.00 + 0.00 secs). > > And > > ls -a /home/vpopmail/domains/domain.tld/shared/projects > > .xxx > .yyy > .zzz > cur > dovecot.index.cache > dovecot.index.log > dovecot.mailbox.log > dovecot.mailbox.log.2 > dovecot-uidlist > dovecot-uidvalidity > dovecot-uidvalidity.4d991164 > new > subscriptions > tmp > > Eric > > > > On 4/6/2016 1:03 PM, Timo Sirainen wrote: >> On 05 Apr 2016, at 05:23, Eric wrote: >>> Hello list, >>> >>> I have a namespace called 'projects' which when clicked in Thunderbird (nonexistent in eM Client) yields the following error: >>> >>> "The current operation on 'projects' did not succeed. The mail server for account >>> user at domain.tld responded: mailbox doesn't exist: projects.projects (0.00 + 0.00 secs)." >>> >>> The namespace is configure as follows: >>> >>> # Shared namespace 'projects' >>> namespace { >>> location = maildir:/home/vpopmail/domains/domain.tld/shared/projects >>> prefix = projects. >>> separator = . >>> type = public >>> } >> Try talking IMAP protocol to see what's actually happening here: >> >> telnet localhost 143 >> a login user pass >> b list "" * >> >> Also what's actually supposed to exist under the projects? ls -a /home/vpopmail/domains/domain.tld/shared/projects ? From cell at eceb.co.uk Wed Apr 6 20:41:12 2016 From: cell at eceb.co.uk (Mobile Phone) Date: Wed, 6 Apr 2016 21:41:12 +0100 Subject: Intermittent IMAP Login failures - about 25% fail Message-ID: New server & just added three domains: now I see "dovecot: imap-login: Aborted login (auth failed, 1 attempts in 5 secs): user=, method=PLAIN, rip=1.1.1.1, lip=99.99.99.99, TLS, session=" Plus all Outlook users keep being bounced and finally get in. I am going to kill all the users soon... Not too many files open, nor bandwidth, nor load. Any light/help appreciated. root at brazil:/var/log# dovecot --version 2.2.9 root at brazil:/var/log# dovecot -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.19.0-58-generic x86_64 Ubuntu 14.04.4 LTS auth_debug_passwords = yes auth_mechanisms = plain login mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap pop3 pop3 ssl_cert = References: <1459941911555-55752.post@n4.nabble.com> Message-ID: <57058766.6060408@rename-it.nl> Op 4/6/2016 om 1:25 PM schreef wuwei: > hi all > edit via vi editor to change dovecot.sieve and enotify works fine.but > when I telnet 4190 port via managesieve to edit it with the same code,the > managesieve said "NO "Error in MANAGESIEVE command CHECKSCRIPT: "", find > many topic in wiki and maillist but not solved. > need you help!thanks!!dovecot version 2.2.15,pigonhole version 0.4.4 > here are more infos below: > *managesieve cmds:* > "IMPLEMENTATION" "Dovecot Pigeonhole" > "SIEVE" "fileinto reject envelope encoded-character vacation subaddress > comparator-i;ascii-numeric relational regex imap4flags copy include > variables body enotify environment mailbox date ihave duplicate > vacation-seconds" > "NOTIFY" "mailto" > "SASL" "PLAIN LOGIN" > "VERSION" "1.0" > OK "Dovecot ready." > listscripts > NO "Error in MANAGESIEVE command received by server." > AUTHENTICATE "PLAIN" "AGFuZ196aGFAdG9tLmNvbQAxMTExMTE=" > OK "Logged in." > listscripts > "blackwhitelist" > "rulefilter" ACTIVE > OK "Listscripts completed." > getscript "rulefilter" > {471} > require > ["reject","fileinto","imap4flags","vacation","regex","encoded-character","include","copy","enotify","variables"]; > if header :matches "Subject" "*" { > set "Subject" "${1}"; > } > if header :matches "From" "*" { > set "From" "${1}"; > } > if header :matches "Message-ID" "*" { > set "msg_id" "${1}"; > } > if header :matches "To" "*" { > set "To" "${1}"; > } > if header :matches "Date" "*" { > set "Date" "${1}"; > } > notify "mailto:wuweiwwd at tom.com"; > > OK "Getscript completed." > checkscript {471} > require > ["reject","fileinto","imap4flags","vacation","regex","encoded-character","include","copy","enotify","variables"]; > if header :matches "Subject" "*" { > set "Subject" "${1}"; > } > if header :matches "From" "*" { > set "From" "${1}"; > } > if header :matches "Message-ID" "*" { > set "msg_id" "${1}"; > } > if header :matches "To" "*" { > set "To" "${1}"; > } > if header :matches "Date" "*" { > set "Date" "${1}"; > } > notify "mailto:wuweiwwd at tom.com"; > *NO "Error in MANAGESIEVE command CHECKSCRIPT: "* > BYE "Disconnected for inactivity" > Connection closed by foreign host. Copy-pasting in your terminal does not necessarily preserve TABs and newlines as-is. This means that the {471} bytes for the length of what you're pasting is probably not correct (in this case too low). The rest of the script is then interpreted as subsequent commands. causing obscure errors. I find it difficult to tell for sure how many bytes it will be. If you're just fooling around, you could try a byte count that is a little too high and bridge the gap with spaces and newlines; eventually it will be accepted. Why are you doing this anyway? If you upgrade to Pigeonhole v0.4.7+, you can manage scripts from command line using the "doveadm sieve" command. If that is not an option, there are a few command line ManageSieve clients available; e.g., "sieve-connect". Regards, Stephan. From tss at iki.fi Wed Apr 6 22:39:16 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 7 Apr 2016 01:39:16 +0300 Subject: "Lost" e-mail after alternate partition offline In-Reply-To: References: Message-ID: <9BE6698F-DE50-43D7-AAEF-E05BEF45C1C4@iki.fi> On 01 Apr 2016, at 21:15, Daniel van Ham Colchete wrote: > > Hey guys! > > I've got a problem here and I wish you could help me. A drive failed here > and went offline for some time. This was a alternate storage drive so it > took a while (hours) for us to notice. There was a problem with DRBD also, > so it didn't move to the redundancy, it just went offline. It's a good idea to keep the alt storage mountpoint directory's permissions so that Dovecot doesn't have read permissions to it unless it's mounted. That way Dovecot would just start logging errors instead of thinking that the alt storage mails are lost. > I was able to recover all the files there, but a few of my users still > don't see their old e-mails, the ones that are supposed to be on the > alternate storage. > > From what I could troubleshoot here file are there, vmail user can access > them, so it's not a permission issue, but a doveadm dump on the index file > of each mail folder, won't show the e-mail at the alternate storage drive. > > So, they are there (at the filesystem), but they aren't (from a imap > client). > > Is there a way to rebuild the dovecot.index file, re-adding everything back > to each folder? There aren't any easy ways to fix it except doveadm fore-resync. From simonpie at cs.mcgill.ca Thu Apr 7 00:26:25 2016 From: simonpie at cs.mcgill.ca (Simon Pierre Desrosiers) Date: Wed, 6 Apr 2016 20:26:25 -0400 Subject: State for dsync not working In-Reply-To: References: Message-ID: <9CA77B04-6AE9-43BB-85AA-184B6F696625@cs.mcgill.ca> No one will answer, so I will provide my own answer for posterity. The -s flag does not accept a file, but a string. So a correct for loop would be the following : for user in $userlist ; do state=$(cat "/Users/_dovecot/.bin/syncStates/syncstate$user" ) doveadm sync -u $user -s $state tcp:xxx.xxx.xxx.xxx > "/Users/_dovecot/.bin/syncStates/syncstate$user" done Hope it helps someone. > > ------------------------------ > > Message: 3 > Date: Fri, 25 Mar 2016 19:26:11 -0400 > From: Simon Pierre Desrosiers > To: dovecot at dovecot.org > Subject: State for dsync not working. > Message-ID: > Content-Type: text/plain; charset=us-ascii > > Hello, > > Since replication does not seem to work on Mac OSX, I will run doveadm sync by hand every few minutes. > > In order to improve efficiency, I would like to use state. I have tried a few ways, but I always get the following error > doveadm(user): Error: Saved sync state is invalid, falling back to full sync: Invalid base64 data > KBtMOd0181bQ/wAAoQsxE90181YBAAAAAQAAAAAAAAAAAAAAAAAAABtI+mg= > > > Here is the code I use to sync : > for user in $userlist ; do > doveadm sync -u $user -s "/Users/_dovecot/.bin/syncStates/syncstate$user" tcp:xxx.xxx.xxx.xxx > "/Users/_dovecot/.bin/syncStates/syncstate$user" > done > > Any idea on how I can correct the encoding error ? > > Thank you > > ------------------------------ > > Message: 4 > Date: Sat, 26 Mar 2016 13:30:03 +1000 > From: Noel Butler > To: dovecot at dovecot.org > Subject: Re: NetApp NFS vs. ZFS and NFS for Maildir > Message-ID: <79e7f44d74014b5c83d370d74e02205b at ausics.net> > Content-Type: text/plain; charset=US-ASCII; format=flowed > > It seems its troll time again on this list, ohh maybe its Harry in > disguise... So I will play along, for today anyway :) > > > On 19/03/2016 18:11, Stephan von Krawczynski wrote: >> On Sat, 19 Mar 2016 17:37:04 +1000 >> Noel Butler wrote: >> >>> On 14/03/2016 18:49, Stephan von Krawczynski wrote: >>>> >>>>> >>>>> and you've never seen these cause problems with FS? then you must be >>>>> a >>>>> newbie, in over 25 years I've seen it happen several times - yes even >>>>> after an apparent controlled shutdown. >>>> >>>> Maybe you're doing something wrong then. because in my last 21 years >>>> working >>>> exactly in this business I've not seen a single deadly fs-crash because >>>> of a >>>> power-outage. Not one. And we had of course several, all backed by UPS. >>> >>> Consider yourself lucky, Most network admins whove been around large >>> busy ISP DC's have seen this in their lifetime, to not have seen one >>> is >>> rare, go buy yourself a lotto ticket :) >>> >>>> >>>> If your servers get drowned with water during a fire your fs is >>>> probably the >>>> least of your worries. You don't really plan to re-enable servers with >>>> water- or fire-damage, do you? That's probably why there shouldn't be a >>>> fireman pouring water in the first place. >>> >>> This shows you dont understand structural engineering, the fire does >>> not >>> have to be on your floor, it can be far away as two or so levels >>> above, >>> with the high pressure water used - equating to a shitload of water, >>> there are ducts, shafts, other risers and so on that with a shit-tone >>> of >>> water can easily penetrate fireblocks of floors below - dont take my >>> work, go ask a fireman, or maybe watch the nightly news sometime >>> (building fire - many levels water affected blah blah blah)... so >>> keeping those boxes on via UPS's is asking for lots of charcoaled >>> boards >>> and fried drives. IOW, total stupidity. >>> >>> Should those machines be depowered as required by our building codes, >>> well, might take a few days of drying out but at least they will power >>> back up without error - yes, done it in risk assessments. >> > >> Obviously you must work for people that have not the slightest idea >> about >> using hardware in a correct way and don't know when the time has come >> to throw > >> it away. Man, there is no way to let a drowned box survive. It is not >> back to > > Wow, how long did you allege to have been in network/sys admin? 20 > years? Really? I think you made a typo and and it should have read 20 > minutes, ya know I have refrained from posting no here for a long time > (apart from fact I rarely read the list), and I was not going to feed > the trolls, but sometimes the smart mouthed know nothing, need to bitch > slap upside the head so thats why I am devoting about 60 seconds to you. > > Of course there is, networks dont throw away many hundreds of servers > valued $7K to $10K, nor $100K+ storage systems, or $40K routers, LB's or > switches, just because they got drenched - with power isolated. > > >> normal when it is dry. If you don't get that I am pretty happy to be no >> customer. This can only be an idea born in the sick mind of a >> controller who > > You will never be a customer _or_employee_ of mine, trust me on that > one! > >> didn't want to pay insurance in the first place. We are talking about >> serious > > Got nothing to with insurance, it might take 2 days to dry out and get > back up and running, it will take an awful lot longer to get offsite > backups and restore every last one of them. > > I hope your employer reads this list, because he/she should be seeing > alarm bells from your comments. > >> corrosion effects here let alone that you have a hard time even >> knowning when > > yep, you sure did fail basic engineering > >> your boxes are really dry. Your fireman on the other hand seem to be >> stuck in >> the 80ths. Today there are solar panels almost everywhere _which you >> cannot >> turn off_. > > Wow, you really are clutching the fantasy straws arnt you, perhaps your > country lacks modernisation, I can go to the side of my house and > isolate the panels with a flick of a switch, strangely enough and I > guess in your eyes horrifyingly called "solar isolator" that stops the > panels providing power to my electrical circuits, yes, there might be > power from panels to it, but thats not going to affect my power circuits > or equipment > > > > -- > If you have the urge to reply to all rather than reply to list, you best > first read http://members.ausics.net/qwerty/ > > > ------------------------------ > > Message: 5 > Date: Sat, 26 Mar 2016 13:34:34 +1000 > From: Noel Butler > To: dovecot at dovecot.org > Subject: Re: Email hosting provider > Message-ID: <2b1abc9c94e3f1322753d7547cb991e4 at ausics.net> > Content-Type: text/plain; charset=UTF-8; format=flowed > > On 21/03/2016 17:06, Andre Rodier wrote: >> Hello, >> >> Sorry if I am off topic a little. >> >> I am looking for an email host provider that supports dovecot, sieve >> and manage sieve. Ideally with the roundcube webmail and managesieve >> plugin >> >> Better if it is in Europe or switzerland. I don't mind paying a little. >> >> Thanks, >> Andr?. > > Hi Andre, > > see www.webhostingtalk.com > > There are a number of reliable and reasonable priced hosts in Germany > (best place if you value your privacy) and Netherlands. > > > -- > If you have the urge to reply to all rather than reply to list, you best > first read http://members.ausics.net/qwerty/ > > > ------------------------------ > > Message: 6 > Date: Sat, 26 Mar 2016 10:52:33 +0530 > From: Joy > To: Joseph Tam > Cc: Dovecot Mailing List > Subject: Re: IMAP Idle > Message-ID: > > Content-Type: text/plain; charset=UTF-8 > > I am ok if connection is closed automatically after 30 min if client is not > responding but connection is not being closed even after 2 days. > > > On Sat, Mar 26, 2016 at 2:52 AM, Joseph Tam wrote: > >> Joy wrote: >> >> We have implement imap idle in web mail built by us to have >>> push mail feature. IMAP idle working perfectly with browser notification >>> and we are happy with it but having one issue with users who close the >>> browser directly and never logout in that case there are number of idle >>> connection which are not in use and users are unable to login once IP wise >>> connection limit is reached. >>> >>> Dovecot is not closing connection which are not in use, is there any >>> setting available which can help me to resolve this issue. >>> >> >> I had much the same situation where a user signed up with a roaming >> wireless carrier that assigned a new IP to the client whenever it got >> passed from one access point to another. Good fun when this person >> took a bus ride through the city, leaving orphaned connections in >> its wake. >> >> The IDLE disconnection timeout is hardwired in the Dovecot code >> >> http://wiki.dovecot.org/Timeouts >> >> It's set to the RFC minimum of 30min. You'll have to recompile Dovecot >> to lower this to a non-RFC compliant value. I'm not sure how this this >> will affect clients, but 30min seems to be overly generous. >> >> Joseph Tam >> > > > ------------------------------ > > Message: 7 > Date: Sat, 26 Mar 2016 08:04:33 +0100 > From: Stephan von Krawczynski > To: dovecot at dovecot.org > Subject: Re: Email hosting provider > Message-ID: <20160326080433.07fcf216.skraw at ithnet.com> > Content-Type: text/plain; charset=ISO-8859-1 > > On Sat, 26 Mar 2016 13:34:34 +1000 > Noel Butler wrote: > >> On 21/03/2016 17:06, Andre Rodier wrote: >>> Hello, >>> >>> Sorry if I am off topic a little. >>> >>> I am looking for an email host provider that supports dovecot, sieve >>> and manage sieve. Ideally with the roundcube webmail and managesieve >>> plugin >>> >>> Better if it is in Europe or switzerland. I don't mind paying a little. >>> >>> Thanks, >>> Andr?. >> >> Hi Andre, >> >> see www.webhostingtalk.com >> >> There are a number of reliable and reasonable priced hosts in Germany >> (best place if you value your privacy) and Netherlands. > > You mean "best place if you have no idea of the german laws and whats really > going on" ... > > -- > Regards, > Stephan > > > ------------------------------ > > Message: 8 > Date: Sat, 26 Mar 2016 10:48:47 +0000 > From: michael crane > To: dovecot at dovecot.org > Subject: mailbox prefix > Message-ID: > > Content-Type: text/plain; charset=UTF-8 > > dovecot version 2.2.13 > > hello, > I try to make a new server just for me after having old one working for > ages with Dovecot, Fetchmail, Squirrelmail, Procmail > making new one with above plus Postfix using Maildir structure. > I am having a bit of trouble understanding exactly what the namespace and > prefix are. > Is the "private/" prefix an internal thing with Dovecot ? Or is it supposed > to be a real directory ? > I'm not quite sure how to properly address the INBOX in Procmail, > Squirrelmail, Postfix config. > > > for example am I supposed to say inbox is ".private/.INBOX" > > > > cheers > > zemlik > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > dovecot mailing list > dovecot at dovecot.org > http://dovecot.org/cgi-bin/mailman/listinfo/dovecot > > ------------------------------ > > End of dovecot Digest, Vol 155, Issue 45 > **************************************** From pernovana-dovecot at yahoo.com Thu Apr 7 02:21:08 2016 From: pernovana-dovecot at yahoo.com (Hamy) Date: Thu, 7 Apr 2016 02:21:08 +0000 (UTC) Subject: What is dovecot.socket and do i need it? References: <81287989.656408.1459995668883.JavaMail.yahoo.ref@mail.yahoo.com> Message-ID: <81287989.656408.1459995668883.JavaMail.yahoo@mail.yahoo.com> Helloafter rebooting the server, i keep getting these errors in mail.err : Apr? 7 06:08:09 main dovecot: master: Error: systemd listens on port 143, but it's not configured in Dovecot. Closing.????????????????????????????????????????????????? Apr? 7 06:08:09 main dovecot: master: Error: systemd listens on port 993, but it's not configured in Dovecot. Closing.????????????????????????????????????????????????? Apr? 7 06:08:09 main dovecot: master: Error: systemd listens on port 993, but it's not configured in Dovecot. Closing.????????????????????????????????????????????????? And then dovecot refuses any connection. the problem is solved if i do a manual restart of dovecot.service. After some search, i found 2 different solutions, one suggesting disabling dovecot.socket completely, the other one adjusting its settings: https://sowhatisthesolution.wordpress.com/2015/04/27/upgrading-dovecot-debian-wheezy-to-jessie/http://appbead.com/blog/fix-errors-reported-in-syslog-for-debian-8-jessie.html I also found an old thread in the mailing list that might be relevant: http://dovecot.org/list/dovecot/2012-March/134376.html The errors indeed seem to go away if i disable dovecot.socket . I would be grateful is someone could help me understand the role of dovecot.socket , and why that error happens and what is the right way to solve it? PS: I am using Ubuntu server 15.10 and dovecot package v2.2.18 Best Regards, From gsue-dvctnews at gameduell.de Thu Apr 7 04:30:08 2016 From: gsue-dvctnews at gameduell.de (Georg Schuetze) Date: Thu, 7 Apr 2016 06:30:08 +0200 Subject: [Dovecot] Replication and public namespaces In-Reply-To: <56FCE92A.9000700@bgoperator.com> References: <52DA80D4.3000900@gekmihesg.de> <56E9795C.2040003@gameduell.de> <56EA4533.1080505@gameduell.de> <56FBF4A5.8000103@gameduell.de> <56FCE92A.9000700@bgoperator.com> Message-ID: <5705E250.4080205@gameduell.de> On 03/31/2016 11:08 AM, Sergey Schwartz wrote: > There is a workaround - limit replication scope with INBOX namespace > only. Sergey, thanks for pointing that out. I already thought of that, but this means, that i need some extra periodic replication for the public namespaces (hence on a failover, there is likely something missing). Best, Georg. From wuweiwwd at sina.com Thu Apr 7 04:28:48 2016 From: wuweiwwd at sina.com (wuwei) Date: Wed, 6 Apr 2016 21:28:48 -0700 (PDT) Subject: [help]enotify "mail to" run fine edit via managesieve 0.4.4 complied failed In-Reply-To: <57058766.6060408@rename-it.nl> References: <1459941911555-55752.post@n4.nabble.com> <57058766.6060408@rename-it.nl> Message-ID: <1460003328261-55777.post@n4.nabble.com> thanks a lot! now it works well.at first ,I copy other cmds, and it works.so I thought this error might be a configuration error. -- View this message in context: http://dovecot.2317879.n4.nabble.com/help-enotify-mail-to-run-fine-edit-via-managesieve-0-4-4-complied-failed-tp55752p55777.html Sent from the Dovecot mailing list archive at Nabble.com. From abi at oleane.net Thu Apr 7 09:40:18 2016 From: abi at oleane.net (abi at oleane.net) Date: Thu, 7 Apr 2016 11:40:18 +0200 Subject: enable/disable shared namespace in passdb In-Reply-To: References: <570241CB.3010005@oleane.net> Message-ID: <57062B02.6080908@oleane.net> Le 06/04/2016 21:41, Timo Sirainen a ?crit : > On 04 Apr 2016, at 13:28, abi at oleane.net wrote: >> >> namespace shared { >> type = shared >> list = yes # children >> disabled = yes >> separator = / >> prefix = shared/%%u/ >> location = imapc:~/dovemail/shared/%%u/ >> } > > Don't you get a warning with this? > > Warning: Obsolete setting in dovecot.conf:1: namespace shared {} has been replaced by namespace { type=shared } > > This is because of the v1.x dovecot.conf auto-conversion code. Try giving it a different name than "shared" and see if it works. > yes i get this exact warning i tried with and without given the fact that other namespaces parameters can be changed dynamically through passdb by returning "namespace"/NAMESPACE_NAME/PARAMETER=VALUE, i was hoping to do the same with shared namespaces which is why i added a name i'm wondering : is using shared namespaces with non generic acls and imapc currently supported in dovecot ? i'm running into 2 problems : --> the acl files are looked up in the filesystem in ~loggedin_user/.../shared/sharing_user/ rather than in ~sharing_user so the filesystem paths are not translated. i can circumvent with symlinks but i assume the ACLs should be looked up using imap or an extra location attribute could be added to the namespace so the acls are read in the proper location. --> the sharers might themselves have other people sharing with them so the imapc connections loop. i need a way to selectively disable the shared namespace. ( based on a specific port, the source address, something passed by imapc:, the fact that there is a master login... whatever works ) i'm ready to beta-test if that can help in any way thanks for your great work best regards alexis From abi at oleane.net Thu Apr 7 09:51:48 2016 From: abi at oleane.net (abi at oleane.net) Date: Thu, 7 Apr 2016 11:51:48 +0200 Subject: enable/disable shared namespace in passdb In-Reply-To: References: <570241CB.3010005@oleane.net> Message-ID: <57062DB4.10502@oleane.net> > > This is because of the v1.x dovecot.conf auto-conversion code. Try giving it a different name than "shared" and see if it works. > hello it does, and there is no warning. i feel foolish i did not bother to try thanks, that solves part of the problem best regards alexis From cell at eceb.co.uk Thu Apr 7 10:21:44 2016 From: cell at eceb.co.uk (Mobile Phone) Date: Thu, 7 Apr 2016 11:21:44 +0100 Subject: Fwd: Intermittent IMAP Login failures - about 25% fail In-Reply-To: References: Message-ID: New server & just added three domains: now I see "dovecot: imap-login: Aborted login (auth failed, 1 attempts in 5 secs): user=, method=PLAIN, rip=1.1.1.1, lip=99.99.99.99, TLS, session=" Plus all Outlook users keep being bounced and finally get in. Failure rate is a predictable 25% I am going to kill all the users soon... Not too many files open, nor bandwidth, nor load. Any light/help appreciated. root at brazil:/var/log# dovecot --version 2.2.9 root at brazil:/var/log# dovecot -n # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.19.0-58-generic x86_64 Ubuntu 14.04.4 LTS auth_debug_passwords = yes auth_mechanisms = plain login mail_location = maildir:~/Maildir namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } protocols = imap pop3 pop3 ssl_cert = I've set lmtp_user_concurrency_limit to 5 and now LMTP throws this at me for every delivery: Apr 07 13:38:33 lmtp(4434): Error: net_connect_unix(/var/run/dovecot/anvil) failed: Permission denied ls -l /var/run/dovecot/anvil srw------- 1 root root 0 Apr 7 13:32 /var/run/dovecot/anvil If I set lmtp_user_concurrency_limit to 0, the error goes away. -- Tom From mail at tomsommer.dk Thu Apr 7 11:49:39 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 07 Apr 2016 13:49:39 +0200 Subject: Opportunistic quota recalc In-Reply-To: <37a6b68e75d99db0507399edf935f73b@tomsommer.dk> References: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> <37a6b68e75d99db0507399edf935f73b@tomsommer.dk> Message-ID: <11b843dcfa9d753dcaeeab033a7f0dfa@tomsommer.dk> On 2016-04-06 21:09, Tom Sommer wrote: > On 2016-04-06 20:38, Timo Sirainen wrote: >> On 06 Apr 2016, at 13:43, Tom Sommer wrote: >>> >>> I'm switching quota backend to redis (from maildir++), so all my >>> current usages are reset. >>> >>> I get that I can do "doveadm quota recalc -A", but it takes forever >>> (and auth processes time out/crash). >>> >>> It would make much more sense to recalc the usage on login if the >>> current usage is unset. Is there no way to do a >>> recalc-quota-on-first-login? >> >> I'd actually recommend switching to "count" quota: >> http://wiki2.dovecot.org/Quota/Count > > I tried count, but it crashes because of dotlocks :) There is another > post about it :) Any change you will have time to fix this? Because I would really love to switch to "count". From lkolbe at willert.de Thu Apr 7 12:23:46 2016 From: lkolbe at willert.de (Lukas Kolbe) Date: Thu, 7 Apr 2016 14:23:46 +0200 Subject: doveadm sync -1 -R In-Reply-To: <3B135B42-BD29-4BE1-A947-D5819DB23BAB@iki.fi> References: <5F5A1A66-CA50-4F7D-8AA9-FDD580259299@willert.de> <3B135B42-BD29-4BE1-A947-D5819DB23BAB@iki.fi> Message-ID: <99FA3CDF-0C1C-4D6C-A41A-66055CBB5772@willert.de> Hi, > Am 06.04.2016 um 21:18 schrieb Timo Sirainen : > > On 05 Apr 2016, at 13:49, Lukas Kolbe wrote: >> >> For each invoke of doveadm backup -R, the local (new) mailbox gets wiped and all mails are retransferred - so far, so good. I?d like to use "doveadm sync -1? as per the manpage to keep the downtime short, however sync doesn?t like the -R option: >> >> sync: invalid option -- 'R' >> doveadm sync [-u |-A] [-S ] [-1fPU] [-l ] [-r ] [-m ] [-g ] [-n | -N] [-x ] [-s ] -d| >> >> If I understand it correctly, without -R it would mean that doveadm sync would incorporate the changes from the local dovecot-mailbox into the remote imapc:-Mailbox, which is the opposite of what I want. > > I completely forgot doveadm sync -1 when I removed -R :( > > Reverted original "fix": https://github.com/dovecot/core/commit/eba17ecf3a70c10010cd893f3c1a0c1ddd9c5bc0 > > This is what it should have been: https://github.com/dovecot/core/commit/53c42948d25b1593c1d16a71799c0ffe8d80aa79 > Timo, thanks a lot - this seems to work now as expected! Kind regards, Lukas From mail at tomsommer.dk Thu Apr 7 12:27:29 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 07 Apr 2016 14:27:29 +0200 Subject: lmtp_rcpt_check_quota = yes silently blocks mail if quota check fails Message-ID: I have a user which has a quota-check that fails with 'Internal error', if I enable lmtp_rcpt_check_quota, the mail is silently tempfailed. Actually it looks like lmtp_rcpt_check_quota=yes suppresses normal Info/Error logging, even on Director. The MTA just gets " 451 4.3.0 Temporary internal error (in reply to end of DATA command)" from the director, but nothing is logged with lmtp_rcpt_check_quota=yes, anywhere. -- Tom From mail at tomsommer.dk Thu Apr 7 12:39:05 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Thu, 07 Apr 2016 14:39:05 +0200 Subject: Setting lmtp_user_concurrency_limit causes anvil permission error In-Reply-To: References: Message-ID: On 2016-04-07 13:41, Tom Sommer wrote: > I've set lmtp_user_concurrency_limit to 5 and now LMTP throws this at > me for every delivery: > > Apr 07 13:38:33 lmtp(4434): Error: > net_connect_unix(/var/run/dovecot/anvil) failed: Permission denied > > ls -l /var/run/dovecot/anvil > srw------- 1 root root 0 Apr 7 13:32 /var/run/dovecot/anvil > > If I set lmtp_user_concurrency_limit to 0, the error goes away. Hrm, if I disable lmtp_rcpt_check_quota, then the error goes away as well. Very confusing. From forondarena at gmail.com Thu Apr 7 13:01:07 2016 From: forondarena at gmail.com (Luis Ugalde) Date: Thu, 07 Apr 2016 13:01:07 +0000 Subject: ETOOMANYREFS related errors In-Reply-To: References: <25F66FDB-A06E-495B-A3B5-60B89DA2D133@iki.fi> Message-ID: Hi, I've been running a Debian-Jessie backported 4.4 kernel for the last few days, and I can confirm the same issue happening with this kernel as well. Regards, Luis El vie., 11 mar. 2016 a las 9:01, Luis Ugalde () escribi?: > El vie., 11 mar. 2016 a las 2:08, Timo Sirainen () escribi?: > >> On 11 Mar 2016, at 03:48, Luis Ugalde wrote: >> > >> > Hi, >> > >> > I'm starting to see, on a pretty standard Debian Jessie installation, >> some >> > error messages that are apparently related to the ETOOMANYREFS errno. >> > >> > Firstly, the mail log shows this: >> > dovecot: pop3-login: Error: fd_send(pop3, 18) failed: Too many >> references: >> > cannot splice >> >> Apparently because Linux thinks the same fd has been passed around >> recursively too many times: >> http://lkml.iu.edu/hypermail/linux/kernel/1101.0/01917.html >> >> But Dovecot doesn't pass it recursively. It's only passed once from >> pop3-login to pop3 process. >> >> > Is this something that Dovecot should be able to handle, or is it >> strictly >> > Debian/libc/MySillyMistake related? >> > >> > #uname -a >> > Linux server 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt20-1+deb8u3 >> > (2016-01-17) x86_64 GNU/Linux >> >> I wonder if there's a new kernel change that started detecting the >> recursion wrong. >> >> > Yes, It's started to happen with the latest kernels from the Stable > branch. This is the latest I have installed: > 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt20-1+deb8u3 (2016-01-17) x86_64 > > Older Debian kernels are not showing up anything. This one, for example: > 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1+deb8u6 (2015-11-09) x86_64 > > > Regards. > From tss at iki.fi Thu Apr 7 13:02:03 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 7 Apr 2016 16:02:03 +0300 Subject: Opportunistic quota recalc In-Reply-To: <11b843dcfa9d753dcaeeab033a7f0dfa@tomsommer.dk> References: <3173976558a88a93d1b6afa485b0cbd7@tomsommer.dk> <37a6b68e75d99db0507399edf935f73b@tomsommer.dk> <11b843dcfa9d753dcaeeab033a7f0dfa@tomsommer.dk> Message-ID: On 07 Apr 2016, at 14:49, Tom Sommer wrote: > > On 2016-04-06 21:09, Tom Sommer wrote: >> On 2016-04-06 20:38, Timo Sirainen wrote: >>> On 06 Apr 2016, at 13:43, Tom Sommer wrote: >>>> I'm switching quota backend to redis (from maildir++), so all my current usages are reset. >>>> I get that I can do "doveadm quota recalc -A", but it takes forever (and auth processes time out/crash). >>>> It would make much more sense to recalc the usage on login if the current usage is unset. Is there no way to do a recalc-quota-on-first-login? >>> I'd actually recommend switching to "count" quota: >>> http://wiki2.dovecot.org/Quota/Count >> I tried count, but it crashes because of dotlocks :) There is another >> post about it :) > > Any change you will have time to fix this? Because I would really love to switch to "count". Looks unlikely right now, but lets see. You could also in theory just mount with -o nolock and use fcntl/flock locking so each server does the locking internally only. Having director working correctly is of course even more important in that case. From skdovecot at smail.inf.fh-brs.de Thu Apr 7 13:02:47 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Thu, 7 Apr 2016 15:02:47 +0200 (CEST) Subject: Fwd: Intermittent IMAP Login failures - about 25% fail In-Reply-To: References: Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 7 Apr 2016, Mobile Phone wrote: > New server & just added three domains: > now I see > "dovecot: imap-login: Aborted login (auth failed, 1 attempts in 5 secs): > user=, method=PLAIN, rip=1.1.1.1, lip=99.99.99.99, > TLS, session=" > Plus all Outlook users keep being bounced and finally get in. Did you tried to enable auth debug? http://wiki2.dovecot.org/Debugging/Authentication - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVwZad3z1H7kL/d9rAQLDGwf/RS54zzxS4P6XxBmwPL2b3iA2YD5a9dHL +jTs6s5zS0leX8PWcrjES9BoU8pRBRm4IRqJFI5eZeWmhSVvHSe5iAEZ0n8k+MGc yunHljQLvsNg5EJtxiOf7TLw9k7lJuilKb5WR1aC5gBO0NscxWUIhXHy1uSGOGv8 xtzZPSvmZJcjQWqtVl7NklUy8+jRj42uwtS3Q3G2OhyBR45vpsPQBkeNsYHaITdF Q+LE6lAaVFuxCoX7d4XQyt+craNq0mNEl3A6DBb41YY6bK+QdXt9ciG1iOAF1aR1 zPRlII0Vt1USX9Jw+B24/f6zfFv5yQ6q/k35o9YO0taot5swtnJBOA== =2aRu -----END PGP SIGNATURE----- From tss at iki.fi Thu Apr 7 13:11:12 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 7 Apr 2016 16:11:12 +0300 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <201604061629.43612@pali> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <201604041935.23571@pali> <201604061629.43612@pali> Message-ID: On 06 Apr 2016, at 17:29, Pali Roh?r wrote: > > On Monday 04 April 2016 19:35:22 Pali Roh?r wrote: >> On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: >>> Can you please send them directly to me, please? >>> --- >>> Aki Tuomi >> >> Sent. > > Received? Are patches OK now? It would be nice if each commit was accompanied with the corresponding unit test change in test-message-address.c. Now that the unit test changes are done in a separate commit I'm not really sure which test change is testing which commit or if some tests are missing. At least the "Quote and escape strings if needed" patch needs more tests for different kinds of escapes/atext/non-atext chars and =? in strings. From stephan at rename-it.nl Thu Apr 7 13:44:04 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 7 Apr 2016 15:44:04 +0200 Subject: A few new Pigeonhole features Message-ID: <57066424.8040508@rename-it.nl> Hi, A few new Pigeonhole features that enthusiasts can experiment with: - Recently, I implemented support for the "imapsieve" extension in Sieve and its IMAP counterpart (https://tools.ietf.org/html/rfc6785). This is now in the Pigeonhole master branch. This allows running Sieve scripts at IMAP activity, rather than at delivery. There are also facilities for the familiar sieve_before/sieve_after administrator scripts. The documentation is currently only in the sources and not on the wiki: https://raw.githubusercontent.com/dovecot/pigeonhole/master/doc/plugins/imapsieve.txt - Yesterday, I implemented online trace debugging for Sieve scripts: i.e., directly during delivery rather than only using the sieve-test tool. This is also supported for the IMAPSIEVE feature discussed above. This is documented in the INSTALL file: https://github.com/dovecot/pigeonhole/blob/master/INSTALL#L522 In other news, I started a specification for a new Sieve feature that allows using the IMAP SPECIAL-USE attributes from Sieve scripts: https://tools.ietf.org/html/draft-bosch-sieve-special-use-00 There is no implementation yet. Any comments, suggestions or bug reports are welcome. Regards, Stephan. From cell at eceb.co.uk Thu Apr 7 16:02:00 2016 From: cell at eceb.co.uk (Mobile Phone) Date: Thu, 7 Apr 2016 17:02:00 +0100 Subject: Fwd: Intermittent IMAP Login failures - about 25% fail In-Reply-To: References: Message-ID: Yes, I had as soon as I saw strange results. The fault is still intermittent and affecting all clients. auth.log: Apr 7 15:05:27 brazil auth: message repeated 10 times: [ pam_unix(dovecot:auth): authentication failure; logname= uid=0 euid=0 tty=dovecot ruser=prtg.08dir rhost=91.91.91.91 user=prtg.08dir] mail.log: Apr 7 15:05:01 brazil dovecot: imap-login: Aborted login (auth failed, 1 attempts in 4 secs): user=, method=PLAIN, rip=99.99.99.99, lip=91.91.91.91, TLS, session= Apr 7 15:05:02 brazil postfix/smtpd[13968]: connect from unknown[91.91.19.91] Apr 7 15:05:02 brazil postfix/smtpd[13968]: disconnect from unknown[91.91.19.91] Apr 7 15:05:27 brazil dovecot: auth: Debug: auth client connected (pid=14880) Apr 7 15:05:27 brazil dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=AY8JkxUvzQBex5Un#011lip=99.99.99.99#011rip=91.91.19.91#011lport=143#011rport=59085#011resp=AHBydGcuMDhkaXJlY3QAV2VmdWNraW5IYXRlU3BhbQ== (previous base64 data may contain sensitive data) Apr 7 15:05:27 brazil dovecot: auth-worker(13031): Debug: pam(prtg.08dir,91.91.19.91): lookup service=dovecot Apr 7 15:05:27 brazil dovecot: auth-worker(13031): Debug: pam(prtg.08dir,91.91.19.91): #1/1 style=1 msg=Password: Apr 7 15:05:29 brazil dovecot: auth-worker(13031): pam(prtg.08dir,91.91.19.91): pam_authenticate() failed: Authentication failure (password mismatch?) (given password: YesThisWasTheCorrectPassword) Apr 7 15:05:31 brazil dovecot: auth: Debug: client passdb out: FAIL#0111#011user=prtg.08dir Apr 7 15:05:31 brazil dovecot: imap-login: Aborted login (auth failed, 1 attempts in 4 secs): user=, method=PLAIN, rip=91.91.19.91, lip=99.99.99.99, TLS, session= syslog: root at brazil:/var/log# cat syslog|grep "Apr 7 15:05"|more Apr 7 15:05:01 brazil dovecot: auth: Debug: client passdb out: FAIL#0111#011user=prtg.08dir Apr 7 15:05:01 brazil dovecot: imap-login: Aborted login (auth failed, 1 attempts in 4 secs): user=, method=PLAIN, rip=91.91.91.91, lip=99.99.99.99, TLS, session= Apr 7 15:05:02 brazil postfix/smtpd[13968]: connect from unknown[91.91.91.91] Apr 7 15:05:02 brazil postfix/smtpd[13968]: disconnect from unknown[91.91.91.91] Apr 7 15:05:27 brazil dovecot: auth: Debug: auth client connected (pid=14880) Apr 7 15:05:27 brazil dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=AY8JkuUvzQBex5Un#011lip=99.99.99.99#011rip=91.91.91.91#011lport=143#011rport=59085#011resp=AHBydGcuMDhkaXJlY3QAV2VmdWNraW5IYXRlU3BhbQ== (previous base64 data may contain sensitive data) Apr 7 15:05:27 brazil dovecot: auth-worker(13031): Debug: pam(prtg.08dir,91.91.91.91): lookup service=dovecot Apr 7 15:05:27 brazil dovecot: auth-worker(13031): Debug: pam(prtg.08dir,91.91.91.91): #1/1 style=1 msg=Password: Apr 7 15:05:29 brazil dovecot: auth-worker(13031): pam(prtg.08dir,91.91.91.91): pam_authenticate() failed: Authentication failure (password mismatch?) (given password: YesThisWasTheCorrectPassword) Apr 7 15:05:31 brazil dovecot: auth: Debug: client passdb out: FAIL#0111#011user=prtg.08dir Apr 7 15:05:31 brazil dovecot: imap-login: Aborted login (auth failed, 1 attempts in 4 secs): user=, method=PLAIN, rip=91.91.91.91, lip=99.99.99.99, TLS, session= Apr 7 15:05:33 brazil dovecot: auth: Debug: auth client connected (pid=14881) Why it this bouncing 25% + of IMAP AUTH LOGINs? On 7 April 2016 at 14:02, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Thu, 7 Apr 2016, Mobile Phone wrote: > > New server & just added three domains: >> now I see >> "dovecot: imap-login: Aborted login (auth failed, 1 attempts in 5 secs): >> user=, method=PLAIN, rip=1.1.1.1, lip=99.99.99.99, >> TLS, session=" >> Plus all Outlook users keep being bounced and finally get in. >> > > Did you tried to enable auth debug? > > http://wiki2.dovecot.org/Debugging/Authentication > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVwZad3z1H7kL/d9rAQLDGwf/RS54zzxS4P6XxBmwPL2b3iA2YD5a9dHL > +jTs6s5zS0leX8PWcrjES9BoU8pRBRm4IRqJFI5eZeWmhSVvHSe5iAEZ0n8k+MGc > yunHljQLvsNg5EJtxiOf7TLw9k7lJuilKb5WR1aC5gBO0NscxWUIhXHy1uSGOGv8 > xtzZPSvmZJcjQWqtVl7NklUy8+jRj42uwtS3Q3G2OhyBR45vpsPQBkeNsYHaITdF > Q+LE6lAaVFuxCoX7d4XQyt+craNq0mNEl3A6DBb41YY6bK+QdXt9ciG1iOAF1aR1 > zPRlII0Vt1USX9Jw+B24/f6zfFv5yQ6q/k35o9YO0taot5swtnJBOA== > =2aRu > -----END PGP SIGNATURE----- > > From tss at iki.fi Thu Apr 7 16:24:07 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 7 Apr 2016 19:24:07 +0300 Subject: Intermittent IMAP Login failures - about 25% fail In-Reply-To: References: Message-ID: <71709142-66AC-4380-892D-B5E4F29A51B4@iki.fi> On 07 Apr 2016, at 19:02, Mobile Phone wrote: > > pam(prtg.08dir,91.91.91.91): pam_authenticate() failed: Authentication > failure (password mismatch?) (given password: YesThisWasTheCorrectPassword) .. > Why it this bouncing 25% + of IMAP AUTH LOGINs? PAM said that login wasn't allowed. PAM can have all kinds of plugins that can do all kinds of things. Maybe you have enabled some PAM plugin that denies the user's access even if the password is correct. Unfortunately there's no way to enable debugging for PAM. Try simplifying your PAM setup, or if you can't figure out anything else switch to passdb shadow. From martijn.list at gmail.com Fri Apr 8 06:19:48 2016 From: martijn.list at gmail.com (martijn.list) Date: Fri, 8 Apr 2016 08:19:48 +0200 Subject: Own implementation of a dict server. Is dict lookup multi threaded or single threaded? Message-ID: <57074D84.2050500@gmail.com> Hi, I have created my own dict server (proxy:[]:) to access a proprietary database. What happens if the dict server lookup is slow? for example because the lookup process takes some time? Does Dovecot access the dict proxy from multiple threads or is this a single threaded process? Kind regards, Martijn Brinkers From martijn.list at gmail.com Fri Apr 8 08:08:58 2016 From: martijn.list at gmail.com (martijn.list) Date: Fri, 8 Apr 2016 10:08:58 +0200 Subject: Broken pipe with own dict server. Timing issue? Message-ID: <5707671A.8060700@gmail.com> Hi, I have created my own dict server (proxy:[]:) to access a proprietary database. The dict server basically creates a listing socket on a separate thread and then waits for incoming requests with accept(handle, NULL, 0). When a request comes in (i.e., when accept returns the accepted socket fd), the request is handed over to a handler thread (from a thread pool). The handler thread then read from the input. The issue that I have is that if the read is done too fast after the accept, Dovecot reports a broken pipe: dovecot: auth-worker(19904): Error: write(/usr/share/test-server/tmp/test-dict) failed: Broken pipe This happens for almost all processes that try to access the dict server. However If I add some sort of delay between the accept call and read (for example a sleep), everything works. No broken pipe even after testing with a large number of parallel requests for a long time. Somehow it looks like if the first read is done too fast, it takes a long time to read the data. During this time it looks like all other Dovecot processes are no longer able to connect and report the broken pipe. With the artificial delay, everything works ok and I can see that multiple incoming request are handled by multiple threads so it looks like Dovecot uses multiple auth worker processes. If however one connection hangs on the read it looks like no Dovecot proccess is able to connect Any idea what might be causing the broken pipe in relation to timing of the read? Kind regards, Martijn From tss at iki.fi Fri Apr 8 08:33:06 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 8 Apr 2016 11:33:06 +0300 Subject: Own implementation of a dict server. Is dict lookup multi threaded or single threaded? In-Reply-To: <57074D84.2050500@gmail.com> References: <57074D84.2050500@gmail.com> Message-ID: On 08 Apr 2016, at 09:19, martijn.list wrote: > > Hi, > > I have created my own dict server (proxy:[]: dict>) to access a proprietary database. > > What happens if the dict server lookup is slow? for example because the > lookup process takes some time? Looking at the code, there's a 30sec timeout: /* Abort dict lookup after this many seconds. */ #define DICT_CLIENT_READ_TIMEOUT_SECS 30 /* Log a warning if dict lookup takes longer than this many seconds. */ #define DICT_CLIENT_READ_WARN_TIMEOUT_SECS 5 > Does Dovecot access the dict proxy from multiple threads or is this a > single threaded process? It depends on what you're using the dict for. If you're using passdb-dict or userdb-dict, then I think all the lookups are coming from the one auth master process. If you're using it elsewhere, then you'll probably be getting connections from many different processes. From tss at iki.fi Fri Apr 8 08:38:10 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 8 Apr 2016 11:38:10 +0300 Subject: Broken pipe with own dict server. Timing issue? In-Reply-To: <5707671A.8060700@gmail.com> References: <5707671A.8060700@gmail.com> Message-ID: On 08 Apr 2016, at 11:08, martijn.list wrote: > > Hi, > > I have created my own dict server (proxy:[]: dict>) to access a proprietary database. The dict server basically > creates a listing socket on a separate thread and then waits for > incoming requests with accept(handle, NULL, 0). When a request comes in > (i.e., when accept returns the accepted socket fd), the request is > handed over to a handler thread (from a thread pool). The handler thread > then read from the input. > > The issue that I have is that if the read is done too fast after the > accept, Dovecot reports a broken pipe: > > dovecot: auth-worker(19904): Error: > write(/usr/share/test-server/tmp/test-dict) failed: Broken pipe That doesn't make much sense.. Broken pipe means that the other side disconnected the socket. A read wouldn't disconnect a socket no matter when it was done. I'd say that some bug in your code is causing the socket to be disconnected too early. stracing it might be helpful. Oh, and apparently I remembered wrong and the passdb/userdb dict lookups are done via auth-workers, so you'd be getting a connection from each auth-worker. It would be just one connection per auth-worker process though. But they're disconnecting immediately after having finished the pending lookups. From martijn.list at gmail.com Fri Apr 8 09:52:39 2016 From: martijn.list at gmail.com (martijn.list) Date: Fri, 8 Apr 2016 11:52:39 +0200 Subject: Broken pipe with own dict server. Timing issue? In-Reply-To: References: <5707671A.8060700@gmail.com> Message-ID: <57077F67.9040607@gmail.com> On 04/08/2016 10:38 AM, Timo Sirainen wrote: > On 08 Apr 2016, at 11:08, martijn.list > wrote: >> >> Hi, >> >> I have created my own dict server (proxy:[> path>]:) to access a proprietary database. The >> dict server basically creates a listing socket on a separate thread >> and then waits for incoming requests with accept(handle, NULL, 0). >> When a request comes in (i.e., when accept returns the accepted >> socket fd), the request is handed over to a handler thread (from a >> thread pool). The handler thread then read from the input. >> >> The issue that I have is that if the read is done too fast after >> the accept, Dovecot reports a broken pipe: >> >> dovecot: auth-worker(19904): Error: >> write(/usr/share/test-server/tmp/test-dict) failed: Broken pipe > > That doesn't make much sense.. Broken pipe means that the other side > disconnected the socket. A read wouldn't disconnect a socket no > matter when it was done. I'd say that some bug in your code is > causing the socket to be disconnected too early. stracing it might be > helpful. Yes my bad ... That's why I always assume the bugs are in my own code ;) It turned out that the hello message was not always send in the same packet as the next line. Which is understandable. However it's not directly clear to me when you can assume that all data has been sent. Am I right to assume that there are always two lines which end with a newline? Example: H2\t0\t0\tname-of-pipe\nLshared/userdb/martijn.list at gmail.com\n In other words can my service stop reading when two lines are received and close the connection? It looks like there is not some sort of "END OF DATA" command. > Oh, and apparently I remembered wrong and the passdb/userdb dict > lookups are done via auth-workers, so you'd be getting a connection > from each auth-worker. It would be just one connection per > auth-worker process though. But they're disconnecting immediately > after having finished the pending lookups. Yes I can confirm this. I added some really long delays to slow down the dict handling and multiple connections were established. Kind regards, Martijn From cell at eceb.co.uk Fri Apr 8 10:20:17 2016 From: cell at eceb.co.uk (Mobile Phone) Date: Fri, 8 Apr 2016 11:20:17 +0100 Subject: Intermittent IMAP Login failures - about 25% fail In-Reply-To: <71709142-66AC-4380-892D-B5E4F29A51B4@iki.fi> References: <71709142-66AC-4380-892D-B5E4F29A51B4@iki.fi> Message-ID: SOLVED: Should anyone else run into this and debugging shows no issues, just random dovecot logins fails - there was a bad username stored. "pwck" showed it up. Only cost me 3 days On 7 April 2016 at 17:24, Timo Sirainen wrote: > On 07 Apr 2016, at 19:02, Mobile Phone wrote: > > > > pam(prtg.08dir,91.91.91.91): pam_authenticate() failed: Authentication > > failure (password mismatch?) (given password: > YesThisWasTheCorrectPassword) > .. > > Why it this bouncing 25% + of IMAP AUTH LOGINs? > > PAM said that login wasn't allowed. PAM can have all kinds of plugins that > can do all kinds of things. Maybe you have enabled some PAM plugin that > denies the user's access even if the password is correct. Unfortunately > there's no way to enable debugging for PAM. Try simplifying your PAM setup, > or if you can't figure out anything else switch to passdb shadow. > > From lists at lazygranch.com Fri Apr 8 12:04:38 2016 From: lists at lazygranch.com (lists at lazygranch.com) Date: Fri, 08 Apr 2016 05:04:38 -0700 Subject: Intermittent IMAP Login failures - about 25% fail In-Reply-To: References: <71709142-66AC-4380-892D-B5E4F29A51B4@iki.fi> Message-ID: <20160408120438.5484629.36252.587@lazygranch.com> I'm not getting a hit on "Dovecot pwck". Can you elaborate. ? Original Message ? From: Mobile Phone Sent: Friday, April 8, 2016 3:20 AM To: Dovecot Mailing List Reply To: support at eceb.co.uk Subject: Re: Intermittent IMAP Login failures - about 25% fail SOLVED: Should anyone else run into this and debugging shows no issues, just random dovecot logins fails - there was a bad username stored. "pwck" showed it up. Only cost me 3 days On 7 April 2016 at 17:24, Timo Sirainen wrote: > On 07 Apr 2016, at 19:02, Mobile Phone wrote: > > > > pam(prtg.08dir,91.91.91.91): pam_authenticate() failed: Authentication > > failure (password mismatch?) (given password: > YesThisWasTheCorrectPassword) > .. > > Why it this bouncing 25% + of IMAP AUTH LOGINs? > > PAM said that login wasn't allowed. PAM can have all kinds of plugins that > can do all kinds of things. Maybe you have enabled some PAM plugin that > denies the user's access even if the password is correct. Unfortunately > there's no way to enable debugging for PAM. Try simplifying your PAM setup, > or if you can't figure out anything else switch to passdb shadow. > > From cell at eceb.co.uk Fri Apr 8 14:19:09 2016 From: cell at eceb.co.uk (Mobile Phone) Date: Fri, 8 Apr 2016 15:19:09 +0100 Subject: Intermittent IMAP Login failures - about 25% fail In-Reply-To: <20160408120438.5484629.36252.587@lazygranch.com> References: <71709142-66AC-4380-892D-B5E4F29A51B4@iki.fi> <20160408120438.5484629.36252.587@lazygranch.com> Message-ID: Validating /etc/passwd & shadow: /usr/sbin/pwck On 8 April 2016 at 13:04, wrote: > I'm not getting a hit on "Dovecot pwck". Can you elaborate. > > Original Message > From: Mobile Phone > Sent: Friday, April 8, 2016 3:20 AM > To: Dovecot Mailing List > Reply To: support at eceb.co.uk > Subject: Re: Intermittent IMAP Login failures - about 25% fail > > SOLVED: Should anyone else run into this and debugging shows no issues, > just random dovecot logins fails - there was a bad username stored. > "pwck" showed it up. > Only cost me 3 days > > On 7 April 2016 at 17:24, Timo Sirainen wrote: > > > On 07 Apr 2016, at 19:02, Mobile Phone wrote: > > > > > > pam(prtg.08dir,91.91.91.91): pam_authenticate() failed: Authentication > > > failure (password mismatch?) (given password: > > YesThisWasTheCorrectPassword) > > .. > > > Why it this bouncing 25% + of IMAP AUTH LOGINs? > > > > PAM said that login wasn't allowed. PAM can have all kinds of plugins > that > > can do all kinds of things. Maybe you have enabled some PAM plugin that > > denies the user's access even if the password is correct. Unfortunately > > there's no way to enable debugging for PAM. Try simplifying your PAM > setup, > > or if you can't figure out anything else switch to passdb shadow. > > > > > > From chris.laif at googlemail.com Fri Apr 8 15:08:53 2016 From: chris.laif at googlemail.com (Chris Laif) Date: Fri, 8 Apr 2016 17:08:53 +0200 Subject: fts_solr: Lookup failed: 400 Bad Request / GET null null In-Reply-To: <9DA7CE29-342A-4337-98B3-8D001D9EEFEA@iki.fi> References: <5701268C.703@rename-it.nl> <9DA7CE29-342A-4337-98B3-8D001D9EEFEA@iki.fi> Message-ID: On Wed, Apr 6, 2016 at 9:27 PM, Timo Sirainen wrote: > On 05 Apr 2016, at 11:33, Chris Laif wrote: >> >> I've captured some requests and they look like this (some parts >> changed due to privacy concerns): >> >> GET /solr/select?fl=uid,score&rows=439&sort=uid+asc&q={!lucene+q.op%3dAND}hdr:%3c56Fxxxx3A6.7080904 at domain.de%3e+OR+hdr:%3c664DCDxxxxx1A4FACD8B7922C495FEF at CZCHOWS1356.prg%5c-domain.com%3e+OR+hdr:%3c00cxxxxxde3$70ad7880$52 >> ... (many many more OR hdrs) >> &fq=%2Bbox:f696f93xxxxxx6e+%2Buser:user at domain.de HTTP/1.1 >> >> The total request size is 31708 bytes and it contains many (hundreds?) >> of 'OR hdrs' (side note: I wonder which client action triggers these >> kind of requests, maybe the user selected hundreds of mails for >> search?) > > I bet this is the weird iOS client stupidity where they for some weird reason started issuing commands like: > > SEARCH OR HEADER Message-ID id1 OR HEADER Message-ID id2 OR HEADER Message-ID id3 ... > > With the entire command about ~32 kB. It does it for every single message in the folder. Why not simply FETCH 1:* HEADER.FIELDS[Message-ID] and do the matching itself.. > >> I _think_ this is a problem of the URL length / max http header size. >> (Debian Jessie) Tomcat7 very likely does not accept more than 32kb >> data in a request. >> >> I wonder if Dovecot should limit SOLR requests to a specific size and >> deny long requests with an imap error (?) > > Or just issue multiple Solr requests.. In any case, troublesome.. Could those limits be just increased in Tomcat? > From chris.laif at googlemail.com Fri Apr 8 15:13:29 2016 From: chris.laif at googlemail.com (Chris Laif) Date: Fri, 8 Apr 2016 17:13:29 +0200 Subject: fts_solr: Lookup failed: 400 Bad Request / GET null null In-Reply-To: <9DA7CE29-342A-4337-98B3-8D001D9EEFEA@iki.fi> References: <5701268C.703@rename-it.nl> <9DA7CE29-342A-4337-98B3-8D001D9EEFEA@iki.fi> Message-ID: On Wed, Apr 6, 2016 at 9:27 PM, Timo Sirainen wrote: >> The total request size is 31708 bytes and it contains many (hundreds?) >> of 'OR hdrs' (side note: I wonder which client action triggers these >> kind of requests, maybe the user selected hundreds of mails for >> search?) > > I bet this is the weird iOS client stupidity where they for some weird reason started issuing commands like: > > SEARCH OR HEADER Message-ID id1 OR HEADER Message-ID id2 OR HEADER Message-ID id3 ... > > With the entire command about ~32 kB. It does it for every single message in the folder. Why not simply FETCH 1:* HEADER.FIELDS[Message-ID] and do the matching itself.. > >> I _think_ this is a problem of the URL length / max http header size. >> (Debian Jessie) Tomcat7 very likely does not accept more than 32kb >> data in a request. >> >> I wonder if Dovecot should limit SOLR requests to a specific size and >> deny long requests with an imap error (?) > > Or just issue multiple Solr requests.. In any case, troublesome.. Could those limits be just increased in Tomcat? > I've set maxHttpHeaderSize="65536" ("Connector"-definition in /etc/tomcat7/server.xml) and at least during the last two days no error occured anymore :-) Chris From philip at mcgaw.eu Fri Apr 8 23:25:51 2016 From: philip at mcgaw.eu (Philip McGaw) Date: Sat, 9 Apr 2016 00:25:51 +0100 Subject: Fwd: Plus addressing on Sentora using Postfix References: Message-ID: <50B1436F-E46E-45C5-B2EE-F92CC4A6B909@mcgaw.eu> I am running Ubuntu 14.04.4 LTS ?Trusty? and "postconf -d | grep mail_version? gives me ?mail_version = 2.11.0?, with Dovecot 2.2.9 I have installed Sentora (http://sentora.org) which sets most of the configuration up for Postfix up, I have made some changes to allow me to use certificates for IMAP and SMTP SSL (https://skippy.org.uk/lets-encrypt-postfix-and-dovecot/), My Postfix main config file is http://pastebin.com/hdxdNK4d My Postfix master process configuration file is http://pastebin.com/YuCTq0JQ Dovecot -n gives me the following http://pastebin.com/05xixDtD I am trying to send an email to site at skippy.org.uk and site+test at skippy.org.uk (sending from an iCloud account), it works to site at skippy.org.uk (site at skippy.org.uk is a real email address), the lines from mail.log are as follows: > Mar 11 17:48:07 njoror postfix/smtpd[32706]: connect from mr11p26im-asmtp004.me.com[17.110.86.109] > Mar 11 17:48:07 njoror postfix/smtpd[32706]: Anonymous TLS connection established from mr11p26im-asmtp004.me.com[17.110.86.109]: TLSv1.2 with cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits) > Mar 11 17:48:08 njoror postfix/smtpd[32706]: 1BAF055AB6: client=mr11p26im-asmtp004.me.com[17.110.86.109] > Mar 11 17:48:08 njoror postfix/cleanup[32710]: 1BAF055AB6: message-id=<90594925-C294-4A38-8275-C23DA55A9308 at icloud.com> > Mar 11 17:48:08 njoror postfix/qmgr[32599]: 1BAF055AB6: from=, size=1513, nrcpt=1 (queue active) > Mar 11 17:48:08 njoror postfix/pipe[32605]: 1BAF055AB6: to=, relay=dovecot, delay=0.43, delays=0.34/0.01/0/0.09, dsn=4.1.1, status=SOFTBOUNCE (user unknown) > Mar 11 17:48:08 njoror postfix/smtpd[32706]: disconnect from mr11p26im-asmtp004.me.com[17.110.86.109] vs > Mar 11 17:49:23 njoror postfix/smtpd[32706]: connect from mr11p26im-asmtp004.me.com[17.110.86.109] > Mar 11 17:49:23 njoror postfix/smtpd[32706]: Anonymous TLS connection established from mr11p26im-asmtp004.me.com[17.110.86.109]: TLSv1.2 with cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits) > Mar 11 17:49:24 njoror postfix/smtpd[32706]: 33D2355AB9: client=mr11p26im-asmtp004.me.com[17.110.86.109] > Mar 11 17:49:24 njoror postfix/cleanup[32710]: 33D2355AB9: message-id=<2456DC97-4E3A-4A91-B3A0-CAFE056F116F at icloud.com> > Mar 11 17:49:24 njoror postfix/qmgr[32599]: 33D2355AB9: from=, size=1249, nrcpt=1 (queue active) > Mar 11 17:49:25 njoror postfix/smtpd[32706]: disconnect from mr11p26im-asmtp004.me.com[17.110.86.109] > Mar 11 17:49:26 njoror postfix/pipe[32605]: 33D2355AB9: to=, relay=dovecot, delay=1.8, delays=0.63/0/0/1.2, dsn=2.0.0, status=sent (delivered via dovecot service) > Mar 11 17:49:26 njoror postfix/qmgr[32599]: 33D2355AB9: removed Looking at the lines from mail.log it looks like it thinks there should be a user called site+test at skippy.org.uk, this has been puzzling me for a while, I was wondering if any one on here could see what was wrong, and what I needed to change, Looking at a few examples and online guides I thought I had covered all the bases. Looking at the log it looks like the message is either succeeding, or failing via Dovecot > Mar 11 17:48:08 njoror postfix/pipe[32605]: 1BAF055AB6: to=, relay=dovecot, delay=0.43, delays=0.34/0.01/0/0.09, dsn=4.1.1, status=SOFTBOUNCE (user unknown) Does any one have any ideas? -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 236 bytes Desc: Message signed with OpenPGP using GPGMail URL: From dave at mtfbwy.cz Fri Apr 8 10:56:34 2016 From: dave at mtfbwy.cz (=?UTF-8?Q?David_Cig=c3=a1nek?=) Date: Fri, 8 Apr 2016 12:56:34 +0200 Subject: Permissions for new folders Message-ID: <57078E62.8030201@mtfbwy.cz> Hi, I have a problem with permissions for newly created folders in Dovecot. Everything worked fine until few days ago, when i did a little change in userdb lookup - but i don't know why it is causing problems. Server uses following directory structure: index - /data/mail/index mail - /data/mail/mail alt - /data/mail/archive all 3 on separate volumes, for performance reasons. Up until few days, i used following: # doveadm user dave at example.com field value user dave at example.com uid 13726 gid 1004 home /data/mail/mail/003/3726/da/dave mail mdbox:~/mbox/:DIRNAME=.00f-dbox-Mails:INDEX=/data/mail/stub/index/data/mail/mail/003/3726/da/dave:ALT=/data/mail/stub/archive/data/mail/mail/003/3726/da/dave config is quite simple: mail_location = mdbox:~/mbox/:DIRNAME=.00f-dbox-Mails:INDEX=/data/mail/stub/index%h:ALT=/data/mail/stub/archive%h passdb { driver = sql args = /data/mail/sql/dovecot-sql.conf.ext } userdb { driver = static args = gid=vmail } from SQL i get those fileds username domain password userdb_home userdb_uid userdb_quota_rule userdb_quota_over_flag For nicer paths, i created a symlinks /data/mail/stub/index/data/mail -> /data/mail/index /data/mail/stub/archive/data/mail -> /data/mail/archive so path /data/mail/stub/index/data/mail/mail/003/3726/da/dave is in fact in /data/mail/index/003/3726/da/dave In that setup, everything worked fine, but i didn't like those simlinks, so i altered the SQL query to return all paths in userdb_mail filed: # doveadm user dave at example.com field value user dave at example.com uid 13726 gid 1004 home /data/mail/mail/003/3726/da/dave mail mdbox:~/mbox/:DIRNAME=.00f-dbox-Mails:INDEX=/data/mail/index/003/3726/da/dave:ALT=/data/mail/archive/003/3726/da/dave So everything is in fact the same but little nicer. But since then, newly created directories doesn't get the same permissions like parent folder as day should (2770), but instead they are created with 2700: # stat -c "%a (%A)" /data/mail/mail/ 2770 (drwxrws---) # stat -c "%a (%A)" /data/mail/mail/003 2700 (drwx--S---) I need to have there 2770 perms, especialy because when other user like this is created: user dave at example.com uid 13999 gid 1004 home /data/mail/mail/003/3999/da/dave Dovecot is unable to create directory /data/mail/mail/003/3999, because it doesn't have write permissions for group on /data/mail/mail/003. I can't find any reason for this behavior - is it something in Dovecot or am I doing something wrong? Thank you, David Dovecot version: 2.2.21 # doveconf -n # 2.2.21 (5345f22): /usr/local/dovecot/2.2.21/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.12 (c1c0a23) # OS: Linux 3.10.0-327.4.5.el7.x86_64 x86_64 CentOS Linux release 7.2.1511 (Core) auth_master_user_separator = xxxxxx dict { sieve_movespam = mysql:/data/mail/sql/dovecot-movespam-sql.conf.ext sieve_redirect = mysql:/data/mail/sql/dovecot-redirects-sql.conf.ext } mail_location = mdbox:~/mbox/:DIRNAME=.00f-dbox-Mails:INDEX=/data/mail/stub/index%h:ALT=/data/mail/stub/archive%h mail_plugins = " quota notify replication" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mdbox_rotate_size = 15 M passdb { args = xxxxxx driver = passwd-file master = yes pass = yes skip = authenticated } passdb { args = /data/mail/sql/dovecot-sql.conf.ext driver = sql } passdb { args = /data/mail/sql/dovecot-catchall-sql.conf.ext driver = sql } plugin { mail_replica = tcp:xxx:xxx quota = dict:user-quota::file:~/user_quota.dat quota2 = dict:domain-quota:%d:file:~/../../domain_quota.dat quota2_over_flag_value = 1 quota2_over_script = quota-warning domain %d %n@%d %i missmatch2 quota2_rule = *:bytes=500M quota2_rule2 = Trash:bytes=+5%% quota2_warning = bytes=90%% quota-warning domain %d %n@%d %i warn 90 quota2_warning2 = bytes=100%% quota-warning domain %d %n@%d %i over 100 quota2_warning3 = -bytes=100%% quota-warning domain %d %n@%d %i under 100 quota_grace = 5%% quota_over_flag_value = 1 quota_over_script = quota-warning user %n %n@%d %i missmatch1 quota_rule = *:bytes=0 quota_rule2 = Trash:bytes=+5%% quota_warning = bytes=90%% quota-warning user %n %n@%d %i warn 90 quota_warning2 = bytes=100%% quota-warning user %n %n@%d %i over 100 quota_warning3 = -bytes=100%% quota-warning user %n %n@%d %i under 100 sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = dict:proxy::sieve_movespam;name=sieve_movespam;bindir=~ sieve_before2 = dict:proxy::sieve_redirect;name=sieve_before;bindir=~ sieve_max_actions = 500 sieve_max_redirects = 500 sieve_redirect_envelope_from = recipient } pop3_no_flag_updates = yes protocols = imap pop3 lmtp sieve replication_dsync_parameters = -1 -d -N -l 30 -U replication_max_conns = 5 service aggregator { fifo_listener replication-notify-fifo { group = vmail mode = 0660 user = vmail } unix_listener replication-notify { group = vmail mode = 0660 user = vmail } } service dict { unix_listener dict { group = vmail mode = 0660 user = vmail } } service doveadm { inet_listener { port = xxxx } } service imap-login { client_limit = 10000 inet_listener imap { port = 143 } process_min_avail = 50 service_count = 0 vsz_limit = 256 M } service imap { client_limit = 1 process_limit = 20000 vsz_limit = 1 G } service lmtp { inet_listener lmtp { port = 2525 } } service pop3-login { inet_listener pop3 { port = 110 } } service quota-warning { executable = script /data/mail/scripts/quota-actions.sh unix_listener quota-warning { mode = 0666 } user = root } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl = no ssl_client_ca_file = /etc/pki/tls/cert.pem syslog_facility = local5 userdb { args = gid=vmail driver = static } userdb { args = /data/mail/sql/dovecot-sql.conf.ext driver = sql override_fields = gid=vmail } protocol imap { mail_max_userip_connections = 1000 mail_plugins = " quota notify replication imap_quota" } protocol lmtp { mail_plugins = " quota notify replication sieve" } protocol lda { mail_plugins = " quota notify replication sieve" } From ml+dovecot at valo.at Sat Apr 9 07:07:20 2016 From: ml+dovecot at valo.at (Christian Kivalo) Date: Sat, 09 Apr 2016 09:07:20 +0200 Subject: Fwd: Plus addressing on Sentora using Postfix In-Reply-To: <50B1436F-E46E-45C5-B2EE-F92CC4A6B909@mcgaw.eu> References: <50B1436F-E46E-45C5-B2EE-F92CC4A6B909@mcgaw.eu> Message-ID: Am 9. April 2016 01:25:51 MESZ, schrieb Philip McGaw : >I am running Ubuntu 14.04.4 LTS ?Trusty? and "postconf -d | grep >mail_version? gives me ?mail_version = 2.11.0?, with Dovecot 2.2.9 > >I have installed Sentora (http://sentora.org) which sets most of the >configuration up for Postfix up, I have made some changes to allow me >to use certificates for IMAP and SMTP SSL >(https://skippy.org.uk/lets-encrypt-postfix-and-dovecot/), > >My Postfix main config file is http://pastebin.com/hdxdNK4d >My Postfix master process configuration file is >http://pastebin.com/YuCTq0JQ >Dovecot -n gives me the following http://pastebin.com/05xixDtD > >I am trying to send an email to site at skippy.org.uk and >site+test at skippy.org.uk (sending from an iCloud account), it works to >site at skippy.org.uk (site at skippy.org.uk is a real email address), the >lines from mail.log are as follows: > >> Mar 11 17:48:07 njoror postfix/smtpd[32706]: connect from >mr11p26im-asmtp004.me.com[17.110.86.109] >> Mar 11 17:48:07 njoror postfix/smtpd[32706]: Anonymous TLS connection >established from mr11p26im-asmtp004.me.com[17.110.86.109]: TLSv1.2 with >cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits) >> Mar 11 17:48:08 njoror postfix/smtpd[32706]: 1BAF055AB6: >client=mr11p26im-asmtp004.me.com[17.110.86.109] >> Mar 11 17:48:08 njoror postfix/cleanup[32710]: 1BAF055AB6: >message-id=<90594925-C294-4A38-8275-C23DA55A9308 at icloud.com> >> Mar 11 17:48:08 njoror postfix/qmgr[32599]: 1BAF055AB6: >from=, size=1513, nrcpt=1 (queue active) >> Mar 11 17:48:08 njoror postfix/pipe[32605]: 1BAF055AB6: >to=, relay=dovecot, delay=0.43, >delays=0.34/0.01/0/0.09, dsn=4.1.1, status=SOFTBOUNCE (user unknown) >> Mar 11 17:48:08 njoror postfix/smtpd[32706]: disconnect from >mr11p26im-asmtp004.me.com[17.110.86.109] > >vs > >> Mar 11 17:49:23 njoror postfix/smtpd[32706]: connect from >mr11p26im-asmtp004.me.com[17.110.86.109] >> Mar 11 17:49:23 njoror postfix/smtpd[32706]: Anonymous TLS connection >established from mr11p26im-asmtp004.me.com[17.110.86.109]: TLSv1.2 with >cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits) >> Mar 11 17:49:24 njoror postfix/smtpd[32706]: 33D2355AB9: >client=mr11p26im-asmtp004.me.com[17.110.86.109] >> Mar 11 17:49:24 njoror postfix/cleanup[32710]: 33D2355AB9: >message-id=<2456DC97-4E3A-4A91-B3A0-CAFE056F116F at icloud.com> >> Mar 11 17:49:24 njoror postfix/qmgr[32599]: 33D2355AB9: >from=, size=1249, nrcpt=1 (queue active) >> Mar 11 17:49:25 njoror postfix/smtpd[32706]: disconnect from >mr11p26im-asmtp004.me.com[17.110.86.109] >> Mar 11 17:49:26 njoror postfix/pipe[32605]: 33D2355AB9: >to=, relay=dovecot, delay=1.8, delays=0.63/0/0/1.2, >dsn=2.0.0, status=sent (delivered via dovecot service) >> Mar 11 17:49:26 njoror postfix/qmgr[32599]: 33D2355AB9: removed > > >Looking at the lines from mail.log it looks like it thinks there should >be a user called site+test at skippy.org.uk, this has been puzzling me for >a while, I was wondering if any one on here could see what was wrong, >and what I needed to change, Looking at a few examples and online >guides I thought I had covered all the bases. > >Looking at the log it looks like the message is either succeeding, or >failing via Dovecot >> Mar 11 17:48:08 njoror postfix/pipe[32605]: 1BAF055AB6: >to=, relay=dovecot, delay=0.43, >delays=0.34/0.01/0/0.09, dsn=4.1.1, status=SOFTBOUNCE (user unknown) > >Does any one have any ideas? In dovecots 15-lda.conf uncomment the "recipient_delimiter = +" setting. The delimiter is configured in postfix but apparently not in your dovecot lda config -- Christian From hughbragg at dodo.com.au Sat Apr 9 18:48:54 2016 From: hughbragg at dodo.com.au (Hugh Bragg) Date: Sun, 10 Apr 2016 04:48:54 +1000 Subject: mail-search backtrace Message-ID: <57094E96.7020501@dodo.com.au> I'm repeatedly getting this error: Apr 07 04:37:27 imap(mymail at address): Panic: file mail-search.c: line 84 (mail_search_arg_init): assertion failed: (arg->initialized.keywords == NULL) Apr 07 04:37:27 imap(mymail at address): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x827c2) [0x7fcb7f65e7c2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x828ad) [0x7fcb7f65e8ad] -> /usr/lib64/dov ecot/libdovecot.so.0(i_fatal+0) [0x7fcb7f605b01] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_search_arg_init+0x228) [0x7fcb7f91a328] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_search_result_updat e_flags+0x100) [0x7fcb7f98e470] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_sync_search_results_update+0x52) [0x7fcb7f9983e2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mailbox_sync_deinit+0x185 ) [0x7fcb7f998bb5] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_sync_deinit+0x32) [0x7fcb7f921222] -> /usr/lib64/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xab3) [0x7fcb7e9f7313] -> /usr /lib64/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x3b) [0x7fcb7f92119b] -> dovecot/imap(imap_sync_init+0x68) [0x55b6ef47c238] -> dovecot/imap(cmd_sync_delayed+0x242) [0x55b6ef47cfb2] -> dovecot/imap(clie nt_handle_input+0x220) [0x55b6ef4706b0] -> dovecot/imap(client_input+0x82) [0x55b6ef470b82] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7fcb7f67228c] -> /usr/lib64/dovecot/libdovecot.so.0(io_l oop_handler_run_internal+0x101) [0x7fcb7f673731] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7fcb7f672315] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fcb7f6724b8] -> /usr/ lib64/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fcb7f60b663] -> dovecot/imap(main+0x2db) [0x55b6ef463a0b] -> /lib64/libc.so.6(__libc_start_main+0xf0) [0x7fcb7f23b580] -> dovecot/imap(_start+0x29) [0x5 5b6ef463b99] [root:~] # dovecot -n # 2.2.22 (fe789d2): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.12 (c1c0a23) # OS: Linux 4.4.6-300.fc23.x86_64 x86_64 Fedora release 23 (Twenty Three) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb imap_client_workarounds = tb-extra-mailbox-sep listen = * log_path = /var/log/dovecot.log mail_access_groups = mail, vmail mail_home = /var/mail/vmail/%d/%n mail_location = maildir:~/mail mail_plugins = virtual, acl managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } namespace virtual { location = virtual:/var/mail/vhosts/%d/%n/virtual prefix = virtual. separator = . } passdb { args = scheme=PLAIN username_format=%u /etc/dovecot/dovecot-users driver = passwd-file } plugin { acl = vfile acl_shared_dict = file:/var/mail/vhosts/shared-mailboxes.db fetchmail_helper = /var/mail/vhosts/bin/restart_fetchmail %h reload fetchmail_interval = 3000000 fetchmail_pidfile = %h/.fetchmail.pid sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/mail/vhosts/sieve-global } protocols = imap lmtp sieve service auth-worker { user = vmail } service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } unix_listener auth-userdb { group = vmail mode = 0660 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 0 ssl = yes } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } service managesieve-login { inet_listener sieve { port = 4190 } } service pop3-login { inet_listener pop3 { port = 0 } inet_listener pop3s { port = 0 } } ssl = required ssl_cert = Hi, I am trying to set up a Dovecot proxy which proxies through POP3, IMAP and LTMP towards a different Dovecot machine. On the proxy machine I use a MySQL database as a userdb and passwdb backend and it returns the proper information as described here: http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy IMAP and POP3 works just fine, but with LMTP I run into a problem. On the 'proxy' machine Postfix is also running and it deliver locally to LTMP via Socket: virtual_transport = lmtp:unix:private/dovecot-lmtp Dovecot there is also configured to proxy LTMP: lmtp_proxy = yes service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } } So far so good. A telnet to localhost 110 or 143 allows me to log in to the POP3/IMAP. When Postfix delivers the message locally to Dovecot through LTMP it tries to proxy it though. When doing so it tries to connect to TCP port 0 (zero). dovecot: lmtp(22580): Error: lmtp client: connect(mbox01.XXXX.nl, 0) failed: Connection refused I know I can return the 'port' field in the userdb query, but the same query is used for POP3, IMAP and LMTP. So that can't be hardcoded. I fixed it for now with a CASE statement in SQL: password_query = SELECT b.hostname AS host, NULL AS password, \ 'Y' AS nopassword, u.email AS destuser, 'Y' AS proxy, \ CASE '%s' WHEN 'lmtp' THEN 2525 WHEN 'pop3' THEN 110 WHEN 'imap' THEN 143 END AS port \ FROM User u, Backend b, Domain d \ WHERE u.domainID = d.domainID \ AND b.backendID = d.backendID \ AND u.email = '%u' %s is a variable containing the service Dovecot is trying to look up. This is however rather hacky. On my destination machine LMTP is listening on port 2525. Is there any way to tell the Dovecot LTMP client to connect to port 2525 by default? Thanks, Wido From wido at widodh.nl Sat Apr 9 11:51:08 2016 From: wido at widodh.nl (Wido den Hollander) Date: Sat, 9 Apr 2016 13:51:08 +0200 (CEST) Subject: Dovecot Proxy LTMP client connect to TCP port 0 In-Reply-To: <788991517.2652.160e133c-ee3f-4c6e-9b8b-e4d468651d78.open-xchange@ox.pcextreme.nl> References: <788991517.2652.160e133c-ee3f-4c6e-9b8b-e4d468651d78.open-xchange@ox.pcextreme.nl> Message-ID: <498850626.2659.160e133c-ee3f-4c6e-9b8b-e4d468651d78.open-xchange@ox.pcextreme.nl> I looked into the further and it seems that there is no default port for LMTP in Dovecot. I patched the code and this seems right: https://github.com/wido/core/commit/a5917908850eb570ca441517e6bc33f6ce63ed7a This will make the LMTP client connect to TCP port 24 if no port has been provided. I will submitted it as a Pull Request on Github: https://github.com/dovecot/core/pull/6 Wido > Op 9 april 2016 om 11:25 schreef Wido den Hollander : > > > Hi, > > I am trying to set up a Dovecot proxy which proxies through POP3, IMAP and > LTMP > towards a different Dovecot machine. > > On the proxy machine I use a MySQL database as a userdb and passwdb backend > and > it returns the proper information as described here: > http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy > > IMAP and POP3 works just fine, but with LMTP I run into a problem. > > On the 'proxy' machine Postfix is also running and it deliver locally to LTMP > via Socket: > > virtual_transport = lmtp:unix:private/dovecot-lmtp > > Dovecot there is also configured to proxy LTMP: > > lmtp_proxy = yes > > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > > So far so good. A telnet to localhost 110 or 143 allows me to log in to the > POP3/IMAP. > > When Postfix delivers the message locally to Dovecot through LTMP it tries to > proxy it though. > > When doing so it tries to connect to TCP port 0 (zero). > > dovecot: lmtp(22580): Error: lmtp client: connect(mbox01.XXXX.nl, 0) failed: > Connection refused > > I know I can return the 'port' field in the userdb query, but the same query > is > used for POP3, IMAP and LMTP. So that can't be hardcoded. > > I fixed it for now with a CASE statement in SQL: > > password_query = SELECT b.hostname AS host, NULL AS password, \ > 'Y' AS nopassword, u.email AS destuser, 'Y' AS proxy, \ > CASE '%s' WHEN 'lmtp' THEN 2525 WHEN 'pop3' THEN 110 WHEN 'imap' THEN > 143 > END AS port \ > FROM User u, Backend b, Domain d \ > WHERE u.domainID = d.domainID \ > AND b.backendID = d.backendID \ > AND u.email = '%u' > > %s is a variable containing the service Dovecot is trying to look up. > > This is however rather hacky. > > On my destination machine LMTP is listening on port 2525. Is there any way to > tell the Dovecot LTMP client to connect to port 2525 by default? > > Thanks, > > Wido From dion at dion.org.ua Sat Apr 9 17:38:34 2016 From: dion at dion.org.ua (Dmitry Nezhevenko) Date: Sat, 9 Apr 2016 20:38:34 +0300 Subject: mdbox and shared \Seen flag Message-ID: <20160409173834.GA30072@debpad.local> Hi, I've just switched mail storage from maildir to mdbox and found it's very amazing. The only question I've is related to shared mailboxes. In the past I've had a few mailboxes that were shared between two users by just symlinking maildir. So everything was shared including flags and \Seen status. Now I want to get something like this. As far as I understand, "shared" namespace will keep \Seen flag private. So any suggestions how to make \Seen shared? My idea is to create some 'private' mdbox-based namespace that points to fixed location on server, that doesn't depends on username? Is it safe (in terms of locking, accessing indexes, etc)? I'm 100% sure that nobody except dovecot will access it. PS. It's latest version of dovecot. Thanks. -- WBR, Dmitry From tlx at leuxner.net Sat Apr 9 17:47:47 2016 From: tlx at leuxner.net (Thomas Leuxner) Date: Sat, 9 Apr 2016 19:47:47 +0200 Subject: mdbox and shared \Seen flag In-Reply-To: <20160409173834.GA30072@debpad.local> References: <20160409173834.GA30072@debpad.local> Message-ID: <20160409174736.GA42408@nihlus.leuxner.net> * Dmitry Nezhevenko 2016.04.09 19:38: > As far as I understand, "shared" namespace will keep \Seen flag private. > So any suggestions how to make \Seen shared? This can be done using INDEXPVT: location = mdbox:/var/vmail/shared:INDEXPVT=~/mdbox/shared http://wiki2.dovecot.org/SharedMailboxes/Shared -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: Digital signature URL: From bostjan at a2o.si Sat Apr 9 18:04:14 2016 From: bostjan at a2o.si (Bostjan Skufca) Date: Sat, 9 Apr 2016 20:04:14 +0200 Subject: Slow reading of large dovecot-uidlist files Message-ID: Hi there, (context: I was optimizing Roundcube mailbox list server response, and in that 300-400ms response time, around 170ms is spent on single fgets() call which is waiting IMAP repsonse to "SELECT MyMailbox" command) I straced dovecot and of the whole request/response process, around 30ms is spent for everything else, and overwhelming majority of time (150-170ms) is spent for reading dovecot-uidlist file for given mailbox. I skimmed over src/lib-storage/index/maildir/maildir-uidlist.c and src/src/lib/istream.c, but I am out of ideas on how to optimize mentioned file reading elegantly to make it faster. Is there any way to cache parsed content of uidlist file(s) or some other obvious quicktrick I am missing to speed this process up? Does anyone have any other ideas, how to speed this up? b. From dion at dion.org.ua Sat Apr 9 19:34:14 2016 From: dion at dion.org.ua (Dmitry Nezhevenko) Date: Sat, 9 Apr 2016 22:34:14 +0300 Subject: mdbox and shared \Seen flag In-Reply-To: <20160409174736.GA42408@nihlus.leuxner.net> References: <20160409173834.GA30072@debpad.local> <20160409174736.GA42408@nihlus.leuxner.net> Message-ID: <20160409193414.GA1696@debpad.local> On Sat, Apr 09, 2016 at 07:47:47PM +0200, Thomas Leuxner wrote: > * Dmitry Nezhevenko 2016.04.09 19:38: > > > As far as I understand, "shared" namespace will keep \Seen flag private. > > So any suggestions how to make \Seen shared? > > This can be done using INDEXPVT: > > location = mdbox:/var/vmail/shared:INDEXPVT=~/mdbox/shared > > http://wiki2.dovecot.org/SharedMailboxes/Shared Hi, I've actually asked how to make \Seen shared (one user marks message as read, others see it read too). It looks like just removing INDEXPVT fixes it for me. Thanks a lot! -- WBR, Dmitry From adrian.minta at gmail.com Sun Apr 10 08:27:15 2016 From: adrian.minta at gmail.com (Adrian Minta) Date: Sun, 10 Apr 2016 11:27:15 +0300 Subject: Slow reading of large dovecot-uidlist files In-Reply-To: References: Message-ID: <570A0E63.1050907@gmail.com> It will be nice if the "SELECT MyMailbox" command will be "SELECT mymailbox LIMIT 100" or something, to get the first files since only the last messages are shown to the user. I don't know if "Limit" clause is available over IMAP. On 04/09/2016 09:04 PM, Bostjan Skufca wrote: > Hi there, > > (context: I was optimizing Roundcube mailbox list server response, and in > that 300-400ms response time, around 170ms is spent on single fgets() call > which is waiting IMAP repsonse to "SELECT MyMailbox" command) > > I straced dovecot and of the whole request/response process, around 30ms is > spent for everything else, and overwhelming majority of time (150-170ms) is > spent for reading dovecot-uidlist file for given mailbox. > > I skimmed over src/lib-storage/index/maildir/maildir-uidlist.c > and src/src/lib/istream.c, but I am out of ideas on how to optimize > mentioned file reading elegantly to make it faster. > > Is there any way to cache parsed content of uidlist file(s) or some other > obvious quicktrick I am missing to speed this process up? > > Does anyone have any other ideas, how to speed this up? > > > b. -- Best regards, Adrian Minta From daniel-dovecot at demus.dk Sun Apr 10 08:43:25 2016 From: daniel-dovecot at demus.dk (Daniel Demus) Date: Sun, 10 Apr 2016 10:43:25 +0200 Subject: Segfaults in indexer when after Maildir filename S value is updated Message-ID: <570A122D.50205@demus.dk> Every now and then the S value in the Maildir filname is wrong, and is automaticcaly fixed by Dovecot while updating the index. It seems the indexer retains a handle pointing to the old filename and crashes immediately afterwards. The index is updated the next time the indexer is run, is this is only an annoyance and somethign that fills up the log. dovecot: indexer-worker(demus): Error: Maildir filename has wrong S value, renamed the file from /home/demus/Maildir/.INBOX.NYTimes/cur/1100506665.M177356P6525V0000000000000302I010100CD_0.server.demus.dk,S=12206:2,S to /home/demus/Maildir/.INBOX.NYTimes/cur/1100506665.M177356P6525V0000000000000302I010100CD_0.server.demus.dk,S=12658:2,S: 1 Time(s) dovecot: indexer-worker(demus): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x79988) [0xb6dc7988] -> /usr/lib/dovecot/libdovecot.so.0(i_warning+0) [0xb6dc7aa8] -> /usr/lib/dovecot/libdovecot.so.0(i_panic+0x64) [0xb6d6a948] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9d27c) [0xb6ed627c] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_init_stream+0x1c8) [0xb6ed67c0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x568a0) [0xb6e8f8a0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_stream+0x68) [0xb6e5f3ac] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x56678) [0xb6e8f678] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_virtual_size+0x48) [0xb6e5efd4] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_precache+0x124) [0xb6ed7ee8] -> /usr/lib/dovecot/lib20_fts_plugin.so(+0xd5d4) [0xb6b6f5d4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x40) [0xb6e5f804] -> dovecot/indexer-worker(+0x1ee8) [0x7f570ee8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x68) [0xb6ddc5cc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x120) [0xb6dddd10] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x34) [0xb6ddc684] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x50) [0xb6ddc8b4] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) [0xb6d70c84] -> dovecot/indexer-worker(main+0xe8) [0x7f570880] -> /lib/libc.so.6(__libc_start_main+0x114) [0xb6bd2b54]: 1 Time(s) dovecot: indexer-worker(demus): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x79988) [0xb6e43988] -> /usr/lib/dovecot/libdovecot.so.0(i_warning+0) [0xb6e43aa8] -> /usr/lib/dovecot/libdovecot.so.0(i_panic+0x64) [0xb6de6948] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x9d27c) [0xb6f5227c] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_init_stream+0x1c8) [0xb6f527c0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x568a0) [0xb6f0b8a0] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_stream+0x68) [0xb6edb3ac] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x56678) [0xb6f0b678] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_virtual_size+0x48) [0xb6edafd4] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_precache+0x124) [0xb6f53ee8] -> /usr/lib/dovecot/lib20_fts_plugin.so(+0xd5d4) [0xb6beb5d4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x40) [0xb6edb804] -> dovecot/indexer-worker(+0x1ee8) [0x7f5eeee8] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x68) [0xb6e585cc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x120) [0xb6e59d10] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x34) [0xb6e58684] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x50) [0xb6e588b4] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) [0xb6decc84] -> dovecot/indexer-worker(main+0xe8) [0x7f5ee880] -> /lib/libc.so.6(__libc_start_main+0x114) [0xb6c4eb54]: 1 Time(s) Regards, Daniel Demus From trashcan at ellael.org Sun Apr 10 12:49:36 2016 From: trashcan at ellael.org (Michael Grimm) Date: Sun, 10 Apr 2016 14:49:36 +0200 Subject: issues with doveadm sieve commands Message-ID: <7A7AB430-525E-4BBF-90C5-AACC6973CBC5@ellael.org> Hi This is dovecot-pigeonhole 0.4.13 and dovecot 2.2.23 at FBSD 10.3-STABLE. I am used to run doveadm sieve commands for some time now whenever updating a sieve script. Recently those commands fail with a user set explicitly, e.g.: mail> doveadm sieve list -u test doveadm(root): Error: User doesn't exist When asking for all users, I do not run into any error: mail> doveadm sieve list -u '*' user1 default ACTIVE [snip] test default ACTIVE mail> doveadm sieve list -A user1 default ACTIVE [snip] test default ACTIVE That is true for all doveadm sieve commands, but other will work, like: mail> doveadm user -u test userdb: test user : test mail : mdbox:/?path-to-maildir--/test Hmm, any idea what is going on? I do not know when those commands stopped to work, I didn't try to update my sieve scripts for some time now. Thanks and regards, Michael From nerijus at users.sourceforge.net Sun Apr 10 19:30:46 2016 From: nerijus at users.sourceforge.net (Nerijus Baliunas) Date: Sun, 10 Apr 2016 22:30:46 +0300 Subject: Segfaults in indexer when after Maildir filename S value is updated In-Reply-To: <570A122D.50205@demus.dk> References: <570A122D.50205@demus.dk> Message-ID: Hello, it is probably the same crash I reported 2 weeks ago - http://article.gmane.org/gmane.mail.imap.dovecot/85223 Regards, Nerijus On Sun, 10 Apr 2016 10:43:25 +0200 Daniel Demus wrote: > Every now and then the S value in the Maildir filname is wrong, and is > automaticcaly fixed by Dovecot while updating the index. It seems the > indexer retains a handle pointing to the old filename and crashes > immediately afterwards. The index is updated the next time the indexer > is run, is this is only an annoyance and somethign that fills up the > log. > > dovecot: indexer-worker(demus): Error: Maildir filename has wrong S > value, renamed the file from > /home/demus/Maildir/.INBOX.NYTimes/cur/1100506665.M177356P6525V0000000000000302I010100CD_0.server.demus.dk,S=12206:2,S > to > /home/demus/Maildir/.INBOX.NYTimes/cur/1100506665.M177356P6525V0000000000000302I010100CD_0.server.demus.dk,S=12658:2,S: > 1 Time(s) > dovecot: indexer-worker(demus): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0x79988) [0xb6dc7988] -> > /usr/lib/dovecot/libdovecot.so.0(i_warning+0) [0xb6dc7aa8] -> > /usr/lib/dovecot/libdovecot.so.0(i_panic+0x64) [0xb6d6a948] -> > /usr/lib/dovecot/libdovecot-storage.so.0(+0x9d27c) [0xb6ed627c] -> > /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_init_stream+0x1c8) > [0xb6ed67c0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x568a0) > [0xb6e8f8a0] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_stream+0x68) > [0xb6e5f3ac] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x56678) > [0xb6e8f678] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_virtual_size+0x48) > [0xb6e5efd4] -> > /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_precache+0x124) > [0xb6ed7ee8] -> /usr/lib/dovecot/lib20_fts_plugin.so(+0xd5d4) > [0xb6b6f5d4] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x40) > [0xb6e5f804] -> dovecot/indexer-worker(+0x1ee8) [0x7f570ee8] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x68) [0xb6ddc5cc] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x120) > [0xb6dddd10] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x34) [0xb6ddc684] > -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x50) [0xb6ddc8b4] -> > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) [0xb6d70c84] > -> dovecot/indexer-worker(main+0xe8) [0x7f570880] -> > /lib/libc.so.6(__libc_start_main+0x114) [0xb6bd2b54]: 1 Time(s) > dovecot: indexer-worker(demus): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0x79988) [0xb6e43988] -> > /usr/lib/dovecot/libdovecot.so.0(i_warning+0) [0xb6e43aa8] -> > /usr/lib/dovecot/libdovecot.so.0(i_panic+0x64) [0xb6de6948] -> > /usr/lib/dovecot/libdovecot-storage.so.0(+0x9d27c) [0xb6f5227c] -> > /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_init_stream+0x1c8) > [0xb6f527c0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x568a0) > [0xb6f0b8a0] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_stream+0x68) > [0xb6edb3ac] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x56678) > [0xb6f0b678] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_virtual_size+0x48) > [0xb6edafd4] -> > /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_precache+0x124) > [0xb6f53ee8] -> /usr/lib/dovecot/lib20_fts_plugin.so(+0xd5d4) > [0xb6beb5d4] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x40) > [0xb6edb804] -> dovecot/indexer-worker(+0x1ee8) [0x7f5eeee8] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x68) [0xb6e585cc] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x120) > [0xb6e59d10] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x34) [0xb6e58684] > -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x50) [0xb6e588b4] -> > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) [0xb6decc84] > -> dovecot/indexer-worker(main+0xe8) [0x7f5ee880] -> > /lib/libc.so.6(__libc_start_main+0x114) [0xb6c4eb54]: 1 Time(s) > > > Regards, > Daniel Demus From bostjan at a2o.si Sun Apr 10 21:35:16 2016 From: bostjan at a2o.si (Bostjan Skufca) Date: Sun, 10 Apr 2016 23:35:16 +0200 Subject: Slow reading of large dovecot-uidlist files In-Reply-To: <570A0E63.1050907@gmail.com> References: <570A0E63.1050907@gmail.com> Message-ID: I tested this by timestamping tcpdump output while issuing this command directly to dovecot (limit 100 works, but does nothing) and there is no difference, it keeps taking ~160ms to respond. b. On 10 April 2016 at 10:27, Adrian Minta wrote: > It will be nice if the "SELECT MyMailbox" command will be "SELECT > mymailbox LIMIT 100" or something, to get the first files since only the > last messages are shown to the user. > I don't know if "Limit" clause is available over IMAP. > > > > > On 04/09/2016 09:04 PM, Bostjan Skufca wrote: > >> Hi there, >> >> (context: I was optimizing Roundcube mailbox list server response, and in >> that 300-400ms response time, around 170ms is spent on single fgets() call >> which is waiting IMAP repsonse to "SELECT MyMailbox" command) >> >> I straced dovecot and of the whole request/response process, around 30ms >> is >> spent for everything else, and overwhelming majority of time (150-170ms) >> is >> spent for reading dovecot-uidlist file for given mailbox. >> >> I skimmed over src/lib-storage/index/maildir/maildir-uidlist.c >> and src/src/lib/istream.c, but I am out of ideas on how to optimize >> mentioned file reading elegantly to make it faster. >> >> Is there any way to cache parsed content of uidlist file(s) or some other >> obvious quicktrick I am missing to speed this process up? >> >> Does anyone have any other ideas, how to speed this up? >> >> >> b. >> > > -- > Best regards, > Adrian Minta > From philip at mcgaw.eu Sun Apr 10 22:54:36 2016 From: philip at mcgaw.eu (Philip McGaw) Date: Sun, 10 Apr 2016 23:54:36 +0100 Subject: Plus addressing on Sentora using Postfix In-Reply-To: References: <50B1436F-E46E-45C5-B2EE-F92CC4A6B909@mcgaw.eu> Message-ID: <932416D1-C86A-437C-A538-BD9B2C05F022@mcgaw.eu> > In dovecots 15-lda.conf uncomment the "recipient_delimiter = +" setting. The delimiter is configured in postfix but apparently not in your dovecot lda config I am not sure of the location of 15-lda.conf, however in my main dovecot.conf file I added "recipient_delimiter = +" The output of the lad part of "dovecot -n" is now > protocol lda { > mail_plugins = quota sieve > postmaster_address = postmaster at njoror.squashedfly.eu > recipient_delimiter = + > } However my mail.log file still shows every message is bounced with the following > Apr 10 23:53:23 njoror postfix/smtpd[23320]: connect from mr11p26im-asmtp004.me.com[17.110.86.109] > Apr 10 23:53:24 njoror postfix/smtpd[23320]: Anonymous TLS connection established from mr11p26im-asmtp004.me.com[17.110.86.109]: TLSv1.2 with cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits) > Apr 10 23:53:24 njoror postfix/smtpd[23320]: 6D44955ADC: client=mr11p26im-asmtp004.me.com[17.110.86.109] > Apr 10 23:53:24 njoror postfix/cleanup[23435]: 6D44955ADC: message-id=<1D905D9B-99E0-4156-A652-51D1A9BD96D0 at icloud.com> > Apr 10 23:53:24 njoror postfix/qmgr[13937]: 6D44955ADC: from=, size=2021, nrcpt=1 (queue active) > Apr 10 23:53:24 njoror postfix/pipe[23436]: 6D44955ADC: to=, relay=dovecot, delay=0.43, delays=0.34/0.01/0/0.08, dsn=4.1.1, status=SOFTBOUNCE (user unknown) > Apr 10 23:53:25 njoror postfix/smtpd[23320]: disconnect from mr11p26im-asmtp004.me.com[17.110.86.109] Any ideas on why this is still not working for me, as its now driving me right up the wall :( -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 236 bytes Desc: Message signed with OpenPGP using GPGMail URL: From ml+dovecot at valo.at Mon Apr 11 07:15:13 2016 From: ml+dovecot at valo.at (Christian Kivalo) Date: Mon, 11 Apr 2016 09:15:13 +0200 Subject: Plus addressing on Sentora using Postfix In-Reply-To: <932416D1-C86A-437C-A538-BD9B2C05F022@mcgaw.eu> References: <50B1436F-E46E-45C5-B2EE-F92CC4A6B909@mcgaw.eu> <932416D1-C86A-437C-A538-BD9B2C05F022@mcgaw.eu> Message-ID: <41fac6514ef67ff4dcfdf3b4f4490c0f@valo.at> On 2016-04-11 00:54, Philip McGaw wrote: >> In dovecots 15-lda.conf uncomment the "recipient_delimiter = +" >> setting. The delimiter is configured in postfix but apparently not in >> your dovecot lda config > > I am not sure of the location of 15-lda.conf, however in my main > dovecot.conf file I added "recipient_delimiter = +" > > The output of the lad part of "dovecot -n" is now > >> protocol lda { > >> mail_plugins = quota sieve > >> postmaster_address = postmaster at njoror.squashedfly.eu > >> recipient_delimiter = + > >> } Ok, nevermind. I suspect that sentora creates it's own config files from whatever you configure. > However my mail.log file still shows every message is bounced with the > following > >> Apr 10 23:53:23 njoror postfix/smtpd[23320]: connect from >> mr11p26im-asmtp004.me.com[17.110.86.109] >> Apr 10 23:53:24 njoror postfix/smtpd[23320]: Anonymous TLS connection >> established from mr11p26im-asmtp004.me.com[17.110.86.109]: TLSv1.2 >> with cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits) >> Apr 10 23:53:24 njoror postfix/smtpd[23320]: 6D44955ADC: >> client=mr11p26im-asmtp004.me.com[17.110.86.109] >> Apr 10 23:53:24 njoror postfix/cleanup[23435]: 6D44955ADC: >> message-id=<1D905D9B-99E0-4156-A652-51D1A9BD96D0 at icloud.com> >> Apr 10 23:53:24 njoror postfix/qmgr[13937]: 6D44955ADC: >> from=, size=2021, nrcpt=1 (queue active) >> Apr 10 23:53:24 njoror postfix/pipe[23436]: 6D44955ADC: >> to=, relay=dovecot, delay=0.43, >> delays=0.34/0.01/0/0.08, dsn=4.1.1, status=SOFTBOUNCE (user unknown) >> Apr 10 23:53:25 njoror postfix/smtpd[23320]: disconnect from >> mr11p26im-asmtp004.me.com[17.110.86.109] > > Any ideas on why this is still not working for me, as its now driving > me right up the wall :( What's in your dovecot log? It should log something and maybe give a hint on whats wrong. Also take a look at the LDA wiki page http://wiki2.dovecot.org/LDA -- Christian Kivalo From pali.rohar at gmail.com Mon Apr 11 10:44:02 2016 From: pali.rohar at gmail.com (Pali =?utf-8?B?Um9ow6Fy?=) Date: Mon, 11 Apr 2016 12:44:02 +0200 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <201604041935.23571@pali> <201604061629.43612@pali> Message-ID: <20160411104402.GR8413@pali> On Thursday 07 April 2016 16:11:12 Timo Sirainen wrote: > On 06 Apr 2016, at 17:29, Pali Roh?r wrote: > > > > On Monday 04 April 2016 19:35:22 Pali Roh?r wrote: > >> On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: > >>> Can you please send them directly to me, please? > >>> --- > >>> Aki Tuomi > >> > >> Sent. > > > > Received? Are patches OK now? > > It would be nice if each commit was accompanied with the corresponding unit test change in test-message-address.c. Now that the unit test changes are done in a separate commit I'm not really sure which test change is testing which commit or if some tests are missing. At least the "Quote and escape strings if needed" patch needs more tests for different kinds of escapes/atext/non-atext chars and =? in strings. > Ok. If you really need that I can rework my patches. But I'm thinking what to do with tests... I have written lot of examples and tests scenarios in perl for that new perl module. But dovecot test framework is not easy to use as perl Test::More/Test::Spec and such complicated tests which I have are really hard to write directory for dovecot... Anyway, are you recofigured dovecot mailing list filter to finally accept git patches? Now you have all emails, so you should know what hit "drop" action and probably also how to fix it... -- Pali Roh?r pali.rohar at gmail.com From abi at oleane.net Mon Apr 11 11:07:15 2016 From: abi at oleane.net (abi at oleane.net) Date: Mon, 11 Apr 2016 13:07:15 +0200 Subject: enable/disable shared namespace in passdb In-Reply-To: References: <570241CB.3010005@oleane.net> Message-ID: <570B8563.9040206@oleane.net> hello. i gave a different name to the namespace. now i can properly disable it from passdb (so i do not produce a loops with shared namespaces configured with imapc) --- but providing a name breaks even local acls with the following config namespace sharedboxes { type = shared list = yes # children disabled = no # should be yes, but this is convenient when testing with doveadm separator = / # useful ? does not change a thing... direcgt access is ok, imapc is broken prefix = shared/%%u/ # THIS MAKES USE OF THE LOCAL FILESYSTEM FOR THE REMOTE USER'S MAILBOX LOCATION. WORKS BUT NOT CLUSTER-SAFE # NOTE : specifying a separate INDEX allows for unshared flags # NOTE : userdb sets mail location to maildir:~/dovemail:INBOX=~/dovemail/.INBOX location = maildir:%%h/dovemail/ # :INDEXPVT=~/dovemail/private_indexes/%%u # THIS ONE IS CLUSTER-SAFE BUT CURRENTLY DOES NOT WORK #location = imapc:~/dovemail/shared/%%u/ # cache for shared indexes } acl debug produces the following output # doveadm acl debug -u abi3 at oleane.fr.fto shared/abi2 at oleane.fr.fto/AA doveadm(abi3 at oleane.fr.fto): Error: Mailbox 'shared.abi2 at oleane\2efr\2efto.AA' in namespace '' doesn't exist in /var/mailboxes/mail02b/fr.fto/o/l/oleane/abi3/home/dovemail/.shared.abi2 at oleane\2efr\2efto.AA --- but if i remove "sharedboxes", it works as expected # doveadm acl debug -u abi3 at oleane.fr.fto shared/abi2 at oleane.fr.fto/AA doveadm(abi3 at oleane.fr.fto): Info: Mailbox 'AA' is in namespace 'shared/abi2 at oleane.fr.fto/' doveadm(abi3 at oleane.fr.fto): Info: Mailbox path: /var/mailboxes/mail02b/fr.fto/o/l/oleane/abi2/home/dovemail/.AA doveadm(abi3 at oleane.fr.fto): Info: All message flags are shared across users in mailbox doveadm(abi3 at oleane.fr.fto): Info: User abi3 at oleane.fr.fto has rights: lookup read write write-seen write-deleted insert post expunge create delete admin doveadm(abi3 at oleane.fr.fto): Info: Mailbox found from dovecot-acl-list doveadm(abi3 at oleane.fr.fto): Info: User abi2 at oleane.fr.fto found from ACL shared dict doveadm(abi3 at oleane.fr.fto): Info: Mailbox shared/abi2 at oleane.fr.fto/AA is visible in LIST i also tried changing the prefix to sharedboxes/%%u/ and changing the debug command accordingly but that did not make a difference. --- if i try the same config ( without naming the namespace ) with imapc ( using the location line that is commented in the above config sample ) it does not seem to loop when using doveadm debug, but it does not work either # doveadm acl debug -u abi3 at oleane.fr.fto shared/abi2 at oleane.fr.fto/AA doveadm(abi3 at oleane.fr.fto): Info: Mailbox 'AA' is in namespace 'shared/abi2 at oleane.fr.fto/' doveadm(abi3 at oleane.fr.fto): Info: Mailbox path: /var/mailboxes/mail02b/fr.fto/o/l/oleane/abi3/home/dovemail/shared/abi2 at oleane.fr.fto/.AA doveadm(abi3 at oleane.fr.fto): Info: All message flags are shared across users in mailbox doveadm(abi3 at oleane.fr.fto): Info: User abi3 at oleane.fr.fto has no rights for mailbox doveadm(abi3 at oleane.fr.fto): Error: User abi3 at oleane.fr.fto is missing 'lookup' right doveadm(abi3 at oleane.fr.fto): Info: Mailbox shared/abi2 at oleane.fr.fto/AA is NOT visible in LIST the log show that the proper dovecot-acl file is read when ~abi logs in as ~abi2, but i do not see any trace of the acls being read over imap nor directly in the filesystem if i actually use imap, i produce a loop ( rather a storm in fact if i setup many to many shares ) and end up with an empty shared namespace what did i miss ? thanks for your help alex Le 06/04/2016 21:41, Timo Sirainen a ?crit : > On 04 Apr 2016, at 13:28, abi at oleane.net wrote: >> namespace shared { >> type = shared >> list = yes # children >> disabled = yes >> separator = / >> prefix = shared/%%u/ >> location = imapc:~/dovemail/shared/%%u/ >> } > Don't you get a warning with this? > > Warning: Obsolete setting in dovecot.conf:1: namespace shared {} has been replaced by namespace { type=shared } > > This is because of the v1.x dovecot.conf auto-conversion code. Try giving it a different name than "shared" and see if it works. > From order at mxgr.de Mon Apr 11 12:06:45 2016 From: order at mxgr.de (Max) Date: Mon, 11 Apr 2016 14:06:45 +0200 Subject: doveadm sync ignores -u option Message-ID: <20160411120645.GB6225@4k.mxgr.de> Hi, Since I upgraded from 2.2.21 to 2.2.23, the user option -u seems to be ignored by doveadm sync, or at least it doesn't handle it correctly. If I run the following in the shell as user 'max': % doveadm sync -u foo at example.com -d doveadm(max): Error: User doesn't exist I get it to work if I set the USER environment variable to foo at example.com: % USER=foo at example.com doveadm sync -u foo at example.com -d # sync runs as expected. Kind Regards, Max From sergey.schwartz at bgoperator.com Mon Apr 11 17:20:15 2016 From: sergey.schwartz at bgoperator.com (Sergey Schwartz) Date: Mon, 11 Apr 2016 20:20:15 +0300 Subject: [Dovecot] Replication and public namespaces In-Reply-To: <5705E250.4080205@gameduell.de> References: <52DA80D4.3000900@gekmihesg.de> <56E9795C.2040003@gameduell.de> <56EA4533.1080505@gameduell.de> <56FBF4A5.8000103@gameduell.de> <56FCE92A.9000700@bgoperator.com> <5705E250.4080205@gameduell.de> Message-ID: <570BDCCF.1030900@bgoperator.com> Georg, I don't think you need to do any extra work, just replicate INBOX namespace. For my setup any shared mailbox is actually someone's mailbox from INBOX namespace and it is replicated normally. Best regards, Sergey Schwartz Senior System Administrator Biblio Globus Tour Operator www.bgoperator.ru T: +7 495 5042500 ext 1532 E: sergey.schwartz at bgoperator.com 07.04.2016 07:30, Georg Schuetze ?????: > On 03/31/2016 11:08 AM, Sergey Schwartz wrote: >> There is a workaround - limit replication scope with INBOX namespace >> only. > Sergey, > > thanks for pointing that out. > I already thought of that, but this means, that i need some extra > periodic replication for the public namespaces (hence on a failover, > there is likely something missing). > > Best, > Georg. From dion at dion.org.ua Tue Apr 12 08:05:08 2016 From: dion at dion.org.ua (Dmitry Nezhevenko) Date: Tue, 12 Apr 2016 11:05:08 +0300 Subject: fts-lucene with virtual folders Message-ID: <20160412080508.GA30106@debpad.local> Hi, It looks like I've found something strange. It looks like dovecot updates fts-lucene index every time I'm opening virtual folder that contains FTS query: indexer-worker(dion): Warning: fts-lucene: Settings have changed, rebuilding index for mailbox dovecot-virtual is pretty simple: archive/INBOX BODY "test" first of all, I'm trying to perform FTS in archive/INBOX itself, then I'm trying to open virtual folder. both default namespace and 'archive' are private namespaces with mdbox storage. plugin { fts = lucene fts_lucene = whitespace_chars=@. fts_autoindex = no } Any suggestions? -- WBR, Dmitry -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: not available URL: From alec at alec.pl Tue Apr 12 08:23:15 2016 From: alec at alec.pl (A.L.E.C) Date: Tue, 12 Apr 2016 10:23:15 +0200 Subject: Slow reading of large dovecot-uidlist files In-Reply-To: <570A0E63.1050907@gmail.com> References: <570A0E63.1050907@gmail.com> Message-ID: <570CB073.9050208@alec.pl> On 04/10/2016 10:27 AM, Adrian Minta wrote: > It will be nice if the "SELECT MyMailbox" command will be "SELECT > mymailbox LIMIT 100" or something, to get the first files since only the > last messages are shown to the user. SELECTing a mailbox has nothing to do with FETCHing messages, so above does not make much sense. I don't know dovecot's code, but I suppose it uses uidlist file to get mailbox statistics that it returns as EXISTS, RECENT, UNSEEN, UIDNEXT, UIDVALIDITY, etc, which are required by IMAP standard. I don't know, maybe they could be stored in more optimized way, but I think in most cases this data is also needed for SORT/THREAD/FETCH which is sent after SELECT in many cases - so it will be needed anyway. There are cases (e.g. mailbox synchronization) when you indeed do only SELECT. -- Aleksander 'A.L.E.C' Machniak Kolab Groupware Developer [http://kolab.org] Roundcube Webmail Developer [http://roundcube.net] --------------------------------------------------- PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl From dion at dion.org.ua Tue Apr 12 08:26:05 2016 From: dion at dion.org.ua (Dmitry Nezhevenko) Date: Tue, 12 Apr 2016 11:26:05 +0300 Subject: fts-lucene with virtual folders In-Reply-To: <20160412080508.GA30106@debpad.local> References: <20160412080508.GA30106@debpad.local> Message-ID: <20160412082605.GA20421@debpad.local> On Tue, Apr 12, 2016 at 11:05:08AM +0300, Dmitry Nezhevenko wrote: > Hi, > > It looks like I've found something strange. It looks like dovecot > updates fts-lucene index every time I'm opening virtual folder that > contains FTS query: > > indexer-worker(dion): Warning: fts-lucene: Settings have changed, rebuilding index for mailbox > Ok. It seems that it's unrelated to virtual at all. It's enough to just use any folder from non-inbox private namespace and perform FTS multiple times. I've added a few debug prints around fts_lucene_settings_checksum, fts_index_have_compatible_settings and fts_index_set_header and fount that fts_lucene_settings_checksum is always same. The root issue is that fts_lucene_settings_checksum reads checksum from mailbox with empty name (probably namespace root mbox). At the same time fts_index_set_header is called for all mailboxes in namespace except this 'root' mbox. That's actually why I'm always getting 'Settings have changed' warning. I've tried to create 'archive' mailbox (same as namespace name) and got call to fts_index_set_header() for it during scan, but with zero settings_checksum. Any suggestions how to fix it? -- WBR, Dmitry -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: not available URL: From bostjan at a2o.si Tue Apr 12 08:43:53 2016 From: bostjan at a2o.si (Bostjan Skufca) Date: Tue, 12 Apr 2016 10:43:53 +0200 Subject: Slow reading of large dovecot-uidlist files In-Reply-To: <570CB073.9050208@alec.pl> References: <570A0E63.1050907@gmail.com> <570CB073.9050208@alec.pl> Message-ID: On 12 April 2016 at 10:23, A.L.E.C wrote: > I don't know dovecot's code, but I suppose it uses uidlist file to get > mailbox statistics that it returns as EXISTS, RECENT, UNSEEN, UIDNEXT, > UIDVALIDITY, etc, which are required by IMAP standard. I don't know, > maybe they could be stored in more optimized way, but I think in most > cases this data is also needed for SORT/THREAD/FETCH which is sent after > SELECT in many cases - so it will be needed anyway. There are cases > (e.g. mailbox synchronization) when you indeed do only SELECT. > (Oh, Alec, hi :) Can someone (who is more intimate with Dovecot's internals) comment on what dovecot is actually doing, where this time is being spent? That would be awesome:) My uidfile is 4MB "large" and reading it takes about 3ms on my system, so there is still ~160ms (98%) of dovecot's delay that is unaccounted for. BTW: I would have thought that the whole process goes like this: - user logs in, dovecot imap process starts - "SELECT MyMailbox" is issued for the first time - dovecot reads uidlist file for that mailbox and caches it along with timestamp metadata - on subsequent requests, uidlist file is stat-ed to detect any changes (changed by i.e. another process that handles same user's connection, from another device) and trigger rereading when needed, otherwise cache is used - I would imagine having certain (fairly low) TTL on the cache to prevent too much memory consumption would be nice, too. Would that make sense? (I am just trying to figure out the way how to optimize response time to SELECT and thus make rendering mailbox listing in Roundcube faster, or, better, acceptable.) Best, b. > > -- > Aleksander 'A.L.E.C' Machniak > Kolab Groupware Developer [http://kolab.org] > Roundcube Webmail Developer [http://roundcube.net] > --------------------------------------------------- > PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl > From dion at dion.org.ua Tue Apr 12 09:40:55 2016 From: dion at dion.org.ua (Dmitry Nezhevenko) Date: Tue, 12 Apr 2016 12:40:55 +0300 Subject: fts-lucene with virtual folders In-Reply-To: <20160412082605.GA20421@debpad.local> References: <20160412080508.GA30106@debpad.local> <20160412082605.GA20421@debpad.local> Message-ID: <20160412094055.GA533@debpad.local> On Tue, Apr 12, 2016 at 11:26:05AM +0300, Dmitry Nezhevenko wrote: > On Tue, Apr 12, 2016 at 11:05:08AM +0300, Dmitry Nezhevenko wrote: > > indexer-worker(dion): Warning: fts-lucene: Settings have changed, rebuilding index for mailbox > The root issue is that fts_lucene_settings_checksum reads checksum from > mailbox with empty name (probably namespace root mbox). At the same time > fts_index_set_header is called for all mailboxes in namespace except this > 'root' mbox. This proof-of-concept patch fixes issue for me. I don't think that this is right way to fix it. I've copied vname calculation code from fts_index_have_compatible_settings. Maybe it's better to create something like fts_index_write_settings_checksum() in fts-api. Index: dovecot-2.2.22/src/plugins/fts-lucene/lucene-wrapper.cc =================================================================== --- dovecot-2.2.22.orig/src/plugins/fts-lucene/lucene-wrapper.cc +++ dovecot-2.2.22/src/plugins/fts-lucene/lucene-wrapper.cc @@ -832,6 +832,11 @@ static void rescan_clear_unseen_mailboxe struct mailbox_metadata metadata; struct fts_index_header hdr; + struct mail_namespace *ns; + const char* vname; + struct fts_index_header hdr_root; + unsigned int len; + memset(&hdr, 0, sizeof(hdr)); hdr.settings_checksum = fts_lucene_settings_checksum(&index->set); @@ -852,6 +857,26 @@ static void rescan_clear_unseen_mailboxe mailbox_free(&box); } (void)mailbox_list_iter_deinit(&iter); + + // Make sure we've stored settings checksum for non-INBOX namespaces + ns = mailbox_list_get_namespace(index->list); + if ((ns->flags & NAMESPACE_FLAG_INBOX_USER) == 0) { + len = strlen(ns->prefix); + if (len > 0 && ns->prefix[len-1] == mail_namespace_get_sep(ns)) + len--; + vname = t_strndup(ns->prefix, len); + + box = mailbox_alloc(index->list, vname, + (enum mailbox_flags)0); + if (mailbox_open(box) == 0 && + fts_index_get_header(box, &hdr_root)) { + if (hdr_root.settings_checksum != hdr.settings_checksum) { + hdr_root.settings_checksum = hdr.settings_checksum; + (void)fts_index_set_header(box, &hdr_root); + } + } + mailbox_free(&box); + } } int lucene_index_rescan(struct lucene_index *index) -- WBR, Dmitry -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: not available URL: From ve at vetienne.net Tue Apr 12 11:32:05 2016 From: ve at vetienne.net (ve at vetienne.net) Date: Tue, 12 Apr 2016 11:32:05 +0000 Subject: doveadm sync ignores -u option In-Reply-To: <20160411120645.GB6225@4k.mxgr.de> References: <20160411120645.GB6225@4k.mxgr.de> Message-ID: <1bb3818eb4372a6c40ac58109794ecab@webmail.aprogsys.com> 11 avril 2016 14:07 "Max" a ?crit: > Hi, > > Since I upgraded from 2.2.21 to 2.2.23, the user option -u seems to be ignored > by doveadm sync, or at least it doesn't handle it correctly. > I can confirm it breaks replication for me ( multiple user so i have to replicate through ssh by user root as described in replication wiki page ). No longer work with 2.2.23, reverting to 2.2.22 get it back to a working state Log filled with : Apr 12 09:52:03 mailhost dovecot: doveadm: Error: doveadm(root): Error: Invalid settings in userdb: userdb returned 0 as uid Apr 12 09:52:03 mailhost dovecot: doveadm: Error: doveadm(root): Error: User lookup failed: Invalid user settings. Refer to server log for more information. Regards Vincent ETIENNE From skdovecot at smail.inf.fh-brs.de Tue Apr 12 12:04:42 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Tue, 12 Apr 2016 14:04:42 +0200 (CEST) Subject: Slow reading of large dovecot-uidlist files In-Reply-To: References: <570A0E63.1050907@gmail.com> <570CB073.9050208@alec.pl> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 12 Apr 2016, Bostjan Skufca wrote: > On 12 April 2016 at 10:23, A.L.E.C wrote: > >> I don't know dovecot's code, but I suppose it uses uidlist file to get >> mailbox statistics that it returns as EXISTS, RECENT, UNSEEN, UIDNEXT, >> UIDVALIDITY, etc, which are required by IMAP standard. I don't know, >> maybe they could be stored in more optimized way, but I think in most >> cases this data is also needed for SORT/THREAD/FETCH which is sent after >> SELECT in many cases - so it will be needed anyway. There are cases >> (e.g. mailbox synchronization) when you indeed do only SELECT. >> > > (Oh, Alec, hi :) > > Can someone (who is more intimate with Dovecot's internals) comment on what > dovecot is actually doing, where this time is being spent? That would be > awesome:) > > My uidfile is 4MB "large" and reading it takes about 3ms on my system, so > there is still ~160ms (98%) of dovecot's delay that is unaccounted for. You could try to trace Dovecot and see if there are a lot of syscalls when a new connection starts up, e.g. with strace or dtruss. > BTW: I would have thought that the whole process goes like this: > - user logs in, dovecot imap process starts > - "SELECT MyMailbox" is issued for the first time > - dovecot reads uidlist file for that mailbox and caches it along with > timestamp metadata does your mailboxes change without Dovecot? Do you have some script or something like that that causes the mtime of the directory change? If Dovecot thinks an external program changed the mailbox, it validates all messages in cache and from store. > - on subsequent requests, uidlist file is stat-ed to detect any changes > (changed by i.e. another process that handles same user's connection, from > another device) and trigger rereading when needed, otherwise cache is used > - I would imagine having certain (fairly low) TTL on the cache to prevent > too much memory consumption would be nice, too. > > Would that make sense? > > (I am just trying to figure out the way how to optimize response time to > SELECT and thus make rendering mailbox listing in Roundcube faster, or, > better, acceptable.) > > > Best, > b. > > > >> >> -- >> Aleksander 'A.L.E.C' Machniak >> Kolab Groupware Developer [http://kolab.org] >> Roundcube Webmail Developer [http://roundcube.net] >> --------------------------------------------------- >> PGP: 19359DC1 @@ GG: 2275252 @@ WWW: http://alec.pl >> > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVwzkWnz1H7kL/d9rAQLxzgf/VYvyXO2AhhpMO96EWHekgUZAFx8f+Wn+ UKJcVcbRVUvabo+8CDHyqClLbBugGDJfYDVMTOLplIJ3ZrExRqbh3sENmoRYnk8q nlWoKuwoskUYYM30Ax9yYuVxDzhGOdrI7TDrojsnJgyV1w8u8jMW6iCi1ziYvcIc u34DvOBLL16biP/rqziCouTbOZcsy9wL/T7RgBE/27ph651I7A8kQ3udfKWMW0gn +EIaDWquVnHmgozP93Ln0TpN5tMi9GW50zNmT8tWUnr07aYc3E5vaS3uYLvwxVx9 P5WIVgEObF4+BrZVCFfVRpkp51hxngk2k70RdmjgzD1dOSGGLELZkw== =j6AD -----END PGP SIGNATURE----- From philip at mcgaw.eu Tue Apr 12 12:56:33 2016 From: philip at mcgaw.eu (Philip McGaw) Date: Tue, 12 Apr 2016 13:56:33 +0100 Subject: Plus addressing on Sentora using Postfix In-Reply-To: <41fac6514ef67ff4dcfdf3b4f4490c0f@valo.at> References: <50B1436F-E46E-45C5-B2EE-F92CC4A6B909@mcgaw.eu> <932416D1-C86A-437C-A538-BD9B2C05F022@mcgaw.eu> <41fac6514ef67ff4dcfdf3b4f4490c0f@valo.at> Message-ID: <8B15DCE8-5CC4-4658-8379-ED29B613AC24@mcgaw.eu> Dovecot.log Dovecot-info.log Dovecot-debug.log Are all devoid of information, the only log that seems to give anything is mail.log I edited the working dovecot config file to add in recipient_delimiter = + line. And it shows up when running Dovecot -n. Sent from my iPhone > On 11 Apr 2016, at 08:15, Christian Kivalo wrote: > > On 2016-04-11 00:54, Philip McGaw wrote: >>> In dovecots 15-lda.conf uncomment the "recipient_delimiter = +" setting. The delimiter is configured in postfix but apparently not in your dovecot lda config >> I am not sure of the location of 15-lda.conf, however in my main >> dovecot.conf file I added "recipient_delimiter = +" >> The output of the lad part of "dovecot -n" is now >>> protocol lda { >>> mail_plugins = quota sieve >>> postmaster_address = postmaster at njoror.squashedfly.eu >>> recipient_delimiter = + >>> } > > Ok, nevermind. I suspect that sentora creates it's own config files from whatever you configure. > >> However my mail.log file still shows every message is bounced with the following >>> Apr 10 23:53:23 njoror postfix/smtpd[23320]: connect from mr11p26im-asmtp004.me.com[17.110.86.109] >>> Apr 10 23:53:24 njoror postfix/smtpd[23320]: Anonymous TLS connection established from mr11p26im-asmtp004.me.com[17.110.86.109]: TLSv1.2 with cipher DHE-RSA-AES128-GCM-SHA256 (128/128 bits) >>> Apr 10 23:53:24 njoror postfix/smtpd[23320]: 6D44955ADC: client=mr11p26im-asmtp004.me.com[17.110.86.109] >>> Apr 10 23:53:24 njoror postfix/cleanup[23435]: 6D44955ADC: message-id=<1D905D9B-99E0-4156-A652-51D1A9BD96D0 at icloud.com> >>> Apr 10 23:53:24 njoror postfix/qmgr[13937]: 6D44955ADC: from=, size=2021, nrcpt=1 (queue active) >>> Apr 10 23:53:24 njoror postfix/pipe[23436]: 6D44955ADC: to=, relay=dovecot, delay=0.43, delays=0.34/0.01/0/0.08, dsn=4.1.1, status=SOFTBOUNCE (user unknown) >>> Apr 10 23:53:25 njoror postfix/smtpd[23320]: disconnect from mr11p26im-asmtp004.me.com[17.110.86.109] >> Any ideas on why this is still not working for me, as its now driving >> me right up the wall :( > > What's in your dovecot log? It should log something and maybe give a hint on whats wrong. > > Also take a look at the LDA wiki page http://wiki2.dovecot.org/LDA > > -- > Christian Kivalo > From bostjan at a2o.si Tue Apr 12 13:31:10 2016 From: bostjan at a2o.si (Bostjan Skufca) Date: Tue, 12 Apr 2016 15:31:10 +0200 Subject: Slow reading of large dovecot-uidlist files In-Reply-To: References: <570A0E63.1050907@gmail.com> <570CB073.9050208@alec.pl> Message-ID: On 12 April 2016 at 14:04, Steffen Kaiser wrote: > > You could try to trace Dovecot and see if there are a lot of syscalls when > a new connection starts up, e.g. with strace or dtruss. Not that many, if I exclude reading the uidlist file contents. See the trace below. does your mailboxes change without Dovecot? Do you have some script or > something like that that causes the mtime of the directory change? If > Dovecot thinks an external program changed the mailbox, it validates all > messages in cache and from store. Are you talking about main directory of mailbox, where /cur, /new etc reside? Nothing external touches it, we migrated postfix LDA to dovecot LDA for this very reason. What I observed now: dovecot creates a dovecot-uidlist.lock file on average once every minute. The reason is Roundcube's minutely refresh configuration. However, even with that disabled and dir mtime not updated, if I issue SELECT, it rereads uidlist file entirely. I can see in strace there is no .lock file manipulation and no change in dir mtime. b. strace output: ====================== {{EPOLLIN, {u32=22457424, u64=22457424}}}, 5, 1780008) = 1 13:07:35.305074 read(7, "A0002 SELECT Gmail\r\n", 5336) = 20 13:07:35.305180 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/tmp", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 13:07:35.305261 stat("/var/mail/virtual/stage.mail.teon.si/bostjan/.Gmail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 13:07:35.305305 stat("/var/mail/virtual/stage.mail.teon.si/bostjan/.Gmail", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 13:07:35.305343 open("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", O_RDWR|O_APPEND) = 13 13:07:35.305379 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.305409 pread(13, "\1\2(\0\330\22\0W\\\0\0\0[\0\0\0(\251\1\0\314\270\1Wp\22\1\0\0\0\0\0"..., 40, 0) = 40 13:07:35.305445 open("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot.index", O_RDWR) = 14 13:07:35.305476 fstat(14, {st_mode=S_IFREG|0600, st_size=1686936, ...}) = 0 13:07:35.305507 mmap(NULL, 1686936, PROT_READ|PROT_WRITE, MAP_PRIVATE, 14, 0) = 0x7f9540451000 13:07:35.305562 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.305596 pread(13, "\200\200\200\205\4\0\0\0\204\22\1\0\204\22\1\0\10\0\0\0\200\200\200\203\0\0\10\20X\0\0\0"..., 8192, 10284) = 3980 13:07:35.305626 pread(13, "", 8192, 14264) = 0 13:07:35.305657 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.305684 mmap(NULL, 14264, PROT_READ, MAP_SHARED, 13, 0) = 0x7f95405fc000 13:07:35.305712 madvise(0x7f95405fc000, 14264, MADV_SEQUENTIAL) = 0 13:07:35.305738 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.306249 munmap(0x7f9540451000, 1686936) = 0 13:07:35.306387 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/new", {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 13:07:35.306429 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/cur", {st_mode=S_IFDIR|0700, st_size=6311936, ...}) = 0 13:07:35.306482 umask(0177) = 077 13:07:35.306512 lstat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", 0x7ffea1ef7bd0) = -1 ENOENT (No such file or directory) 13:07:35.306553 open("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", O_RDWR|O_CREAT|O_EXCL, 0666) = 15 13:07:35.306618 write(15, "9815:labrat-1", 13) = 13 13:07:35.306662 fstat(15, {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 13:07:35.306690 close(15) = 0 13:07:35.306716 lstat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 13:07:35.306747 umask(077) = 0177 13:07:35.306772 open("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist", O_RDWR) = 15 13:07:35.306802 lseek(15, 0, SEEK_SET) = 0 13:07:35.306827 fstat(15, {st_mode=S_IFREG|0600, st_size=3875867, ...}) = 0 13:07:35.306856 brk(0x1bec000) = 0x1bec000 13:07:35.306918 fstat(15, {st_mode=S_IFREG|0600, st_size=3875867, ...}) = 0 13:07:35.306955 pread(15, "3 V1459433542 N1 G8cfaa815851200"..., 8192, 0) = 8192 13:07:35.307183 pread(15, "-1,S=14182,W=14669\n156 :14596233"..., 8156, 8192) = 8156 13:07:35.307404 pread(15, "89.M700263P26773.labrat-1,S=805,"..., 8179, 16348) = 8179 13:07:35.307621 pread(15, "4.M540099P26773.labrat-1,S=11962"..., 8178, 24527) = 8178 13:07:35.307840 pread(15, "W=4891\n612 :1459624371.M994429P2"..., 8146, 32705) = 8146 13:07:35.308056 pread(15, "73.labrat-1,S=15387,W=15911\n764 "..., 8165, 40851) = 8165 ... ... ... 13:07:35.537511 pread(15, "3283P31774.labrat-1,S=9466,W=968"..., 8171, 3837511) = 8171 13:07:35.537878 pread(15, "52\n69737 :1459730261.M163039P317"..., 8140, 3845682) = 8140 13:07:35.538242 pread(15, "774.labrat-1,S=1394,W=1431\n69883"..., 8164, 3853822) = 8164 13:07:35.538607 pread(15, "rat-1,S=12084,W=12326\n70030 :145"..., 8157, 3861986) = 8157 13:07:35.538962 pread(15, "2882,W=2928\n70176 :1459730412.M3"..., 8149, 3870143) = 5724 13:07:35.539232 pread(15, "", 2425, 3875867) = 0 13:07:35.540551 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log.2", 0x7ffea1ef7dd0) = -1 ENOENT (No such file or directory) 13:07:35.540712 alarm(180) = 0 13:07:35.540778 fcntl(13, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}) = 0 13:07:35.540856 alarm(0) = 180 13:07:35.540929 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.541015 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.541127 access("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/cur", W_OK) = 0 13:07:35.553975 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/cur", {st_mode=S_IFDIR|0700, st_size=6311936, ...}) = 0 13:07:35.554155 fcntl(13, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 13:07:35.554906 lstat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 13:07:35.555088 unlink("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock") = 0 13:07:35.555238 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.555321 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.555396 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.555455 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/dovecot.list.index.log", {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 13:07:35.555495 fstat(4, {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 13:07:35.555585 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 13:07:35.555618 write(7, "* FLAGS (\\Answered \\Flagged \\Del"..., 382) = 382 13:07:35.555656 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 13:07:35.555774 epoll_wait(12, {{EPOLLIN, {u32=22457424, u64=22457424}}}, 5, 1800000) = 1 13:07:35.556355 read(7, "A0003 UID SEARCH 70231\r\n", 5316) = 24 13:07:35.556499 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/dovecot.list.index.log", {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 13:07:35.556543 fstat(4, {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 13:07:35.556603 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.556641 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.556676 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.556734 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/dovecot.list.index.log", {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 13:07:35.556771 fstat(4, {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 13:07:35.556819 stat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.556855 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.556889 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 13:07:35.556944 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 13:07:35.556976 write(7, "* SEARCH 70278\r\nA0003 OK Search "..., 65) = 65 13:07:35.557011 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 13:07:35.557061 epoll_wait(12, {{EPOLLIN, {u32=22457424, u64=22457424}}}, 5, 1799999) = 1 13:07:35.576027 read(7, "A0004 STATUS Gmail (MESSAGES UNS"..., 5292) = 38 13:07:35.576142 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 13:07:35.576185 write(7, "* STATUS Gmail (MESSAGES 70231 U"..., 125) = 125 13:07:35.576225 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 13:07:35.576299 epoll_wait(12, {{EPOLLIN, {u32=22457424, u64=22457424}}}, 5, 1800000) = 1 13:07:35.612494 read(7, "A0005 GETQUOTAROOT Gmail\r\n", 5254) = 26 13:07:35.612654 socket(PF_LOCAL, SOCK_STREAM, 0) = 16 13:07:35.612741 fcntl(16, F_GETFL) = 0x2 (flags O_RDWR) 13:07:35.612817 fcntl(16, F_SETFL, O_RDWR|O_NONBLOCK) = 0 13:07:35.612888 connect(16, {sa_family=AF_LOCAL, sun_path="/var/run/dovecot/dict"}, 110) = 0 13:07:35.612959 fcntl(16, F_GETFL) = 0x802 (flags O_RDWR|O_NONBLOCK) 13:07:35.612994 fcntl(16, F_SETFL, O_RDWR) = 0 13:07:35.613028 fstat(16, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 13:07:35.613068 lseek(16, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) 13:07:35.613149 getsockname(16, {sa_family=AF_LOCAL, NULL}, [2]) = 0 13:07:35.613229 write(16, "H2\t0\t0\tbostjan at stage.mail.teon.s"..., 40) = 40 13:07:35.613285 write(16, "Lpriv/quota/storage\n", 20) = 20 13:07:35.613337 alarm(30) = 0 13:07:35.613389 read(16, "O2960032661\n", 8192) = 12 13:07:35.621249 alarm(0) = 30 13:07:35.621330 write(16, "Lpriv/quota/messages\n", 21) = 21 13:07:35.621392 alarm(30) = 0 13:07:35.621431 read(16, "O70251\n", 8180) = 7 13:07:35.621508 alarm(0) = 30 13:07:35.621585 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 13:07:35.621640 write(7, "* QUOTAROOT Gmail \"User quota\"\r\n"..., 136) = 136 13:07:35.621694 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 13:07:35.621788 epoll_wait(12, {}, 5, 0) = 0 13:07:35.621830 close(16) = 0 13:07:35.621893 epoll_wait(12, {{EPOLLIN, {u32=22457424, u64=22457424}}}, 5, 1800000) = 1 13:07:35.626137 read(7, "C64 EXAMINE \"\"\r\n", 5228) = 16 13:07:35.626210 close(15) = 0 13:07:35.628537 brk(0x17ec000) = 0x17ec000 13:07:35.629407 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 13:07:35.629448 write(7, "* OK [CLOSED] Previous mailbox c"..., 115) = 115 13:07:35.629481 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 13:07:35.629560 epoll_wait(12, From moiseev at mezonplus.ru Tue Apr 12 14:30:58 2016 From: moiseev at mezonplus.ru (Alexander Moisseev) Date: Tue, 12 Apr 2016 17:30:58 +0300 Subject: sis deduplication broken from 2.2.16 upwards In-Reply-To: <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> References: <20160307135040.6923898b@ass> <4B63D93F-DBD4-481B-BCE4-201D3C1400C3@iki.fi> <56E1788B.30209@Media-Brokers.com> <9C729B0F-BF04-4AB0-AD6A-F5F40B79EA05@iki.fi> Message-ID: <2cd7aba7-6fcc-545b-533c-72e53568ca80@mezonplus.ru> On 11.03.2016 3:56, Timo Sirainen wrote: >> So, after the fix is applied, does dovecot silently delete the >> duplicated files, or is there a command that needs to be run manually? > > You'd have to do it manually in some way. A script that does something like: > > Go through all attachment directories and for each file: > - Sort files by filename > - Identify that files A and B the same (beginning of the filename begins with same hash), but have a different inode > - ln A B.tmp && mv B.tmp B > The problem turned out to be a bit more complicated than that. Finally a came up with that script: https://github.com/moisseev/doveadm-tools/blob/master/bin/dsisck It assumes Dovecot should not run. From lucabert at lucabert.de Tue Apr 12 17:50:13 2016 From: lucabert at lucabert.de (Luca Bertoncello) Date: Tue, 12 Apr 2016 19:50:13 +0200 Subject: Problem setting owner Message-ID: <20160412195013.54cce344@frodo.lucabert.intra> Hi list! I have a Dovecot 2.2.9 installed from Ubuntu-Repository. It uses LDAP to authenticate against an Active Directory controller. The authentication works, but it tries always to use the UID of the user for the mailbox... I already added: mail_uid = 1005 mail_gid = 8 in 10-mail.conf and: user_attrs = \ =user=exim, \ =uid=1005, \ =gid=8, \ =quota_rule=*:bytes=%{ldap:quotaBytes}, \ =home=/home/mailboxes/%{ldap:sAMAccountName}/Maildir, \ =mail=maildir:/home/mailboxes/%{ldap:sAMAccountName}/Maildir in the dovecot-ldap.conf.ext, but it seems to ignore them... Could someone help me? Thanks Luca Bertoncello (lucabert at lucabert.de) From johannes at rohr.org Tue Apr 12 18:14:30 2016 From: johannes at rohr.org (Johannes Rohr) Date: Tue, 12 Apr 2016 20:14:30 +0200 Subject: antispam plugin, pipe backend, how to make it work? Message-ID: <570D3B06.5070305@rohr.org> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise with the antispam plugin in version 2.0+20120225-2 and spamassassin at version 3.2.2 I have been trying and failed to get the pipe backend of the antispam plugin to work. Spamassin by itself works, a manual call of sa-learn works fine. Bayes data is stored in a mysql DB. I have the following configuration in /etc/dovecot/conf.d/90-plugin.conf plugin { #setting_name = value sieve=~/.dovecot.sieve sieve_dir=~/sieve antispam_pipe_program_spam_arg = --spam antispam_pipe_program_notspam_arg = --ham antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh antispam_pipe_program_args = --username=%u # % expansion done by dovecot antispam_trash = trash;Trash;Deleted Items;Deleted Messages antispam_spam = SPAM;Junk antispam_backend = pipe antispam_verbose_debug = 1 antispam_debug_target = syslog antispam_pipe_tmpdir = /tmp } I have tried the following wrapper script: #!/bin/bash # set -x LOGFILE=/tmp/sa-learn-pipe.log echo "$$-start ($*)" >> $LOGFILE #echo $* > /tmp/sendmail-parms.txt cat<&0 >> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn $* -D /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ rm -f /tmp/sendmail-msg-$$.txt echo "$$-end" >> $LOGFILE exit 0 It somehow isn't working. I can call the wrapper script manually e.g. sudo -u vmail /usr/local/bin/sa-learn-pipe.sh --username=some at mail.user --ham \ < someham But it doesn't work from dovecot. It seems the script is called. but no new patterns show up in the bayes DB. Unfortunately, the plugin seems to be documented poorly. How does it call the programme it pipes to? Is it something like $programme --par1 --par2 < message ? Why can't / shouldn't I call sa-learn directly? All the instructions I found on the in internet contained a wrapper script, but none bothered to explain why you would actually need it. I would be very grateful, if someone could enlighten me on that... Cheers, Johannes From j.echter at echter-kuechen-elektro.de Tue Apr 12 18:18:59 2016 From: j.echter at echter-kuechen-elektro.de (J. Echter) Date: Tue, 12 Apr 2016 20:18:59 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570D3B06.5070305@rohr.org> References: <570D3B06.5070305@rohr.org> Message-ID: <570D3C13.7030802@echter-kuechen-elektro.de> Hi, here (Centos 7) its already integrated... Just add something like this: plugin { antispam_mail_sendmail = /usr/bin/sa-learn antispam_mail_sendmail_args = -u amavis antispam_mail_spam = --spam antispam_mail_notspam = --ham } to dovecot.conf Cheers J?rgen Am 12.04.2016 um 20:14 schrieb Johannes Rohr: > Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise with > the antispam plugin in version 2.0+20120225-2 and spamassassin at > version 3.2.2 > > I have been trying and failed to get the pipe backend of the antispam > plugin to work. Spamassin by itself works, a manual call of sa-learn > works fine. Bayes data is stored in a mysql DB. > > I have the following configuration in /etc/dovecot/conf.d/90-plugin.conf > > plugin { > #setting_name = value > sieve=~/.dovecot.sieve > sieve_dir=~/sieve > antispam_pipe_program_spam_arg = --spam > antispam_pipe_program_notspam_arg = --ham > antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh > antispam_pipe_program_args = --username=%u # % expansion done by > dovecot > antispam_trash = trash;Trash;Deleted Items;Deleted Messages > antispam_spam = SPAM;Junk > antispam_backend = pipe > antispam_verbose_debug = 1 > antispam_debug_target = syslog > antispam_pipe_tmpdir = /tmp > } > > I have tried the following wrapper script: > #!/bin/bash > # set -x > LOGFILE=/tmp/sa-learn-pipe.log > echo "$$-start ($*)" >> $LOGFILE > #echo $* > /tmp/sendmail-parms.txt > cat<&0 >> /tmp/sendmail-msg-$$.txt > /usr/bin/sa-learn $* -D /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ > rm -f /tmp/sendmail-msg-$$.txt > echo "$$-end" >> $LOGFILE > exit 0 > > It somehow isn't working. I can call the wrapper script manually e.g. > sudo -u vmail /usr/local/bin/sa-learn-pipe.sh --username=some at mail.user > --ham \ > < someham > > But it doesn't work from dovecot. It seems the script is called. but no > new patterns show up in the bayes DB. Unfortunately, the plugin seems to > be documented poorly. How does it call the programme it pipes to? Is it > something like $programme --par1 --par2 < message ? Why can't / > shouldn't I call sa-learn directly? All the instructions I found on the > in internet contained a wrapper script, but none bothered to explain why > you would actually need it. > > I would be very grateful, if someone could enlighten me on that... > > Cheers, > > Johannes From j.echter at echter-kuechen-elektro.de Tue Apr 12 18:22:04 2016 From: j.echter at echter-kuechen-elektro.de (J. Echter) Date: Tue, 12 Apr 2016 20:22:04 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570D3C13.7030802@echter-kuechen-elektro.de> References: <570D3B06.5070305@rohr.org> <570D3C13.7030802@echter-kuechen-elektro.de> Message-ID: <570D3CCC.9040909@echter-kuechen-elektro.de> dovecot 2.2.10 Am 12.04.2016 um 20:18 schrieb J. Echter: > Hi, > > here (Centos 7) its already integrated... > > Just add something like this: > > plugin { > > > antispam_mail_sendmail = /usr/bin/sa-learn > antispam_mail_sendmail_args = -u amavis > antispam_mail_spam = --spam > antispam_mail_notspam = --ham > } > > to dovecot.conf > > Cheers > > J?rgen > > Am 12.04.2016 um 20:14 schrieb Johannes Rohr: >> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise with >> the antispam plugin in version 2.0+20120225-2 and spamassassin at >> version 3.2.2 >> >> I have been trying and failed to get the pipe backend of the antispam >> plugin to work. Spamassin by itself works, a manual call of sa-learn >> works fine. Bayes data is stored in a mysql DB. >> >> I have the following configuration in /etc/dovecot/conf.d/90-plugin.conf >> >> plugin { >> #setting_name = value >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> antispam_pipe_program_spam_arg = --spam >> antispam_pipe_program_notspam_arg = --ham >> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >> antispam_pipe_program_args = --username=%u # % expansion done by >> dovecot >> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >> antispam_spam = SPAM;Junk >> antispam_backend = pipe >> antispam_verbose_debug = 1 >> antispam_debug_target = syslog >> antispam_pipe_tmpdir = /tmp >> } >> >> I have tried the following wrapper script: >> #!/bin/bash >> # set -x >> LOGFILE=/tmp/sa-learn-pipe.log >> echo "$$-start ($*)" >> $LOGFILE >> #echo $* > /tmp/sendmail-parms.txt >> cat<&0 >> /tmp/sendmail-msg-$$.txt >> /usr/bin/sa-learn $* -D /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ >> rm -f /tmp/sendmail-msg-$$.txt >> echo "$$-end" >> $LOGFILE >> exit 0 >> >> It somehow isn't working. I can call the wrapper script manually e.g. >> sudo -u vmail /usr/local/bin/sa-learn-pipe.sh --username=some at mail.user >> --ham \ >> < someham >> >> But it doesn't work from dovecot. It seems the script is called. but no >> new patterns show up in the bayes DB. Unfortunately, the plugin seems to >> be documented poorly. How does it call the programme it pipes to? Is it >> something like $programme --par1 --par2 < message ? Why can't / >> shouldn't I call sa-learn directly? All the instructions I found on the >> in internet contained a wrapper script, but none bothered to explain why >> you would actually need it. >> >> I would be very grateful, if someone could enlighten me on that... >> >> Cheers, >> >> Johannes From ml+dovecot at valo.at Tue Apr 12 19:17:35 2016 From: ml+dovecot at valo.at (Christian Kivalo) Date: Tue, 12 Apr 2016 21:17:35 +0200 Subject: Plus addressing on Sentora using Postfix In-Reply-To: <8B15DCE8-5CC4-4658-8379-ED29B613AC24@mcgaw.eu> References: <50B1436F-E46E-45C5-B2EE-F92CC4A6B909@mcgaw.eu> <932416D1-C86A-437C-A538-BD9B2C05F022@mcgaw.eu> <41fac6514ef67ff4dcfdf3b4f4490c0f@valo.at> <8B15DCE8-5CC4-4658-8379-ED29B613AC24@mcgaw.eu> Message-ID: <2d8f70bc7eda2a1cbb2367fa0b4662cc@valo.at> On 2016-04-12 14:56, Philip McGaw wrote: > Dovecot.log > Dovecot-info.log > Dovecot-debug.log > > Are all devoid of information, the only log that seems to give > anything is mail.log Maybe you need to change some logging settings in dovecot, see http://wiki2.dovecot.org/Logging Is there some mail_debug = yes in your config? The sentora dovecot.conf from github has it set, maybe the setting was changed to no? Some logging showing the failure would be helpful. > > I edited the working dovecot config file to add in recipient_delimiter > = + line. And it shows up when running Dovecot -n. > > > > Sent from my iPhone > >> On 11 Apr 2016, at 08:15, Christian Kivalo wrote: >> >> On 2016-04-11 00:54, Philip McGaw wrote: >>>> In dovecots 15-lda.conf uncomment the "recipient_delimiter = +" >>>> setting. The delimiter is configured in postfix but apparently not >>>> in your dovecot lda config >>> I am not sure of the location of 15-lda.conf, however in my main >>> dovecot.conf file I added "recipient_delimiter = +" >>> The output of the lad part of "dovecot -n" is now >>>> protocol lda { >>>> mail_plugins = quota sieve >>>> postmaster_address = postmaster at njoror.squashedfly.eu >>>> recipient_delimiter = + >>>> } >> >> Ok, nevermind. I suspect that sentora creates it's own config files >> from whatever you configure. >> >>> However my mail.log file still shows every message is bounced with >>> the following >>>> Apr 10 23:53:23 njoror postfix/smtpd[23320]: connect from >>>> mr11p26im-asmtp004.me.com[17.110.86.109] >>>> Apr 10 23:53:24 njoror postfix/smtpd[23320]: Anonymous TLS >>>> connection established from >>>> mr11p26im-asmtp004.me.com[17.110.86.109]: TLSv1.2 with cipher >>>> DHE-RSA-AES128-GCM-SHA256 (128/128 bits) >>>> Apr 10 23:53:24 njoror postfix/smtpd[23320]: 6D44955ADC: >>>> client=mr11p26im-asmtp004.me.com[17.110.86.109] >>>> Apr 10 23:53:24 njoror postfix/cleanup[23435]: 6D44955ADC: >>>> message-id=<1D905D9B-99E0-4156-A652-51D1A9BD96D0 at icloud.com> >>>> Apr 10 23:53:24 njoror postfix/qmgr[13937]: 6D44955ADC: >>>> from=, size=2021, nrcpt=1 (queue active) >>>> Apr 10 23:53:24 njoror postfix/pipe[23436]: 6D44955ADC: >>>> to=, relay=dovecot, delay=0.43, >>>> delays=0.34/0.01/0/0.08, dsn=4.1.1, status=SOFTBOUNCE (user unknown) >>>> Apr 10 23:53:25 njoror postfix/smtpd[23320]: disconnect from >>>> mr11p26im-asmtp004.me.com[17.110.86.109] >>> Any ideas on why this is still not working for me, as its now driving >>> me right up the wall :( >> >> What's in your dovecot log? It should log something and maybe give a >> hint on whats wrong. >> >> Also take a look at the LDA wiki page http://wiki2.dovecot.org/LDA >> >> -- >> Christian Kivalo >> -- Christian Kivalo From johannes at rohr.org Tue Apr 12 20:04:53 2016 From: johannes at rohr.org (Johannes Rohr) Date: Tue, 12 Apr 2016 22:04:53 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570D3C13.7030802@echter-kuechen-elektro.de> References: <570D3B06.5070305@rohr.org> <570D3C13.7030802@echter-kuechen-elektro.de> Message-ID: <570D54E5.8070304@rohr.org> Hi J?rgen, what do you mean by "It's already integrated"? Of course I added the configuration, see my initial mail below. I still am struggling to understand what the reason for the wrapper script is and how the plugin is supposed to call he helper programme, is the message passed to it via stdout? This is what I find in the syslog: Apr 12 21:54:32 vm10 imap: antispam: plugin initialising (2.0-notgit) Apr 12 21:54:32 vm10 imap: antispam: verbose debug enabled Apr 12 21:54:32 vm10 imap: antispam: "SPAM" is exact match spam folder Apr 12 21:54:32 vm10 imap: antispam: "Junk" is exact match spam folder Apr 12 21:54:32 vm10 imap: antispam: no unsure folders Apr 12 21:54:32 vm10 imap: antispam: "trash" is exact match trash folder Apr 12 21:54:32 vm10 imap: antispam: "Trash" is exact match trash folder Apr 12 21:54:32 vm10 imap: antispam: "Deleted Items" is exact match trash folder Apr 12 21:54:32 vm10 imap: antispam: "Deleted Messages" is exact match trash folder Apr 12 21:54:32 vm10 imap: antispam: pipe backend spam argument = --spam Apr 12 21:54:32 vm10 imap: antispam: pipe backend not-spam argument = --ham Apr 12 21:54:32 vm10 imap: antispam: pipe backend program = /usr/bin/sa-learn Apr 12 21:54:32 vm10 imap: antispam: pipe backend program arg[0] = --username=[blanked out]@rohr.org Apr 12 21:54:32 vm10 imap: antispam: pipe backend tmpdir /tmp It doesn't hint at any particular error, however, when I tried to move a message to junk, nothing happens, the message just stays at its original place and I see that the contents of the bayes db is unchanged, so somehow nothing happens. When I disable the plugin, moving messages to Junk works again. I wonder whether this is a bug in a particular version, it is quite ancient software, the server is running on Ubuntu precise. Cheers, Johannes Am 12.04.2016 um 20:18 schrieb J. Echter: > Hi, > > here (Centos 7) its already integrated... > > Just add something like this: > > plugin { > > > antispam_mail_sendmail = /usr/bin/sa-learn > antispam_mail_sendmail_args = -u amavis > antispam_mail_spam = --spam > antispam_mail_notspam = --ham > } > > to dovecot.conf > > Cheers > > J?rgen > > Am 12.04.2016 um 20:14 schrieb Johannes Rohr: >> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise with >> the antispam plugin in version 2.0+20120225-2 and spamassassin at >> version 3.2.2 >> >> I have been trying and failed to get the pipe backend of the antispam >> plugin to work. Spamassin by itself works, a manual call of sa-learn >> works fine. Bayes data is stored in a mysql DB. >> >> I have the following configuration in /etc/dovecot/conf.d/90-plugin.conf >> >> plugin { >> #setting_name = value >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> antispam_pipe_program_spam_arg = --spam >> antispam_pipe_program_notspam_arg = --ham >> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >> antispam_pipe_program_args = --username=%u # % expansion done by >> dovecot >> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >> antispam_spam = SPAM;Junk >> antispam_backend = pipe >> antispam_verbose_debug = 1 >> antispam_debug_target = syslog >> antispam_pipe_tmpdir = /tmp >> } >> >> I have tried the following wrapper script: >> #!/bin/bash >> # set -x >> LOGFILE=/tmp/sa-learn-pipe.log >> echo "$$-start ($*)" >> $LOGFILE >> #echo $* > /tmp/sendmail-parms.txt >> cat<&0 >> /tmp/sendmail-msg-$$.txt >> /usr/bin/sa-learn $* -D /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ >> rm -f /tmp/sendmail-msg-$$.txt >> echo "$$-end" >> $LOGFILE >> exit 0 >> >> It somehow isn't working. I can call the wrapper script manually e.g. >> sudo -u vmail /usr/local/bin/sa-learn-pipe.sh --username=some at mail.user >> --ham \ >> < someham >> >> But it doesn't work from dovecot. It seems the script is called. but no >> new patterns show up in the bayes DB. Unfortunately, the plugin seems to >> be documented poorly. How does it call the programme it pipes to? Is it >> something like $programme --par1 --par2 < message ? Why can't / >> shouldn't I call sa-learn directly? All the instructions I found on the >> in internet contained a wrapper script, but none bothered to explain why >> you would actually need it. >> >> I would be very grateful, if someone could enlighten me on that... >> >> Cheers, >> >> Johannes From lucabert at lucabert.de Tue Apr 12 20:14:19 2016 From: lucabert at lucabert.de (Luca Bertoncello) Date: Tue, 12 Apr 2016 22:14:19 +0200 Subject: Different usernames for different login method Message-ID: <20160412221419.55306d28@frodo.lucabert.intra> Hi again! With Dovecot 2.2.9 authenticating against the Active Directory I have following problem: - if I login using LOGIN, PLAIN or CRAM, the username is REALM\login (in my case: CCH\lucabert) - if I login using GSSAPI, the username is just login (in my case: lucabert) this makes the access to the mailbox very difficult, since I don't what can I write in mail_location... If I login with LOGIN, I can write: maildir:/home/mailboxes/%4.u/Maildir but of course it does not work if I login using GSSAPI... The mailboxes have just the login (in my case: lucabert). Can someone explain me why %u is different and how can I solve my problem? Thanks a lot Luca Bertoncello (lucabert at lucabert.de) From tom at whyscream.net Tue Apr 12 20:26:12 2016 From: tom at whyscream.net (Tom Hendrikx) Date: Tue, 12 Apr 2016 22:26:12 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570D3B06.5070305@rohr.org> References: <570D3B06.5070305@rohr.org> Message-ID: <570D59E4.3080705@whyscream.net> On 12-04-16 20:14, Johannes Rohr wrote: > Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise with > the antispam plugin in version 2.0+20120225-2 and spamassassin at > version 3.2.2 > > I have been trying and failed to get the pipe backend of the antispam > plugin to work. Spamassin by itself works, a manual call of sa-learn > works fine. Bayes data is stored in a mysql DB. > > I have the following configuration in /etc/dovecot/conf.d/90-plugin.conf > > plugin { > #setting_name = value > sieve=~/.dovecot.sieve > sieve_dir=~/sieve > antispam_pipe_program_spam_arg = --spam > antispam_pipe_program_notspam_arg = --ham > antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh > antispam_pipe_program_args = --username=%u # % expansion done by > dovecot You need to specify the argument list as a list seperated by semicolons, per example on the wiki: antispam_pipe_program_args = --username;%u The verbose debug should give you some logging to work with. Also, what does the wrapper script log when dovecot runs it? How does that differ from a manual run? > antispam_trash = trash;Trash;Deleted Items;Deleted Messages > antispam_spam = SPAM;Junk > antispam_backend = pipe > antispam_verbose_debug = 1 > antispam_debug_target = syslog > antispam_pipe_tmpdir = /tmp > } > > I have tried the following wrapper script: > #!/bin/bash > # set -x > LOGFILE=/tmp/sa-learn-pipe.log > echo "$$-start ($*)" >> $LOGFILE > #echo $* > /tmp/sendmail-parms.txt > cat<&0 >> /tmp/sendmail-msg-$$.txt > /usr/bin/sa-learn $* -D /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ > rm -f /tmp/sendmail-msg-$$.txt > echo "$$-end" >> $LOGFILE > exit 0 > > It somehow isn't working. I can call the wrapper script manually e.g. > sudo -u vmail /usr/local/bin/sa-learn-pipe.sh --username=some at mail.user > --ham \ > < someham > > But it doesn't work from dovecot. It seems the script is called. but no > new patterns show up in the bayes DB. Unfortunately, the plugin seems to > be documented poorly. How does it call the programme it pipes to? Is it > something like $programme --par1 --par2 < message ? Why can't / > shouldn't I call sa-learn directly? All the instructions I found on the > in internet contained a wrapper script, but none bothered to explain why > you would actually need it. > > I would be very grateful, if someone could enlighten me on that... > > Cheers, > > Johannes -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From aki.tuomi at dovecot.net Tue Apr 12 11:37:01 2016 From: aki.tuomi at dovecot.net (Aki Tuomi) Date: Tue, 12 Apr 2016 14:37:01 +0300 Subject: doveadm sync ignores -u option In-Reply-To: <1bb3818eb4372a6c40ac58109794ecab@webmail.aprogsys.com> References: <20160411120645.GB6225@4k.mxgr.de> <1bb3818eb4372a6c40ac58109794ecab@webmail.aprogsys.com> Message-ID: <570CDDDD.1090901@dovecot.net> On 12.04.2016 14:32, ve at vetienne.net wrote: > 11 avril 2016 14:07 "Max" a ?crit: >> Hi, >> >> Since I upgraded from 2.2.21 to 2.2.23, the user option -u seems to be ignored >> by doveadm sync, or at least it doesn't handle it correctly. >> > I can confirm it breaks replication for me ( multiple user so i have to replicate through ssh by user root as described in replication wiki page ). No longer work with 2.2.23, reverting to 2.2.22 get it back to a working state > > Log filled with : > > Apr 12 09:52:03 mailhost dovecot: doveadm: Error: doveadm(root): Error: Invalid settings in userdb: userdb returned 0 as uid > Apr 12 09:52:03 mailhost dovecot: doveadm: Error: doveadm(root): Error: User lookup failed: Invalid user settings. Refer to server log for more information. > > Regards > > Vincent ETIENNE Hi all! We are aware of this bug and it has already been fixed in master, https://github.com/dovecot/core/commit/9ba5c4965ca244efeeb525229f1293ef52a4bf3a and will be included in next release. In the mean time you have to use USER environment variable as workaround. Very sorry about this. Aki From Burak.Seydioglu at servicenow.com Tue Apr 12 18:00:37 2016 From: Burak.Seydioglu at servicenow.com (Burak Seydioglu) Date: Tue, 12 Apr 2016 18:00:37 +0000 Subject: pop3 and dsync master-master replication issue causing duplicate delivery Message-ID: Hello, I am having an issue with a dsync master-master replication setup. Messages are not being marked current or deleted during the first session causing duplicate delivery when replication is running. It takes two logins and delete commands to get rid of the message. Topology: mda01.dcactive <---> mda01.dcpassive All interaction is happening on mda01.dcactive. I was running 2.2.13 and upgraded to 2.2.23 hoping it would help but I am still running into the same issue. Version before upgrade: [mda01.xxx:/root]# dovecot --version 2.2.13 Version after upgrade: [mda01.xxx:/root]# dovecot --version 2.2.23 (806d709) The issue is happening on both VMs and baremetal servers. Operating system is CentOS 6.7 x86_64. Filesystem is ext3. POP commands are executed via telnet but the behavior is present with Java clients as well. Related reports: http://dovecot.org/list/dovecot/2015-June/101254.html http://thr3ads.net/dovecot/2013/05/2644111-Problem-with-dsync-replication-mails-are-not-deleted-correctly ############################################## ################ DOVECOT CONF ################ ############################################## Configuration is idential on both servers (except the host name in the login greeting): # 2.2.23 (806d709): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-573.22.1.el6.x86_64 x86_64 CentOS release 6.7 (Final) auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it first_valid_uid = 89 last_valid_uid = 89 login_greeting = Dovecot ready on mda01.dcpassive.domain.com. login_trusted_networks = 127.0.0.1 mail_debug = yes mail_gid = 89 mail_plugins = " notify replication" mail_uid = 89 mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/conf.d/dovecot-ldap-passdb.conf.ext driver = ldap } plugin { mail_replica = tcps:mdareplica:12345 } protocols = pop3 lmtp replication_full_sync_interval = 3 hours replication_max_conns = 20 service aggregator { fifo_listener replication-notify-fifo { group = postfix mode = 0640 user = postfix } unix_listener replication-notify { group = postfix mode = 0640 user = postfix } } service auth { unix_listener auth { mode = 0660 } } service doveadm { inet_listener { port = 12345 ssl = yes } } service lmtp { process_min_avail = 10 unix_listener lmtp { group = postfix mode = 0640 user = postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = postfix mode = 0640 user = postfix } } ssl_cert = Delivered-To: buraktest1 at buraktest1.domain.com Received: from mda01.dcactive.domain.com by mda01.dcactive.domain.com (Dovecot) with LMTP id IXEcCPEnDVeqQgAApTIvcA for ; Tue, 12 Apr 2016 09:53:05 -0700 Received: from mta01.dcactive.domain.com (unknown [10.*.*.*]) by mda01.dcactive.domain.com (Postfix) with ESMTPS id 166837C086 for ; Tue, 12 Apr 2016 09:53:05 -0700 (PDT) Received: from localhost (unknown [10.*.*.*]) by mta01.dcactive.domain.com (Postfix) with ESMTP id C9C67142001 for ; Tue, 12 Apr 2016 09:53:04 -0700 (PDT) SUBJECT: mail test from : mail test for dysnc Tue Apr 12 17:55:49 BST 2016. . dele 1 +OK Marked to be deleted. quit +OK Logging out, messages deleted. Connection closed by foreign host. ############################################### ################ ACTIVE SERVER ################ ############################################### ################ EMAIL DELIVERY ################ [mda01.dcactive:/glide/mail/spool/buraktest1/maildir]# ls -al * -rw------- 1 postfix postfix 248 Apr 11 17:07 dovecot.index -rw------- 1 postfix postfix 4436 Apr 12 09:54 dovecot.index.cache -rw------- 1 postfix postfix 17372 Apr 12 09:54 dovecot.index.log -rw------- 1 postfix postfix 1681904 Apr 11 10:50 dovecot.index.log.2 -rw------- 1 postfix postfix 126 Apr 12 09:54 dovecot-uidlist -rw------- 1 postfix postfix 8 Jul 7 2015 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Jul 7 2015 dovecot-uidvalidity.559c5cc2 -rw------- 1 postfix postfix 0 Jul 7 2015 maildirfolder cur: total 84 drwx------ 2 postfix postfix 77824 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. new: total 5532 drwx------ 2 postfix postfix 5644288 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. -rw------- 1 postfix postfix 781 Apr 12 09:53 1460479985.M153155P17066.mda01.dcactive.domain.com,S=781,W=795 tmp: total 776 drwx------ 2 postfix postfix 786432 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. Apr 11 17:25:29 mda01 dovecot: lmtp(24058): Debug: none: root=, index=, indexpvt=, control=, inbox=, alt= Apr 11 17:25:29 mda01 dovecot: lmtp(24058): Connect from local Apr 11 17:25:29 mda01 dovecot: lmtp(buraktest1 at buraktest1.domain.com): Debug: Loading modules from directory: /usr/lib64/dovecot Apr 11 17:25:29 mda01 dovecot: lmtp(buraktest1 at buraktest1.domain.com): Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so Apr 11 17:25:29 mda01 dovecot: lmtp(buraktest1 at buraktest1.domain.com): Debug: Module loaded: /usr/lib64/dovecot/lib20_replication_plugin.so Apr 11 17:25:29 mda01 dovecot: lmtp(buraktest1 at buraktest1.domain.com): Debug: auth input: buraktest1 at buraktest1.domain.com home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: lmtp(buraktest1 at buraktest1.domain.com): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: lmtp(24058, buraktest1 at buraktest1.domain.com): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:25:29 mda01 dovecot: lmtp(24058, buraktest1 at buraktest1.domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maild ir/ Apr 11 17:25:29 mda01 dovecot: lmtp(24058, buraktest1 at buraktest1.domain.com): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:25:29 mda01 dovecot: lmtp(buraktest1 at buraktest1.domain.com): Debug: replication: Replication requested by 'transaction commit', priority=2 Apr 11 17:25:29 mda01 dovecot: lmtp(buraktest1 at buraktest1.domain.com): cefKJHlADFf6XQAApTIvcA: msgid=unspecified: saved mail to INBOX Apr 11 17:25:29 mda01 dovecot: lmtp(24058): Disconnect from local: Successful quit Apr 11 17:25:29 mda01 postfix-mda/lmtp[9826]: 93BE07C086: to=, relay=mda01.dcactive.domain.com[/var/run/dovecot/lmtp], delay=0.03, delays=0.01/0.01/0/0.02, dsn=2.0.0, status=sent (250 2.0.0 cefKJHlADFf6XQAApTIvcA Saved) Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: auth input: buraktest1 at buraktest1.domain.com home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Performing auto-detection Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: sync: Synchronization active Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: auth input: buraktest1 at buraktest1.domain.com home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(10.*.*.*,buraktest1 at buraktest1.domain.com): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:25:29 mda01 dovecot: doveadm(10.*.*.*,buraktest1 at buraktest1.domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/burakte st1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(10.*.*.*,buraktest1 at buraktest1.domain.com): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Performing auto-detection Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: sync: Synchronization active ################ FIRST LOGIN ################ [mda01.dcactive:/glide/mail/spool/buraktest1/maildir]# ls -al * -rw------- 1 postfix postfix 248 Apr 11 17:07 dovecot.index -rw------- 1 postfix postfix 4436 Apr 12 09:54 dovecot.index.cache -rw------- 1 postfix postfix 17372 Apr 12 09:54 dovecot.index.log -rw------- 1 postfix postfix 1681904 Apr 11 10:50 dovecot.index.log.2 -rw------- 1 postfix postfix 126 Apr 12 09:54 dovecot-uidlist -rw------- 1 postfix postfix 8 Jul 7 2015 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Jul 7 2015 dovecot-uidvalidity.559c5cc2 -rw------- 1 postfix postfix 0 Jul 7 2015 maildirfolder cur: total 84 drwx------ 2 postfix postfix 77824 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. new: total 5532 drwx------ 2 postfix postfix 5644288 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. -rw------- 1 postfix postfix 781 Apr 12 09:53 1460479985.M153155P17066.mda01.dcactive.domain.com,S=781,W=795 <<<<<<<<<<<<<<<<<<<<<< Email still in new folder. tmp: total 776 drwx------ 2 postfix postfix 786432 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. Apr 11 17:31:37 mda01 dovecot: pop3-login: Login: user=, method=PLAIN, rip=10.*.*.*, lip=10.*.*.*, mpid=20529, session= Apr 11 17:31:37 mda01 dovecot: pop3(buraktest1): Debug: Loading modules from directory: /usr/lib64/dovecot Apr 11 17:31:37 mda01 dovecot: pop3(buraktest1): Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so Apr 11 17:31:37 mda01 dovecot: pop3(buraktest1): Debug: Module loaded: /usr/lib64/dovecot/lib20_replication_plugin.so Apr 11 17:31:37 mda01 dovecot: pop3(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:37 mda01 dovecot: pop3(buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:31:37 mda01 dovecot: pop3(buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:37 mda01 dovecot: pop3(buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:31:42 mda01 dovecot: pop3(buraktest1): Debug: replication: Replication requested by 'transaction commit', priority=1 Apr 11 17:31:42 mda01 dovecot: pop3(buraktest1): Disconnected: Logged out top=0/0, retr=1/811, del=1/1, size=795 Apr 11 17:31:42 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:42 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: sync: Synchronization active Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: replication: Replication requested by 'transaction commit', priority=2 Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: sync: Synchronization active Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: sync: Synchronization active ################ SECOND LOGIN ################ [mda01.dcactive:/glide/mail/spool/buraktest1/maildir]# ls -al * -rw------- 1 postfix postfix 248 Apr 11 17:07 dovecot.index -rw------- 1 postfix postfix 4436 Apr 12 10:07 dovecot.index.cache -rw------- 1 postfix postfix 17776 Apr 12 10:07 dovecot.index.log -rw------- 1 postfix postfix 1681904 Apr 11 10:50 dovecot.index.log.2 -rw------- 1 postfix postfix 55 Apr 12 10:07 dovecot-uidlist -rw------- 1 postfix postfix 8 Jul 7 2015 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Jul 7 2015 dovecot-uidvalidity.559c5cc2 -rw------- 1 postfix postfix 0 Jul 7 2015 maildirfolder cur: total 84 drwx------ 2 postfix postfix 77824 Apr 12 10:07 . drwx------ 5 postfix postfix 4096 Apr 12 10:07 .. new: total 5528 drwx------ 2 postfix postfix 5644288 Apr 12 10:07 . drwx------ 5 postfix postfix 4096 Apr 12 10:07 .. tmp: total 776 drwx------ 2 postfix postfix 786432 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 10:07 .. Apr 11 17:38:12 mda01 dovecot: pop3-login: Login: user=, method=PLAIN, rip=10.*.*.*, lip=10.*.*.*, mpid=22548, session=<0bxC4D4wLNEK/xKh> Apr 11 17:38:12 mda01 dovecot: pop3(buraktest1): Debug: Loading modules from directory: /usr/lib64/dovecot Apr 11 17:38:12 mda01 dovecot: pop3(buraktest1): Debug: Module loaded: /usr/lib64/dovecot/lib15_notify_plugin.so Apr 11 17:38:12 mda01 dovecot: pop3(buraktest1): Debug: Module loaded: /usr/lib64/dovecot/lib20_replication_plugin.so Apr 11 17:38:12 mda01 dovecot: pop3(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:12 mda01 dovecot: pop3(buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:38:12 mda01 dovecot: pop3(buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:12 mda01 dovecot: pop3(buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:38:16 mda01 dovecot: pop3(buraktest1): Debug: replication: Replication requested by 'transaction commit', priority=1 Apr 11 17:38:16 mda01 dovecot: pop3(buraktest1): Disconnected: Logged out top=0/0, retr=1/811, del=1/1, size=795 Apr 11 17:38:16 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:16 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:16 mda01 dovecot: doveadm(buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:38:16 mda01 dovecot: doveadm(buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:16 mda01 dovecot: doveadm(buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:38:16 mda01 dovecot: doveadm(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: sync: Synchronization active Apr 11 17:38:17 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:17 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:17 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:38:17 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:17 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: sync: Synchronization active ################################################ ################ PASSIVE SERVER ################ ################################################ ################ EMAIL DELIVERY ################ [mda01.dcpassive:/glide/mail/spool/buraktest1/maildir]# ls -al * -rw------- 1 postfix postfix 272 Apr 11 17:16 dovecot.index -rw------- 1 postfix postfix 4060 Apr 12 09:53 dovecot.index.cache -rw------- 1 postfix postfix 16856 Apr 12 09:53 dovecot.index.log -rw------- 1 postfix postfix 1681960 Apr 11 10:46 dovecot.index.log.2 -rw------- 1 postfix postfix 126 Apr 12 09:53 dovecot-uidlist -rw------- 1 postfix postfix 8 Jul 7 2015 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Jul 7 2015 dovecot-uidvalidity.559c5cbc cur: total 5308 drwx------ 2 postfix postfix 5419008 Apr 11 16:06 . drwx------ 5 postfix postfix 4096 Apr 12 09:53 .. new: total 4444 drwx------ 2 postfix postfix 4530176 Apr 12 09:53 . drwx------ 5 postfix postfix 4096 Apr 12 09:53 .. -rw------- 1 postfix postfix 781 Apr 12 09:53 1460479985.M153155P17066.mda01.dcactive.domain.com,S=781,W=795 tmp: total 8 drwx------ 2 postfix postfix 4096 Apr 12 09:53 . drwx------ 5 postfix postfix 4096 Apr 12 09:53 .. Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: auth input: buraktest1 at buraktest1.domain.com home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(10.*.*.*,buraktest1 at buraktest1.domain.com): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:25:29 mda01 dovecot: doveadm(10.*.*.*,buraktest1 at buraktest1.domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/burakte st1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(10.*.*.*,buraktest1 at buraktest1.domain.com): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Performing auto-detection Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: sync: Synchronization active Apr 11 17:25:29 mda01 dovecot: dsync-server(buraktest1 at buraktest1.domain.com): Debug: replication: Replication requested by 'transaction commit', priority=2 Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: auth input: buraktest1 at buraktest1.domain.com home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:25:29 mda01 dovecot: doveadm(buraktest1 at buraktest1.domain.com): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Performing auto-detection Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:25:29 mda01 dovecot: dsync-local(buraktest1 at buraktest1.domain.com): Debug: sieve: file storage: sync: Synchronization active ################ FIRST LOGIN ################ [mda01.dcpassive:/glide/mail/spool/buraktest1/maildir]# ls -al * -rw------- 1 postfix postfix 272 Apr 11 17:16 dovecot.index -rw------- 1 postfix postfix 4196 Apr 12 09:54 dovecot.index.cache -rw------- 1 postfix postfix 17416 Apr 12 09:54 dovecot.index.log -rw------- 1 postfix postfix 1681960 Apr 11 10:46 dovecot.index.log.2 -rw------- 1 postfix postfix 189 Apr 12 09:54 dovecot-uidlist -rw------- 1 postfix postfix 8 Jul 7 2015 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Jul 7 2015 dovecot-uidvalidity.559c5cbc cur: total 5308 drwx------ 2 postfix postfix 5419008 Apr 11 16:06 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. new: total 4444 drwx------ 2 postfix postfix 4530176 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. -rw------- 1 postfix postfix 781 Apr 12 09:53 1460480044.M279955P928.mda01.dcpassive.domain.com,S=781,W=795 <<<<<<<<<<<<<<<<<<<<<< IMPORTANT: File name changes on the passive side. Still marked new. tmp: total 8 drwx------ 2 postfix postfix 4096 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 09:54 .. Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: sync: Synchronization active Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: replication: Replication requested by 'transaction commit', priority=1 Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: replication: Replication requested by 'transaction commit', priority=1 Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:31:43 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:31:43 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: sync: Synchronization active Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:31:43 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: sync: Synchronization active ################ SECOND LOGIN ################ [mda01.dcpassive:/glide/mail/spool/buraktest1/maildir]# ls -al * -rw------- 1 postfix postfix 272 Apr 11 17:16 dovecot.index -rw------- 1 postfix postfix 4196 Apr 12 10:07 dovecot.index.cache -rw------- 1 postfix postfix 17744 Apr 12 10:07 dovecot.index.log -rw------- 1 postfix postfix 1681960 Apr 11 10:46 dovecot.index.log.2 -rw------- 1 postfix postfix 189 Apr 12 09:54 dovecot-uidlist -rw------- 1 postfix postfix 8 Jul 7 2015 dovecot-uidvalidity -r--r--r-- 1 postfix postfix 0 Jul 7 2015 dovecot-uidvalidity.559c5cbc cur: total 5308 drwx------ 2 postfix postfix 5419008 Apr 11 16:06 . drwx------ 5 postfix postfix 4096 Apr 12 10:07 .. new: total 4440 drwx------ 2 postfix postfix 4530176 Apr 12 10:07 . drwx------ 5 postfix postfix 4096 Apr 12 10:07 .. tmp: total 8 drwx------ 2 postfix postfix 4096 Apr 12 09:54 . drwx------ 5 postfix postfix 4096 Apr 12 10:07 .. Apr 11 17:38:16 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:16 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:16 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:38:16 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:16 mda01 dovecot: doveadm(10.*.*.*,buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:38:16 mda01 dovecot: dsync-server(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: sieve: file storage: sync: Synchronization active Apr 11 17:38:17 mda01 dovecot: dsync-server(buraktest1): Debug: replication: Replication requested by 'transaction commit', priority=1 Apr 11 17:38:17 mda01 dovecot: doveadm(buraktest1): Debug: auth input: buraktest1 home=/glide/mail/spool/buraktest1 mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:17 mda01 dovecot: doveadm(buraktest1): Debug: Added userdb setting: mail=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:17 mda01 dovecot: doveadm(buraktest1): Debug: Effective uid=89, gid=89, home=/glide/mail/spool/buraktest1 Apr 11 17:38:17 mda01 dovecot: doveadm(buraktest1): Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:/glide/mail/spool/buraktest1/maildir/ Apr 11 17:38:17 mda01 dovecot: doveadm(buraktest1): Debug: maildir++: root=/glide/mail/spool/buraktest1/maildir, index=, indexpvt=, control=, inbox=/glide/mail/spool/buraktest1/maildir, alt= Apr 11 17:38:17 mda01 dovecot: doveadm(buraktest1): Debug: Namespace : Using permissions from /glide/mail/spool/buraktest1/maildir: mode=0700 gid=default Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: doveadm-sieve: Iterating Sieve mailbox attributes Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: Pigeonhole version 0.4.13 (7b14904) initializing Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Performing auto-detection Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Root exists (/glide/mail/spool/buraktest1) Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Active script path is unconfigured; using default (path=~/.dovecot.sieve) Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using active Sieve script path: /glide/mail/spool/buraktest1/.dovecot.sieve Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using script storage path: /glide/mail/spool/buraktest1/sieve Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Using permissions from /glide/mail/spool/buraktest1/sieve: mode=0700 gid=-1 Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Apr 11 17:38:17 mda01 dovecot: dsync-local(buraktest1): Debug: sieve: file storage: sync: Synchronization active From tss at iki.fi Tue Apr 12 20:41:51 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 12 Apr 2016 23:41:51 +0300 Subject: mail-search backtrace In-Reply-To: <57094E96.7020501@dodo.com.au> References: <57094E96.7020501@dodo.com.au> Message-ID: <2D05C734-10E5-4F8E-B26C-39B981C18FBC@iki.fi> On 09 Apr 2016, at 21:48, Hugh Bragg wrote: > > I'm repeatedly getting this error: > > Apr 07 04:37:27 imap(mymail at address): Panic: file mail-search.c: line 84 (mail_search_arg_init): assertion failed: (arg->initialized.keywords == NULL) > Apr 07 04:37:27 imap(mymail at address): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0x827c2) [0x7fcb7f65e7c2] -> /usr/lib64/dovecot/libdovecot.so.0(+0x828ad) [0x7fcb7f65e8ad] -> /usr/lib64/dov > ecot/libdovecot.so.0(i_fatal+0) [0x7fcb7f605b01] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_search_arg_init+0x228) [0x7fcb7f91a328] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_search_result_updat > e_flags+0x100) [0x7fcb7f98e470] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_sync_search_results_update+0x52) [0x7fcb7f9983e2] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mailbox_sync_deinit+0x185 > ) [0x7fcb7f998bb5] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_sync_deinit+0x32) [0x7fcb7f921222] -> /usr/lib64/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0xab3) [0x7fcb7e9f7313] -> /usr It's coming from virtual mailboxes. > namespace virtual { > location = virtual:/var/mail/vhosts/%d/%n/virtual > prefix = virtual. > separator = . > } What do your dovecot-virtual files contain? I guess opening one of those virtual mailboxes crashes always. Related to searching keywords. From ml+dovecot at valo.at Tue Apr 12 20:50:52 2016 From: ml+dovecot at valo.at (Christian Kivalo) Date: Tue, 12 Apr 2016 22:50:52 +0200 Subject: Plus addressing on Sentora using Postfix In-Reply-To: <8B15DCE8-5CC4-4658-8379-ED29B613AC24@mcgaw.eu> References: <50B1436F-E46E-45C5-B2EE-F92CC4A6B909@mcgaw.eu> <932416D1-C86A-437C-A538-BD9B2C05F022@mcgaw.eu> <41fac6514ef67ff4dcfdf3b4f4490c0f@valo.at> <8B15DCE8-5CC4-4658-8379-ED29B613AC24@mcgaw.eu> Message-ID: <400c9062db25944ad1fe8b7a6c00b7d3@valo.at> On 2016-04-12 14:56, Philip McGaw wrote: > Dovecot.log > Dovecot-info.log > Dovecot-debug.log > > Are all devoid of information, the only log that seems to give > anything is mail.log > > I edited the working dovecot config file to add in recipient_delimiter > = + line. And it shows up when running Dovecot -n. You did restart dovecot after that change? The changed setting is shown by doveconf -n even if you don't restart dovecot. I just tried that here, the only difference is i'm using LMTP for delivery from postfix to dovecot. As long as i have "recipient_delimiter = +" everything is ok and test mails are delivered from postfix to dovecot: Postfix log: root at uschi:~ # grep 540B5100273 /var/log/mail.log Apr 12 22:14:34 uschi postfix/dspam-return/smtpd[24932]: 540B5100273: client=localhost[127.0.0.1] Apr 12 22:14:58 uschi postfix/cleanup[24938]: 540B5100273: message-id=<20160412201434.540B5100273 at uschi.sec-svcs.eu> Apr 12 22:14:58 uschi postfix/qmgr[29255]: 540B5100273: from=, size=384, nrcpt=1 (queue active) Apr 12 22:14:58 uschi postfix/lmtp[24940]: 540B5100273: to=, relay=uschi.sec-svcs.eu[private/dovecot-lmtp], delay=31, delays=31/0/0.01/0.02, dsn=2.0.0, status=sent (250 2.0.0 JX+LFEJXDVdtYQAAo97fFA Saved) Apr 12 22:14:58 uschi postfix/qmgr[29255]: 540B5100273: removed Dovecot log: root at uschi:~ # grep JX+LFEJXDVdtYQAAo97fFA /var/log/dovecot.log Apr 12 22:14:58 uschi dovecot: lmtp(USER at AAAA.AA): JX+LFEJXDVdtYQAAo97fFA: sieve: msgid=<20160412201434.540B5100273 at uschi.sec-svcs.eu>, from=postmaster at AAAA.AA, envelope from=postmaster at AAAA.AA, envelope to=USER+test at AAAA.AA, delivery time=14ms, lmtp session time=10ms, status=stored mail into mailbox 'INBOX' When i set "recipient_delimiter =" and restart dovecot the test mail is not delivered to dovecot: Postfix log root at uschi:~ # grep 811E3100273 /var/log/mail.log Apr 12 22:30:17 uschi postfix/dspam-return/smtpd[26033]: 811E3100273: client=localhost[127.0.0.1] Apr 12 22:30:43 uschi postfix/cleanup[26048]: 811E3100273: message-id=<20160412203017.811E3100273 at uschi.sec-svcs.eu> Apr 12 22:30:43 uschi postfix/qmgr[29255]: 811E3100273: from=, size=384, nrcpt=1 (queue active) Apr 12 22:30:43 uschi postfix/lmtp[26051]: 811E3100273: to=, relay=uschi.sec-svcs.eu[private/dovecot-lmtp], delay=34, delays=34/0/0.01/0.01, dsn=5.1.1, status=bounced (host uschi.sec-svcs.eu[private/dovecot-lmtp] said: 550 5.1.1 User doesn't exist: USER+test at AAAA.AA (in reply to RCPT TO command)) Apr 12 22:30:43 uschi postfix/bounce[26054]: 811E3100273: sender non-delivery notification: 5C24E1002DA Apr 12 22:30:43 uschi postfix/bounce[26054]: 811E3100273: postmaster non-delivery notification: 5CE34100310 Apr 12 22:30:43 uschi postfix/qmgr[29255]: 811E3100273: removed i add the "+" back to the recipient_delimiter setting, restart dovecot and everything is back to normal... -- Christian Kivalo From tss at iki.fi Tue Apr 12 21:05:55 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 13 Apr 2016 00:05:55 +0300 Subject: Dsync Header Hashing In-Reply-To: <570D5E96.1000006@wiktel.com> References: <56D9217F.20908@wiktel.com> <56DE603B.2050507@wiktel.com> <570D5E96.1000006@wiktel.com> Message-ID: <615C4F47-C226-4B3E-AFB8-FACEA13A804F@iki.fi> I added it today: https://github.com/dovecot/core/commit/03af8e5325a7b4fec36414ac35949457bc426c0b > On 12 Apr 2016, at 23:46, Richard Laager wrote: > > We've completed our migration to Dovecot (yay!), so this isn't critical for me any more. But this change might still be a useful addition to Dovecot. It doesn't create any non-standard behavior (like my patch for non-atom flags). > > On 03/07/2016 11:16 PM, Richard Laager wrote: >> On 03/04/2016 08:52 AM, Timo Sirainen wrote: >>> On 04 Mar 2016, at 07:47, Richard Laager wrote: >>>> Is there any way to disable the header hashing in dsync? >> ... >>> Does the attached patch happen to work? Compiles, but untested for now. >> >> It works with one more change on top of your patch: >> >> diff --git a/src/doveadm/dsync/dsync-mailbox-export.c b/src/doveadm/dsync/dsync-mailbox-export.c >> index 361cc55..0267f86 100644 >> --- a/src/doveadm/dsync/dsync-mailbox-export.c >> +++ b/src/doveadm/dsync/dsync-mailbox-export.c >> @@ -518,7 +518,7 @@ dsync_mailbox_export_init(struct mailbox *box, >> p_array_init(&exporter->expunged_seqs, pool, 16); >> p_array_init(&exporter->expunged_guids, pool, 16); >> >> - if (!exporter->mails_have_guids) >> + if (!exporter->mails_have_guids && !exporter->no_hdr_hashes) >> exporter->wanted_headers = dsync_mail_get_hash_headers(box); >> >> /* first scan transaction log and save any expunges and flag changes */ >> > > -- > Richard > From johannes at rohr.org Tue Apr 12 21:09:44 2016 From: johannes at rohr.org (Johannes Rohr) Date: Tue, 12 Apr 2016 23:09:44 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570D59E4.3080705@whyscream.net> References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> Message-ID: <570D6418.4020804@rohr.org> Hi Tom, Am 12.04.2016 um 22:26 schrieb Tom Hendrikx: > On 12-04-16 20:14, Johannes Rohr wrote: >> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise with >> the antispam plugin in version 2.0+20120225-2 and spamassassin at >> version 3.2.2 >> >> I have been trying and failed to get the pipe backend of the antispam >> plugin to work. Spamassin by itself works, a manual call of sa-learn >> works fine. Bayes data is stored in a mysql DB. >> >> I have the following configuration in /etc/dovecot/conf.d/90-plugin.conf >> >> plugin { >> #setting_name = value >> sieve=~/.dovecot.sieve >> sieve_dir=~/sieve >> antispam_pipe_program_spam_arg = --spam >> antispam_pipe_program_notspam_arg = --ham >> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >> antispam_pipe_program_args = --username=%u # % expansion done by >> dovecot > You need to specify the argument list as a list seperated by semicolons, > per example on the wiki: > > antispam_pipe_program_args = --username;%u Not sure about that, because sa-learn expects the parameter --username=user at na.me, this is one parameter, not two, and it works for me locally, where I also set up dovecot to test. The main differences are that the versions I have here are newer, I'm running Debian sid, the server is on Ubuntu Precise, and second, the server is handling virtual users, locally I have only real Unix users. Also, dovecot doesn't complain about configuration errors regard --username=%u. What other way would be there to get the parameter passed to sa-learn the way I want? btw, I tried this, just to be sure, but the result was the same. > > The verbose debug should give you some logging to work with. Yes, and I pasted the output. I can of course repeat: Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(Junk): 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_trash(INBOX): 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_trash(Junk): 0 Apr 12 22:53:02 vm10 imap: antispam: mail copy: from trash: 0, to trash: 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(INBOX): 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(Junk): 1 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(INBOX): 0 Apr 12 22:53:02 vm10 imap: antispam: mail copy: src spam: 0, dst spam: 1, src unsure: 0 Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend program /usr/bin/sa-learn Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend program parameter 1 --username=johannes at rohr.org Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend program parameter 2 --spam Apr 12 22:53:03 vm10 imap: antispam: run program failed with exit code -1 > Also, what > does the wrapper script log when dovecot runs it? I have actually ditched the wrapper script because it works without locally, I have configured the plugin to call sa-learn directly. > How does that differ > from a manual run? sa-learn works just fine with a manual run. It seems as if the plugin is passing the parameters wrongly, but the debugging output doesn't reveal the actual command, so it's just guesswork. Cheers, Johannes > > >> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >> antispam_spam = SPAM;Junk >> antispam_backend = pipe >> antispam_verbose_debug = 1 >> antispam_debug_target = syslog >> antispam_pipe_tmpdir = /tmp >> } >> >> I have tried the following wrapper script: >> #!/bin/bash >> # set -x >> LOGFILE=/tmp/sa-learn-pipe.log >> echo "$$-start ($*)" >> $LOGFILE >> #echo $* > /tmp/sendmail-parms.txt >> cat<&0 >> /tmp/sendmail-msg-$$.txt >> /usr/bin/sa-learn $* -D /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ >> rm -f /tmp/sendmail-msg-$$.txt >> echo "$$-end" >> $LOGFILE >> exit 0 >> >> It somehow isn't working. I can call the wrapper script manually e.g. >> sudo -u vmail /usr/local/bin/sa-learn-pipe.sh --username=some at mail.user >> --ham \ >> < someham >> >> But it doesn't work from dovecot. It seems the script is called. but no >> new patterns show up in the bayes DB. Unfortunately, the plugin seems to >> be documented poorly. How does it call the programme it pipes to? Is it >> something like $programme --par1 --par2 < message ? Why can't / >> shouldn't I call sa-learn directly? All the instructions I found on the >> in internet contained a wrapper script, but none bothered to explain why >> you would actually need it. >> >> I would be very grateful, if someone could enlighten me on that... >> >> Cheers, >> >> Johannes > From rlaager at wiktel.com Tue Apr 12 20:46:14 2016 From: rlaager at wiktel.com (Richard Laager) Date: Tue, 12 Apr 2016 15:46:14 -0500 Subject: Dsync Header Hashing In-Reply-To: <56DE603B.2050507@wiktel.com> References: <56D9217F.20908@wiktel.com> <56DE603B.2050507@wiktel.com> Message-ID: <570D5E96.1000006@wiktel.com> We've completed our migration to Dovecot (yay!), so this isn't critical for me any more. But this change might still be a useful addition to Dovecot. It doesn't create any non-standard behavior (like my patch for non-atom flags). On 03/07/2016 11:16 PM, Richard Laager wrote: > On 03/04/2016 08:52 AM, Timo Sirainen wrote: >> On 04 Mar 2016, at 07:47, Richard Laager wrote: >>> Is there any way to disable the header hashing in dsync? > ... >> Does the attached patch happen to work? Compiles, but untested for now. > > It works with one more change on top of your patch: > > diff --git a/src/doveadm/dsync/dsync-mailbox-export.c b/src/doveadm/dsync/dsync-mailbox-export.c > index 361cc55..0267f86 100644 > --- a/src/doveadm/dsync/dsync-mailbox-export.c > +++ b/src/doveadm/dsync/dsync-mailbox-export.c > @@ -518,7 +518,7 @@ dsync_mailbox_export_init(struct mailbox *box, > p_array_init(&exporter->expunged_seqs, pool, 16); > p_array_init(&exporter->expunged_guids, pool, 16); > > - if (!exporter->mails_have_guids) > + if (!exporter->mails_have_guids && !exporter->no_hdr_hashes) > exporter->wanted_headers = dsync_mail_get_hash_headers(box); > > /* first scan transaction log and save any expunges and flag changes */ > -- Richard -------------- next part -------------- A non-text attachment was scrubbed... Name: dsync.diff Type: text/x-patch Size: 2801 bytes Desc: not available URL: From rlaager at wiktel.com Tue Apr 12 21:09:31 2016 From: rlaager at wiktel.com (Richard Laager) Date: Tue, 12 Apr 2016 16:09:31 -0500 Subject: Dsync Header Hashing In-Reply-To: <615C4F47-C226-4B3E-AFB8-FACEA13A804F@iki.fi> References: <56D9217F.20908@wiktel.com> <56DE603B.2050507@wiktel.com> <570D5E96.1000006@wiktel.com> <615C4F47-C226-4B3E-AFB8-FACEA13A804F@iki.fi> Message-ID: <570D640B.20905@wiktel.com> On 04/12/2016 04:05 PM, Timo Sirainen wrote: > I added it today: https://github.com/dovecot/core/commit/03af8e5325a7b4fec36414ac35949457bc426c0b Cool. And thanks for the awesome software! -- Richard From tss at iki.fi Tue Apr 12 21:16:33 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 13 Apr 2016 00:16:33 +0300 Subject: Slow reading of large dovecot-uidlist files In-Reply-To: References: Message-ID: <8DBF69AD-F0A7-4F46-B310-617EAFA3A429@iki.fi> On 09 Apr 2016, at 21:04, Bostjan Skufca wrote: > > Hi there, > > (context: I was optimizing Roundcube mailbox list server response, and in > that 300-400ms response time, around 170ms is spent on single fgets() call > which is waiting IMAP repsonse to "SELECT MyMailbox" command) > > I straced dovecot and of the whole request/response process, around 30ms is > spent for everything else, and overwhelming majority of time (150-170ms) is > spent for reading dovecot-uidlist file for given mailbox. > > I skimmed over src/lib-storage/index/maildir/maildir-uidlist.c > and src/src/lib/istream.c, but I am out of ideas on how to optimize > mentioned file reading elegantly to make it faster. > > Is there any way to cache parsed content of uidlist file(s) or some other > obvious quicktrick I am missing to speed this process up? > > Does anyone have any other ideas, how to speed this up? Switch to mdbox or sdbox format to get better performance. I'm sure there are ways to optimize Maildir too, but it doesn't seem worth the effort since it'll always be slower than mdbox/sdbox. From bostjan at a2o.si Wed Apr 13 00:20:04 2016 From: bostjan at a2o.si (Bostjan Skufca) Date: Wed, 13 Apr 2016 02:20:04 +0200 Subject: Slow reading of large dovecot-uidlist files In-Reply-To: <8DBF69AD-F0A7-4F46-B310-617EAFA3A429@iki.fi> References: <8DBF69AD-F0A7-4F46-B310-617EAFA3A429@iki.fi> Message-ID: On 12 April 2016 at 23:16, Timo Sirainen wrote: > > On 09 Apr 2016, at 21:04, Bostjan Skufca wrote: > > (context: I was optimizing Roundcube mailbox list server response, and in > > that 300-400ms response time, around 170ms is spent on single fgets() call > > which is waiting IMAP repsonse to "SELECT MyMailbox" command) > > > > Does anyone have any other ideas, how to speed this up? > > Switch to mdbox or sdbox format to get better performance. I'm sure there are ways to optimize Maildir too, but it doesn't seem worth the effort since it'll always be slower than mdbox/sdbox. Now we are talking! Response time cut almost in half. Thanks Timo, b. From skdovecot at smail.inf.fh-brs.de Wed Apr 13 05:03:22 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 13 Apr 2016 07:03:22 +0200 (CEST) Subject: Slow reading of large dovecot-uidlist files In-Reply-To: References: <570A0E63.1050907@gmail.com> <570CB073.9050208@alec.pl> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 12 Apr 2016, Bostjan Skufca wrote: > On 12 April 2016 at 14:04, Steffen Kaiser > wrote: >> >> You could try to trace Dovecot and see if there are a lot of syscalls when >> a new connection starts up, e.g. with strace or dtruss. > > > Not that many, if I exclude reading the uidlist file contents. See the > trace below. > > > does your mailboxes change without Dovecot? Do you have some script or >> something like that that causes the mtime of the directory change? If >> Dovecot thinks an external program changed the mailbox, it validates all >> messages in cache and from store. > > > Are you talking about main directory of mailbox, where /cur, /new etc > reside? > Nothing external touches it, we migrated postfix LDA to dovecot LDA for > this very reason. > > What I observed now: dovecot creates a dovecot-uidlist.lock file on average > once every minute. The reason is Roundcube's minutely refresh > configuration. However, even with that disabled and dir mtime not updated, > if I issue SELECT, it rereads uidlist file entirely. I can see in strace > there is no .lock file manipulation and no change in dir mtime. The SELECT starts 13:07:35.305074 and ends 13:07:35.555618, that's 0.25 seconds. > > strace output: > ====================== > {{EPOLLIN, {u32=22457424, u64=22457424}}}, 5, 1780008) = 1 > 13:07:35.305074 read(7, "A0002 SELECT Gmail\r\n", 5336) = 20 > 13:07:35.305180 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/tmp", {st_mode=S_IFDIR|0700, > st_size=4096, ...}) = 0 > 13:07:35.305261 stat("/var/mail/virtual/stage.mail.teon.si/bostjan/.Gmail", > {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 > 13:07:35.305305 stat("/var/mail/virtual/stage.mail.teon.si/bostjan/.Gmail", > {st_mode=S_IFDIR|0700, st_size=4096, ...}) = 0 > 13:07:35.305343 open("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", O_RDWR|O_APPEND) = 13 > 13:07:35.305379 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.305409 pread(13, > "\1\2(\0\330\22\0W\\\0\0\0[\0\0\0(\251\1\0\314\270\1Wp\22\1\0\0\0\0\0"..., > 40, 0) = 40 > 13:07:35.305445 open("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot.index", O_RDWR) = 14 > 13:07:35.305476 fstat(14, {st_mode=S_IFREG|0600, st_size=1686936, ...}) = 0 > 13:07:35.305507 mmap(NULL, 1686936, PROT_READ|PROT_WRITE, MAP_PRIVATE, 14, > 0) = 0x7f9540451000 > 13:07:35.305562 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.305596 pread(13, > "\200\200\200\205\4\0\0\0\204\22\1\0\204\22\1\0\10\0\0\0\200\200\200\203\0\0\10\20X\0\0\0"..., > 8192, 10284) = 3980 > 13:07:35.305626 pread(13, "", 8192, 14264) = 0 > 13:07:35.305657 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.305684 mmap(NULL, 14264, PROT_READ, MAP_SHARED, 13, 0) = > 0x7f95405fc000 > 13:07:35.305712 madvise(0x7f95405fc000, 14264, MADV_SEQUENTIAL) = 0 > 13:07:35.305738 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.306249 munmap(0x7f9540451000, 1686936) = 0 > 13:07:35.306387 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/new", {st_mode=S_IFDIR|0700, > st_size=4096, ...}) = 0 > 13:07:35.306429 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/cur", {st_mode=S_IFDIR|0700, > st_size=6311936, ...}) = 0 > 13:07:35.306482 umask(0177) = 077 > 13:07:35.306512 lstat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", 0x7ffea1ef7bd0) = > -1 ENOENT (No such file or directory) > 13:07:35.306553 open("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", > O_RDWR|O_CREAT|O_EXCL, 0666) = 15 > 13:07:35.306618 write(15, "9815:labrat-1", 13) = 13 > 13:07:35.306662 fstat(15, {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 > 13:07:35.306690 close(15) = 0 > 13:07:35.306716 lstat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", > {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 > 13:07:35.306747 umask(077) = 0177 > 13:07:35.306772 open("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist", O_RDWR) = 15 > 13:07:35.306802 lseek(15, 0, SEEK_SET) = 0 > 13:07:35.306827 fstat(15, {st_mode=S_IFREG|0600, st_size=3875867, ...}) = 0 > 13:07:35.306856 brk(0x1bec000) = 0x1bec000 > 13:07:35.306918 fstat(15, {st_mode=S_IFREG|0600, st_size=3875867, ...}) = 0 > 13:07:35.306955 pread(15, "3 V1459433542 N1 G8cfaa815851200"..., 8192, 0) = > 8192 > 13:07:35.307183 pread(15, "-1,S=14182,W=14669\n156 :14596233"..., 8156, > 8192) = 8156 > 13:07:35.307404 pread(15, "89.M700263P26773.labrat-1,S=805,"..., 8179, > 16348) = 8179 > 13:07:35.307621 pread(15, "4.M540099P26773.labrat-1,S=11962"..., 8178, > 24527) = 8178 > 13:07:35.307840 pread(15, "W=4891\n612 :1459624371.M994429P2"..., 8146, > 32705) = 8146 > 13:07:35.308056 pread(15, "73.labrat-1,S=15387,W=15911\n764 "..., 8165, > 40851) = 8165 > ... > ... > ... > 13:07:35.537511 pread(15, "3283P31774.labrat-1,S=9466,W=968"..., 8171, > 3837511) = 8171 > 13:07:35.537878 pread(15, "52\n69737 :1459730261.M163039P317"..., 8140, > 3845682) = 8140 > 13:07:35.538242 pread(15, "774.labrat-1,S=1394,W=1431\n69883"..., 8164, > 3853822) = 8164 > 13:07:35.538607 pread(15, "rat-1,S=12084,W=12326\n70030 :145"..., 8157, > 3861986) = 8157 > 13:07:35.538962 pread(15, "2882,W=2928\n70176 :1459730412.M3"..., 8149, > 3870143) = 5724 > 13:07:35.539232 pread(15, "", 2425, 3875867) = 0 > 13:07:35.540551 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log.2", 0x7ffea1ef7dd0) = > -1 ENOENT (No such file or directory) > 13:07:35.540712 alarm(180) = 0 > 13:07:35.540778 fcntl(13, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, > start=0, len=0}) = 0 > 13:07:35.540856 alarm(0) = 180 > 13:07:35.540929 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", > {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.541015 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.541127 access("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/cur", W_OK) = 0 > 13:07:35.553975 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/cur", {st_mode=S_IFDIR|0700, > st_size=6311936, ...}) = 0 > 13:07:35.554155 fcntl(13, F_SETLK, {type=F_UNLCK, whence=SEEK_SET, start=0, > len=0}) = 0 > 13:07:35.554906 lstat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", > {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 > 13:07:35.555088 unlink("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock") = 0 > 13:07:35.555238 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", > {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.555321 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.555396 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.555455 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/dovecot.list.index.log", {st_mode=S_IFREG|0600, > st_size=2916, ...}) = 0 > 13:07:35.555495 fstat(4, {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 > 13:07:35.555585 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 > 13:07:35.555618 write(7, "* FLAGS (\\Answered \\Flagged \\Del"..., 382) = > 382 > 13:07:35.555656 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 > 13:07:35.555774 epoll_wait(12, {{EPOLLIN, {u32=22457424, u64=22457424}}}, > 5, 1800000) = 1 > 13:07:35.556355 read(7, "A0003 UID SEARCH 70231\r\n", 5316) = 24 > 13:07:35.556499 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/dovecot.list.index.log", {st_mode=S_IFREG|0600, > st_size=2916, ...}) = 0 > 13:07:35.556543 fstat(4, {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 > 13:07:35.556603 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", > {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.556641 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.556676 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.556734 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/dovecot.list.index.log", {st_mode=S_IFREG|0600, > st_size=2916, ...}) = 0 > 13:07:35.556771 fstat(4, {st_mode=S_IFREG|0600, st_size=2916, ...}) = 0 > 13:07:35.556819 stat("/var/mail/virtual/ > stage.mail.teon.si/bostjan/.Gmail/dovecot.index.log", > {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.556855 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.556889 fstat(13, {st_mode=S_IFREG|0600, st_size=14264, ...}) = 0 > 13:07:35.556944 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 > 13:07:35.556976 write(7, "* SEARCH 70278\r\nA0003 OK Search "..., 65) = 65 > 13:07:35.557011 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 > 13:07:35.557061 epoll_wait(12, {{EPOLLIN, {u32=22457424, u64=22457424}}}, > 5, 1799999) = 1 > 13:07:35.576027 read(7, "A0004 STATUS Gmail (MESSAGES UNS"..., 5292) = 38 > 13:07:35.576142 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 > 13:07:35.576185 write(7, "* STATUS Gmail (MESSAGES 70231 U"..., 125) = 125 > 13:07:35.576225 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 > 13:07:35.576299 epoll_wait(12, {{EPOLLIN, {u32=22457424, u64=22457424}}}, > 5, 1800000) = 1 > 13:07:35.612494 read(7, "A0005 GETQUOTAROOT Gmail\r\n", 5254) = 26 > 13:07:35.612654 socket(PF_LOCAL, SOCK_STREAM, 0) = 16 > 13:07:35.612741 fcntl(16, F_GETFL) = 0x2 (flags O_RDWR) > 13:07:35.612817 fcntl(16, F_SETFL, O_RDWR|O_NONBLOCK) = 0 > 13:07:35.612888 connect(16, {sa_family=AF_LOCAL, > sun_path="/var/run/dovecot/dict"}, 110) = 0 > 13:07:35.612959 fcntl(16, F_GETFL) = 0x802 (flags O_RDWR|O_NONBLOCK) > 13:07:35.612994 fcntl(16, F_SETFL, O_RDWR) = 0 > 13:07:35.613028 fstat(16, {st_mode=S_IFSOCK|0777, st_size=0, ...}) = 0 > 13:07:35.613068 lseek(16, 0, SEEK_CUR) = -1 ESPIPE (Illegal seek) > 13:07:35.613149 getsockname(16, {sa_family=AF_LOCAL, NULL}, [2]) = 0 > 13:07:35.613229 write(16, "H2\t0\t0\tbostjan at stage.mail.teon.s"..., 40) = 40 > 13:07:35.613285 write(16, "Lpriv/quota/storage\n", 20) = 20 > 13:07:35.613337 alarm(30) = 0 > 13:07:35.613389 read(16, "O2960032661\n", 8192) = 12 > 13:07:35.621249 alarm(0) = 30 > 13:07:35.621330 write(16, "Lpriv/quota/messages\n", 21) = 21 > 13:07:35.621392 alarm(30) = 0 > 13:07:35.621431 read(16, "O70251\n", 8180) = 7 > 13:07:35.621508 alarm(0) = 30 > 13:07:35.621585 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 > 13:07:35.621640 write(7, "* QUOTAROOT Gmail \"User quota\"\r\n"..., 136) = > 136 > 13:07:35.621694 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 > 13:07:35.621788 epoll_wait(12, {}, 5, 0) = 0 > 13:07:35.621830 close(16) = 0 > 13:07:35.621893 epoll_wait(12, {{EPOLLIN, {u32=22457424, u64=22457424}}}, > 5, 1800000) = 1 > 13:07:35.626137 read(7, "C64 EXAMINE \"\"\r\n", 5228) = 16 > 13:07:35.626210 close(15) = 0 > 13:07:35.628537 brk(0x17ec000) = 0x17ec000 > 13:07:35.629407 setsockopt(7, SOL_TCP, TCP_CORK, [1], 4) = 0 > 13:07:35.629448 write(7, "* OK [CLOSED] Previous mailbox c"..., 115) = 115 > 13:07:35.629481 setsockopt(7, SOL_TCP, TCP_CORK, [0], 4) = 0 > 13:07:35.629560 epoll_wait(12, > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVw3TGnz1H7kL/d9rAQK1jgf/aYR+zFswuXsKn2Vm19J+r0ATI1e2x1bS ukv+evXN6FZHnDUAuR/Ay2GHVE76TBdcCkxWPVfBnbGgQ1DG/zV+6CWYts+O6b/4 D5TPhMILMhwokiFv1NjpgHDz+u8vV2+6Gv69/Qr5I1l0NhMYrx8f1qdk2QYlfND4 01aBomKPEkK2mNhVpoRTDp/jks27Ji3or2NbAW7HToEuB00FjVSSTkZACRGtwtty /qb648it3STSy4re+2Mej0lI6ByFkhSDgZnJE3dIt/3iZedON8ILJvpato74mmr4 Sx72Mic/pzr6mu+kaYv9EWwS71kSAoKVXH6tgCub7CKfCnZZR5FB6g== =3KMD -----END PGP SIGNATURE----- From skdovecot at smail.inf.fh-brs.de Wed Apr 13 05:52:36 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 13 Apr 2016 07:52:36 +0200 (CEST) Subject: Different usernames for different login method In-Reply-To: <20160412221419.55306d28@frodo.lucabert.intra> References: <20160412221419.55306d28@frodo.lucabert.intra> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 12 Apr 2016, Luca Bertoncello wrote: > With Dovecot 2.2.9 authenticating against the Active Directory I have > following problem: > > - if I login using LOGIN, PLAIN or CRAM, the username is REALM\login (in my > case: CCH\lucabert) > - if I login using GSSAPI, the username is just login (in my case: lucabert) > > this makes the access to the mailbox very difficult, since I don't what can I > write in mail_location... > If I login with LOGIN, I can write: > > maildir:/home/mailboxes/%4.u/Maildir > > but of course it does not work if I login using GSSAPI... > > The mailboxes have just the login (in my case: lucabert). > Can someone explain me why %u is different and how can I solve my problem? What does your passdb /userdb config looks like ? You can return the "user" field, see http://wiki2.dovecot.org/PasswordDatabase , to mangle the username for all passdb's, in order to let Dovecot use the same username. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVw3epXz1H7kL/d9rAQLhtwf+LUMHvIlsLqE6fSllcNSWlnLni1ImzlM1 Ew//xfMrHr8vdIsoM4fxm+D21O7omFkdLWvfmOasdioHxdS62UT0jL9FNN67rp5O qvvjZyxcYdQzqbn1IO050T0V6gSppDik/gyB2ZikbfYDuwrg8BBVUvIvtXAKOtIq 5WPYt9Qv91DXa8cR/GK51Am/q+PDQ34P0wBY+6VABPgYOC2ZBUsGdspEvcFM0GPD Tde31V2XoMHudt42N+36EPDzg/PQMCbMCDkzQWeb1+LMCQBCAuuypF4cqJmgWPFp 9LVaQ58G7Wq6aw6EUBRKmDY+MXpD36Ausf9vVBkQc/6YPZn/yDdV+A== =nl3t -----END PGP SIGNATURE----- From lucabert at lucabert.de Wed Apr 13 06:07:57 2016 From: lucabert at lucabert.de (Luca Bertoncello) Date: Wed, 13 Apr 2016 06:07:57 +0000 Subject: Different usernames for different login method In-Reply-To: References: <20160412221419.55306d28@frodo.lucabert.intra> Message-ID: <20160413060757.Horde.WWkw4C4M64AEm1GAURnD5Mh@horde.lucabert.de> Zitat von Steffen Kaiser : > What does your passdb /userdb config looks like ? > > You can return the "user" field, see > http://wiki2.dovecot.org/PasswordDatabase , to mangle the username > for all passdb's, in order to let Dovecot use the same username. I solved the problem upgrading Dovecot to version 2.2.18 and using %{auth_username}... Now I just have the problem, that mail_uid and mail_gid are ignored. Any idea? Thanks Luca Bertoncello (lucabert at lucabert.de) From johannes at rohr.org Wed Apr 13 06:27:29 2016 From: johannes at rohr.org (Johannes Rohr) Date: Wed, 13 Apr 2016 08:27:29 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570D6418.4020804@rohr.org> References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> Message-ID: <570DE6D1.5080904@rohr.org> Hi List, does the antispam plugin any way of actually seeing how it is calling the pipe program and how it is failing? I can't reproduce the failure when I call sa-learn manually. Can someone tell me, with which UID the call happens, is it the UID the current dovecot process is running under (which would be vmail, as it is a virtual user setup) Cheers, Johannes Am 12.04.2016 um 23:09 schrieb Johannes Rohr: > Hi Tom, > > Am 12.04.2016 um 22:26 schrieb Tom Hendrikx: >> On 12-04-16 20:14, Johannes Rohr wrote: >>> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise >>> with >>> the antispam plugin in version 2.0+20120225-2 and spamassassin at >>> version 3.2.2 >>> >>> I have been trying and failed to get the pipe backend of the antispam >>> plugin to work. Spamassin by itself works, a manual call of sa-learn >>> works fine. Bayes data is stored in a mysql DB. >>> >>> I have the following configuration in >>> /etc/dovecot/conf.d/90-plugin.conf >>> >>> plugin { >>> #setting_name = value >>> sieve=~/.dovecot.sieve >>> sieve_dir=~/sieve >>> antispam_pipe_program_spam_arg = --spam >>> antispam_pipe_program_notspam_arg = --ham >>> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >>> antispam_pipe_program_args = --username=%u # % expansion done by >>> dovecot >> You need to specify the argument list as a list seperated by semicolons, >> per example on the wiki: >> >> antispam_pipe_program_args = --username;%u > > Not sure about that, because sa-learn expects the parameter > --username=user at na.me, this is one parameter, not two, and it works > for me locally, where I also set up dovecot to test. The main > differences are that the versions I have here are newer, I'm running > Debian sid, the server is on Ubuntu Precise, and second, the server is > handling virtual users, locally I have only real Unix users. > > Also, dovecot doesn't complain about configuration errors regard > --username=%u. What other way would be there to get the parameter > passed to sa-learn the way I want? > > btw, I tried this, just to be sure, but the result was the same. > >> >> The verbose debug should give you some logging to work with. > Yes, and I pasted the output. I can of course repeat: > > Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(Junk): 0 > Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_trash(INBOX): 0 > Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_trash(Junk): 0 > Apr 12 22:53:02 vm10 imap: antispam: mail copy: from trash: 0, to > trash: 0 > Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(INBOX): 0 > Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(Junk): 1 > Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(INBOX): 0 > Apr 12 22:53:02 vm10 imap: antispam: mail copy: src spam: 0, dst spam: > 1, src unsure: 0 > Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend program > /usr/bin/sa-learn > Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend program > /usr/bin/sa-learn > Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend program > parameter 1 --username=johannes at rohr.org > Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend program > parameter 2 --spam > Apr 12 22:53:03 vm10 imap: antispam: run program failed with exit code -1 > > > > >> Also, what >> does the wrapper script log when dovecot runs it? > > I have actually ditched the wrapper script because it works without > locally, I have configured the plugin to call sa-learn directly. > >> How does that differ >> from a manual run? > sa-learn works just fine with a manual run. It seems as if the plugin > is passing the parameters wrongly, but the debugging output doesn't > reveal the actual command, so it's just guesswork. > > Cheers, > > Johannes > >> >> >>> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >>> antispam_spam = SPAM;Junk >>> antispam_backend = pipe >>> antispam_verbose_debug = 1 >>> antispam_debug_target = syslog >>> antispam_pipe_tmpdir = /tmp >>> } >>> >>> I have tried the following wrapper script: >>> #!/bin/bash >>> # set -x >>> LOGFILE=/tmp/sa-learn-pipe.log >>> echo "$$-start ($*)" >> $LOGFILE >>> #echo $* > /tmp/sendmail-parms.txt >>> cat<&0 >> /tmp/sendmail-msg-$$.txt >>> /usr/bin/sa-learn $* -D /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ >>> rm -f /tmp/sendmail-msg-$$.txt >>> echo "$$-end" >> $LOGFILE >>> exit 0 >>> >>> It somehow isn't working. I can call the wrapper script manually e.g. >>> sudo -u vmail /usr/local/bin/sa-learn-pipe.sh --username=some at mail.user >>> --ham \ >>> < someham >>> >>> But it doesn't work from dovecot. It seems the script is called. but no >>> new patterns show up in the bayes DB. Unfortunately, the plugin >>> seems to >>> be documented poorly. How does it call the programme it pipes to? Is it >>> something like $programme --par1 --par2 < message ? Why can't / >>> shouldn't I call sa-learn directly? All the instructions I found on the >>> in internet contained a wrapper script, but none bothered to explain >>> why >>> you would actually need it. >>> >>> I would be very grateful, if someone could enlighten me on that... >>> >>> Cheers, >>> >>> Johannes >> From tom at whyscream.net Wed Apr 13 07:17:40 2016 From: tom at whyscream.net (Tom Hendrikx) Date: Wed, 13 Apr 2016 09:17:40 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570DE6D1.5080904@rohr.org> References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> Message-ID: <570DF294.4070501@whyscream.net> On 13-04-16 08:27, Johannes Rohr wrote: > Hi List, > > does the antispam plugin any way of actually seeing how it is > calling the pipe program and how it is failing? I can't reproduce the > failure when I call sa-learn manually. Can someone tell me, with > which UID the call happens, is it the UID the current dovecot process > is running under (which would be vmail, as it is a virtual user > setup) Cheers, > Hi Johannes, This is exactly what the wrapper script is supposed to log for you, or which is trivially to add to its output. The wrapper script is not actually useful for production, but it is for debugging. That is why I asked for its logging, and any differences between manual run and a dovecot run. Regards, Tom > Johannes > > Am 12.04.2016 um 23:09 schrieb Johannes Rohr: >> Hi Tom, >> >> Am 12.04.2016 um 22:26 schrieb Tom Hendrikx: >>> On 12-04-16 20:14, Johannes Rohr wrote: >>>> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise >>>> with the antispam plugin in version 2.0+20120225-2 and >>>> spamassassin at version 3.2.2 >>>> >>>> I have been trying and failed to get the pipe backend of the >>>> antispam plugin to work. Spamassin by itself works, a manual >>>> call of sa-learn works fine. Bayes data is stored in a mysql >>>> DB. >>>> >>>> I have the following configuration in >>>> /etc/dovecot/conf.d/90-plugin.conf >>>> >>>> plugin { #setting_name = value sieve=~/.dovecot.sieve >>>> sieve_dir=~/sieve antispam_pipe_program_spam_arg = --spam >>>> antispam_pipe_program_notspam_arg = --ham >>>> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >>>> antispam_pipe_program_args = --username=%u # % expansion done >>>> by dovecot >>> You need to specify the argument list as a list seperated by >>> semicolons, per example on the wiki: >>> >>> antispam_pipe_program_args = --username;%u >> >> Not sure about that, because sa-learn expects the parameter >> --username=user at na.me, this is one parameter, not two, and it >> works for me locally, where I also set up dovecot to test. The >> main differences are that the versions I have here are newer, I'm >> running Debian sid, the server is on Ubuntu Precise, and second, >> the server is handling virtual users, locally I have only real Unix >> users. >> >> Also, dovecot doesn't complain about configuration errors regard >> --username=%u. What other way would be there to get the parameter >> passed to sa-learn the way I want? >> >> btw, I tried this, just to be sure, but the result was the same. >> >>> >>> The verbose debug should give you some logging to work with. >> Yes, and I pasted the output. I can of course repeat: >> >> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(Junk): 0 Apr >> 12 22:53:02 vm10 imap: antispam: mailbox_is_trash(INBOX): 0 Apr 12 >> 22:53:02 vm10 imap: antispam: mailbox_is_trash(Junk): 0 Apr 12 >> 22:53:02 vm10 imap: antispam: mail copy: from trash: 0, to trash: >> 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(INBOX): 0 >> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(Junk): 1 Apr >> 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(INBOX): 0 Apr 12 >> 22:53:02 vm10 imap: antispam: mail copy: src spam: 0, dst spam: 1, >> src unsure: 0 Apr 12 22:53:02 vm10 imap: antispam: running >> mailtrain backend program /usr/bin/sa-learn Apr 12 22:53:02 vm10 >> imap: antispam: running mailtrain backend program >> /usr/bin/sa-learn Apr 12 22:53:02 vm10 imap: antispam: running >> mailtrain backend program parameter 1 --username=johannes at rohr.org >> Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend >> program parameter 2 --spam Apr 12 22:53:03 vm10 imap: antispam: run >> program failed with exit code -1 >> >> >> >> >>> Also, what does the wrapper script log when dovecot runs it? >> >> I have actually ditched the wrapper script because it works >> without locally, I have configured the plugin to call sa-learn >> directly. >> >>> How does that differ from a manual run? >> sa-learn works just fine with a manual run. It seems as if the >> plugin is passing the parameters wrongly, but the debugging output >> doesn't reveal the actual command, so it's just guesswork. >> >> Cheers, >> >> Johannes >> >>> >>> >>>> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >>>> antispam_spam = SPAM;Junk antispam_backend = pipe >>>> antispam_verbose_debug = 1 antispam_debug_target = syslog >>>> antispam_pipe_tmpdir = /tmp } >>>> >>>> I have tried the following wrapper script: #!/bin/bash # set >>>> -x LOGFILE=/tmp/sa-learn-pipe.log echo "$$-start ($*)" >> >>>> $LOGFILE #echo $* > /tmp/sendmail-parms.txt cat<&0 >> >>>> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn $* -D >>>> /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ rm -f >>>> /tmp/sendmail-msg-$$.txt echo "$$-end" >> $LOGFILE exit 0 >>>> >>>> It somehow isn't working. I can call the wrapper script >>>> manually e.g. sudo -u vmail /usr/local/bin/sa-learn-pipe.sh >>>> --username=some at mail.user --ham \ < someham >>>> >>>> But it doesn't work from dovecot. It seems the script is >>>> called. but no new patterns show up in the bayes DB. >>>> Unfortunately, the plugin seems to be documented poorly. How >>>> does it call the programme it pipes to? Is it something like >>>> $programme --par1 --par2 < message ? Why can't / shouldn't I >>>> call sa-learn directly? All the instructions I found on the in >>>> internet contained a wrapper script, but none bothered to >>>> explain why you would actually need it. >>>> >>>> I would be very grateful, if someone could enlighten me on >>>> that... >>>> >>>> Cheers, >>>> >>>> Johannes >>> From johannes at rohr.org Wed Apr 13 07:45:14 2016 From: johannes at rohr.org (Johannes Rohr) Date: Wed, 13 Apr 2016 09:45:14 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570DF294.4070501@whyscream.net> References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> <570DF294.4070501@whyscream.net> Message-ID: <570DF90A.1060505@rohr.org> Am 13.04.2016 um 09:17 schrieb Tom Hendrikx: > On 13-04-16 08:27, Johannes Rohr wrote: >> Hi List, >> >> does the antispam plugin any way of actually seeing how it is >> calling the pipe program and how it is failing? I can't reproduce the >> failure when I call sa-learn manually. Can someone tell me, with >> which UID the call happens, is it the UID the current dovecot process >> is running under (which would be vmail, as it is a virtual user >> setup) Cheers, >> > Hi Johannes, > http://wiki2.dovecot.org/Pigeonhole/Sieve/Troubleshooting > This is exactly what the wrapper script is supposed to log for you, or > which is trivially to add to its output. The wrapper script is not > actually useful for production, but it is for debugging. That is why I > asked for its logging, and any differences between manual run and a > dovecot run. When I used the wrapper script recommended at http://wiki2.dovecot.org/Plugins/Antispam, it merely reported the PID and parameters (--username=some at na.me --ham). The wrapper script noted in the dovecot wiki seems broken. Note the commented out line: #echo $* > /tmp/sendmail-parms.txt cat<&0 >> /tmp/sendmail-msg-$$.txt It seems like the second half of the line "cat<&0 >> /tmp/sendmail-msg-$$.txt" was originally a separate line, catting the message, which has been passed by the plugin via STDOUT to a file. Without that command, the call of sa-learn in the next line has no file to read from: /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt && rm -f /tmp/sendmail-msg-$$.txt & So I moved the cat command to a separate uncommented line and to be sure I also commented out the rm -f /tmp/sendmail-msg-$$.txt & to verify that the file actually contains something, (why is there an "&" terminating the line, which would have the rm command executed in the background?) But it seems the /tmp/sendmail-msg-$$.txt & was empty and the whole operation continued to fail. Could it be that the plugin fails to pass the actual message? Cheers, Johannes > > Regards, > Tom > > >> Johannes >> >> Am 12.04.2016 um 23:09 schrieb Johannes Rohr: >>> Hi Tom, >>> >>> Am 12.04.2016 um 22:26 schrieb Tom Hendrikx: >>>> On 12-04-16 20:14, Johannes Rohr wrote: >>>>> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise >>>>> with the antispam plugin in version 2.0+20120225-2 and >>>>> spamassassin at version 3.2.2 >>>>> >>>>> I have been trying and failed to get the pipe backend of the >>>>> antispam plugin to work. Spamassin by itself works, a manual >>>>> call of sa-learn works fine. Bayes data is stored in a mysql >>>>> DB. >>>>> >>>>> I have the following configuration in >>>>> /etc/dovecot/conf.d/90-plugin.conf >>>>> >>>>> plugin { #setting_name = value sieve=~/.dovecot.sieve >>>>> sieve_dir=~/sieve antispam_pipe_program_spam_arg = --spam >>>>> antispam_pipe_program_notspam_arg = --ham >>>>> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >>>>> antispam_pipe_program_args = --username=%u # % expansion done >>>>> by dovecot >>>> You need to specify the argument list as a list seperated by >>>> semicolons, per example on the wiki: >>>> >>>> antispam_pipe_program_args = --username;%u >>> Not sure about that, because sa-learn expects the parameter >>> --username=user at na.me, this is one parameter, not two, and it >>> works for me locally, where I also set up dovecot to test. The >>> main differences are that the versions I have here are newer, I'm >>> running Debian sid, the server is on Ubuntu Precise, and second, >>> the server is handling virtual users, locally I have only real Unix >>> users. >>> >>> Also, dovecot doesn't complain about configuration errors regard >>> --username=%u. What other way would be there to get the parameter >>> passed to sa-learn the way I want? >>> >>> btw, I tried this, just to be sure, but the result was the same. >>> >>>> The verbose debug should give you some logging to work with. >>> Yes, and I pasted the output. I can of course repeat: >>> >>> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(Junk): 0 Apr >>> 12 22:53:02 vm10 imap: antispam: mailbox_is_trash(INBhttp://wiki2.dovecot.org/Pigeonhole/Sieve/TroubleshootingOX): 0 Apr 12 >>> 22:53:02 vm10 imap: antispam: mailbox_is_trash(Junk): 0 Apr 12 >>> 22:53:02 vm10 imap: antispam: mail copy: from trash: 0, to trash: >>> 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(INBOX): 0 >>> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(Junk): 1 Apr >>> 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(INBOX): 0 Apr 12 >>> 22:53:02 vm10 imap: antispam: mail copy: src spam: 0, dst spam: 1, >>> src unsure: 0 Apr 12 22:53:02 vm10 imap: antispam: running >>> mailtrain backend program /usr/bin/sa-learn Apr 12 22:53:02 vm10 >>> imap: antispam: running mailtrain backend program >>> /usr/bin/sa-learn Apr 12 22:53:02 vm10 imap: antispam: running >>> mailtrain backend program parameter 1 --username=johannes at rohr.org >>> Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend >>> program parameter 2 --spam Apr 12 22:53:03 vm10 imap: antispam: run >>> program failed with exit code -1 >>> >>> >>> >>> >>>> Also, what does the wrapper script log when dovecot runs it? >>> I have actually ditched the wrapper script because it works >>> without locally, I have configured the plugin to call sa-learn >>> directly. >>> >>>> How does that differ from a manual run? >>> sa-learn works just fine with a manual run. It seems as if the >>> plugin is passing the parameters wrongly, but the debugging output >>> doesn't reveal the actual command, so it's just guesswork. >>> >>> Cheers, >>> >>> Johannes >>> >>>> >>>>> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >>>>> antispam_spam = SPAM;Junk antispam_backend = pipe >>>>> antispam_verbose_debug = 1 antispam_debug_target = syslog >>>>> antispam_pipe_tmpdir = /tmp } >>>>> >>>>> I have tried the following wrapper script: #!/bin/bash # set >>>>> -x LOGFILE=/tmp/sa-learn-pipe.log echo "$$-start ($*)" >> >>>>> $LOGFILE #echo $* > /tmp/sendmail-parms.txt cat<&0 >> >>>>> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn $* -D >>>>> /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ rm -f >>>>> /tmp/sendmail-msg-$$.txt echo "$$-end" >> $LOGFILE exit 0 >>>>> >>>>> It somehow isn't working. I can call the wrapper script >>>>> manually e.g. sudo -u vmail /usr/local/bin/sa-learn-pipe.sh >>>>> --username=some at mail.user --ham \ < someham >>>>> >>>>> But it doesn't work from dovecot. It seems the script is >>>>> called. but no new patterns show up in the bayes DB. >>>>> Unfortunately, the plugin seems to be documented poorly. How >>>>> does it call the programme it pipes to? Is it something like >>>>> $programme --par1 --par2 < message ? Why can't / shouldn't I >>>>> call sa-learn directly? All the instructions I found on the in >>>>> internet contained a wrapper script, but none bothered to >>>>> explain why you would actually need it. >>>>> >>>>> I would be very grateful, if someone could enlighten me on >>>>> that... >>>>> >>>>> Cheers, >>>>> >>>>> Johannes From johannes at rohr.org Wed Apr 13 08:35:59 2016 From: johannes at rohr.org (Johannes Rohr) Date: Wed, 13 Apr 2016 10:35:59 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570DF90A.1060505@rohr.org> References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> <570DF294.4070501@whyscream.net> <570DF90A.1060505@rohr.org> Message-ID: <570E04EF.6010207@rohr.org> tweaked the wrapper script to make it work. It seems like the sa-learn call silently fails: "/usr/local/bin/sa-learn-pipe.sh" 10L, 350C geschrieben root at vm10:/etc/dovecot/conf.d# cat /tmp/sa-learn-pipe.log starting log 25200-start (--username=johannes at rohr.org --spam) libgcc_s.so.1 must be installed for pthread_cancel to work 25200-end Does the above error message have anything to do with it? Running the script & sa-learn manually works fine. do virtual users change something how dovecot calls programs, such as chrooting them? Cheers, Johannes Am 13.04.2016 um 09:45 schrieb Johannes Rohr: > Am 13.04.2016 um 09:17 schrieb Tom Hendrikx: >> On 13-04-16 08:27, Johannes Rohr wrote: >>> Hi List, >>> >>> does the antispam plugin any way of actually seeing how it is >>> calling the pipe program and how it is failing? I can't reproduce the >>> failure when I call sa-learn manually. Can someone tell me, with >>> which UID the call happens, is it the UID the current dovecot process >>> is running under (which would be vmail, as it is a virtual user >>> setup) Cheers, >>> >> Hi Johannes, >> http://wiki2.dovecot.org/Pigeonhole/Sieve/Troubleshooting >> This is exactly what the wrapper script is supposed to log for you, or >> which is trivially to add to its output. The wrapper script is not >> actually useful for production, but it is for debugging. That is why I >> asked for its logging, and any differences between manual run and a >> dovecot run. > > When I used the wrapper script recommended at > http://wiki2.dovecot.org/Plugins/Antispam, it merely reported the PID > and parameters (--username=some at na.me --ham). The wrapper script noted > in the dovecot wiki seems broken. Note the commented out line: > > #echo $* > /tmp/sendmail-parms.txt cat<&0 >> /tmp/sendmail-msg-$$.txt > > It seems like the second half of the line "cat<&0 >> > /tmp/sendmail-msg-$$.txt" was originally a separate line, catting the > message, which has been passed by the plugin via STDOUT to a file. > Without that command, the call of sa-learn in the next line has no > file to read from: > > /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt && rm -f > /tmp/sendmail-msg-$$.txt & > > So I moved the cat command to a separate uncommented line and to be > sure I also commented out the > > rm -f /tmp/sendmail-msg-$$.txt & > > to verify that the file actually contains something, (why is there an > "&" terminating the line, which would have the rm command executed in > the background?) > > But it seems the > > /tmp/sendmail-msg-$$.txt & > > was empty and the whole operation continued to fail. Could it be that > the plugin fails to pass the actual message? > > Cheers, > > Johannes > >> >> Regards, >> Tom >> >> >>> Johannes >>> >>> Am 12.04.2016 um 23:09 schrieb Johannes Rohr: >>>> Hi Tom, >>>> >>>> Am 12.04.2016 um 22:26 schrieb Tom Hendrikx: >>>>> On 12-04-16 20:14, Johannes Rohr wrote: >>>>>> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise >>>>>> with the antispam plugin in version 2.0+20120225-2 and >>>>>> spamassassin at version 3.2.2 >>>>>> >>>>>> I have been trying and failed to get the pipe backend of the >>>>>> antispam plugin to work. Spamassin by itself works, a manual >>>>>> call of sa-learn works fine. Bayes data is stored in a mysql >>>>>> DB. >>>>>> >>>>>> I have the following configuration in >>>>>> /etc/dovecot/conf.d/90-plugin.conf >>>>>> >>>>>> plugin { #setting_name = value sieve=~/.dovecot.sieve >>>>>> sieve_dir=~/sieve antispam_pipe_program_spam_arg = --spam >>>>>> antispam_pipe_program_notspam_arg = --ham >>>>>> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >>>>>> antispam_pipe_program_args = --username=%u # % expansion done >>>>>> by dovecot >>>>> You need to specify the argument list as a list seperated by >>>>> semicolons, per example on the wiki: >>>>> >>>>> antispam_pipe_program_args = --username;%u >>>> Not sure about that, because sa-learn expects the parameter >>>> --username=user at na.me, this is one parameter, not two, and it >>>> works for me locally, where I also set up dovecot to test. The >>>> main differences are that the versions I have here are newer, I'm >>>> running Debian sid, the server is on Ubuntu Precise, and second, >>>> the server is handling virtual users, locally I have only real Unix >>>> users. >>>> >>>> Also, dovecot doesn't complain about configuration errors regard >>>> --username=%u. What other way would be there to get the parameter >>>> passed to sa-learn the way I want? >>>> >>>> btw, I tried this, just to be sure, but the result was the same. >>>> >>>>> The verbose debug should give you some logging to work with. >>>> Yes, and I pasted the output. I can of course repeat: >>>> >>>> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(Junk): 0 Apr >>>> 12 22:53:02 vm10 imap: antispam: >>>> mailbox_is_trash(INBhttp://wiki2.dovecot.org/Pigeonhole/Sieve/TroubleshootingOX): >>>> 0 Apr 12 >>>> 22:53:02 vm10 imap: antispam: mailbox_is_trash(Junk): 0 Apr 12 >>>> 22:53:02 vm10 imap: antispam: mail copy: from trash: 0, to trash: >>>> 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(INBOX): 0 >>>> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(Junk): 1 Apr >>>> 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(INBOX): 0 Apr 12 >>>> 22:53:02 vm10 imap: antispam: mail copy: src spam: 0, dst spam: 1, >>>> src unsure: 0 Apr 12 22:53:02 vm10 imap: antispam: running >>>> mailtrain backend program /usr/bin/sa-learn Apr 12 22:53:02 vm10 >>>> imap: antispam: running mailtrain backend program >>>> /usr/bin/sa-learn Apr 12 22:53:02 vm10 imap: antispam: running >>>> mailtrain backend program parameter 1 --username=johannes at rohr.org >>>> Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend >>>> program parameter 2 --spam Apr 12 22:53:03 vm10 imap: antispam: run >>>> program failed with exit code -1 >>>> >>>> >>>> >>>> >>>>> Also, what does the wrapper script log when dovecot runs it? >>>> I have actually ditched the wrapper script because it works >>>> without locally, I have configured the plugin to call sa-learn >>>> directly. >>>> >>>>> How does that differ from a manual run? >>>> sa-learn works just fine with a manual run. It seems as if the >>>> plugin is passing the parameters wrongly, but the debugging output >>>> doesn't reveal the actual command, so it's just guesswork. >>>> >>>> Cheers, >>>> >>>> Johannes >>>> >>>>> >>>>>> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >>>>>> antispam_spam = SPAM;Junk antispam_backend = pipe >>>>>> antispam_verbose_debug = 1 antispam_debug_target = syslog >>>>>> antispam_pipe_tmpdir = /tmp } >>>>>> >>>>>> I have tried the following wrapper script: #!/bin/bash # set >>>>>> -x LOGFILE=/tmp/sa-learn-pipe.log echo "$$-start ($*)" >> >>>>>> $LOGFILE #echo $* > /tmp/sendmail-parms.txt cat<&0 >> >>>>>> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn $* -D >>>>>> /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ rm -f >>>>>> /tmp/sendmail-msg-$$.txt echo "$$-end" >> $LOGFILE exit 0 >>>>>> >>>>>> It somehow isn't working. I can call the wrapper script >>>>>> manually e.g. sudo -u vmail /usr/local/bin/sa-learn-pipe.sh >>>>>> --username=some at mail.user --ham \ < someham >>>>>> >>>>>> But it doesn't work from dovecot. It seems the script is >>>>>> called. but no new patterns show up in the bayes DB. >>>>>> Unfortunately, the plugin seems to be documented poorly. How >>>>>> does it call the programme it pipes to? Is it something like >>>>>> $programme --par1 --par2 < message ? Why can't / shouldn't I >>>>>> call sa-learn directly? All the instructions I found on the in >>>>>> internet contained a wrapper script, but none bothered to >>>>>> explain why you would actually need it. >>>>>> >>>>>> I would be very grateful, if someone could enlighten me on >>>>>> that... >>>>>> >>>>>> Cheers, >>>>>> >>>>>> Johannes From skdovecot at smail.inf.fh-brs.de Wed Apr 13 09:31:28 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 13 Apr 2016 11:31:28 +0200 (CEST) Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570E04EF.6010207@rohr.org> References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> <570DF294.4070501@whyscream.net> <570DF90A.1060505@rohr.org> <570E04EF.6010207@rohr.org> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Wed, 13 Apr 2016, Johannes Rohr wrote: > tweaked the wrapper script to make it work. It seems like the sa-learn call See the page again. > silently fails: > > "/usr/local/bin/sa-learn-pipe.sh" 10L, 350C geschrieben > root at vm10:/etc/dovecot/conf.d# cat /tmp/sa-learn-pipe.log > starting log > 25200-start (--username=johannes at rohr.org --spam) > libgcc_s.so.1 must be installed for pthread_cancel to work > 25200-end > > Does the above error message have anything to do with it? Running the script > & sa-learn manually works fine. do virtual users change something how dovecot > calls programs, such as chrooting them? Maybe, the script uses different search paths? Uncomment "# env" to verify. > > Cheers, > > Johannes > > > Am 13.04.2016 um 09:45 schrieb Johannes Rohr: >> Am 13.04.2016 um 09:17 schrieb Tom Hendrikx: >>> On 13-04-16 08:27, Johannes Rohr wrote: >>>> Hi List, >>>> >>>> does the antispam plugin any way of actually seeing how it is >>>> calling the pipe program and how it is failing? I can't reproduce the >>>> failure when I call sa-learn manually. Can someone tell me, with >>>> which UID the call happens, is it the UID the current dovecot process >>>> is running under (which would be vmail, as it is a virtual user >>>> setup) Cheers, >>>> >>> Hi Johannes, >>> http://wiki2.dovecot.org/Pigeonhole/Sieve/Troubleshooting >>> This is exactly what the wrapper script is supposed to log for you, or >>> which is trivially to add to its output. The wrapper script is not >>> actually useful for production, but it is for debugging. That is why I >>> asked for its logging, and any differences between manual run and a >>> dovecot run. >> >> When I used the wrapper script recommended at >> http://wiki2.dovecot.org/Plugins/Antispam, it merely reported the PID and >> parameters (--username=some at na.me --ham). The wrapper script noted in the >> dovecot wiki seems broken. Note the commented out line: >> >> #echo $* > /tmp/sendmail-parms.txt cat<&0 >> /tmp/sendmail-msg-$$.txt >> >> It seems like the second half of the line "cat<&0 >> >> /tmp/sendmail-msg-$$.txt" was originally a separate line, catting the >> message, which has been passed by the plugin via STDOUT to a file. Without >> that command, the call of sa-learn in the next line has no file to read >> from: >> >> /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt && rm -f >> /tmp/sendmail-msg-$$.txt & >> >> So I moved the cat command to a separate uncommented line and to be sure I >> also commented out the >> >> rm -f /tmp/sendmail-msg-$$.txt & >> >> to verify that the file actually contains something, (why is there an "&" >> terminating the line, which would have the rm command executed in the >> background?) >> >> But it seems the >> >> /tmp/sendmail-msg-$$.txt & >> >> was empty and the whole operation continued to fail. Could it be that the >> plugin fails to pass the actual message? >> >> Cheers, >> >> Johannes >> >>> >>> Regards, >>> Tom >>> >>> >>>> Johannes >>>> >>>> Am 12.04.2016 um 23:09 schrieb Johannes Rohr: >>>>> Hi Tom, >>>>> >>>>> Am 12.04.2016 um 22:26 schrieb Tom Hendrikx: >>>>>> On 12-04-16 20:14, Johannes Rohr wrote: >>>>>>> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise >>>>>>> with the antispam plugin in version 2.0+20120225-2 and >>>>>>> spamassassin at version 3.2.2 >>>>>>> >>>>>>> I have been trying and failed to get the pipe backend of the >>>>>>> antispam plugin to work. Spamassin by itself works, a manual >>>>>>> call of sa-learn works fine. Bayes data is stored in a mysql >>>>>>> DB. >>>>>>> >>>>>>> I have the following configuration in >>>>>>> /etc/dovecot/conf.d/90-plugin.conf >>>>>>> >>>>>>> plugin { #setting_name = value sieve=~/.dovecot.sieve >>>>>>> sieve_dir=~/sieve antispam_pipe_program_spam_arg = --spam >>>>>>> antispam_pipe_program_notspam_arg = --ham >>>>>>> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >>>>>>> antispam_pipe_program_args = --username=%u # % expansion done >>>>>>> by dovecot >>>>>> You need to specify the argument list as a list seperated by >>>>>> semicolons, per example on the wiki: >>>>>> >>>>>> antispam_pipe_program_args = --username;%u >>>>> Not sure about that, because sa-learn expects the parameter >>>>> --username=user at na.me, this is one parameter, not two, and it >>>>> works for me locally, where I also set up dovecot to test. The >>>>> main differences are that the versions I have here are newer, I'm >>>>> running Debian sid, the server is on Ubuntu Precise, and second, >>>>> the server is handling virtual users, locally I have only real Unix >>>>> users. >>>>> >>>>> Also, dovecot doesn't complain about configuration errors regard >>>>> --username=%u. What other way would be there to get the parameter >>>>> passed to sa-learn the way I want? >>>>> >>>>> btw, I tried this, just to be sure, but the result was the same. >>>>> >>>>>> The verbose debug should give you some logging to work with. >>>>> Yes, and I pasted the output. I can of course repeat: >>>>> >>>>> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(Junk): 0 Apr >>>>> 12 22:53:02 vm10 imap: antispam: >>>>> mailbox_is_trash(INBhttp://wiki2.dovecot.org/Pigeonhole/Sieve/TroubleshootingOX): >>>>> 0 Apr 12 >>>>> 22:53:02 vm10 imap: antispam: mailbox_is_trash(Junk): 0 Apr 12 >>>>> 22:53:02 vm10 imap: antispam: mail copy: from trash: 0, to trash: >>>>> 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(INBOX): 0 >>>>> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(Junk): 1 Apr >>>>> 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(INBOX): 0 Apr 12 >>>>> 22:53:02 vm10 imap: antispam: mail copy: src spam: 0, dst spam: 1, >>>>> src unsure: 0 Apr 12 22:53:02 vm10 imap: antispam: running >>>>> mailtrain backend program /usr/bin/sa-learn Apr 12 22:53:02 vm10 >>>>> imap: antispam: running mailtrain backend program >>>>> /usr/bin/sa-learn Apr 12 22:53:02 vm10 imap: antispam: running >>>>> mailtrain backend program parameter 1 --username=johannes at rohr.org >>>>> Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend >>>>> program parameter 2 --spam Apr 12 22:53:03 vm10 imap: antispam: run >>>>> program failed with exit code -1 >>>>> >>>>> >>>>> >>>>> >>>>>> Also, what does the wrapper script log when dovecot runs it? >>>>> I have actually ditched the wrapper script because it works >>>>> without locally, I have configured the plugin to call sa-learn >>>>> directly. >>>>> >>>>>> How does that differ from a manual run? >>>>> sa-learn works just fine with a manual run. It seems as if the >>>>> plugin is passing the parameters wrongly, but the debugging output >>>>> doesn't reveal the actual command, so it's just guesswork. >>>>> >>>>> Cheers, >>>>> >>>>> Johannes >>>>> >>>>>> >>>>>>> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >>>>>>> antispam_spam = SPAM;Junk antispam_backend = pipe >>>>>>> antispam_verbose_debug = 1 antispam_debug_target = syslog >>>>>>> antispam_pipe_tmpdir = /tmp } >>>>>>> >>>>>>> I have tried the following wrapper script: #!/bin/bash # set >>>>>>> -x LOGFILE=/tmp/sa-learn-pipe.log echo "$$-start ($*)" >> >>>>>>> $LOGFILE #echo $* > /tmp/sendmail-parms.txt cat<&0 >> >>>>>>> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn $* -D >>>>>>> /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ rm -f >>>>>>> /tmp/sendmail-msg-$$.txt echo "$$-end" >> $LOGFILE exit 0 >>>>>>> >>>>>>> It somehow isn't working. I can call the wrapper script >>>>>>> manually e.g. sudo -u vmail /usr/local/bin/sa-learn-pipe.sh >>>>>>> --username=some at mail.user --ham \ < someham >>>>>>> >>>>>>> But it doesn't work from dovecot. It seems the script is >>>>>>> called. but no new patterns show up in the bayes DB. >>>>>>> Unfortunately, the plugin seems to be documented poorly. How >>>>>>> does it call the programme it pipes to? Is it something like >>>>>>> $programme --par1 --par2 < message ? Why can't / shouldn't I >>>>>>> call sa-learn directly? All the instructions I found on the in >>>>>>> internet contained a wrapper script, but none bothered to >>>>>>> explain why you would actually need it. >>>>>>> >>>>>>> I would be very grateful, if someone could enlighten me on >>>>>>> that... >>>>>>> >>>>>>> Cheers, >>>>>>> >>>>>>> Johannes > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVw4R8Hz1H7kL/d9rAQKs7gf9F0QTDOugkaoIFCbzPlFohhhXGOKt6awv AWVCqJdZgwmnYqH2WTn+xyueIG+HDZUrHLQB7CirjOIB2J8YWyprcsaBkcnZwxBW kzklgjp9zK9ttHD7HHhkw7o4LwVjkOGtXJR49vz9bWL0P0N05dtdpI+HZuLS/Inx qz+F7FLd7th2SFrFSRSKTlaVRyv/Ta6fh50tra+DQe5f4NblUwHe7dOUmXKYxs+U Ievm4eKTxQA0GuQwyQSgKVqIKWZdAmA1bbmhbREK+7AEROCDt8XBYK1EJsRsG7LH fGh6+kLi5QHihbumJtv14ba6P137UjnCwQ+6y8X38tDY50hOnVXASw== =bmyk -----END PGP SIGNATURE----- From elm at skweez.net Wed Apr 13 09:54:56 2016 From: elm at skweez.net (Florian Mutter) Date: Wed, 13 Apr 2016 11:54:56 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570E04EF.6010207@rohr.org> References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> <570DF294.4070501@whyscream.net> <570DF90A.1060505@rohr.org> <570E04EF.6010207@rohr.org> Message-ID: Am 13.04.2016 um 10:35 schrieb Johannes Rohr : > > tweaked the wrapper script to make it work. It seems like the sa-learn call silently fails: > > "/usr/local/bin/sa-learn-pipe.sh" 10L, 350C geschrieben > root at vm10:/etc/dovecot/conf.d# cat /tmp/sa-learn-pipe.log > starting log > 25200-start (--username=johannes at rohr.org --spam) > libgcc_s.so.1 must be installed for pthread_cancel to work > 25200-end > > Does the above error message have anything to do with it? Running the script & sa-learn manually works fine. do virtual users change something how dovecot calls programs, such as chrooting them? Here [1] is an old thread about that problem.In short: It seems to be a problem in sa-learn that is triggered by the privilege drop that dovecot does when starting. I have the same problem and I have not found a solution yet. [1] http://www.dovecot.org/list/dovecot/2013-November/093378.html > > Cheers, > > Johannes From johannes at rohr.org Wed Apr 13 09:55:33 2016 From: johannes at rohr.org (Johannes Rohr) Date: Wed, 13 Apr 2016 11:55:33 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> <570DF294.4070501@whyscream.net> <570DF90A.1060505@rohr.org> <570E04EF.6010207@rohr.org> Message-ID: <570E1795.5040703@rohr.org> Am 13.04.2016 um 11:31 schrieb Steffen Kaiser: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Wed, 13 Apr 2016, Johannes Rohr wrote: > >> tweaked the wrapper script to make it work. It seems like the >> sa-learn call > > See the page again. Can you kindly be more precise? The wrapper script at the page is broken, it cannot work, as it fails to write the message passed from the plugin to /tmp/sendmail-msg-$$.txt. So the input passed to sa-learn is missing, which I fixed by inserting "cat > /tmp/sendmail-msg-$$.txt" at the beginning of the script. However, this is not the actual issue, as sa-learn even fails even when the script is fixed. > >> silently fails: >> >> "/usr/local/bin/sa-learn-pipe.sh" 10L, 350C geschrieben >> root at vm10:/etc/dovecot/conf.d# cat /tmp/sa-learn-pipe.log >> starting log >> 25200-start (--username=johannes at rohr.org --spam) >> libgcc_s.so.1 must be installed for pthread_cancel to work >> 25200-end >> >> Does the above error message have anything to do with it? Running the >> script & sa-learn manually works fine. do virtual users change >> something how dovecot calls programs, such as chrooting them? > > Maybe, the script uses different search paths? Uncomment "# env" to > verify. I'll try later, although I doubt that environment variables are to blame. (For now we have a cronjob which is scanning the Junk directories periodically as a workaround.) I have to change back a whole bunch of config files to enable the plugin again. It seems to be a bug which hits daemons that run as a limited user, see https://bugs.launchpad.net/ubuntu/+source/gcc-3.3/+bug/40285/comments/30 I am a bit worried because the same error is reported from newer Ubuntu versions, so unless the spamassassin guys have fixed it their way, it might not go away by upgrading Cheers, Johannes > >> >> Cheers, >> >> Johannes >> >> >> Am 13.04.2016 um 09:45 schrieb Johannes Rohr: >>> Am 13.04.2016 um 09:17 schrieb Tom Hendrikx: >>>> On 13-04-16 08:27, Johannes Rohr wrote: >>>>> Hi List, >>>>> >>>>> does the antispam plugin any way of actually seeing how it is >>>>> calling the pipe program and how it is failing? I can't reproduce the >>>>> failure when I call sa-learn manually. Can someone tell me, with >>>>> which UID the call happens, is it the UID the current dovecot process >>>>> is running under (which would be vmail, as it is a virtual user >>>>> setup) Cheers, >>>>> >>>> Hi Johannes, >>>> http://wiki2.dovecot.org/Pigeonhole/Sieve/Troubleshooting >>>> This is exactly what the wrapper script is supposed to log for you, or >>>> which is trivially to add to its output. The wrapper script is not >>>> actually useful for production, but it is for debugging. That is why I >>>> asked for its logging, and any differences between manual run and a >>>> dovecot run. >>> >>> When I used the wrapper script recommended at >>> http://wiki2.dovecot.org/Plugins/Antispam, it merely reported the >>> PID and parameters (--username=some at na.me --ham). The wrapper script >>> noted in the dovecot wiki seems broken. Note the commented out line: >>> >>> #echo $* > /tmp/sendmail-parms.txt cat<&0 >> /tmp/sendmail-msg-$$.txt >>> >>> It seems like the second half of the line "cat<&0 >> >>> /tmp/sendmail-msg-$$.txt" was originally a separate line, catting >>> the message, which has been passed by the plugin via STDOUT to a >>> file. Without that command, the call of sa-learn in the next line >>> has no file to read from: >>> >>> /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt && rm -f >>> /tmp/sendmail-msg-$$.txt & >>> >>> So I moved the cat command to a separate uncommented line and to be >>> sure I also commented out the >>> >>> rm -f /tmp/sendmail-msg-$$.txt & >>> >>> to verify that the file actually contains something, (why is there >>> an "&" terminating the line, which would have the rm command >>> executed in the background?) >>> >>> But it seems the >>> >>> /tmp/sendmail-msg-$$.txt & >>> >>> was empty and the whole operation continued to fail. Could it be >>> that the plugin fails to pass the actual message? >>> >>> Cheers, >>> >>> Johannes >>> >>>> >>>> Regards, >>>> Tom >>>> >>>> >>>>> Johannes >>>>> >>>>> Am 12.04.2016 um 23:09 schrieb Johannes Rohr: >>>>>> Hi Tom, >>>>>> >>>>>> Am 12.04.2016 um 22:26 schrieb Tom Hendrikx: >>>>>>> On 12-04-16 20:14, Johannes Rohr wrote: >>>>>>>> Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise >>>>>>>> with the antispam plugin in version 2.0+20120225-2 and >>>>>>>> spamassassin at version 3.2.2 >>>>>>>> >>>>>>>> I have been trying and failed to get the pipe backend of the >>>>>>>> antispam plugin to work. Spamassin by itself works, a manual >>>>>>>> call of sa-learn works fine. Bayes data is stored in a mysql >>>>>>>> DB. >>>>>>>> >>>>>>>> I have the following configuration in >>>>>>>> /etc/dovecot/conf.d/90-plugin.conf >>>>>>>> >>>>>>>> plugin { #setting_name = value sieve=~/.dovecot.sieve >>>>>>>> sieve_dir=~/sieve antispam_pipe_program_spam_arg = --spam >>>>>>>> antispam_pipe_program_notspam_arg = --ham >>>>>>>> antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh >>>>>>>> antispam_pipe_program_args = --username=%u # % expansion done >>>>>>>> by dovecot >>>>>>> You need to specify the argument list as a list seperated by >>>>>>> semicolons, per example on the wiki: >>>>>>> >>>>>>> antispam_pipe_program_args = --username;%u >>>>>> Not sure about that, because sa-learn expects the parameter >>>>>> --username=user at na.me, this is one parameter, not two, and it >>>>>> works for me locally, where I also set up dovecot to test. The >>>>>> main differences are that the versions I have here are newer, I'm >>>>>> running Debian sid, the server is on Ubuntu Precise, and second, >>>>>> the server is handling virtual users, locally I have only real Unix >>>>>> users. >>>>>> >>>>>> Also, dovecot doesn't complain about configuration errors regard >>>>>> --username=%u. What other way would be there to get the parameter >>>>>> passed to sa-learn the way I want? >>>>>> >>>>>> btw, I tried this, just to be sure, but the result was the same. >>>>>> >>>>>>> The verbose debug should give you some logging to work with. >>>>>> Yes, and I pasted the output. I can of course repeat: >>>>>> >>>>>> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(Junk): 0 Apr >>>>>> 12 22:53:02 vm10 imap: antispam: >>>>>> mailbox_is_trash(INBhttp://wiki2.dovecot.org/Pigeonhole/Sieve/TroubleshootingOX): >>>>>> 0 Apr 12 >>>>>> 22:53:02 vm10 imap: antispam: mailbox_is_trash(Junk): 0 Apr 12 >>>>>> 22:53:02 vm10 imap: antispam: mail copy: from trash: 0, to trash: >>>>>> 0 Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(INBOX): 0 >>>>>> Apr 12 22:53:02 vm10 imap: antispam: mailbox_is_spam(Junk): 1 Apr >>>>>> 12 22:53:02 vm10 imap: antispam: mailbox_is_unsure(INBOX): 0 Apr 12 >>>>>> 22:53:02 vm10 imap: antispam: mail copy: src spam: 0, dst spam: 1, >>>>>> src unsure: 0 Apr 12 22:53:02 vm10 imap: antispam: running >>>>>> mailtrain backend program /usr/bin/sa-learn Apr 12 22:53:02 vm10 >>>>>> imap: antispam: running mailtrain backend program >>>>>> /usr/bin/sa-learn Apr 12 22:53:02 vm10 imap: antispam: running >>>>>> mailtrain backend program parameter 1 --username=johannes at rohr.org >>>>>> Apr 12 22:53:02 vm10 imap: antispam: running mailtrain backend >>>>>> program parameter 2 --spam Apr 12 22:53:03 vm10 imap: antispam: run >>>>>> program failed with exit code -1 >>>>>> >>>>>> >>>>>> >>>>>> >>>>>>> Also, what does the wrapper script log when dovecot runs it? >>>>>> I have actually ditched the wrapper script because it works >>>>>> without locally, I have configured the plugin to call sa-learn >>>>>> directly. >>>>>> >>>>>>> How does that differ from a manual run? >>>>>> sa-learn works just fine with a manual run. It seems as if the >>>>>> plugin is passing the parameters wrongly, but the debugging output >>>>>> doesn't reveal the actual command, so it's just guesswork. >>>>>> >>>>>> Cheers, >>>>>> >>>>>> Johannes >>>>>> >>>>>>> >>>>>>>> antispam_trash = trash;Trash;Deleted Items;Deleted Messages >>>>>>>> antispam_spam = SPAM;Junk antispam_backend = pipe >>>>>>>> antispam_verbose_debug = 1 antispam_debug_target = syslog >>>>>>>> antispam_pipe_tmpdir = /tmp } >>>>>>>> >>>>>>>> I have tried the following wrapper script: #!/bin/bash # set >>>>>>>> -x LOGFILE=/tmp/sa-learn-pipe.log echo "$$-start ($*)" >> >>>>>>>> $LOGFILE #echo $* > /tmp/sendmail-parms.txt cat<&0 >> >>>>>>>> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn $* -D >>>>>>>> /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ rm -f >>>>>>>> /tmp/sendmail-msg-$$.txt echo "$$-end" >> $LOGFILE exit 0 >>>>>>>> >>>>>>>> It somehow isn't working. I can call the wrapper script >>>>>>>> manually e.g. sudo -u vmail /usr/local/bin/sa-learn-pipe.sh >>>>>>>> --username=some at mail.user --ham \ < someham >>>>>>>> >>>>>>>> But it doesn't work from dovecot. It seems the script is >>>>>>>> called. but no new patterns show up in the bayes DB. >>>>>>>> Unfortunately, the plugin seems to be documented poorly. How >>>>>>>> does it call the programme it pipes to? Is it something like >>>>>>>> $programme --par1 --par2 < message ? Why can't / shouldn't I >>>>>>>> call sa-learn directly? All the instructions I found on the in >>>>>>>> internet contained a wrapper script, but none bothered to >>>>>>>> explain why you would actually need it. >>>>>>>> >>>>>>>> I would be very grateful, if someone could enlighten me on >>>>>>>> that... >>>>>>>> >>>>>>>> Cheers, >>>>>>>> >>>>>>>> Johannes >> > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVw4R8Hz1H7kL/d9rAQKs7gf9F0QTDOugkaoIFCbzPlFohhhXGOKt6awv > AWVCqJdZgwmnYqH2WTn+xyueIG+HDZUrHLQB7CirjOIB2J8YWyprcsaBkcnZwxBW > kzklgjp9zK9ttHD7HHhkw7o4LwVjkOGtXJR49vz9bWL0P0N05dtdpI+HZuLS/Inx > qz+F7FLd7th2SFrFSRSKTlaVRyv/Ta6fh50tra+DQe5f4NblUwHe7dOUmXKYxs+U > Ievm4eKTxQA0GuQwyQSgKVqIKWZdAmA1bbmhbREK+7AEROCDt8XBYK1EJsRsG7LH > fGh6+kLi5QHihbumJtv14ba6P137UjnCwQ+6y8X38tDY50hOnVXASw== > =bmyk > -----END PGP SIGNATURE----- From johannes at rohr.org Wed Apr 13 10:14:04 2016 From: johannes at rohr.org (Johannes Rohr) Date: Wed, 13 Apr 2016 12:14:04 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> <570DF294.4070501@whyscream.net> <570DF90A.1060505@rohr.org> <570E04EF.6010207@rohr.org> Message-ID: <570E1BEC.7020001@rohr.org> Am 13.04.2016 um 11:54 schrieb Florian Mutter: > Am 13.04.2016 um 10:35 schrieb Johannes Rohr : >> tweaked the wrapper script to make it work. It seems like the sa-learn call silently fails: >> >> "/usr/local/bin/sa-learn-pipe.sh" 10L, 350C geschrieben >> root at vm10:/etc/dovecot/conf.d# cat /tmp/sa-learn-pipe.log >> starting log >> 25200-start (--username=johannes at rohr.org --spam) >> libgcc_s.so.1 must be installed for pthread_cancel to work >> 25200-end >> >> Does the above error message have anything to do with it? Running the script & sa-learn manually works fine. do virtual users change something how dovecot calls programs, such as chrooting them? > Here [1] is an old thread about that problem.In short: It seems to be a problem in sa-learn that is triggered by the privilege drop that dovecot does when starting. > > I have the same problem and I have not found a solution yet. Yikes! Our server is running a fairly dated Ubuntu Precise, what's your version? Did an upgrade fail to fix it? I am not seeing this error on Debian Sid but I am not using virtual users over here, so that might be the cause. Did you report the bug to the Spamassassin bugzilla? Cheers, Johannes > > [1] http://www.dovecot.org/list/dovecot/2013-November/093378.html > >> Cheers, >> >> Johannes From johannes at rohr.org Wed Apr 13 10:28:23 2016 From: johannes at rohr.org (Johannes Rohr) Date: Wed, 13 Apr 2016 12:28:23 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> <570DF294.4070501@whyscream.net> <570DF90A.1060505@rohr.org> <570E04EF.6010207@rohr.org> Message-ID: <570E1F47.1000101@rohr.org> Am 13.04.2016 um 11:54 schrieb Florian Mutter: > Am 13.04.2016 um 10:35 schrieb Johannes Rohr : >> tweaked the wrapper script to make it work. It seems like the sa-learn call silently fails: >> >> "/usr/local/bin/sa-learn-pipe.sh" 10L, 350C geschrieben >> root at vm10:/etc/dovecot/conf.d# cat /tmp/sa-learn-pipe.log >> starting log >> 25200-start (--username=johannes at rohr.org --spam) >> libgcc_s.so.1 must be installed for pthread_cancel to work >> 25200-end >> >> Does the above error message have anything to do with it? Running the script & sa-learn manually works fine. do virtual users change something how dovecot calls programs, such as chrooting them? > Here [1] is an old thread about that problem.In short: It seems to be a problem in sa-learn that is triggered by the privilege drop that dovecot does when starting. > > I have the same problem and I have not found a solution yet. I have just filed a bug with spamassassin, https://bz.apache.org/SpamAssassin/show_bug.cgi?id=7309 I am not sure that they will act upon it, as it is an old version, and SA isn't the ultimate cause anyway. Cheers, Johannes > > [1] http://www.dovecot.org/list/dovecot/2013-November/093378.html > >> Cheers, >> >> Johannes From oliver at riesen.org Wed Apr 13 07:40:19 2016 From: oliver at riesen.org (Oliver Riesen-Mallmann) Date: Wed, 13 Apr 2016 09:40:19 +0200 Subject: Warning: Global setting won't change the setting inside an earlier filter Message-ID: <570DF7E3.7040900@riesen.org> Hi, I'm using the Dovecot Prebuilt Binary: deb http://xi.rename-it.nl/debian/ stable-auto/dovecot-2.2 main I configured multiple SSL certificates with client TLS SNI (see http://wiki2.dovecot.org/SSL/DovecotConfiguration). Since my last update I get some warnings: doveconf: Warning: /etc/dovecot/conf.d/10-ssl.conf line 12: Global setting ssl_cert won't change the setting inside an earlier filter at /etc/dovecot/conf.d/10-ssl-langzeittest.de.conf line 4 doveconf: Warning: /etc/dovecot/conf.d/10-ssl.conf line 13: Global setting ssl_key won't change the setting inside an earlier filter at /etc/dovecot/conf.d/10-ssl-langzeittest.de.conf line 5 doveconf: Warning: /etc/dovecot/conf.d/10-ssl.conf line 12: Global setting ssl_cert won't change the setting inside an earlier filter at /etc/dovecot/conf.d/10-ssl-langzeittest.de.conf line 4 doveconf: Warning: /etc/dovecot/conf.d/10-ssl.conf line 13: Global setting ssl_key won't change the setting inside an earlier filter at /etc/dovecot/conf.d/10-ssl-langzeittest.de.conf line 5 The reason is this commit: doveconf: Log a warning if a global setting is updated after it was a? ?lready set inside a filter https://github.com/dovecot/core/commit/87404eae4581d7ef834f490507503e59a500066e My configuration is (shorted): # dovecot -n # 2.2.devel (87404ea): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (215349a) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.10 [...] ssl_cert = References: <570DF7E3.7040900@riesen.org> Message-ID: <2291D10C-CD78-45F4-99B3-F6796337652D@iki.fi> On 13 Apr 2016, at 10:40, Oliver Riesen-Mallmann wrote: > > Hi, > > I'm using the Dovecot Prebuilt Binary: > deb http://xi.rename-it.nl/debian/ stable-auto/dovecot-2.2 main > > I configured multiple SSL certificates with client TLS SNI (see > http://wiki2.dovecot.org/SSL/DovecotConfiguration). > > Since my last update I get some warnings: > > doveconf: Warning: /etc/dovecot/conf.d/10-ssl.conf line 12: Global > setting ssl_cert won't change the setting inside an earlier filter at > /etc/dovecot/conf.d/10-ssl-langzeittest.de.conf line 4 > doveconf: Warning: /etc/dovecot/conf.d/10-ssl.conf line 13: Global > setting ssl_key won't change the setting inside an earlier filter at > /etc/dovecot/conf.d/10-ssl-langzeittest.de.conf line 5 > doveconf: Warning: /etc/dovecot/conf.d/10-ssl.conf line 12: Global > setting ssl_cert won't change the setting inside an earlier filter at > /etc/dovecot/conf.d/10-ssl-langzeittest.de.conf line 4 > doveconf: Warning: /etc/dovecot/conf.d/10-ssl.conf line 13: Global > setting ssl_key won't change the setting inside an earlier filter at > /etc/dovecot/conf.d/10-ssl-langzeittest.de.conf line 5 > > The reason is this commit: > doveconf: Log a warning if a global setting is updated after it was a? > ?lready set inside a filter > https://github.com/dovecot/core/commit/87404eae4581d7ef834f490507503e59a500066e > > My configuration is (shorted): > > # dovecot -n > # 2.2.devel (87404ea): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.devel (215349a) > # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.10 > [...] > ssl_cert = [...] > ssl_key = [...] > local_name imap.langzeittest.de { > ssl_cert = > ssl_key = } > local_name mail.langzeittest.de { > ssl_cert = > ssl_key = } > > I understand, that the warning is correct. I configured ssl_cert and > ssl_key both, globally (like a default) and in some local_name filters. You should be able to solve this by moving the ssl_cert & ssl_key before the local_name {}. Note that doveconf -n reorders the settings here. So right now doveconf reads: local_name { ssl_cert = .. } ssl_cert = .. # it gives a warning here If it's instead: ssl_cert = .. local_name { ssl_cert = .. } There is no warning. From tss at iki.fi Wed Apr 13 10:57:23 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 13 Apr 2016 13:57:23 +0300 Subject: v2.3 development tree forked in git Message-ID: <7A0863B4-2C1E-4941-B2F7-77D5B7DD60A2@iki.fi> The git master branch starts tracking Dovecot v2.3 development from now on. There are soon going to be several API changes there that might break plugins. If you wish to keep tracking latest v2.2.x development instead, switch to master-2.2 branch. The nightly releases at http://dovecot.org/nightly/ will also track v2.3 tree. From elm at skweez.net Wed Apr 13 11:05:22 2016 From: elm at skweez.net (Florian Mutter) Date: Wed, 13 Apr 2016 13:05:22 +0200 Subject: antispam plugin, pipe backend, how to make it work? In-Reply-To: <570E1BEC.7020001@rohr.org> References: <570D3B06.5070305@rohr.org> <570D59E4.3080705@whyscream.net> <570D6418.4020804@rohr.org> <570DE6D1.5080904@rohr.org> <570DF294.4070501@whyscream.net> <570DF90A.1060505@rohr.org> <570E04EF.6010207@rohr.org> <570E1BEC.7020001@rohr.org> Message-ID: <09CE773B-307C-4B2D-833F-9E45471E88DC@skweez.net> > Am 13.04.2016 um 12:14 schrieb Johannes Rohr : > > Yikes! Our server is running a fairly dated Ubuntu Precise, what's your version? Did an upgrade fail to fix it? I am not seeing this error on Debian Sid but I am not using virtual users over here, so that might be the cause. Did you report the bug to the Spamassassin bugzilla? I?m running Debian 8 (Jessie). Dovecot is version 2.2.13, Dovecot Antispam is 2.0+20130912-2 and SpamAssassin is 3.4.0. I did not fill a bug but I see you already did it. From oliver at riesen.org Wed Apr 13 11:11:41 2016 From: oliver at riesen.org (Oliver Riesen-Mallmann) Date: Wed, 13 Apr 2016 13:11:41 +0200 Subject: Warning: Global setting won't change the setting inside an earlier filter In-Reply-To: <2291D10C-CD78-45F4-99B3-F6796337652D@iki.fi> References: <570DF7E3.7040900@riesen.org> <2291D10C-CD78-45F4-99B3-F6796337652D@iki.fi> Message-ID: <570E296D.3030506@riesen.org> Hi Timo, > You should be able to solve this by moving the ssl_cert & ssl_key > before the local_name {}. Thanks for the hint. I moved all my separate local_name config files from 10-ssl-* to 11-ssl-* The warnings are gone. Regards Oliver From dovecot-ml at makomi.de Wed Apr 13 13:23:47 2016 From: dovecot-ml at makomi.de (M. Koehler) Date: Wed, 13 Apr 2016 15:23:47 +0200 Subject: dlopen() failed: /usr/lib/dovecot/modules/dict/libdict_ldap.so: undefined symbol: ldap_search_star Message-ID: <570E4863.4040901@makomi.de> Hi, I?m using dovecot on debian jessie from the xi-rename-it repo (deb http://xi.rename-it.nl/debian/ stable-auto/dovecot-2.2 main). After upgrading to 2.2.23 I?ve got the following error for example if I delete a message: *Apr 13 15:14:10 mail dovecot: dict(18884): Error: Couldn't load plugin /usr/lib/dovecot/modules/dict/libdict_ldap.so: dlopen() failed: /usr/lib/dovecot/modules/dict/libdict_ldap.so: undefined symbol: ldap_search_start * But I can?t find any ldap settings in my config (doveconf -a). Are any changes that I overlook? Thanks, Michael From stephan at rename-it.nl Wed Apr 13 14:19:05 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 13 Apr 2016 16:19:05 +0200 Subject: v2.3 development tree forked in git In-Reply-To: <7A0863B4-2C1E-4941-B2F7-77D5B7DD60A2@iki.fi> References: <7A0863B4-2C1E-4941-B2F7-77D5B7DD60A2@iki.fi> Message-ID: <570E5559.3090306@rename-it.nl> Op 13-4-2016 om 12:57 schreef Timo Sirainen: > The git master branch starts tracking Dovecot v2.3 development from now on. There are soon going to be several API changes there that might break plugins. If you wish to keep tracking latest v2.2.x development instead, switch to master-2.2 branch. > > The nightly releases at http://dovecot.org/nightly/ will also track v2.3 tree. Current Xi repositories now track master-2.2, since these are dovecot-2.2 repositories. Will start a v2.3 builder later today. Regards, Stephan. From tss at iki.fi Wed Apr 13 14:42:05 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 13 Apr 2016 17:42:05 +0300 Subject: dlopen() failed: /usr/lib/dovecot/modules/dict/libdict_ldap.so: undefined symbol: ldap_search_star In-Reply-To: <570E4863.4040901@makomi.de> References: <570E4863.4040901@makomi.de> Message-ID: <74AB9BF5-4CEE-483A-A264-E3C54DFF8B7F@iki.fi> On 13 Apr 2016, at 16:23, M. Koehler wrote: > > Hi, > > I?m using dovecot on debian jessie from the xi-rename-it repo (deb http://xi.rename-it.nl/debian/ stable-auto/dovecot-2.2 main). After upgrading to 2.2.23 I?ve got the following error for example if I delete a message: > > *Apr 13 15:14:10 mail dovecot: dict(18884): Error: Couldn't load plugin /usr/lib/dovecot/modules/dict/libdict_ldap.so: dlopen() failed: /usr/lib/dovecot/modules/dict/libdict_ldap.so: undefined symbol: ldap_search_start > * > But I can?t find any ldap settings in my config (doveconf -a). Are any changes that I overlook? Thanks, should be fixed in the following builds: https://github.com/dovecot/core/commit/c6f4485a09e4b4ff480a30328679f6b47b39da67 https://github.com/dovecot/core/commit/b025075e4874f6e9ce98883a88554f02f02bdfc5 From dave.mehler at gmail.com Wed Apr 13 14:51:10 2016 From: dave.mehler at gmail.com (David Mehler) Date: Wed, 13 Apr 2016 10:51:10 -0400 Subject: Dovecot and Windows Live Mail 2012? Message-ID: Hello, I hope someone has this working, because I'm pulling my hair out at this one. I'm using well for this it's a win7 x64 machine running Windows Essentials 2012 and using the Windows Live mail component. I am trying to connect to my Dovecot server running 2.23 I believe. I keep getting the error "the imap command could not be sent to the server because of a non-network error" googling showed many with this, but no fix. In this account I'm trying to access port 143 which uses starttls. In Mail I've got the boxes for require a secure connection and authentication checked. I should note of course and with no surprise that Mail works oh just fine with the Hotmail account I've also got configured, it's only with the downloading of folders and sending of email to the dovecot server that mail has the issue. Please let me know if I can provide any additional information. Help appreciated. Thanks. Dave. From aki.tuomi at dovecot.fi Wed Apr 13 15:23:39 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Wed, 13 Apr 2016 18:23:39 +0300 (EEST) Subject: Dovecot and Windows Live Mail 2012? In-Reply-To: References: Message-ID: <1822283844.33509.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> > On April 13, 2016 at 5:51 PM David Mehler wrote: > > > Hello, > > I hope someone has this working, because I'm pulling my hair out at this one. > > I'm using well for this it's a win7 x64 machine running Windows > Essentials 2012 and using the Windows Live mail component. I am trying > to connect to my Dovecot server running 2.23 I believe. I keep getting > the error "the imap command could not be sent to the server because of > a non-network error" googling showed many with this, but no fix. > > In this account I'm trying to access port 143 which uses starttls. In > Mail I've got the boxes for require a secure connection and > authentication checked. > > I should note of course and with no surprise that Mail works oh just > fine with the Hotmail account I've also got configured, it's only with > the downloading of folders and sending of email to the dovecot server > that mail has the issue. > > Please let me know if I can provide any additional information. > > Help appreciated. > > Thanks. > Dave. Are you using public CA signed certificate? Are there any errors in dovecot logs? Aki From dion at dion.org.ua Wed Apr 13 17:11:08 2016 From: dion at dion.org.ua (Dmitry Nezhevenko) Date: Wed, 13 Apr 2016 20:11:08 +0300 Subject: fts-lucene with virtual folders In-Reply-To: <20160412094055.GA533@debpad.local> References: <20160412080508.GA30106@debpad.local> <20160412082605.GA20421@debpad.local> <20160412094055.GA533@debpad.local> Message-ID: <20160413171108.GA14532@debpad.local> On Tue, Apr 12, 2016 at 12:40:55PM +0300, Dmitry Nezhevenko wrote: > > This proof-of-concept patch fixes issue for me. I don't think that this is > right way to fix it. I've copied vname calculation code from > fts_index_have_compatible_settings. Maybe it's better to create > something like fts_index_write_settings_checksum() in fts-api. It looks like dovecot is pretty stable with this patch. I've successfully indexed ~7GB of mails and got ~4GB index. In any case, any comments/suggestions? Maybe there is other solution? -- WBR, Dmitry -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: not available URL: From chris2014 at postbox.xyz Wed Apr 13 17:14:53 2016 From: chris2014 at postbox.xyz (Chris) Date: Wed, 13 Apr 2016 19:14:53 +0200 Subject: Problem setting owner In-Reply-To: <20160412195013.54cce344@frodo.lucabert.intra> References: <20160412195013.54cce344@frodo.lucabert.intra> Message-ID: Luca Bertoncello wrote: > I already added: > > mail_uid = 1005 > mail_gid = 8 > > in 10-mail.conf and: > > user_attrs = \ > =user=exim, \ > =uid=1005, \ > =gid=8, \ > =quota_rule=*:bytes=%{ldap:quotaBytes}, \ > =home=/home/mailboxes/%{ldap:sAMAccountName}/Maildir, \ > =mail=maildir:/home/mailboxes/%{ldap:sAMAccountName}/Maildir > > in the dovecot-ldap.conf.ext, but it seems to ignore them... Have you tried override_fields? - Chris From chris2014 at postbox.xyz Wed Apr 13 17:33:09 2016 From: chris2014 at postbox.xyz (Chris) Date: Wed, 13 Apr 2016 19:33:09 +0200 Subject: speedup doveadm Message-ID: All, I've to set ACLs in public namespace for more than 5000 folders. That takes some hours. I'm calling doveadm by a perl script. Is there any way to speedup doveadm? Is it possible to set ACLs for multiple folders or users in a single call? - Chris From deano-dovecot at areyes.com Wed Apr 13 20:11:23 2016 From: deano-dovecot at areyes.com (deano-dovecot at areyes.com) Date: Wed, 13 Apr 2016 16:11:23 -0400 Subject: antispam plugin, pipe backend, how to make it =?UTF-8?Q?work=3F?= In-Reply-To: <570D3B06.5070305@rohr.org> References: <570D3B06.5070305@rohr.org> Message-ID: <224798b516506863765abd25cf6b60e8@areyes.com> Johannes - I'm running 2.2.9 under Ubuntu 14.04. I gave up on using the pipe backend, just could not get the damn thing to work. I would up using spool2dir and incron, which works perfectly. The issue was that sa-learn would cause a pthread_cancel error with libgcc_s.so.1 Below is an excerpt from my install script : ############################################ # Enable antispam - Damn, not working right with pipe backend # now using spool2dir and incron if [ -e /etc/spamassassin ]; then sed -i " s/^ #mail_plugins.*/ mail_plugins = \$mail_plugins antispam ${DOVENOTIFY}/ s/^ #mail_max_userip.*/mail_max_userip_connections = 20/ " /etc/dovecot/conf.d/20-imap.conf cat > /etc/dovecot/conf.d/99-Installerbox-antispam.conf << EOF ## ## antispam configuration ## plugin { antispam_debug_target = syslog # antispam_verbose_debug = 1 antispam_trash_pattern = Trash;Deleted * antispam_spam = Junk;Spam antispam_backend = spool2dir antispam_spool2dir_spam = /var/cache/dovecot-antispam/spam/%%020lu-%u-%%05luS antispam_spool2dir_notspam = /var/cache/dovecot-antispam/ham/%%020lu-%u-%%05luH # pipe backend not working with sa-learn - causes pthread_cancel error with libgcc_s.so.1 # antispam_backend = pipe # antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh # antispam_pipe_program_args = --for;%u # antispam_pipe_program_spam_arg = --spam # antispam_pipe_program_notspam_arg = --ham # antispam_pipe_tmpdir = /tmp } EOF # incron watches the spam/ham spool dirs, calls sa-learn-pipe.sh to handle echo "root" >> /etc/incron.allow mkdir -p /var/cache/dovecot-antispam/spam /var/cache/dovecot-antispam/ham chown -R ${VMAIL_ID}.dovecot /var/cache/dovecot-antispam/ cat > /var/spool/incron/root << "EOF" /var/cache/dovecot-antispam/spam IN_CLOSE_WRITE /usr/local/bin/sa-learn-pipe.sh --spam /var/cache/dovecot-antispam/spam/$# /var/cache/dovecot-antispam/ham IN_CLOSE_WRITE /usr/local/bin/sa-learn-pipe.sh --ham /var/cache/dovecot-antispam/ham/$# EOF chgrp incron /var/spool/incron/root chmod 600 /var/spool/incron/root # inotify needs a little more room to breath - default of 128 too low cat > /etc/sysctl.d/60-inotify.conf << EOF # inotify changes for Dovecot # http://dovecot.org/list/dovecot/2011-March/058300.html # Defaults are # fs.inotify.max_queued_events = 16384 # fs.inotify.max_user_instances = 128 # fs.inotify.max_user_watches = 8192 fs.inotify.max_user_instances = 2048 EOF # spamassassin learning script cat > /usr/local/bin/sa-learn-pipe.sh << "EOFSPAM" #!/bin/bash # Pipe script to learn/unlearn single email file # Set to read from file or from stdin # From stdin to accomodate dovecot-antispam pipe backend (nor currently working) # echo /usr/bin/sa-learn $* /tmp/sendmail-msg-$$.txt FILE=`echo $* | sed "s/^.* //"` echo "$$-start ($*)" >> /var/log/sa-learn-pipe.log echo -n "$$ " >> /var/log/sa-learn-pipe.log egrep --no-filename "^Subject: " /tmp/sendmail-msg-$$.txt ${FILE} | head -1 >> /var/log/sa-learn-pipe.log cat<&0 >> /tmp/sendmail-msg-$$.txt /usr/bin/sa-learn --progress $* /tmp/sendmail-msg-$$.txt >> /tmp/sa-learn-pipe.$$.log 2>&1 echo $$ sa-learn rc=$? id=$(id) HOME=$HOME >> /var/log/sa-learn-pipe.log while read line; do echo $$-sa-learn "$line" >> /var/log/sa-learn-pipe.log done < /tmp/sa-learn-pipe.$$.log rm -f /tmp/sendmail-msg-$$.txt /tmp/sa-learn-pipe.$$.log rm -f ${FILE} echo "$$-end" >> /var/log/sa-learn-pipe.log exit 0 EOFSPAM chmod 755 /usr/local/bin/sa-learn-pipe.sh touch /var/log/sa-learn-pipe.log chown ${VMAIL_ID}.dovecot /var/log/sa-learn-pipe.log chmod 660 /var/log/sa-learn-pipe.log cat > /etc/logrotate.d/sa-learn-pipe.log << EOFLOG /var/log/sa-learn-pipe.log { daily missingok rotate 10 compress delaycompress notifempty create 660 ${VMAIL_ID} dovecot } EOFLOG fi # spamassassin ############################################ On 2016-04-12 14:14, Johannes Rohr wrote: > Hi, my setup is a dovecot 2.0.19 IMAP server on Ubuntu Precise with > the antispam plugin in version 2.0+20120225-2 and spamassassin at > version 3.2.2 > > I have been trying and failed to get the pipe backend of the antispam > plugin to work. Spamassin by itself works, a manual call of sa-learn > works fine. Bayes data is stored in a mysql DB. > > I have the following configuration in > /etc/dovecot/conf.d/90-plugin.conf > > plugin { > #setting_name = value > sieve=~/.dovecot.sieve > sieve_dir=~/sieve > antispam_pipe_program_spam_arg = --spam > antispam_pipe_program_notspam_arg = --ham > antispam_pipe_program = /usr/local/bin/sa-learn-pipe.sh > antispam_pipe_program_args = --username=%u # % expansion done by > dovecot > antispam_trash = trash;Trash;Deleted Items;Deleted Messages > antispam_spam = SPAM;Junk > antispam_backend = pipe > antispam_verbose_debug = 1 > antispam_debug_target = syslog > antispam_pipe_tmpdir = /tmp > } > > I have tried the following wrapper script: > #!/bin/bash > # set -x > LOGFILE=/tmp/sa-learn-pipe.log > echo "$$-start ($*)" >> $LOGFILE > #echo $* > /tmp/sendmail-parms.txt > cat<&0 >> /tmp/sendmail-msg-$$.txt > /usr/bin/sa-learn $* -D /tmp/sendmail-msg-$$.txt >> $LOGFILE 2>&1 && \ > rm -f /tmp/sendmail-msg-$$.txt > echo "$$-end" >> $LOGFILE > exit 0 > > It somehow isn't working. I can call the wrapper script manually e.g. > sudo -u vmail /usr/local/bin/sa-learn-pipe.sh --username=some at mail.user > --ham \ > < someham > > But it doesn't work from dovecot. It seems the script is called. but > no new patterns show up in the bayes DB. Unfortunately, the plugin > seems to be documented poorly. How does it call the programme it pipes > to? Is it something like $programme --par1 --par2 < message ? Why > can't / shouldn't I call sa-learn directly? All the instructions I > found on the in internet contained a wrapper script, but none bothered > to explain why you would actually need it. > > I would be very grateful, if someone could enlighten me on that... -- Dean Carpenter deano is at areyes dot com 203 six oh four 6644 From order at mxgr.de Wed Apr 13 21:14:06 2016 From: order at mxgr.de (Max) Date: Wed, 13 Apr 2016 23:14:06 +0200 Subject: Best way to only replicate specific users Message-ID: <20160413211406.GC17728@4k.mxgr.de> Hi, I was wondering about the best way to achieve this. Currently, the users I don't want replicated do not exist on the target system. The source tries to sync them but runs into an error. Technically, that works for me, but it doesn't seem like the right way to do it and clutters the log. Kind Regards, Max From dave.mehler at gmail.com Wed Apr 13 22:45:24 2016 From: dave.mehler at gmail.com (David Mehler) Date: Wed, 13 Apr 2016 18:45:24 -0400 Subject: Dovecot and Windows Live Mail 2012? In-Reply-To: <1822283844.33509.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> References: <1822283844.33509.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> Message-ID: Hello, I'm using self-signed certificates, but my CA public key is imported. I checked the logs and was getting an error about no authentication which is probably why it was failing. I then switched to 587 and 993 ports and now it works, but it's very intermediant, sometimes it works, other times not. If there's a better free windows email client, (please not thunderbird), that doesn't have these Microsoft-isms i'd appreciate knowing about it. Thanks. Dave. On 4/13/16, aki.tuomi at dovecot.fi wrote: > >> On April 13, 2016 at 5:51 PM David Mehler wrote: >> >> >> Hello, >> >> I hope someone has this working, because I'm pulling my hair out at this >> one. >> >> I'm using well for this it's a win7 x64 machine running Windows >> Essentials 2012 and using the Windows Live mail component. I am trying >> to connect to my Dovecot server running 2.23 I believe. I keep getting >> the error "the imap command could not be sent to the server because of >> a non-network error" googling showed many with this, but no fix. >> >> In this account I'm trying to access port 143 which uses starttls. In >> Mail I've got the boxes for require a secure connection and >> authentication checked. >> >> I should note of course and with no surprise that Mail works oh just >> fine with the Hotmail account I've also got configured, it's only with >> the downloading of folders and sending of email to the dovecot server >> that mail has the issue. >> >> Please let me know if I can provide any additional information. >> >> Help appreciated. >> >> Thanks. >> Dave. > > Are you using public CA signed certificate? Are there any errors in dovecot > logs? > > Aki > From matthias.lay at securepoint.de Thu Apr 14 10:08:21 2016 From: matthias.lay at securepoint.de (Matthias Lay) Date: Thu, 14 Apr 2016 12:08:21 +0200 Subject: A few new Pigeonhole features In-Reply-To: <57066424.8040508@rename-it.nl> References: <57066424.8040508@rename-it.nl> Message-ID: <20160414120821.5e07c9ed@eugen.spdev.local> On Thu, 7 Apr 2016 15:44:04 +0200 Stephan Bosch wrote: > > - Recently, I implemented support for the "imapsieve" extension in > Sieve and its IMAP counterpart (https://tools.ietf.org/html/rfc6785). > This is now in the Pigeonhole master branch. This allows running > Sieve scripts at IMAP activity, rather than at delivery. There are > also facilities for the familiar sieve_before/sieve_after > administrator scripts. The documentation is currently only in th this sounds great! I guess this will work with dovecot hardlinks on sieve copying in contrast to lda sieve? Greetz Matze > sources and not on the wiki: > > https://raw.githubusercontent.com/dovecot/pigeonhole/master/doc/plugins/imapsieve.txt > > - Yesterday, I implemented online trace debugging for Sieve scripts: > i.e., directly during delivery rather than only using the sieve-test > tool. This is also supported for the IMAPSIEVE feature discussed > above. This is documented in the INSTALL file: > > https://github.com/dovecot/pigeonhole/blob/master/INSTALL#L522 > > > > In other news, I started a specification for a new Sieve feature that > allows using the IMAP SPECIAL-USE attributes from Sieve scripts: > > https://tools.ietf.org/html/draft-bosch-sieve-special-use-00 > > There is no implementation yet. > > > Any comments, suggestions or bug reports are welcome. > > Regards, > > Stephan. From stephan at rename-it.nl Thu Apr 14 10:22:22 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 14 Apr 2016 12:22:22 +0200 Subject: A few new Pigeonhole features In-Reply-To: <20160414120821.5e07c9ed@eugen.spdev.local> References: <57066424.8040508@rename-it.nl> <20160414120821.5e07c9ed@eugen.spdev.local> Message-ID: <570F6F5E.4070702@rename-it.nl> Op 14-4-2016 om 12:08 schreef Matthias Lay: > On Thu, 7 Apr 2016 15:44:04 +0200 > Stephan Bosch wrote: > > >> - Recently, I implemented support for the "imapsieve" extension in >> Sieve and its IMAP counterpart (https://tools.ietf.org/html/rfc6785). >> This is now in the Pigeonhole master branch. This allows running >> Sieve scripts at IMAP activity, rather than at delivery. There are >> also facilities for the familiar sieve_before/sieve_after >> administrator scripts. The documentation is currently only in th > > this sounds great! > I guess this will work with dovecot hardlinks on sieve copying in > contrast to lda sieve? I am not sure what you mean exactly. Can you clarify? Regards, Stephan. From jerry at seibercom.net Thu Apr 14 10:36:24 2016 From: jerry at seibercom.net (Jerry) Date: Thu, 14 Apr 2016 06:36:24 -0400 Subject: Dovecot and Windows Live Mail 2012? In-Reply-To: References: <1822283844.33509.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> Message-ID: <20160414063624.0000790f@seibercom.net> On Wed, 13 Apr 2016 18:45:24 -0400, David Mehler stated: >Hello, > >I'm using self-signed certificates, but my CA public key is imported. > >I checked the logs and was getting an error about no authentication >which is probably why it was failing. I then switched to 587 and 993 >ports and now it works, but it's very intermediant, sometimes it >works, other times not. > >If there's a better free windows email client, (please not >thunderbird), that doesn't have these Microsoft-isms i'd appreciate >knowing about it. > >Thanks. >Dave. 99% of all the problems I have witnessed with a Windows based MUA is due to a firewall misconfiguration. Check there first. Also, check the official documentation for the application, etc. Outlook.com uses 587 and 993 by default, assuming an IMAP connection. Please see this URL for complete instructions. https://www.outlook-apps.com/outlook-com-pop-settings/ -- Jerry From matthias.lay at securepoint.de Thu Apr 14 10:46:12 2016 From: matthias.lay at securepoint.de (Matthias Lay) Date: Thu, 14 Apr 2016 12:46:12 +0200 Subject: A few new Pigeonhole features In-Reply-To: <570F6F5E.4070702@rename-it.nl> References: <57066424.8040508@rename-it.nl> <20160414120821.5e07c9ed@eugen.spdev.local> <570F6F5E.4070702@rename-it.nl> Message-ID: <20160414124612.561ced38@eugen.spdev.local> On Thu, 14 Apr 2016 12:22:22 +0200 Stephan Bosch wrote: > > I am not sure what you mean exactly. Can you clarify? > sure, at the moment, if I am using a script like this fileinto :copy "myspecialplace" in lda sieve, the hardlinking is not working the mail gets duplicated on the FS, as far as I can see. So if the sieve is acting on an already saved mail, I guess it would be hard linked? Regards Matze From stephan at rename-it.nl Thu Apr 14 11:13:51 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Thu, 14 Apr 2016 13:13:51 +0200 Subject: A few new Pigeonhole features In-Reply-To: <20160414124612.561ced38@eugen.spdev.local> References: <57066424.8040508@rename-it.nl> <20160414120821.5e07c9ed@eugen.spdev.local> <570F6F5E.4070702@rename-it.nl> <20160414124612.561ced38@eugen.spdev.local> Message-ID: <570F7B6F.9080008@rename-it.nl> Op 14-4-2016 om 12:46 schreef Matthias Lay: > On Thu, 14 Apr 2016 12:22:22 +0200 > Stephan Bosch wrote: > > >> I am not sure what you mean exactly. Can you clarify? >> > > sure, > > at the moment, if I am using a script like this > > fileinto :copy "myspecialplace" > > in lda sieve, the hardlinking is not working the mail gets duplicated on > the FS, as far as I can see. > > So if the sieve is acting on an already saved mail, I guess it would be > hard linked? Not sure. I should test that. As far as I know, Dovecot does that implicitly if possible. Regards, Stephan. From claude at phyto.qc.ca Thu Apr 14 11:32:51 2016 From: claude at phyto.qc.ca (Claude) Date: Thu, 14 Apr 2016 07:32:51 -0400 Subject: How to filter spam with same to: and from: adress Message-ID: Is it possible to create a filter somewhere to delete email that have same to: and from: adress. All these email are forged using my domain name with always different fictif user name. The only common point is that they have the same user name in the from: and to: adress Claude Gelinas agr. Phyto Ressources Inc. From infoomatic at gmx.at Thu Apr 14 13:54:29 2016 From: infoomatic at gmx.at (Infoomatic) Date: Thu, 14 Apr 2016 15:54:29 +0200 Subject: Aw: How to filter spam with same to: and from: adress In-Reply-To: References: Message-ID: This is usually solved within your mta. In most simple setups, the MX server receiving the mails should not accept mails for which it is responsible itself, so your mailserver phyto.qc.ca should not accept mails with "from: any at phyto.qc.ca" from other servers than what you defined (e.g. in "mynetworks" if you are using postfix). On the other hand, you should make sure that your users cannot send their mails other than that linked to their accounts, so make sure joe at phyto.qc.ca cannot send as maria at phyto.qc.ca ... if you are using postfix, you might have a look at reject_sender_login_mismatch. hope this helps, infoomatic > Gesendet: Donnerstag, 14. April 2016 um 13:32 Uhr > Von: Claude > An: "dovecot at dovecot.org >> dovecot dovecot.org" > Betreff: How to filter spam with same to: and from: adress > > Is it possible to create a filter somewhere to delete email that have same to: and from: adress. All these email are forged using my domain name with always different fictif user name. The only common point is that they have the same user name in the from: and to: adress > > Claude Gelinas agr. > Phyto Ressources Inc. From wlt at o-sinc.com Wed Apr 13 19:12:51 2016 From: wlt at o-sinc.com (William L. Thomson Jr.) Date: Wed, 13 Apr 2016 15:12:51 -0400 Subject: v2.2.23 released In-Reply-To: References: Message-ID: On Wednesday, March 30, 2016 03:48:04 PM Timo Sirainen wrote: > http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz > http://dovecot.org/releases/2.2/dovecot-2.2.23.tar.gz.sig > > This is a bugfix-only release with various important fixes on top of > v2.2.22. > > - director: Fixed a situation where directors keep re-sending > different states to each others and never becoming synced. I think this addressed my replication/syncing issue http://dovecot.org/pipermail/dovecot/2016-March/103680.html Thus far on 2.2.23 I have not run into the situation were emails get stuck on one server, and never syncing to the other. Knock on wood.... -- William L. Thomson Jr. Obsidian-Studios, Inc. http://www.obsidian-studios.com From martin_dovecot at sg3.yourweb.de Thu Apr 14 17:55:11 2016 From: martin_dovecot at sg3.yourweb.de (Martin) Date: Thu, 14 Apr 2016 19:55:11 +0200 Subject: Tighten TLS - usage of specific ssl_ec-curve In-Reply-To: References: Message-ID: <570FD97F.5010207@sg3.yourweb.de> Hi folks, at first: thanks very much for the great piece of software! I have a proposal to tighten the TLS security: enable the usage of a specific ec-curve in the 10-ssl.conf, e.g. ssl_ec-curve = secp384r1 Reason: I use a 384 bit EC server key, but dovecot uses "only" a prime256v1 curve. Keygen was: f=dovecot; openssl ecparam -name secp384r1 -genkey -out $f.key openssl req -new -x509 -key $f.key -out ${f}.crt -days 2000 -sha512 Server check gives: prio ciphersuite protocols pfs curves 1 ECDHE-ECDSA-AES128-GCM-SHA256 TLSv1.2 ECDH,P-256,256bits prime256v1 2 ECDHE-ECDSA-AES128-SHA256 TLSv1.2 ECDH,P-256,256bits prime256v1 3 ECDHE-ECDSA-AES128-SHA TLSv1.2 ECDH,P-256,256bits prime256v1 4 ECDHE-ECDSA-AES256-GCM-SHA384 TLSv1.2 ECDH,P-256,256bits prime256v1 5 ECDHE-ECDSA-AES256-SHA384 TLSv1.2 ECDH,P-256,256bits prime256v1 6 ECDHE-ECDSA-AES256-SHA TLSv1.2 ECDH,P-256,256bits prime256v1 Certificate: UNTRUSTED, 384 bit, ecdsa-with-SHA512 signature $ sudo nano /etc/dovecot/conf.d/10-ssl.conf ssl = required ssl_protocols = !SSlv2 !SSLv3 TLSv1.2 ssl_cipher_list = EECDH+AES128+AESGCM:EECDH+AES256+AESGCM:EECDH+AES128+SHA256:EECDH+AES256+SHA384:EECDH+AES128+SHA:EECDH+AES256+SHA ssl_prefer_server_ciphers = yes ssl_key = References: <570FD97F.5010207@sg3.yourweb.de> Message-ID: <571099B0.4020001@dovecot.fi> On 14.04.2016 20:55, Martin wrote: > Hi folks, at first: thanks very much for the great piece of software! > > I have a proposal to tighten the TLS security: enable the usage of a specific ec-curve in the 10-ssl.conf, e.g. > > ssl_ec-curve = secp384r1 > > > Reason: I use a 384 bit EC server key, but dovecot uses "only" a prime256v1 curve. > > > Keygen was: > f=dovecot; openssl ecparam -name secp384r1 -genkey -out $f.key > openssl req -new -x509 -key $f.key -out ${f}.crt -days 2000 -sha512 > > > Server check gives: > prio ciphersuite protocols pfs curves > 1 ECDHE-ECDSA-AES128-GCM-SHA256 TLSv1.2 ECDH,P-256,256bits prime256v1 > 2 ECDHE-ECDSA-AES128-SHA256 TLSv1.2 ECDH,P-256,256bits prime256v1 > 3 ECDHE-ECDSA-AES128-SHA TLSv1.2 ECDH,P-256,256bits prime256v1 > 4 ECDHE-ECDSA-AES256-GCM-SHA384 TLSv1.2 ECDH,P-256,256bits prime256v1 > 5 ECDHE-ECDSA-AES256-SHA384 TLSv1.2 ECDH,P-256,256bits prime256v1 > 6 ECDHE-ECDSA-AES256-SHA TLSv1.2 ECDH,P-256,256bits prime256v1 > > Certificate: UNTRUSTED, 384 bit, ecdsa-with-SHA512 signature > > Thank you for your suggestion, we will take it under consideration as we are improving security settings for next major release. Aki Tuomi Dovecot oy From bind at enas.net Fri Apr 15 13:14:21 2016 From: bind at enas.net (Urban Loesch) Date: Fri, 15 Apr 2016 15:14:21 +0200 Subject: Randomly SSL Errors since upgrade to 2.2.23-1 (Enterprise Edition) Message-ID: <5710E92D.8060708@enas.net> Hi, first of all, many thanks for a great piece of software. Today I updated one of our 2 IMAP/POP3 proxies from version 2.2.15.17-1 to 2.2.23.1-1 (both are enterprise editions). After the update I now see randomly the following errors in the log file on my first proxy: ... Apr 15 10:28:54 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac Apr 15 10:34:24 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac Apr 15 10:37:11 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 10:39:04 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac Apr 15 10:43:02 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 10:45:14 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac Apr 15 10:50:31 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 10:54:56 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac Apr 15 10:57:44 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 10:59:49 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 11:00:59 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 11:13:43 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:14094438:SSL routines:SSL3_READ_BYTES:tlsv1 alert internal error: SSL alert number 80 Apr 15 11:15:21 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 11:18:33 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 11:20:12 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 11:20:40 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac ... Some more details: OS: Debian wheezy (latest patchlevel) Dovecot: ii dovecot-ee-core 2:2.2.23.1-1 ii dovecot-ee-imapd 2:2.2.23.1-1 ii dovecot-ee-managesieved 2:2.2.23.1-1 ii dovecot-ee-mysql 2:2.2.23.1-1 ii dovecot-ee-pop3d 2:2.2.23.1-1 ii dovecot-ee-sieve 2:2.2.23.1-1 Libssl: ii libssl1.0.0:amd64 1.0.1e-2+deb7u20 One my second proxy there is running also Debian Wheezy with the latest patchlevel but dovecot version 2.2.15.17-1 (not yet updated): ii dovecot-ee-core 1:2.2.15.17-1 ii dovecot-ee-imapd 1:2.2.15.17-1 ii dovecot-ee-managesieved 0.4.6-4 ii dovecot-ee-mysql 1:2.2.15.17-1 ii dovecot-ee-pop3d 1:2.2.15.17-1 ii dovecot-ee-sieve 0.4.6-4 On this box I can't see this strange errors. Until now there was no user that complaints that he can't read his mails. Do you know what could cause this errors (for example: very old clients and so on)? Or are the logging of this errors new in dovecot 2.2.23? Many thanks Urban Loesch From bind at enas.net Fri Apr 15 14:38:44 2016 From: bind at enas.net (Urban Loesch) Date: Fri, 15 Apr 2016 16:38:44 +0200 Subject: Randomly SSL Errors since upgrade to 2.2.23-1 (Enterprise Edition) In-Reply-To: <5710E92D.8060708@enas.net> References: <5710E92D.8060708@enas.net> Message-ID: <5710FCF4.80003@enas.net> [UPDATE]: I digged deeper into my logs and I found that before the upgrade I got this errors: ... Apr 15 09:36:09 imap1 dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408E0F4:SSL routines:SSL3_GET_MESSAGE:unexpected message Apr 15 09:37:56 imap1 dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408E0F4:SSL routines:SSL3_GET_MESSAGE:unexpected message Apr 15 09:45:40 imap1 dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408E0F4:SSL routines:SSL3_GET_MESSAGE:unexpected message Apr 15 09:46:15 imap1 dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408E0F4:SSL routines:SSL3_GET_MESSAGE:unexpected message ... After the upgrade the errors above stopped and now they look like this: .... Apr 15 13:41:30 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac Apr 15 13:41:30 imap1 dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: Unknown error .... or .... Apr 15 11:00:59 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown Apr 15 11:00:59 imap1 dovecot: imap-login: proxy(user at domain.com): disconnecting x.x.x.x (Disconnected by client: read(size=1026) failed: Connection reset by peer(0s idle, in=467, out=384881)): user=, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, TLS: SSL_write() failed: Bad file descriptor, TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits) .... First I didn't see the first errors as they are only written to "mail.log" and not "mail.err" in Debian. So I think this is not really critical as there are no user complaints right now. Thanks Urban Loesch Am 15.04.2016 um 15:14 schrieb Urban Loesch: > Hi, > > first of all, many thanks for a great piece of software. > > Today I updated one of our 2 IMAP/POP3 proxies from version 2.2.15.17-1 to 2.2.23.1-1 (both are enterprise editions). > After the update I now see randomly the following errors in the log file on my first proxy: > > ... > Apr 15 10:28:54 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac > Apr 15 10:34:24 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac > Apr 15 10:37:11 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 10:39:04 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac > Apr 15 10:43:02 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 10:45:14 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac > Apr 15 10:50:31 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 10:54:56 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac > Apr 15 10:57:44 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 10:59:49 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 11:00:59 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 11:13:43 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:14094438:SSL routines:SSL3_READ_BYTES:tlsv1 alert internal error: SSL > alert number 80 > Apr 15 11:15:21 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 11:18:33 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 11:20:12 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 11:20:40 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac > ... > > Some more details: > OS: Debian wheezy (latest patchlevel) > > Dovecot: > ii dovecot-ee-core 2:2.2.23.1-1 > ii dovecot-ee-imapd 2:2.2.23.1-1 > ii dovecot-ee-managesieved 2:2.2.23.1-1 > ii dovecot-ee-mysql 2:2.2.23.1-1 > ii dovecot-ee-pop3d 2:2.2.23.1-1 > ii dovecot-ee-sieve 2:2.2.23.1-1 > > Libssl: > ii libssl1.0.0:amd64 1.0.1e-2+deb7u20 > > > One my second proxy there is running also Debian Wheezy with the latest patchlevel but dovecot version 2.2.15.17-1 (not yet updated): > ii dovecot-ee-core 1:2.2.15.17-1 > ii dovecot-ee-imapd 1:2.2.15.17-1 > ii dovecot-ee-managesieved 0.4.6-4 > ii dovecot-ee-mysql 1:2.2.15.17-1 > ii dovecot-ee-pop3d 1:2.2.15.17-1 > ii dovecot-ee-sieve 0.4.6-4 > > On this box I can't see this strange errors. > > Until now there was no user that complaints that he can't read his mails. > > Do you know what could cause this errors (for example: very old clients and so on)? > Or are the logging of this errors new in dovecot 2.2.23? > > Many thanks > Urban Loesch > From ulrichkenneth at gmail.com Fri Apr 15 14:42:17 2016 From: ulrichkenneth at gmail.com (Kenneth Ulrich) Date: Fri, 15 Apr 2016 09:42:17 -0500 Subject: Possible to use Doveadm for a time range deletion Message-ID: Hello All, I was wondering if it s possible to remove emails between a time range. For example, End Users have emails dating back to Aug 2000. He would like all emails deleted between the time stamp of 07/2014 to 07/2015 yet keep any emails outside of this area. I've ran into some similar examples, but nothing definite. From victorpictor at mailbox.hu Fri Apr 15 16:53:38 2016 From: victorpictor at mailbox.hu (victorpictor at mailbox.hu) Date: Fri, 15 Apr 2016 18:53:38 +0200 Subject: AD LDAP auth shows unknown results Message-ID: Hi List! Been struggling with AD LDAP auth, ldapsearch shows everything fine, but when I try to telnet, the log shows unknown attributes. Dovecot 2.0.19 dovecot -n: # 2.0.19: /etc/dovecot/dovecot.conf # OS: Linux 3.5.0-23-generic x86_64 Ubuntu 12.04.5 LTS ext4 auth_debug = yes auth_mechanisms = plain login auth_username_format = %n auth_verbose = yes disable_plaintext_auth = no listen = * mail_location = maildir:/var/mail/%u%d/Maildir namespace inbox { inbox = yes location = prefix = } passdb { args = /etc/dovecot/dovecot-ldap-passdb.conf driver = ldap } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve sieve_global_dir = /var/lib/dovecot/sieve/ } protocols = " imap lmtp pop3" service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0660 user = postfix } } service lmtp { unix_listener /var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0600 user = postfix } user = vmail } ssl = no ssl_cert = I'm setting up dovecot on a new box; and once again I find myself banging my head against GSSAPI authentication. The particularly irritating thing is that I have this working on another box. ?I've done my best to ape the configuration of that box; but it's been some years since I set it up and somewhere along the line I have failed. My dovecot.conf has: auth_mechanism = plain gssapi passdb { ? driver = pam } userdb { ? driver = ldap ??args = /etc/dovecot/dovecot-ldap.conf.ext } where /etc/dovecot/dovecot-ldap.conf.ext is: hosts = ldap dn = cn=Manager,dc=endoframe,dc=net dnpass = XXXXXXXX ldap_version = 3 base = ou=people,dc=endoframe,dc=net deref = never scope = subtree user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid user_filter = (&(objectClass=posixAccount)(uid=%u)) I've diff'd the contents of /etc/dovecot on the working vs. non-working servers, and I can see nothing of pertinence (just a few lines about loading the sieve plug-in). Now, logging in with the kerberos password via PAM *is* working. ?/etc/pam.d/dovecot: #%PAM-1.0 auth???????sufficient???pam_krb5.so account????sufficient???pam_krb5.so But GSSAPI authentication is not: [ root at hinge ~]# telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=GSSAPI] Dovecot ready. a authenticate GSSAPI a NO [UNAVAILABLE] Temporary authentication failure. [hinge.endoframe.net:2016-04-16 21:33:32] ^] telnet> close Connection closed. Oh... The kerberos server does have an IMAP service key for hinge; and that service key appears in hinge's /etc/krb5.keytab, as well. Any pointers on where I should be looking at this point would be very much appreciated. -- Braden McDaniel From aki.tuomi at dovecot.fi Sun Apr 17 18:49:38 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sun, 17 Apr 2016 21:49:38 +0300 (EEST) Subject: GSSAPI authentication setup In-Reply-To: <1460842913.3259.32.camel@endoframe.com> References: <1460842913.3259.32.camel@endoframe.com> Message-ID: <1529302712.47523.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> > On April 17, 2016 at 12:41 AM Braden McDaniel wrote: > > > I'm setting up dovecot on a new box; and once again I find myself > banging my head against GSSAPI authentication. > > The particularly irritating thing is that I have this working on > another box. ?I've done my best to ape the configuration of that box; > but it's been some years since I set it up and somewhere along the line > I have failed. > > My dovecot.conf has: > > auth_mechanism = plain gssapi > > passdb { > ? driver = pam > } > > userdb { > ? driver = ldap > ??args = /etc/dovecot/dovecot-ldap.conf.ext > } > > where /etc/dovecot/dovecot-ldap.conf.ext is: > > hosts = ldap > dn = cn=Manager,dc=endoframe,dc=net > dnpass = XXXXXXXX > ldap_version = 3 > base = ou=people,dc=endoframe,dc=net > deref = never > scope = subtree > user_attrs = homeDirectory=home,uidNumber=uid,gidNumber=gid > user_filter = (&(objectClass=posixAccount)(uid=%u)) > > I've diff'd the contents of /etc/dovecot on the working vs. non-working > servers, and I can see nothing of pertinence (just a few lines about > loading the sieve plug-in). > > Now, logging in with the kerberos password via PAM *is* working. > ?/etc/pam.d/dovecot: > > #%PAM-1.0 > auth???????sufficient???pam_krb5.so > account????sufficient???pam_krb5.so > > But GSSAPI authentication is not: > > [ root at hinge ~]# telnet localhost 143 > Trying ::1... > Connected to localhost. > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE > STARTTLS AUTH=PLAIN AUTH=GSSAPI] Dovecot ready. > a authenticate GSSAPI > a NO [UNAVAILABLE] Temporary authentication failure. > [hinge.endoframe.net:2016-04-16 21:33:32] > ^] > telnet> close > Connection closed. > > Oh... The kerberos server does have an IMAP service key for hinge; and > that service key appears in hinge's /etc/krb5.keytab, as well. > > Any pointers on where I should be looking at this point would be very > much appreciated. > > -- > Braden McDaniel Hi! Did you check your setup against http://wiki2.dovecot.org/Authentication/Kerberos Also can you provide klist -k on server? --- Aki Tuomi From braden at endoframe.com Mon Apr 18 05:13:22 2016 From: braden at endoframe.com (Braden McDaniel) Date: Mon, 18 Apr 2016 01:13:22 -0400 Subject: GSSAPI authentication setup In-Reply-To: <1529302712.47523.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> References: <1460842913.3259.32.camel@endoframe.com> <1529302712.47523.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> Message-ID: <1460956402.3259.41.camel@endoframe.com> On Sun, 2016-04-17 at 21:49 +0300, aki.tuomi at dovecot.fi wrote: > > > > Did you check your setup against > http://wiki2.dovecot.org/Authentication/Kerberos I did. ?Of course, it's possible I've still managed to overlook something.? > Also can you provide klist -k on server? I assume you mean the kerberos server: [ root at knock ~]# klist -k Keytab name: FILE:/etc/krb5.keytab KVNO Principal ---- -------------------------------------------------------------------------- ???2 host/knock.endoframe.net at ENDOFRAME.NET ???2 host/knock.endoframe.net at ENDOFRAME.NET ???2 host/knock.endoframe.net at ENDOFRAME.NET ???2 host/knock.endoframe.net at ENDOFRAME.NET ???2 host/knock.endoframe.net at ENDOFRAME.NET ???2 host/knock.endoframe.net at ENDOFRAME.NET ???4 host/rail.endoframe.net at ENDOFRAME.NET ???4 host/rail.endoframe.net at ENDOFRAME.NET ???4 host/rail.endoframe.net at ENDOFRAME.NET ???4 host/rail.endoframe.net at ENDOFRAME.NET ???4 host/rail.endoframe.net at ENDOFRAME.NET ???4 host/rail.endoframe.net at ENDOFRAME.NET ???3 nfs/rail.endoframe.net at ENDOFRAME.NET ???5 host/hinge.endoframe.net at ENDOFRAME.NET ???5 host/hinge.endoframe.net at ENDOFRAME.NET ???5 host/hinge.endoframe.net at ENDOFRAME.NET ???5 host/hinge.endoframe.net at ENDOFRAME.NET ???5 host/hinge.endoframe.net at ENDOFRAME.NET ???5 host/hinge.endoframe.net at ENDOFRAME.NET ???5 host/hinge.endoframe.net at ENDOFRAME.NET ???5 host/hinge.endoframe.net at ENDOFRAME.NET -- Braden McDaniel From aki.tuomi at dovecot.fi Mon Apr 18 05:59:33 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Mon, 18 Apr 2016 08:59:33 +0300 (EEST) Subject: GSSAPI authentication setup In-Reply-To: <1460956402.3259.41.camel@endoframe.com> References: <1460842913.3259.32.camel@endoframe.com> <1529302712.47523.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> <1460956402.3259.41.camel@endoframe.com> Message-ID: <1519590920.47956.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> > On April 18, 2016 at 8:13 AM Braden McDaniel wrote: > > > On Sun, 2016-04-17 at 21:49 +0300, aki.tuomi at dovecot.fi wrote: > > > > > > Did you check your setup against > > http://wiki2.dovecot.org/Authentication/Kerberos > > I did. ?Of course, it's possible I've still managed to overlook > something.? > > > Also can you provide klist -k on server? > > I assume you mean the kerberos server: > > [ root at knock ~]# > -- > Braden McDaniel Apologies, I ment your IMAP server. --- Aki Tuomi From bind at enas.net Mon Apr 18 07:12:49 2016 From: bind at enas.net (Urban Loesch) Date: Mon, 18 Apr 2016 09:12:49 +0200 Subject: stats: Error: FIFO input error: CONNECT: Duplicate session ID Message-ID: <571488F1.1060905@enas.net> Hi, yesterday I updatet to Dovecot EE version 2:2.2.23.1-1. Now sometimes I see this errors in my logs: ... Apr 18 09:02:19 dovecot1 dovecot: stats: Error: FIFO input error: CONNECT: Duplicate session ID NjcCDoSAFFd/KQAAFMUCeg for user user at domain1.com service lmtp Apr 18 09:04:05 dovecot1 dovecot: stats: Error: FIFO input error: CONNECT: Duplicate session ID rjV1HtCGFFcoogAAFMUCeg for user user at domain2.com service lmtp Apr 18 09:04:30 dovecot1 dovecot: stats: Error: FIFO input error: CONNECT: Duplicate session ID Sqi0IMWAFFeRNQAAFMUCeg for user user at domain3.com service lmtp ... The error only appears when a mail is sent to 2 ore more recipients concurrently. It's not ciritcal for me, all mails are getting delivered correctly. Thanks and regards Urban Loesch From teemu.huovila at dovecot.fi Mon Apr 18 10:51:54 2016 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Mon, 18 Apr 2016 13:51:54 +0300 Subject: stats: Error: FIFO input error: CONNECT: Duplicate session ID In-Reply-To: <571488F1.1060905@enas.net> References: <571488F1.1060905@enas.net> Message-ID: <5714BC4A.7090507@dovecot.fi> On 18.04.2016 10:12, Urban Loesch wrote: > Hi, > > yesterday I updatet to Dovecot EE version 2:2.2.23.1-1. > Now sometimes I see this errors in my logs: > > ... > Apr 18 09:02:19 dovecot1 dovecot: stats: Error: FIFO input error: CONNECT: Duplicate session ID NjcCDoSAFFd/KQAAFMUCeg for user user at domain1.com service lmtp > Apr 18 09:04:05 dovecot1 dovecot: stats: Error: FIFO input error: CONNECT: Duplicate session ID rjV1HtCGFFcoogAAFMUCeg for user user at domain2.com service lmtp > Apr 18 09:04:30 dovecot1 dovecot: stats: Error: FIFO input error: CONNECT: Duplicate session ID Sqi0IMWAFFeRNQAAFMUCeg for user user at domain3.com service lmtp > ... > > The error only appears when a mail is sent to 2 ore more recipients concurrently. > It's not ciritcal for me, all mails are getting delivered correctly. This is fixed in commit https://github.com/dovecot/core/commit/aeea3dbd1f4031634f7b318614adf51dcfc79f42 br, Teemu Huovila > > Thanks and regards > Urban Loesch From braden at endoframe.com Mon Apr 18 11:22:25 2016 From: braden at endoframe.com (Braden McDaniel) Date: Mon, 18 Apr 2016 07:22:25 -0400 Subject: GSSAPI authentication setup In-Reply-To: <1519590920.47956.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> References: <1460842913.3259.32.camel@endoframe.com> <1529302712.47523.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> <1460956402.3259.41.camel@endoframe.com> <1519590920.47956.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> Message-ID: <1460978545.3259.43.camel@endoframe.com> On Mon, 2016-04-18 at 08:59 +0300, aki.tuomi at dovecot.fi wrote: > > > > On April 18, 2016 at 8:13 AM Braden McDaniel > > wrote: > > > > > > On Sun, 2016-04-17 at 21:49 +0300, aki.tuomi at dovecot.fi wrote: > > > > > > > > > > > > > > > Did you check your setup against > > > http://wiki2.dovecot.org/Authentication/Kerberos > > I did. ?Of course, it's possible I've still managed to overlook > > something.? > > > > > > > > Also can you provide klist -k on server? > > I assume you mean the kerberos server: > > > > ????[????root at knock?????~]#? > > Apologies, I ment your IMAP server. [ root at hinge ~]# klist -k Keytab name: FILE:/etc/krb5.keytab KVNO Principal ---- -------------------------------------------------------------------------- ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???3 host/hinge.endoframe.net at ENDOFRAME.NET ???4 host/hinge.endoframe.net at ENDOFRAME.NET ???4 host/hinge.endoframe.net at ENDOFRAME.NET ???4 host/hinge.endoframe.net at ENDOFRAME.NET ???4 host/hinge.endoframe.net at ENDOFRAME.NET ???4 host/hinge.endoframe.net at ENDOFRAME.NET ???4 host/hinge.endoframe.net at ENDOFRAME.NET ???4 host/hinge.endoframe.net at ENDOFRAME.NET ???4 host/hinge.endoframe.net at ENDOFRAME.NET ???2 imap/hinge.endoframe.net at ENDOFRAME.NET ???2 imap/hinge.endoframe.net at ENDOFRAME.NET ???2 imap/hinge.endoframe.net at ENDOFRAME.NET ???2 imap/hinge.endoframe.net at ENDOFRAME.NET ???2 imap/hinge.endoframe.net at ENDOFRAME.NET ???2 imap/hinge.endoframe.net at ENDOFRAME.NET ???2 imap/hinge.endoframe.net at ENDOFRAME.NET ???2 imap/hinge.endoframe.net at ENDOFRAME.NET -- Braden McDaniel From aki.tuomi at dovecot.fi Mon Apr 18 11:49:17 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 18 Apr 2016 14:49:17 +0300 Subject: GSSAPI authentication setup In-Reply-To: <1460978545.3259.43.camel@endoframe.com> References: <1460842913.3259.32.camel@endoframe.com> <1529302712.47523.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> <1460956402.3259.41.camel@endoframe.com> <1519590920.47956.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> <1460978545.3259.43.camel@endoframe.com> Message-ID: <5714C9BD.2050804@dovecot.fi> On 18.04.2016 14:22, Braden McDaniel wrote: > On Mon, 2016-04-18 at 08:59 +0300, aki.tuomi at dovecot.fi wrote: >>> On April 18, 2016 at 8:13 AM Braden McDaniel >>> wrote: >>> >>> >>> On Sun, 2016-04-17 at 21:49 +0300, aki.tuomi at dovecot.fi wrote: >>>>> >>>>> Did you check your setup against >>>> http://wiki2.dovecot.org/Authentication/Kerberos >>> I did. Of course, it's possible I've still managed to overlook >>> something. >>> >>>> Also can you provide klist -k on server? >>> I assume you mean the kerberos server: >>> >>> [ root at knock ~]# >> Apologies, I ment your IMAP server. > [ root at hinge ~]# klist -k > Keytab name: FILE:/etc/krb5.keytab > KVNO Principal > ---- -------------------------------------------------------------------------- > 3 host/hinge.endoframe.net at ENDOFRAME.NET > 3 host/hinge.endoframe.net at ENDOFRAME.NET > 4 host/hinge.endoframe.net at ENDOFRAME.NET > 2 imap/hinge.endoframe.net at ENDOFRAME.NET > > There was previous case where gssapi did not work with Thunderbird. It apparently has some problems with GSSAPI usage. Also, did you ensure that your client has all the requisite principals? Can you try turning on auth_verbose=yes? Remember that kerberos is very DNS oriented, so missing/incorrect reverse records can also cause failures. Aki From stephane.cottin at vixns.com Mon Apr 18 12:44:37 2016 From: stephane.cottin at vixns.com (=?utf-8?q?St=C3=A9phane?= Cottin) Date: Mon, 18 Apr 2016 14:44:37 +0200 Subject: antispam plugin pipe backend error when moving multiple emails In-Reply-To: <1B80B1F2-2FA3-4F42-A8F7-DD8AEDFA0CB9@vixns.com> References: <1B80B1F2-2FA3-4F42-A8F7-DD8AEDFA0CB9@vixns.com> Message-ID: <9C553CA2-F238-4F7B-A0C8-C8164AE50B14@vixns.com> Hello, I'm bumping this because it still occurs with dovecot 2.2.22. my dovecot-antispam plugin configuration : antispam_allow_append_to_spam = no antispam_backend = pipe antispam_pipe_program = /usr/bin/rspamc antispam_pipe_program_args = -h;127.0.0.1:11334;-P;******** antispam_pipe_program_notspam_arg = learn_ham antispam_pipe_program_spam_arg = learn_spam antispam_pipe_tmpdir = /var/tmp antispam_spam = Junk antispam_trash = trash;Trash;Deleted Items;Deleted Messages zlib enabled: zlib_save = gz zlib_save_level = 9 When moving 2 or more messages from inbox to the Junk folder: "J47 NO [CANNOT] Failed to copy to temporary file (0.000 + 0.000 secs).?. Command attempted: ?J47 UID MOVE 106318:106319 Junk" or sometimes "J123 NO [CANNOT] Failed to read mail beginning (0.000 + 0.000 secs).?. Command attempted: ?J123 UID MOVE 170789:170790 Junk" and still have the "Cached message size smaller..." in dovecot logs. It occurs at least when header lines of an email contains Non-ASCII Text (rfc1342). Batches of full ascii emails are not affected. I can easily reproduce this from/to the Junk folder, but had unconfirmed reports of similar errors when batch moving mails across regular folders. St?phane On 8 Nov 2015, at 11:50, St?phane Cottin wrote: > Hi, > > I've got some trouble with the dovecot antispam plugin and the pipe > backend. > > I'm using dovecot 2.2.18 with maildirs and zlib compression enabled. > > When moving 2 or more emails at once from the Junk folder to another > one, I always have the following error : "Failed to copy to temporary > file" > > In the server logs : > > imap(vvv at vvv.vvv): Error: > read(zlib(/data/Maildir/.test/tmp/1446974366.M123890P936.vvv)) failed: > Cached message size smaller than expected (13553 < 13562, box=test, > UID=0) > > The same operation with one email at a time, on the same emails, works > as expected. > > St?phane From CMarcus at Media-Brokers.com Mon Apr 18 16:02:28 2016 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Mon, 18 Apr 2016 12:02:28 -0400 Subject: [Dovecot] Patch: 2.0 support for URLAUTH, BURL, CATENATE In-Reply-To: <8988EDBE-A0EB-430C-85F3-EBCE288D9D88@apple.com> References: <6CE12CFB-C787-415F-B826-8DD8DA9EE6C4@apple.com> <1276287028.22134.152.camel@kurkku.sapo.corppt.com> <1291612654.5359.63.camel@kurkku.sapo.corppt.com> <8988EDBE-A0EB-430C-85F3-EBCE288D9D88@apple.com> Message-ID: <57150514.80406@Media-Brokers.com> Greetings Mike and Timo, A question about BURL support in Thunderbird came up, and while there is an open bug, it apparently is still not implemented. I'd love to see this get done, so I've been checking on the status of this in both postfix and dovecot... Can someone comment on whether or not this was ever fully/properly implemented? */Charles/*/* */ On 1/14/2011 12:35 PM, Mike Abbott wrote: > On Dec 5, 2010, at 11:17 PM, Timo Sirainen wrote: > >> I don't think there's any need to send "anonymous_username" to imap >> process? It just seems to want to know if the current user is anonymous >> or not. That same thing has been in my TODO list for a while already >> because ManageSieve could use that information too. So committed now: >> http://hg.dovecot.org/dovecot-2.0/rev/c41ba33b8e16 > I just tried out this change and it does not replace the need for the anonymous_username field. I only now fully understand the comment: > /* this is an anonymous login, either via ANONYMOUS > SASL mechanism or simply logging in as the anonymous > user via another mechanism */ > Since the change does not distinguish between those two cases it breaks the "authuser" access identifier for the anonymous user when he is logged in non-anonymously. I would not really care about this edge case except that the contributed implementation requires that the username in the IMAP URL matches the authenticated user's username even for the "anonymous" and "authuser" access identifiers, in violation of RFC 4467 section 4. (The implementation requires a match because Dovecot does not (can not) reach into another user's mail storage.) This means that the "anonymous" and "authuser" access identifiers only work for the anonymous user in the implementation; your change makes the "authuser" access identifier always fail for the anonymous user. The anonymous_username field in the original contributed patch does distinguish between SASL ANONYMOUS and logging in as the anonymous user via another mechanism, so the "anonymous" and "authuser" access identifiers work properly for the anonymous user (but not for any other user). > > If you can teach me how to make urlfetch_url() access any user's mail storage from an IMAP process logged in as a different user (subject to OS uid/gid permission constraints), I can make "anonymous" and "authuser" work for all users and use your change instead of the "anonymous_username" field. > > Alternatively, you could edit your change to add the "anonymous" indication to the auth reply only for SASL ANONYMOUS authentications rather than for all anonymous-user authentications, unless that would cause trouble for ManageSieve. From stephan at rename-it.nl Mon Apr 18 16:35:47 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 18 Apr 2016 18:35:47 +0200 Subject: [Dovecot] Patch: 2.0 support for URLAUTH, BURL, CATENATE In-Reply-To: <57150514.80406@Media-Brokers.com> References: <6CE12CFB-C787-415F-B826-8DD8DA9EE6C4@apple.com> <1276287028.22134.152.camel@kurkku.sapo.corppt.com> <1291612654.5359.63.camel@kurkku.sapo.corppt.com> <8988EDBE-A0EB-430C-85F3-EBCE288D9D88@apple.com> <57150514.80406@Media-Brokers.com> Message-ID: <57150CE3.3070508@rename-it.nl> Op 18-4-2016 om 18:02 schreef Charles Marcus: > Greetings Mike and Timo, > > A question about BURL support in Thunderbird came up, and while there is > an open bug, it apparently is still not implemented. > > I'd love to see this get done, so I've been checking on the status of > this in both postfix and dovecot... > > Can someone comment on whether or not this was ever fully/properly > implemented? Status: URLAUTH - Fully implemented. CATENATE - Fully implemented. BURL - Not really a Dovecot concern, but we've created a Dovecot-based SMTP submission proxy that adds BURL and other advanced functionality to any SMTP backend. This feature is currently a set of patches that is scheduled to be merged for Dovecot v2.3. The Dovecot v2.3 branch was started just a few days ago. Regards, Stephan. > > > */Charles/*/* > > > */ > On 1/14/2011 12:35 PM, Mike Abbott wrote: >> On Dec 5, 2010, at 11:17 PM, Timo Sirainen wrote: >> >>> I don't think there's any need to send "anonymous_username" to imap >>> process? It just seems to want to know if the current user is anonymous >>> or not. That same thing has been in my TODO list for a while already >>> because ManageSieve could use that information too. So committed now: >>> http://hg.dovecot.org/dovecot-2.0/rev/c41ba33b8e16 >> I just tried out this change and it does not replace the need for the anonymous_username field. I only now fully understand the comment: >> /* this is an anonymous login, either via ANONYMOUS >> SASL mechanism or simply logging in as the anonymous >> user via another mechanism */ >> Since the change does not distinguish between those two cases it breaks the "authuser" access identifier for the anonymous user when he is logged in non-anonymously. I would not really care about this edge case except that the contributed implementation requires that the username in the IMAP URL matches the authenticated user's username even for the "anonymous" and "authuser" access identifiers, in violation of RFC 4467 section 4. (The implementation requires a match because Dovecot does not (can not) reach into another user's mail storage.) This means that the "anonymous" and "authuser" access identifiers only work for the anonymous user in the implementation; your change makes the "authuser" access identifier always fail for the anonymous user. The anonymous_username field in the original contributed patch does distinguish between SASL ANONYMOUS and logging in as the anonymous user via another mechanism, so the "anonymous" and "authuser" access identifiers work properly for the anonymous user (but not for any other user). >> >> If you can teach me how to make urlfetch_url() access any user's mail storage from an IMAP process logged in as a different user (subject to OS uid/gid permission constraints), I can make "anonymous" and "authuser" work for all users and use your change instead of the "anonymous_username" field. >> >> Alternatively, you could edit your change to add the "anonymous" indication to the auth reply only for SASL ANONYMOUS authentications rather than for all anonymous-user authentications, unless that would cause trouble for ManageSieve. From aki.tuomi at dovecot.fi Tue Apr 19 09:55:55 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Tue, 19 Apr 2016 12:55:55 +0300 Subject: Foreman component Message-ID: <571600AB.8020900@dovecot.fi> Hi! I am planning to add foreman component to dovecot core and I am hoping for some feedback: Foreman - generic per-user worker handling component It is responsible for managing worker pools per protocol, lifecycle management of workers and handing out instances to others, as in, unix socket connections. Each time a request is made to foreman for a worker, the worker is instantiated (if possible) and locked. Then connection is created to the socket of the worker, and the file descriptor is returned to requestor. When the requestor has completed the task, it's responsibility is to close the DATA channel and also ask foreman to unlock the worker. Components can register new workers using lib-foreman's API. Each worker is registered with struct foreman_worker { const char *protocol; const char *path; const char *version; unsigned int max_instances; unsigned int max_requests; /* how many requests one worker can handle */ unsigned int max_idletime_secs; /* how long worker can idle */ unsigned int max_processtime_secs; /* how long worker can process something */ unsigned int max_lifetime_secs; /* how long a worker can live this can be exceeded if the worker has work to do. */ }; /* minimum lifetime of worker: max_idletime_secs */ /* absolute maximum lifetime of worker: max_lifetime_secs + max_processtime_secs */ The unsigned ints are optional. If they are not defined, the workers are kept until foreman exceeds the total number of workers permitted across pools. Pools are per-worker-class pools, and are generated when a worker is registered. Version specifies the protocol version and is going to be "1000" now. Next version will always be 1001, 1002 etc. Any feedback or questions are welcome! Aki From Ron at Cleven.com Tue Apr 19 12:52:42 2016 From: Ron at Cleven.com (Ron Cleven) Date: Tue, 19 Apr 2016 07:52:42 -0500 (CDT) Subject: Reappearing emails (resolved by 2.2.23) In-Reply-To: References: Message-ID: <57162A20.6060301@Cleven.com> > ------------------------------ > > Message: 6 > Date: Wed, 16 Mar 2016 16:58:49 +1100 > From: Timo Sirainen > To: Dovecot Mailing List > Subject: Re: Reappearing emails - IMAP trace > Message-ID:<4C26CC22-7C7D-4D91-A767-4E5B3D1F12BA at iki.fi> > Content-Type: text/plain; charset=us-ascii > > What mailbox format do you use? Are you able to reproduce this by running doveadm sync commands manually instead of letting replication do it? For example: > > - doveadm sync -s "" -d -u user at domain > state > - Run the UID STORE & UID MOVE > - doveadm sync -s "`cat state`" -d -u user at domain > > There have been some fixes, especially recentlyhttps://github.com/dovecot/core/commit/950a6e61d6c2dac961ce031bdd8b2895bc32b827 sounds a bit similar although I don't really see how it would apply here. Would be a good idea to try anyway with v2.2.22.rc1 (which seems to be stable enough that I'll make v2.2.22 release soon). > > Anyway, I attempted a few times to reproduce it with your test but wasn't able to. We had been running 2 replicating servers (Maildir format) using version 2.2.10 under CentOS 7 in production for quite some time. In this forum, I reported a problem that I traced to a timing problem where unread emails being moved to Trash would magically reappear in the INBOX. I have since upgraded our production servers to 2.2.23. The new version resolved the problem. The version upgrade also resolved the occasional, but annoying, dsync maillog entries "Duplicate file entry at line ...". So, I am a very happy camper and appreciate the feedback. From bkuhn at ebb.org Tue Apr 19 18:01:36 2016 From: bkuhn at ebb.org (Bradley M. Kuhn) Date: Tue, 19 Apr 2016 11:01:36 -0700 Subject: sieve vacation: write to the .lda-dupes database without generating a vacation response. Message-ID: <87shyhtr3z.fsf@ebb.org> I'm using Dovecot's sieve extensions quite happily, they are very good! Thanks for all who worked on them. I have a question that maybe is appropriate for a sieve-specific discussion list, so if there is one I should post to instead, please let me know: I've poked through the sieve vacation RFC and all the documentation I can find and I cannot figure out how to do this. It's more-or-less not the intent of sieve's vacation, so perhaps it's more of a "you can't get there from here" situation, but maybe folks here have an idea: I am (ab)?using sieve vacation to send an automated response at all times to all senders who put me in the To line, every 90 days, which explains my lack of responsiveness and to explain who else might be better contact. (I have hundreds of emails sent to me to which I will never have time to respond, and probably should have been routed to someone else at my organization anyway.) However, I *don't* want my regular correspondents to receive this autoreply. I'd thus like to seed the database with known individuals I'm corresponding with to pretend they've already received the autoresponder. Since I bcc an archive address on all emails, my original thought was to detect people in the To and Cc line of outgoing emails and record them in the .lda-dupes database, as they received a vacation email. I can't figure out how to do this; there is no option on the sieve vacation directive that I can find to do something like this (i.e., I'm looking for a a "do the usual, but *don't* actually send the the email" option on the sieve vacation directive). I do have various other solutions that help in this regard, for example, I never send a vacation email to messages that match: header :contains "In-Reply-To" "@example.org" (where example.org is my domain). This helps, but obviously doesn't handle the situation where the correspondent doesn't reply to one of my emails, or had a stupid MUA. Furthermore, I'd like to implement as many methods as possible for my regular corespondents to limit their receipt of the autoresponder. Any ideas? Thanks in advance for any help or advice you can give! -- -- bkuhn ======================================================================== Become a Conservancy Supporter today: https://sfconservancy.org/supporter From tom at whyscream.net Tue Apr 19 18:55:50 2016 From: tom at whyscream.net (Tom Hendrikx) Date: Tue, 19 Apr 2016 20:55:50 +0200 Subject: sieve vacation: write to the .lda-dupes database without generating a vacation response. In-Reply-To: <87shyhtr3z.fsf@ebb.org> References: <87shyhtr3z.fsf@ebb.org> Message-ID: <57167F36.60302@whyscream.net> On 19-04-16 20:01, Bradley M. Kuhn wrote: > I'm using Dovecot's sieve extensions quite happily, they are very good! > Thanks for all who worked on them. I have a question that maybe is > appropriate for a sieve-specific discussion list, so if there is one I > should post to instead, please let me know: > > > I've poked through the sieve vacation RFC and all the documentation I > can find and I cannot figure out how to do this. It's more-or-less not > the intent of sieve's vacation, so perhaps it's more of a "you can't get > there from here" situation, but maybe folks here have an idea: > > I am (ab)?using sieve vacation to send an automated response at all > times to all senders who put me in the To line, every 90 days, which > explains my lack of responsiveness and to explain who else might be > better contact. (I have hundreds of emails sent to me to which I will > never have time to respond, and probably should have been routed to > someone else at my organization anyway.) > > However, I *don't* want my regular correspondents to receive this > autoreply. I'd thus like to seed the database with known individuals > I'm corresponding with to pretend they've already received the > autoresponder. > You shouldn't try to force feed the dupes files, that's a hack: the dupes files has no public api so you probably shouldnt be messing with it directly. A proper solution would be to include a list of excluded addresses in the sieve script, and exempt those from the autoresponder, maybe something like this: require "envelope"; require "variables"; set :lower "whitelist" "first at example,com second at example.com"; if envelope :matches "from" "*" { set :lower "sender" "${0}"; if string :matches "${sender}" "${whitelist}" { # do nothing, sender is on whitelist } else{ # do regular autoresponder stuff } } The whitelist variable could be auto generated and updated from your address book or archive box parser. I have no idea if this actually scales. You could also implement the whitelist variable using extdata (http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extdata), or outsource the complete whitelist check to an external program (a trivial script in a real programming language) using extprograms's "execute" (http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extprograms). Good luck! Kind regards, Tom -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From rs at sys4.de Tue Apr 19 19:10:54 2016 From: rs at sys4.de (Robert Schetterer) Date: Tue, 19 Apr 2016 21:10:54 +0200 Subject: sieve vacation: write to the .lda-dupes database without generating a vacation response. In-Reply-To: <57167F36.60302@whyscream.net> References: <87shyhtr3z.fsf@ebb.org> <57167F36.60302@whyscream.net> Message-ID: <571682BE.8020801@sys4.de> Am 19.04.2016 um 20:55 schrieb Tom Hendrikx: > On 19-04-16 20:01, Bradley M. Kuhn wrote: >> I'm using Dovecot's sieve extensions quite happily, they are very good! >> Thanks for all who worked on them. I have a question that maybe is >> appropriate for a sieve-specific discussion list, so if there is one I >> should post to instead, please let me know: >> >> >> I've poked through the sieve vacation RFC and all the documentation I >> can find and I cannot figure out how to do this. It's more-or-less not >> the intent of sieve's vacation, so perhaps it's more of a "you can't get >> there from here" situation, but maybe folks here have an idea: >> >> I am (ab)?using sieve vacation to send an automated response at all >> times to all senders who put me in the To line, every 90 days, which >> explains my lack of responsiveness and to explain who else might be >> better contact. (I have hundreds of emails sent to me to which I will >> never have time to respond, and probably should have been routed to >> someone else at my organization anyway.) >> >> However, I *don't* want my regular correspondents to receive this >> autoreply. I'd thus like to seed the database with known individuals >> I'm corresponding with to pretend they've already received the >> autoresponder. >> > > You shouldn't try to force feed the dupes files, that's a hack: the > dupes files has no public api so you probably shouldnt be messing with > it directly. > A proper solution would be to include a list of excluded addresses in > the sieve script, and exempt those from the autoresponder, maybe > something like this: > > require "envelope"; > require "variables"; > > set :lower "whitelist" "first at example,com second at example.com"; > > if envelope :matches "from" "*" { > set :lower "sender" "${0}"; > if string :matches "${sender}" "${whitelist}" { > # do nothing, sender is on whitelist > } else{ > # do regular autoresponder stuff > } > } > > The whitelist variable could be auto generated and updated from your > address book or archive box parser. > > I have no idea if this actually scales. You could also implement the > whitelist variable using extdata > (http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extdata), or > outsource the complete whitelist check to an external program (a trivial > script in a real programming language) using extprograms's "execute" > (http://wiki2.dovecot.org/Pigeonhole/Sieve/Plugins/Extprograms). > > Good luck! > > Kind regards, > Tom > at sometime in the future https://tools.ietf.org/html/draft-ietf-sieve-external-lists-10 may solve such cases Best Regards MfG Robert Schetterer -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From stephan at rename-it.nl Tue Apr 19 22:13:48 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 20 Apr 2016 00:13:48 +0200 Subject: sieve vacation: write to the .lda-dupes database without generating a vacation response. In-Reply-To: <87shyhtr3z.fsf@ebb.org> References: <87shyhtr3z.fsf@ebb.org> Message-ID: <5716AD9C.8010904@rename-it.nl> Op 4/19/2016 om 8:01 PM schreef Bradley M. Kuhn: > I'm using Dovecot's sieve extensions quite happily, they are very good! > Thanks for all who worked on them. I have a question that maybe is > appropriate for a sieve-specific discussion list, so if there is one I > should post to instead, please let me know: > > > I've poked through the sieve vacation RFC and all the documentation I > can find and I cannot figure out how to do this. It's more-or-less not > the intent of sieve's vacation, so perhaps it's more of a "you can't get > there from here" situation, but maybe folks here have an idea: > > I am (ab)?using sieve vacation to send an automated response at all > times to all senders who put me in the To line, every 90 days, which > explains my lack of responsiveness and to explain who else might be > better contact. (I have hundreds of emails sent to me to which I will > never have time to respond, and probably should have been routed to > someone else at my organization anyway.) > > However, I *don't* want my regular correspondents to receive this > autoreply. I'd thus like to seed the database with known individuals > I'm corresponding with to pretend they've already received the > autoresponder. > > Since I bcc an archive address on all emails, my original thought was to > detect people in the To and Cc line of outgoing emails and record them > in the .lda-dupes database, as they received a vacation email. I can't > figure out how to do this; there is no option on the sieve vacation > directive that I can find to do something like this (i.e., I'm looking > for a a "do the usual, but *don't* actually send the the email" option > on the sieve vacation directive). > > I do have various other solutions that help in this regard, for example, > I never send a vacation email to messages that match: > header :contains "In-Reply-To" "@example.org" > (where example.org is my domain). > > This helps, but obviously doesn't handle the situation where the > correspondent doesn't reply to one of my emails, or had a stupid MUA. > > Furthermore, I'd like to implement as many methods as possible for my > regular corespondents to limit their receipt of the autoresponder. You could use the "duplicate" extension: https://tools.ietf.org/html/rfc7352 I haven't thought this through much, but on first glance it should - together with your Bcc archiving - be flexible enough allow you remember responding to certain individuals. Just read the RFC and play with the "duplicate" test a bit and get back here if you have any questions. Regards, Stephan. From stephan at rename-it.nl Tue Apr 19 22:18:25 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 20 Apr 2016 00:18:25 +0200 Subject: sieve vacation: write to the .lda-dupes database without generating a vacation response. In-Reply-To: <571682BE.8020801@sys4.de> References: <87shyhtr3z.fsf@ebb.org> <57167F36.60302@whyscream.net> <571682BE.8020801@sys4.de> Message-ID: <5716AEB1.9050307@rename-it.nl> Op 4/19/2016 om 9:10 PM schreef Robert Schetterer: > Am 19.04.2016 um 20:55 schrieb Tom Hendrikx: >> On 19-04-16 20:01, Bradley M. Kuhn wrote: >>> I'm using Dovecot's sieve extensions quite happily, they are very good! >>> Thanks for all who worked on them. I have a question that maybe is >>> appropriate for a sieve-specific discussion list, so if there is one I >>> should post to instead, please let me know: >>> >>> >>> I've poked through the sieve vacation RFC and all the documentation I >>> can find and I cannot figure out how to do this. It's more-or-less not >>> the intent of sieve's vacation, so perhaps it's more of a "you can't get >>> there from here" situation, but maybe folks here have an idea: >>> >>> I am (ab)?using sieve vacation to send an automated response at all >>> times to all senders who put me in the To line, every 90 days, which >>> explains my lack of responsiveness and to explain who else might be >>> better contact. (I have hundreds of emails sent to me to which I will >>> never have time to respond, and probably should have been routed to >>> someone else at my organization anyway.) >>> >>> However, I *don't* want my regular correspondents to receive this >>> autoreply. I'd thus like to seed the database with known individuals >>> I'm corresponding with to pretend they've already received the >>> autoresponder. > at sometime in the future > > https://tools.ietf.org/html/draft-ietf-sieve-external-lists-10 > > may solve such cases It is an RFC already: https://tools.ietf.org/html/rfc6134 It's on my list for implementation. I've recently implemented something quite similar, so it shouldn't be extremely difficult. It's just that v2.3 development will go first. Regards, Stephan. From braden at endoframe.com Tue Apr 19 23:56:04 2016 From: braden at endoframe.com (Braden McDaniel) Date: Tue, 19 Apr 2016 19:56:04 -0400 Subject: GSSAPI authentication setup In-Reply-To: <5714C9BD.2050804@dovecot.fi> References: <1460842913.3259.32.camel@endoframe.com> <1529302712.47523.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> <1460956402.3259.41.camel@endoframe.com> <1519590920.47956.b1a7cf3f-f47b-4008-b177-2f0e5f195058.open-xchange@appsuite.open-xchange.com> <1460978545.3259.43.camel@endoframe.com> <5714C9BD.2050804@dovecot.fi> Message-ID: <1461110164.3259.57.camel@endoframe.com> On Mon, 2016-04-18 at 14:49 +0300, Aki Tuomi wrote: > > There was previous case where gssapi did not work with Thunderbird. > It > apparently has some problems with GSSAPI usage. I'm using Evolution; but note the telnet session. ?I'll beat mail clients into submission later. I found the problem: I had not made the keytab file on the mail server readable by the dovecot process. (Yes, I'm well aware the wiki mentions this; and I probably read that sentence at least a half dozen times without it really registering with me. ?Ahem.) Thank you for your assistance. -- Braden McDaniel From bill-dovecot at carpenter.org Wed Apr 20 02:17:49 2016 From: bill-dovecot at carpenter.org (WJCarpenter) Date: Tue, 19 Apr 2016 19:17:49 -0700 Subject: expunging messages doesn't update maildirsize Message-ID: <5716E6CD.6050101@carpenter.org> This might be something that everybody thinks of as a well-known fact, but I've been searching around quite a bit without finding anything definitive. Maybe I just have the wrong idea of what's supposed to be going on. I'm using maildir+ quotas. For arriving mail, it works as I expect: new lines are appended to maildirsize to reflect the size of the new messages. But I also expected that mail that is deleted (and expunged, yes totally gone from the disk drive, verified from the command line) would lead to some kind of update to maildirsize or maybe even a complete recalculation. But that does not happen on my system (dovecot 2.2.9 on a Ubuntu variant). Now, I know that I can run "doveadm" from a cron job or whatever to have the maildirsize info recomputed. I also know that the maildirsize file will be recreated when it gets larger than 4k. That's all fine. But I don't see why I should have to have this out-of-band cron job, and I don't see why my users should have to wait if their maildirsize file doesn't tip over the magical 4k mark (which is a lot of individual messages being recorded). Is it by design that dovecot doesn't update maildirsize immediately when messages are expunged? If yes, why? From skdovecot at smail.inf.fh-brs.de Wed Apr 20 05:35:38 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Wed, 20 Apr 2016 07:35:38 +0200 (CEST) Subject: Foreman component In-Reply-To: <571600AB.8020900@dovecot.fi> References: <571600AB.8020900@dovecot.fi> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Tue, 19 Apr 2016, Aki Tuomi wrote: Hi Aki, > > I am planning to add foreman component to dovecot core and I am hoping > for some feedback: > > Foreman - generic per-user worker handling component > > It is responsible for managing worker pools per protocol, lifecycle > management of workers and handing out instances to others, as in, unix > socket connections. > > Each time a request is made to foreman for a worker, the worker is > instantiated (if possible) and locked. Then connection is created to the > socket of the worker, and the file descriptor is returned to requestor. this is not like a multiplexor, that forwards the data between client and worker, but Forman will pass the new fd back to the client and may close the connection to it, right? Like: http://man7.org/tlpi/code/online/dist/sockets/scm_rights_send.c.html http://keithp.com/blogs/fd-passing/ > When the requestor has completed the task, it's responsibility is to > close the DATA channel and also ask foreman to unlock the worker. If the client abends, Foreman would held the worker locked forever. Workers should notify their Foreman, that they are ready to take another task. Or, when a new client wants to make a connection to a worker, Foreman could probe unlocked workers first, then locked workers, if they are available. So the "locked" state is more a soft rather than a hard condition. > Components can register new workers using lib-foreman's API. Each worker > is registered with > > struct foreman_worker { > const char *protocol; > const char *path; > const char *version; > unsigned int max_instances; > unsigned int max_requests; /* how many requests one worker can handle */ > unsigned int max_idletime_secs; /* how long worker can idle */ > unsigned int max_processtime_secs; /* how long worker can process > something */ > unsigned int max_lifetime_secs; /* how long a worker can live > this can be exceeded if the worker > has work to do. */ > }; > > /* minimum lifetime of worker: max_idletime_secs */ > /* absolute maximum lifetime of worker: max_lifetime_secs + > max_processtime_secs */ > > The unsigned ints are optional. If they are not defined, the workers are > kept until foreman exceeds the total number of workers permitted across > pools. > > Pools are per-worker-class pools, and are generated when a worker is > registered. > > Version specifies the protocol version and is going to be "1000" now. > Next version will always be 1001, 1002 etc. > Any feedback or questions are welcome! > > Aki > > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVxcVKnz1H7kL/d9rAQJEnAf9H7qUT5AGVaaUkuRO24rtymCxGa2Pqupl jyYARY4P7hwUVohe+f4WeaPtppq7hzpzpJeVsh3oSsDOm1q96SFGzlGMZALurW78 P4Yqn0OwJXAfGF6g/84PKd+kNum+a9aXVOjHcGMsqpXg8UlVTnz3NrrrG/sGdKna 4cLOlorrITQ38Mo/bjPBxP2BMhUhGRib8pIk6fND25OOJwN0NH420AvXOl80aGa6 a6jJhE80qHaAWDwhpU8Oj09AvD8/WNY172Bg7UjHQhrczQKRRp4dGWIDXVMnm2wd HK9MriOubvdZ4hcSs56W0GsFnY/p8saT+e+94ruT8OPbUrEyYFu1zg== =B3I3 -----END PGP SIGNATURE----- From Christoph.Adomeit at gatworks.de Wed Apr 20 08:29:37 2016 From: Christoph.Adomeit at gatworks.de (Christoph Adomeit) Date: Wed, 20 Apr 2016 10:29:37 +0200 Subject: Deliver same E-Mail in same Mailbox only once ? Message-ID: <20160420082937.GA29067@mp3.niederrhein.de> Hi there, I have a customer with domain a at tld and domain b at tld. b.tld is an alias for a.tld The Server is using virtual users based on mysql, dovecot for delivery and Maildir for Mail-Storage. If someone writes an e-mail to a.tld with a cc: to b.tld the customer receives the E-Mail twice. Is there a way to deliver the same Mail in the same Mailbox only once ? -- Christoph Adomeit GATWORKS GmbH Reststrauch 191 41199 Moenchengladbach Sitz: Moenchengladbach Amtsgericht Moenchengladbach, HRB 6303 Geschaeftsfuehrer: Christoph Adomeit, Hans Wilhelm Terstappen Christoph.Adomeit at gatworks.de Internetloesungen vom Feinsten Fon. +49 2166 9149-32 Fax. +49 2166 9149-10 From tlx at leuxner.net Wed Apr 20 09:04:22 2016 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 20 Apr 2016 11:04:22 +0200 Subject: Deliver same E-Mail in same Mailbox only once ? In-Reply-To: <20160420082937.GA29067@mp3.niederrhein.de> References: <20160420082937.GA29067@mp3.niederrhein.de> Message-ID: <20160420090400.GA56879@nihlus.leuxner.net> * Christoph Adomeit 2016.04.20 10:29: > Is there a way to deliver the same Mail in the same Mailbox only once ? Yes this case is supported via an sieve extension: require ["duplicate"]; #Deduplicate mails sent to aliases for same mailbox using the msgid if duplicate { discard; } -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: Digital signature URL: From hf at spg.tu-darmstadt.de Wed Apr 20 10:21:07 2016 From: hf at spg.tu-darmstadt.de (Hauke Fath) Date: Wed, 20 Apr 2016 12:21:07 +0200 Subject: Reappearing emails (resolved by 2.2.23 - not) In-Reply-To: <57162A20.6060301@Cleven.com> References: <57162A20.6060301@Cleven.com> Message-ID: <20160420122107256609.4dc46f6d@spg.tu-darmstadt.de> On Tue, 19 Apr 2016 07:52:42 -0500 (CDT), Ron Cleven wrote: > We had been running 2 replicating servers (Maildir format) using > version 2.2.10 under CentOS 7 in production for quite some time. In > this forum, I reported a problem that I traced to a timing problem > where unread emails being moved to Trash would magically reappear in > the INBOX. I have since upgraded our production servers to 2.2.23. > The new version resolved the problem. No Replication involved here, but - I have several user reports about re-appearing mails since updating Dovecot from 2.2.21 to 2.2.23. Clients are Thunderbird on Debian and Mac OS X, and GyazMail on Mac OS X. Looks like a recent regression to me? Cheerio, hauke -- The ASCII Ribbon Campaign Hauke Fath () No HTML/RTF in email Institut f?r Nachrichtentechnik /\ No Word docs in email TU Darmstadt Respect for open standards Ruf +49-6151-16-21344 From hs at schlittermann.de Wed Apr 20 17:31:00 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Wed, 20 Apr 2016 19:31:00 +0200 Subject: Deliver same E-Mail in same Mailbox only once ? In-Reply-To: <20160420090400.GA56879@nihlus.leuxner.net> References: <20160420082937.GA29067@mp3.niederrhein.de> <20160420090400.GA56879@nihlus.leuxner.net> Message-ID: <20160420173100.GR14754@jumper.schlittermann.de> Hi, Thomas Leuxner (Mi 20 Apr 2016 11:04:22 CEST): > * Christoph Adomeit 2016.04.20 10:29: > > > Is there a way to deliver the same Mail in the same Mailbox only once ? > > Yes this case is supported via an sieve extension: > require ["duplicate"]; > > > #Deduplicate mails sent to aliases for same mailbox using the msgid > if duplicate { > discard; > } I wouldn't do that. Message with the same message id doesn't need to be duplicates. See the difference between this message (I put you on BCC), you'll receive it via the mailing list AND directly. Depending on the ML configuration the messages are NOT identical. (ML signature, replaced Reply-To, added header lines, ?) Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From tlx at leuxner.net Wed Apr 20 18:18:25 2016 From: tlx at leuxner.net (Thomas Leuxner) Date: Wed, 20 Apr 2016 20:18:25 +0200 Subject: Deliver same E-Mail in same Mailbox only once ? In-Reply-To: <20160420173100.GR14754@jumper.schlittermann.de> References: <20160420082937.GA29067@mp3.niederrhein.de> <20160420090400.GA56879@nihlus.leuxner.net> <20160420173100.GR14754@jumper.schlittermann.de> Message-ID: <20160420181825.GA30263@nihlus.leuxner.net> * Heiko Schlittermann 2016.04.20 19:31: > > * Christoph Adomeit 2016.04.20 10:29: > > #Deduplicate mails sent to aliases for same mailbox using the msgid > > if duplicate { > > discard; > > } > > I wouldn't do that. Message with the same message id doesn't need to be > duplicates. See the difference between this message (I put you on BCC), > you'll receive it via the mailing list AND directly. Depending on the ML > configuration the messages are NOT identical. It really depends on the OPs requirements. The task was to filter cc: mails. Anyway if that is your concern, no message was discarded using bcc: Apr 20 19:31:13 nihlus dovecot: lmtp(27566): Connect from local Apr 20 19:31:13 nihlus dovecot: lmtp(tlx at leuxner.net): NbCKIuG8F1euawAAgUOSbA: sieve: msgid=<20160420173100.GR14754 at jumper.schlittermann.de>, time=115ms, status=stored mail into mailbox 'INBOX' Apr 20 19:31:13 nihlus dovecot: lmtp(27566): Disconnect from local: Successful quit Apr 20 19:31:24 nihlus dovecot: lmtp(27566): Connect from local Apr 20 19:31:25 nihlus dovecot: lmtp(tlx at leuxner.net): OrCKIuG8F1euawAAgUOSbA: sieve: msgid=<20160420173100.GR14754 at jumper.schlittermann.de>, time=117ms, status=stored mail into mailbox ':public/Mailing-Lists/Dovecot' Apr 20 19:31:25 nihlus dovecot: lmtp(tlx at leuxner.net): OrCKIuG8F1euawAAgUOSbA: sieve: msgid=<20160420173100.GR14754 at jumper.schlittermann.de>, time=117ms, status=marked message to be discarded if not explicitly delivered (discard action) Apr 20 19:31:25 nihlus dovecot: lmtp(27566): Disconnect from local: Successful quit Regards Thomas -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 181 bytes Desc: Digital signature URL: From stephan at rename-it.nl Wed Apr 20 19:21:11 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 20 Apr 2016 21:21:11 +0200 Subject: Deliver same E-Mail in same Mailbox only once ? In-Reply-To: <20160420173100.GR14754@jumper.schlittermann.de> References: <20160420082937.GA29067@mp3.niederrhein.de> <20160420090400.GA56879@nihlus.leuxner.net> <20160420173100.GR14754@jumper.schlittermann.de> Message-ID: <5717D6A7.9080709@rename-it.nl> Op 4/20/2016 om 7:31 PM schreef Heiko Schlittermann: > Hi, > > Thomas Leuxner (Mi 20 Apr 2016 11:04:22 CEST): >> * Christoph Adomeit 2016.04.20 10:29: >> >>> Is there a way to deliver the same Mail in the same Mailbox only once ? >> Yes this case is supported via an sieve extension: >> require ["duplicate"]; >> >> >> #Deduplicate mails sent to aliases for same mailbox using the msgid >> if duplicate { >> discard; >> } > I wouldn't do that. Message with the same message id doesn't need to be > duplicates. See the difference between this message (I put you on BCC), > you'll receive it via the mailing list AND directly. Depending on the ML > configuration the messages are NOT identical. The "duplicate" test allows more complex arguments to handle such concerns. This way, for example, the list-id header (if present) can also be part of the unique ID used for duplicate tracking. https://tools.ietf.org/html/rfc7352#section-3.1 Regards, Stephan. From tss at iki.fi Wed Apr 20 19:39:18 2016 From: tss at iki.fi (Timo Sirainen) Date: Wed, 20 Apr 2016 22:39:18 +0300 Subject: Foreman component In-Reply-To: <571600AB.8020900@dovecot.fi> References: <571600AB.8020900@dovecot.fi> Message-ID: <542FCE48-AA5E-4B44-8902-B1A8CF1EFC88@iki.fi> On 19 Apr 2016, at 12:55, Aki Tuomi wrote: > > I am planning to add foreman component to dovecot core and I am hoping > for some feedback: > > Foreman - generic per-user worker handling component First an explanation of what this was planned to be used for: Think about many short-lived JMAP (HTTP) connections with each connection creating a new jmap process that opens the user's mailbox, processes the JMAP command, closes the mailbox and kills the process. Repeat for each command. Not very efficient when the same jmap process could handle all of the user's JMAP requests. The same problem exists also with most webmails' IMAP connections that are very short-lived. One annoying problem with the foreman concept is that it requires an open UNIX socket for all the worker processes. Which could mean >10k open UNIX sockets, which all too often runs into file descriptor limits. We could of course just increase it high enough, and it probably would work ok.. But I also hate adding more of these "master" processes because they don't scale easily to multiple CPUs so they might become bottlenecks at some point (and some of these existing master processes already have become bottlenecks). I've been trying to figure out a nice solution for the above problem for years already, but never really came up with anything better. Except today finally I had the new realization that anvil process already contains all of the needed information. We don't need a new process containing duplicated data, just some expansion of anvil and master. Of course, anvil is still kind of a "master" process that knows about all users, but it's already there anyway. And there's the new idea of how to avoid a single process using a ton of sockets: (Talking only about IMAP here for clarity, but the same applies to POP3, JMAP and others.) - Today anvil already keeps track of (user, protocol, imap-process-pid), which is where "doveadm who" gets the user list. - Today imap-login process already does anvil lookup to see if the user has too many open connections. This lookup could be changed to also return the imap-process-pid[] array. - We'll add a new feature to Dovecot master: Ability to specify service imap { unix_listener /var/run/dovecot/login/imap-%{pid} { .. } }, which would cause such a UNIX socket path to be dynamically created for each created process. Only that one process is listening in the socket, master process itself wouldn't keep it open. When the process gets destroyed, the socket gets deleted automatically. - When imap process starts serving an IMAP connection, it does fchmod(socket, 0) for its imap-%{pid} listener. When it stops serving an active IMAP connection it does fchmod(socket, original-permissions). - imap-login process attempts to connect to each imap-%{pid} socket based on the imap-process-pid[] list returned by anvil. It ignores each EACCES failure, because those are already serving IMAP connections. If it succeeds in connecting, it sends the IMAP connection fd to it. If not, it connects to the default imap socket to create a new process. - The above method of trying to connect to every imap-process-pid[] is probaly efficient enough, although it probably ends up doing a lot of unnecessary connect() syscalls to sockets that are already handling existing connections. If this needs to be optimized, we could also enhance anvil to keep track of the "does this process have an active connection" flag and it would only return imap-process-pid[] for the processes without an active connection. There are of course some race conditions with this in any case but the worst that can happen is that a new imap process is created when there was another existing one already that could have served the connection, so slightly worse performance in some rare situations. These same per-process sockets might be useful for other purposes too.. I've many times wanted an ability to communicate with an existing process. The "ipc" process was an attempt to do something about it, but it's not very nice and has the same problems with potentially using a huge number of fds. Then there's the issue of how the management of idle processes (= processes with no active IMAP connections) goes: - service { idle_kill } already specifies when processes without clients are killed. We can use this here as well, so when IMAP connection has closed the process stays alive for idle_kill number of seconds until it gets closed. - If idle_kill times are set large enough on a busy system, we're usually reaching service { process_limit } constantly. So when no new processes can be created, we need the ability to kill an existing process instead. I think this is master process's job. When connection comes to "imap" and process_limit is reached, master picks the imap process with the longest idle-time and kills it (*). Then it waits for it to die and creates a new process afterwards. There's race condition here though and the process may not die but instead notify master that it's serving a new client. In this case master needs to retry with the next process. The process destroying might also not be fast always. To avoid unnecessarily large latencies due to waiting for process destruction, I think master should always try to stay a bit below process_limit (= a new service setting). - (*) I'm not sure if longest idle-time is the ideal algorithm. Some more heuristics would be useful, but this complicates master process too much. The processes themselves could try to influence master's decisions with some status notifications. For example if we've determined that user at example.com constantly logs in every 5 minutes, and the process has been idle for 4mins59 seconds, which is also the oldest idling process, we still don't want to kill it because we know that it's going to be recreated in 1 second anyway. This is probably not going to be in the first version though. From oliver at riesen.org Thu Apr 21 06:36:44 2016 From: oliver at riesen.org (Oliver Riesen-Mallmann) Date: Thu, 21 Apr 2016 08:36:44 +0200 Subject: Module is for different ABI version Message-ID: <571874FC.2000609@riesen.org> Hi, I'm using the Dovecot Prebuilt Binary: deb http://xi.rename-it.nl/debian/ stable-auto/dovecot-2.2 main It seems, that the Prebuilt Binary provided at least once the 2.3 version, because doveconf -n shows: # 2.3.devel (5e7036c): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (ef25ce6) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.10 Now Prebuilt Binary provides the 2.2 version again, but I get some error messages on updates: Preparing to replace dovecot-imapd 2:2.2.23-1~auto+14 (using .../dovecot-imapd_2%3a2.2.23-1~auto+16_amd64.deb) ... doveconf: Error: Couldn't load plugin /usr/lib/dovecot/modules/settings/libmanagesieve_login_settings.so: Module is for different ABI version 2.2.ABIv20(2.2.devel) (we have 2.3.ABIv0(2.3.devel)) doveconf: Error: Couldn't load plugin /usr/lib/dovecot/modules/settings/libmanagesieve_settings.so: Module is for different ABI version 2.2.ABIv20(2.2.devel) (we have 2.3.ABIv0(2.3.devel)) and: Preparing to replace dovecot-core 2:2.2.23-1~auto+14 (using .../dovecot-core_2%3a2.2.23-1~auto+16_amd64.deb) ... doveconf: Error: Couldn't load plugin /usr/lib/dovecot/modules/settings/libmanagesieve_login_settings.so: Module is for different ABI version 2.2.ABIv20(2.2.devel) (we have 2.3.ABIv0(2.3.devel)) doveconf: Error: Couldn't load plugin /usr/lib/dovecot/modules/settings/libmanagesieve_settings.so: Module is for different ABI version 2.2.ABIv20(2.2.devel) (we have 2.3.ABIv0(2.3.devel)) After the update doveconf -n shows: # 2.2.devel (8828071): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (ef25ce6) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.10 How can I go back to ABI version 2.2? Regards Oliver From alessio at skye.it Thu Apr 21 06:47:56 2016 From: alessio at skye.it (Alessio Cecchi) Date: Thu, 21 Apr 2016 08:47:56 +0200 Subject: Deliver same E-Mail in same Mailbox only once ? In-Reply-To: <20160420090400.GA56879@nihlus.leuxner.net> References: <20160420082937.GA29067@mp3.niederrhein.de> <20160420090400.GA56879@nihlus.leuxner.net> Message-ID: <5718779C.7080905@skye.it> Il 20/04/2016 11:04, Thomas Leuxner ha scritto: > * Christoph Adomeit 2016.04.20 10:29: > >> Is there a way to deliver the same Mail in the same Mailbox only once ? > > Yes this case is supported via an sieve extension: > > require ["duplicate"]; > > > #Deduplicate mails sent to aliases for same mailbox using the msgid > > if duplicate { > discard; > } > Hi, instead of discard I suggest to move the duplicate messagge in a folder: if duplicate { fileinto "Trash"; } so in case of necessity can be recovered. -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice From olfway at gmail.com Thu Apr 21 07:37:09 2016 From: olfway at gmail.com (Pavel Volkovitskiy) Date: Thu, 21 Apr 2016 10:37:09 +0300 Subject: UTF-8 encoded folders on filesystem Message-ID: Hello! I wonder if that possible to have utf-8 encoded folders on filesystem with dovecot? ?May be this feature planned already?? -- Pavel From tss at iki.fi Thu Apr 21 10:30:50 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Apr 2016 13:30:50 +0300 Subject: UTF-8 encoded folders on filesystem In-Reply-To: References: Message-ID: <2635ED99-F760-439A-83D1-006E050D034A@iki.fi> On 21 Apr 2016, at 10:37, Pavel Volkovitskiy wrote: > > Hello! > > > I wonder if that possible to have utf-8 encoded folders on filesystem with > dovecot? > > ?May be this feature planned already?? mail_location = ...:UTF-8 From oliver at riesen.org Thu Apr 21 10:48:16 2016 From: oliver at riesen.org (Oliver Riesen-Mallmann) Date: Thu, 21 Apr 2016 12:48:16 +0200 Subject: UTF-8 encoded folders on filesystem In-Reply-To: <2635ED99-F760-439A-83D1-006E050D034A@iki.fi> References: <2635ED99-F760-439A-83D1-006E050D034A@iki.fi> Message-ID: <5718AFF0.10003@riesen.org> Hi, > mail_location = ...:UTF-8 UTF-8 or UTF8? See http://dovecot.org/list/dovecot-cvs/2011-September/019148.html Documentation doesn't mention this setting... http://wiki.dovecot.org/MailLocation Regards Oliver From pali.rohar at gmail.com Thu Apr 21 10:50:25 2016 From: pali.rohar at gmail.com (Pali =?utf-8?B?Um9ow6Fy?=) Date: Thu, 21 Apr 2016 12:50:25 +0200 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <20160411104402.GR8413@pali> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <201604041935.23571@pali> <201604061629.43612@pali> <20160411104402.GR8413@pali> Message-ID: <20160421105025.GI29406@pali> On Monday 11 April 2016 12:44:02 Pali Roh?r wrote: > On Thursday 07 April 2016 16:11:12 Timo Sirainen wrote: > > On 06 Apr 2016, at 17:29, Pali Roh?r wrote: > > > > > > On Monday 04 April 2016 19:35:22 Pali Roh?r wrote: > > >> On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: > > >>> Can you please send them directly to me, please? > > >>> --- > > >>> Aki Tuomi > > >> > > >> Sent. > > > > > > Received? Are patches OK now? > > > > It would be nice if each commit was accompanied with the corresponding unit test change in test-message-address.c. Now that the unit test changes are done in a separate commit I'm not really sure which test change is testing which commit or if some tests are missing. At least the "Quote and escape strings if needed" patch needs more tests for different kinds of escapes/atext/non-atext chars and =? in strings. > > > > Ok. If you really need that I can rework my patches. But I'm thinking > what to do with tests... I have written lot of examples and tests > scenarios in perl for that new perl module. But dovecot test framework > is not easy to use as perl Test::More/Test::Spec and such complicated > tests which I have are really hard to write directory for dovecot... > > Anyway, are you recofigured dovecot mailing list filter to finally > accept git patches? Now you have all emails, so you should know what hit > "drop" action and probably also how to fix it... > PING! -- Pali Roh?r pali.rohar at gmail.com From giunta at sissa.it Thu Apr 21 11:03:06 2016 From: giunta at sissa.it (Marco Giunta) Date: Thu, 21 Apr 2016 13:03:06 +0200 Subject: problem with Sieve Duplicate Extension when used together with fileinto Message-ID: <5718B36A.3030500@sissa.it> Hi at all, I'm trying to figure out a problem with Sieve Duplicate Extension when used together with fileinto. I use a Dovecot 2.2.23 and Pigeonhole v0.4.13 I have a user (user01) with 3 email addresses (mail01 at example.com, mail02 at example.com, user01 at example.com); I want to discard duplicate, and I want to move email in different folder, so I'm using this sieve script: ---------------------------------------------- require ["fileinto", "duplicate", "imap4flags"]; if duplicate { discard; stop; } if address :is :all "to" "mail01 at example.com" { fileinto "mail01"; } if address :is :all "to" "mail02 at example.com" { fileinto "mail02"; } ------------------------------------- To make my test, I have a script that send always the same email; this is an example: ----------------------------------------- Delivered-To: user01 at example.com Received: from smtp-server.example.com ([192.168.1.214]) by lmtp-server.example.com (Dovecot) with LMTP id YSaBBU53GFdhbwAAIDyJFw for ; Thu, 21 Apr 2016 08:48:41 +0200 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Subject: TEST EMAIL From: myself at example.com To: mail01 at example.com, mail02 at example.com, user01 at example.com Date: Thu, 21 Apr 2016 08:48:41 +0200 Message-ID: <20160421064841.26889.86769 at kratos.example.com> This is a test email Please ignore me. -------------------------------------------- The problem is that duplicate extension doesn't ALWAYS work ; I mean, one time it works (sieve discard 2 duplicate mails), one time it doesn't work at all (sieve doesn't discard any mail), another time it works only for one mail (sieve discards only 1 mail) Here my server log: Apr 21 08:49:07 smtp-server dovecot: lmtp(user01 at example.com): 1dKXOMl3GFdibwAAIDyJFw: sieve: msgid=<20160421064906.26896.49900 at myhost.example.com>: stored mail into mailbox 'mail01' Apr 21 08:49:07 smtp-server dovecot: lmtp(user01 at example.com): 1dKXOMl3GFdibwAAIDyJFw: sieve: msgid=<20160421064906.26896.49900 at myhost.example.com>: stored mail into mailbox 'mail02' Apr 21 08:49:07 smtp-server dovecot: lmtp(user01 at example.com): oSM3And3GFdFaQAAIDyJFw: sieve: msgid=<20160421064906.26896.49900 at myhost.example.com>: marked message to be discarded if not explicitly delivered (discard action) Apr 21 08:49:07 smtp-server dovecot: lmtp(user01 at example.com): eY00CY93GFcucgAAIDyJFw: sieve: msgid=<20160421064906.26896.49900 at myhost.example.com>: marked message to be discarded if not explicitly delivered (discard action) Apr 21 08:49:13 smtp-server dovecot: lmtp(user01 at example.com): dSOyOtV3GFcmdAAAIDyJFw: sieve: msgid=<20160421064913.26904.88802 at myhost.example.com>: stored mail into mailbox 'mail01' Apr 21 08:49:13 smtp-server dovecot: lmtp(user01 at example.com): dSOyOtV3GFcmdAAAIDyJFw: sieve: msgid=<20160421064913.26904.88802 at myhost.example.com>: stored mail into mailbox 'mail02' Apr 21 08:49:13 smtp-server dovecot: lmtp(user01 at example.com): pSM3And3GFdFaQAAIDyJFw: sieve: msgid=<20160421064913.26904.88802 at myhost.example.com>: marked message to be discarded if not explicitly delivered (discard action) Apr 21 08:49:13 smtp-server dovecot: lmtp(user01 at example.com): vZWNOMl3GFcldAAAIDyJFw: sieve: msgid=<20160421064913.26904.88802 at myhost.example.com>: marked message to be discarded if not explicitly delivered (discard action) Apr 21 08:49:18 smtp-server dovecot: lmtp(user01 at example.com): eSOyOtV3GFcmdAAAIDyJFw: sieve: msgid=<20160421064918.26911.55371 at myhost.example.com>: stored mail into mailbox 'mail01' Apr 21 08:49:18 smtp-server dovecot: lmtp(user01 at example.com): qSM3And3GFdFaQAAIDyJFw: sieve: msgid=<20160421064918.26911.55371 at myhost.example.com>: stored mail into mailbox 'mail01' Apr 21 08:49:18 smtp-server dovecot: lmtp(user01 at example.com): qSM3And3GFdFaQAAIDyJFw: sieve: msgid=<20160421064918.26911.55371 at myhost.example.com>: stored mail into mailbox 'mail02' Apr 21 08:49:18 smtp-server dovecot: lmtp(user01 at example.com): aSaBBU53GFdhbwAAIDyJFw: sieve: msgid=<20160421064918.26911.55371 at myhost.example.com>: stored mail into mailbox 'mail01' Apr 21 08:49:18 smtp-server dovecot: lmtp(user01 at example.com): aSaBBU53GFdhbwAAIDyJFw: sieve: msgid=<20160421064918.26911.55371 at myhost.example.com>: stored mail into mailbox 'mail02' Apr 21 08:49:18 smtp-server dovecot: lmtp(user01 at example.com): eSOyOtV3GFcmdAAAIDyJFw: sieve: msgid=<20160421064918.26911.55371 at myhost.example.com>: stored mail into mailbox 'mail02' Apr 21 08:49:22 smtp-server dovecot: lmtp(user01 at example.com): rSM3And3GFdFaQAAIDyJFw: sieve: msgid=<20160421064922.26919.68793 at myhost.example.com>: stored mail into mailbox 'mail01' Apr 21 08:49:22 smtp-server dovecot: lmtp(user01 at example.com): rSM3And3GFdFaQAAIDyJFw: sieve: msgid=<20160421064922.26919.68793 at myhost.example.com>: stored mail into mailbox 'mail02' Apr 21 08:49:22 smtp-server dovecot: lmtp(user01 at example.com): YVCsNPJ3GFd1dgAAIDyJFw: sieve: msgid=<20160421064922.26919.68793 at myhost.example.com>: marked message to be discarded if not explicitly delivered (discard action) Apr 21 08:49:23 smtp-server dovecot: lmtp(user01 at example.com): bSaBBU53GFdhbwAAIDyJFw: sieve: msgid=<20160421064922.26919.68793 at myhost.example.com>: marked message to be discarded if not explicitly delivered (discard action) Apr 21 08:49:27 smtp-server dovecot: lmtp(user01 at example.com): fSOyOtV3GFcmdAAAIDyJFw: sieve: msgid=<20160421064927.26926.28383 at myhost.example.com>: stored mail into mailbox 'mail01' Apr 21 08:49:27 smtp-server dovecot: lmtp(user01 at example.com): sSM3And3GFdFaQAAIDyJFw: sieve: msgid=<20160421064927.26926.28383 at myhost.example.com>: stored mail into mailbox 'mail01' Apr 21 08:49:27 smtp-server dovecot: lmtp(user01 at example.com): sSM3And3GFdFaQAAIDyJFw: sieve: msgid=<20160421064927.26926.28383 at myhost.example.com>: stored mail into mailbox 'mail02' Apr 21 08:49:27 smtp-server dovecot: lmtp(user01 at example.com): fSOyOtV3GFcmdAAAIDyJFw: sieve: msgid=<20160421064927.26926.28383 at myhost.example.com>: stored mail into mailbox 'mail02' Apr 21 08:49:27 smtp-server dovecot: lmtp(user01 at example.com): ZVCsNPJ3GFd1dgAAIDyJFw: sieve: msgid=<20160421064927.26926.28383 at myhost.example.com>: marked message to be discarded if not explicitly delivered (discard action) As you can see, the message ID of a single sent, is the same, so the duplicate extension should work. If I replace the 'fileinto' rule with, for example, a 'setflag' rule: ----------------------------------------------- require ["fileinto", "duplicate", "imap4flags"]; if duplicate { discard; stop; } if address :is :all "to" "mail01 at example.com" { setflag "\\seen"; } if address :is :all "to" "mail02 at example.com" { setflag "\\seen"; } ---------------------------------------------- it works like a charm: for every mail sent, the duplicate extension works. What is it wrong ? someone has any clue ? Cheers, Marco -- Marco Giunta - ITCS SysAdmin Via Bonomea, 265 34136 - Trieste, Italy Tel: +39-040-3787-503 Fax: +39-040-3787-244 From aki.tuomi at dovecot.fi Thu Apr 21 11:10:05 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Thu, 21 Apr 2016 14:10:05 +0300 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <20160421105025.GI29406@pali> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <201604041935.23571@pali> <201604061629.43612@pali> <20160411104402.GR8413@pali> <20160421105025.GI29406@pali> Message-ID: <5718B50D.9010701@dovecot.fi> On 21.04.2016 13:50, Pali Roh?r wrote: > On Monday 11 April 2016 12:44:02 Pali Roh?r wrote: >> On Thursday 07 April 2016 16:11:12 Timo Sirainen wrote: >>> On 06 Apr 2016, at 17:29, Pali Roh?r wrote: >>>> On Monday 04 April 2016 19:35:22 Pali Roh?r wrote: >>>>> On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: >>>>>> Can you please send them directly to me, please? >>>>>> --- >>>>>> Aki Tuomi >>>>> Sent. >>>> Received? Are patches OK now? >>> It would be nice if each commit was accompanied with the corresponding unit test change in test-message-address.c. Now that the unit test changes are done in a separate commit I'm not really sure which test change is testing which commit or if some tests are missing. At least the "Quote and escape strings if needed" patch needs more tests for different kinds of escapes/atext/non-atext chars and =? in strings. >>> >> Ok. If you really need that I can rework my patches. But I'm thinking >> what to do with tests... I have written lot of examples and tests >> scenarios in perl for that new perl module. But dovecot test framework >> is not easy to use as perl Test::More/Test::Spec and such complicated >> tests which I have are really hard to write directory for dovecot... >> >> Anyway, are you recofigured dovecot mailing list filter to finally >> accept git patches? Now you have all emails, so you should know what hit >> "drop" action and probably also how to fix it... >> > PING! > Hi! Please see the other test-*.c files for information on how the unit tests are done. Aki From tss at iki.fi Thu Apr 21 11:24:09 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Apr 2016 14:24:09 +0300 Subject: [PATCH 0/7] Fixes for lib-mail message-address In-Reply-To: <20160411104402.GR8413@pali> References: <1459789983-10827-1-git-send-email-pali.rohar@gmail.com> <1659571648.16346.720408d5-801e-44fb-ac8f-1881f8bd92d1.open-xchange@appsuite.open-xchange.com> <201604041935.23571@pali> <201604061629.43612@pali> <20160411104402.GR8413@pali> Message-ID: <5ECC7DDB-9497-458A-8891-569386939F9D@iki.fi> On 11 Apr 2016, at 13:44, Pali Roh?r wrote: > > On Thursday 07 April 2016 16:11:12 Timo Sirainen wrote: >> On 06 Apr 2016, at 17:29, Pali Roh?r wrote: >>> >>> On Monday 04 April 2016 19:35:22 Pali Roh?r wrote: >>>> On Monday 04 April 2016 19:31:06 aki.tuomi at dovecot.fi wrote: >>>>> Can you please send them directly to me, please? >>>>> --- >>>>> Aki Tuomi >>>> >>>> Sent. >>> >>> Received? Are patches OK now? >> >> It would be nice if each commit was accompanied with the corresponding unit test change in test-message-address.c. Now that the unit test changes are done in a separate commit I'm not really sure which test change is testing which commit or if some tests are missing. At least the "Quote and escape strings if needed" patch needs more tests for different kinds of escapes/atext/non-atext chars and =? in strings. >> > > Ok. If you really need that I can rework my patches. But I'm thinking > what to do with tests... I have written lot of examples and tests > scenarios in perl for that new perl module. But dovecot test framework > is not easy to use as perl Test::More/Test::Spec and such complicated > tests which I have are really hard to write directory for dovecot... Although it would be nice to have a lot of unit tests for everything, I think it would be enough to have just some to show what the change actually fixes. Maybe even just in the git commit message. I remember that by looking at the patches I didn't completely understand what all of the changes did. > Anyway, are you recofigured dovecot mailing list filter to finally > accept git patches? Now you have all emails, so you should know what hit > "drop" action and probably also how to fix it... It was supposed to work already the previous time, but for some reason didn't. I've since disabled the reply-to checking entirely. From taropalo at kronometrix.org Thu Apr 21 11:33:52 2016 From: taropalo at kronometrix.org (Aropalo Tommi) Date: Thu, 21 Apr 2016 14:33:52 +0300 Subject: Setting up replication? In-Reply-To: <56F309FD.6030704@knutejohnson.com> References: <56F309FD.6030704@knutejohnson.com> Message-ID: <5718BAA0.1030908@kronometrix.org> >I'm trying to set up replication between two servers and I've hit a >snag. I have two users and am using mbox files. If anybody has a >sample config file for a simple system like mine I would really be >grateful to see it. >Thanks, >The error I'm getting is: >Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >user nobody: Initialization failed: Namespace '': >mkdir(/nonexistent/mail) failed: Permission denied (euid=65534(nobody) >egid=65534(nogroup)) >Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >dsync-server: User init failed >Mar 23 14:07:31 knute2 dovecot: doveadm(nobody): Error: sync: Failed >to >start dsync-server command: 75 >knute at knute2:/etc/dovecot/conf.d $ sudo doveadm user '*' >nobody >knute >penny You can add to conf.d/10-mail.conf first_valid_uid = 1000 last_valid_uid = 2000 You have nobody uid 65534 so make last_valid_uid less than you have in your /etc/passwd. Same thing with the first_valid_uid just pick first uid after users start in your /etc/passwd >I don't know why the user 'nobody' shows up here? nobody is in the >/etc/passwd file but he has no group. From dovecot at knutejohnson.com Thu Apr 21 16:51:45 2016 From: dovecot at knutejohnson.com (Knute Johnson) Date: Thu, 21 Apr 2016 09:51:45 -0700 Subject: Setting up replication? In-Reply-To: <5718BAA0.1030908@kronometrix.org> References: <56F309FD.6030704@knutejohnson.com> <5718BAA0.1030908@kronometrix.org> Message-ID: <57190521.2020407@knutejohnson.com> On 4/21/2016 04:33, Aropalo Tommi wrote: >> I'm trying to set up replication between two servers and I've hit a >> snag. I have two users and am using mbox files. If anybody has a >> sample config file for a simple system like mine I would really be >> grateful to see it. >> Thanks, >> The error I'm getting is: >> Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >> user nobody: Initialization failed: Namespace '': >> mkdir(/nonexistent/mail) failed: Permission denied (euid=65534(nobody) >> egid=65534(nogroup)) >> Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >> dsync-server: User init failed >> Mar 23 14:07:31 knute2 dovecot: doveadm(nobody): Error: sync: Failed >to >> start dsync-server command: 75 >> knute at knute2:/etc/dovecot/conf.d $ sudo doveadm user '*' >> nobody >> knute >> penny > You can add to conf.d/10-mail.conf > > first_valid_uid = 1000 > last_valid_uid = 2000 > > You have nobody uid 65534 so make last_valid_uid less than you have in > your /etc/passwd. Same thing with the first_valid_uid just pick first > uid after users start in your /etc/passwd > >> I don't know why the user 'nobody' shows up here? nobody is in the >> /etc/passwd file but he has no group. I really appreciate the response to my post as it is the only one I have gotten but that doesn't really solve the problem, in fact it generates even more errors: Apr 21 09:44:19 knute5 dovecot: doveadm(nobody): Error: sync: Failed to start dsync-server command: 75 Apr 21 09:44:34 knute5 dovecot: doveadm(216.240.58.140,nobody): Error: user nobody: Mail access for users with UID 65534 not permitted (see first_valid_uid in config file, uid from userdb lookup). Apr 21 09:44:34 knute5 dovecot: doveadm(216.240.58.140,nobody): Error: dsync-server: User init failed Do you know if there is a guide somewhere on how to set up replication? I would really like to get this to work. Thanks, -- Knute Johnson From tss at iki.fi Thu Apr 21 18:49:14 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Apr 2016 21:49:14 +0300 Subject: Randomly SSL Errors since upgrade to 2.2.23-1 (Enterprise Edition) In-Reply-To: <5710FCF4.80003@enas.net> References: <5710E92D.8060708@enas.net> <5710FCF4.80003@enas.net> Message-ID: <5A30D078-FC54-4D03-9CBC-1F0F6FF5FF2D@iki.fi> Fixed by https://github.com/dovecot/core/commit/b9e1531c80039ee75239d31cdad70d430d255974 > On 15 Apr 2016, at 17:38, Urban Loesch wrote: > > [UPDATE]: > > I digged deeper into my logs and I found that before the upgrade I got this errors: > ... > Apr 15 09:36:09 imap1 dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408E0F4:SSL routines:SSL3_GET_MESSAGE:unexpected message > Apr 15 09:37:56 imap1 dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408E0F4:SSL routines:SSL3_GET_MESSAGE:unexpected message > Apr 15 09:45:40 imap1 dovecot: imap-login: Disconnected (no auth attempts in 1 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408E0F4:SSL routines:SSL3_GET_MESSAGE:unexpected message > Apr 15 09:46:15 imap1 dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: error:1408E0F4:SSL routines:SSL3_GET_MESSAGE:unexpected message > ... > > After the upgrade the errors above stopped and now they look like this: > > .... > Apr 15 13:41:30 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac > Apr 15 13:41:30 imap1 dovecot: pop3-login: Disconnected (no auth attempts in 0 secs): user=<>, rip=x.x.x.x, lip=x.x.x.x, TLS handshaking: SSL_accept() failed: Unknown error > .... > > or > > .... > Apr 15 11:00:59 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown > Apr 15 11:00:59 imap1 dovecot: imap-login: proxy(user at domain.com): disconnecting x.x.x.x (Disconnected by client: read(size=1026) failed: Connection reset by peer(0s idle, in=467, out=384881)): user=, method=PLAIN, rip=x.x.x.x, lip=x.x.x.x, TLS: SSL_write() failed: Bad file descriptor, TLSv1 with cipher ECDHE-RSA-AES128-SHA (128/128 bits) > .... > > First I didn't see the first errors as they are only written to "mail.log" and not "mail.err" in Debian. > > So I think this is not really critical as there are no user complaints right now. > > Thanks > Urban Loesch > > > Am 15.04.2016 um 15:14 schrieb Urban Loesch: >> Hi, >> >> first of all, many thanks for a great piece of software. >> >> Today I updated one of our 2 IMAP/POP3 proxies from version 2.2.15.17-1 to 2.2.23.1-1 (both are enterprise editions). >> After the update I now see randomly the following errors in the log file on my first proxy: >> >> ... >> Apr 15 10:28:54 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac >> Apr 15 10:34:24 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac >> Apr 15 10:37:11 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 10:39:04 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac >> Apr 15 10:43:02 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 10:45:14 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac >> Apr 15 10:50:31 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 10:54:56 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac >> Apr 15 10:57:44 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 10:59:49 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 11:00:59 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 11:13:43 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:14094438:SSL routines:SSL3_READ_BYTES:tlsv1 alert internal error: SSL >> alert number 80 >> Apr 15 11:15:21 imap1 dovecot: imap-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 11:18:33 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 11:20:12 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:140D00CF:SSL routines:SSL_write:protocol is shutdown >> Apr 15 11:20:40 imap1 dovecot: pop3-login: Error: SSL: Stacked error: error:1408F119:SSL routines:SSL3_GET_RECORD:decryption failed or bad record mac >> ... >> >> Some more details: >> OS: Debian wheezy (latest patchlevel) >> >> Dovecot: >> ii dovecot-ee-core 2:2.2.23.1-1 >> ii dovecot-ee-imapd 2:2.2.23.1-1 >> ii dovecot-ee-managesieved 2:2.2.23.1-1 >> ii dovecot-ee-mysql 2:2.2.23.1-1 >> ii dovecot-ee-pop3d 2:2.2.23.1-1 >> ii dovecot-ee-sieve 2:2.2.23.1-1 >> >> Libssl: >> ii libssl1.0.0:amd64 1.0.1e-2+deb7u20 >> >> >> One my second proxy there is running also Debian Wheezy with the latest patchlevel but dovecot version 2.2.15.17-1 (not yet updated): >> ii dovecot-ee-core 1:2.2.15.17-1 >> ii dovecot-ee-imapd 1:2.2.15.17-1 >> ii dovecot-ee-managesieved 0.4.6-4 >> ii dovecot-ee-mysql 1:2.2.15.17-1 >> ii dovecot-ee-pop3d 1:2.2.15.17-1 >> ii dovecot-ee-sieve 0.4.6-4 >> >> On this box I can't see this strange errors. >> >> Until now there was no user that complaints that he can't read his mails. >> >> Do you know what could cause this errors (for example: very old clients and so on)? >> Or are the logging of this errors new in dovecot 2.2.23? >> >> Many thanks >> Urban Loesch >> From tss at iki.fi Thu Apr 21 18:52:41 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Apr 2016 21:52:41 +0300 Subject: UTF-8 encoded folders on filesystem In-Reply-To: <5718AFF0.10003@riesen.org> References: <2635ED99-F760-439A-83D1-006E050D034A@iki.fi> <5718AFF0.10003@riesen.org> Message-ID: > On 21 Apr 2016, at 13:48, Oliver Riesen-Mallmann wrote: > > Hi, > >> mail_location = ...:UTF-8 > > UTF-8 or UTF8? > See http://dovecot.org/list/dovecot-cvs/2011-September/019148.html Looks like the commit message was wrong. The code says UTF-8. > Documentation doesn't mention this setting... > http://wiki.dovecot.org/MailLocation Updated. From tss at iki.fi Thu Apr 21 19:01:19 2016 From: tss at iki.fi (Timo Sirainen) Date: Thu, 21 Apr 2016 22:01:19 +0300 Subject: Setting up replication? In-Reply-To: <57190521.2020407@knutejohnson.com> References: <56F309FD.6030704@knutejohnson.com> <5718BAA0.1030908@kronometrix.org> <57190521.2020407@knutejohnson.com> Message-ID: On 21 Apr 2016, at 19:51, Knute Johnson wrote: > > On 4/21/2016 04:33, Aropalo Tommi wrote: >>> I'm trying to set up replication between two servers and I've hit a >>> snag. I have two users and am using mbox files. If anybody has a >>> sample config file for a simple system like mine I would really be >>> grateful to see it. >>> Thanks, >>> The error I'm getting is: >>> Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >>> user nobody: Initialization failed: Namespace '': >>> mkdir(/nonexistent/mail) failed: Permission denied (euid=65534(nobody) >>> egid=65534(nogroup)) >>> Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >>> dsync-server: User init failed >>> Mar 23 14:07:31 knute2 dovecot: doveadm(nobody): Error: sync: Failed >to >>> start dsync-server command: 75 >>> knute at knute2:/etc/dovecot/conf.d $ sudo doveadm user '*' >>> nobody >>> knute >>> penny >> You can add to conf.d/10-mail.conf >> >> first_valid_uid = 1000 >> last_valid_uid = 2000 >> >> You have nobody uid 65534 so make last_valid_uid less than you have in >> your /etc/passwd. Same thing with the first_valid_uid just pick first >> uid after users start in your /etc/passwd >> >>> I don't know why the user 'nobody' shows up here? nobody is in the >>> /etc/passwd file but he has no group. > > I really appreciate the response to my post as it is the only one I have gotten but that doesn't really solve the problem, in fact it generates even more errors: > > Apr 21 09:44:19 knute5 dovecot: doveadm(nobody): Error: sync: Failed to start dsync-server command: 75 > Apr 21 09:44:34 knute5 dovecot: doveadm(216.240.58.140,nobody): Error: user nobody: Mail access for users with UID 65534 not permitted (see first_valid_uid in config file, uid from userdb lookup). > Apr 21 09:44:34 knute5 dovecot: doveadm(216.240.58.140,nobody): Error: dsync-server: User init failed > > Do you know if there is a guide somewhere on how to set up replication? I would really like to get this to work. Replication attempts to replicate all the users returned by userdb iteration. So you need to make sure that: doveadm user '*' doesn't return any extra users you don't want replicated, such has "nobody". Setting the first_valid_uid and last_valid_uid to exclude the unwanted users should have solved this problem (verify that the above command doesn't return "nobody"). I think the problem you have now is simply that replicator already remembered the "nobody" user and doesn't get rid of it automatically. So remove it with: doveadm replicator remove nobody From cj.keist at colostate.edu Thu Apr 21 20:47:40 2016 From: cj.keist at colostate.edu (CJ Keist) Date: Thu, 21 Apr 2016 14:47:40 -0600 Subject: Thunderbird version 45 no longer can login via SSL Message-ID: <57193C6C.50408@colostate.edu> All, Just ran into issue with the latest Thunderbird release today, version 45.0. This version will no longer login to our dovecot 1.2.17 version. I now this is old version but wanting to know if there is anyone finding a solution to this? Right now our work around is to reinstall Thunderbird version 38.7.2 Thanks... -- C. J. Keist Email: cj.keist at colostate.edu Systems Group Manager Solaris 10 OS (SAI) Engineering Network Services Phone: 970-491-0630 College of Engineering, CSU Fax: 970-491-5569 Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness' From dovecot at knutejohnson.com Thu Apr 21 21:36:45 2016 From: dovecot at knutejohnson.com (Knute Johnson) Date: Thu, 21 Apr 2016 14:36:45 -0700 Subject: Setting up replication? In-Reply-To: References: <56F309FD.6030704@knutejohnson.com> <5718BAA0.1030908@kronometrix.org> <57190521.2020407@knutejohnson.com> Message-ID: <571947ED.10609@knutejohnson.com> On 4/21/2016 12:01, Timo Sirainen wrote: > On 21 Apr 2016, at 19:51, Knute Johnson wrote: >> On 4/21/2016 04:33, Aropalo Tommi wrote: >>>> I'm trying to set up replication between two servers and I've hit a >>>> snag. I have two users and am using mbox files. If anybody has a >>>> sample config file for a simple system like mine I would really be >>>> grateful to see it. >>>> Thanks, >>>> The error I'm getting is: >>>> Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >>>> user nobody: Initialization failed: Namespace '': >>>> mkdir(/nonexistent/mail) failed: Permission denied (euid=65534(nobody) >>>> egid=65534(nogroup)) >>>> Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >>>> dsync-server: User init failed >>>> Mar 23 14:07:31 knute2 dovecot: doveadm(nobody): Error: sync: Failed >to >>>> start dsync-server command: 75 >>>> knute at knute2:/etc/dovecot/conf.d $ sudo doveadm user '*' >>>> nobody >>>> knute >>>> penny >>> You can add to conf.d/10-mail.conf >>> >>> first_valid_uid = 1000 >>> last_valid_uid = 2000 >>> >>> You have nobody uid 65534 so make last_valid_uid less than you have in >>> your /etc/passwd. Same thing with the first_valid_uid just pick first >>> uid after users start in your /etc/passwd >>> >>>> I don't know why the user 'nobody' shows up here? nobody is in the >>>> /etc/passwd file but he has no group. >> I really appreciate the response to my post as it is the only one I have gotten but that doesn't really solve the problem, in fact it generates even more errors: >> >> Apr 21 09:44:19 knute5 dovecot: doveadm(nobody): Error: sync: Failed to start dsync-server command: 75 >> Apr 21 09:44:34 knute5 dovecot: doveadm(216.240.58.140,nobody): Error: user nobody: Mail access for users with UID 65534 not permitted (see first_valid_uid in config file, uid from userdb lookup). >> Apr 21 09:44:34 knute5 dovecot: doveadm(216.240.58.140,nobody): Error: dsync-server: User init failed >> >> Do you know if there is a guide somewhere on how to set up replication? I would really like to get this to work. > Replication attempts to replicate all the users returned by userdb iteration. So you need to make sure that: > > doveadm user '*' > > doesn't return any extra users you don't want replicated, such has "nobody". Setting the first_valid_uid and last_valid_uid to exclude the unwanted users should have solved this problem (verify that the above command doesn't return "nobody"). I think the problem you have now is simply that replicator already remembered the "nobody" user and doesn't get rid of it automatically. So remove it with: > > doveadm replicator remove nobody Thanks, running doveadm replicator remove after setting the first/last uid did solve that issue. Maybe you would take a look at the other errors I'm getting? Nothing has changed in the configurations from the previous posts in this thread. If you need any more information please let me know. Thanks! dovecot version 2.2.13 Apr 21 14:30:19 knute5 dovecot: dsync-server(penny): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Apr 21 14:30:19 knute5 dovecot: dsync-server(penny): Fatal: master: service(doveadm): child 2417 killed with signal 6 (core dumps disabled) Apr 21 14:30:58 knute5 dovecot: dsync-local(knute): Error: read(knutejohnson.com) failed: Connection reset by peer Apr 21 14:30:59 knute5 dovecot: dsync-local(penny): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Apr 21 14:30:59 knute5 dovecot: dsync-local(penny): Fatal: master: service(doveadm): child 2424 killed with signal 6 (core dumps disabled) dovecot version 2.2.9 Apr 21 14:30:58 knutejohnson dovecot: dsync-server(knute): Fatal: master: service(doveadm): child 6631 killed with signal 6 (core dumped) Apr 21 14:30:59 knutejohnson dovecot: dsync-server(penny): Error: read(knute5.frazmtn.com) failed: EOF Apr 21 14:32:45 knutejohnson dovecot: imap-login: Login: user=, method=PLAIN, rip=192.168.3.5, lip=216.240.58.140, mpid=6667, TLS, session= Apr 21 14:32:46 knutejohnson dovecot: dsync-local(knute): Panic: file mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == F_RDLCK || mbox->mbox_lock_type != F_RDLCK) Apr 21 14:32:46 knutejohnson dovecot: dsync-local(knute): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7fc04f02c271] -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7fc04f02c34e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc04efe7a9e] -> /usr/lib/dovecot/libdovecot-storage.so.0(mbox_lock+0xcf) [0x7fc04f2e2c2f] -> /usr/lib/dovecot/libdovecot-storage.so.0(mbox_save_begin+0x5f8) [0x7fc04f2e45b8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x43) [0x7fc04f307813] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x69) [0x7fc04f2ff979] -> /usr/lib/dovecot/modules/lib15_notify_plugin.so(+0x22ae) [0x7fc04e8032ae] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x54) [0x7fc04f3078d4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) [0x7fc04f307985] -> dovecot/doveadm-server(+0x20e4f) [0x7fc04f7e6e4f] -> dovecot/doveadm-server(+0x2181b) [0x7fc04f7e781b] -> dovecot/doveadm-server(dsync_mailbox_import_changes_finish+0x172) [0x7fc04f7e9802] -> dovecot/doveadm-server(dsync_brain_sync_mails+0x6bd) [0x7fc04f7e5add] -> dovecot/doveadm-server(dsync_brain_run+0x523) [0x7fc04f7e1f93] -> dovecot/doveadm-server(+0x1c270) [0x7fc04f7e2270] -> dovecot/doveadm-server(+0x2de60) [0x7fc04f7f3e60] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fc04f03c247] -> /usr/lib dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7fc04f03cfd7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc04f03bde8] -> dovecot/doveadm-server(+0x198fd) [0x7fc04f7df8fd] -> dovecot/doveadm-server(+0xebeb) [0x7fc04f7d4beb] -> dovecot/doveadm-server(+0x184d3) [0x7fc04f7de4d3] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) [0x7fc04f03c247] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7fc04f03cfd7] -> /usr/lib/dovecot/libdoveco .so.0(io_loop_run+0x38) [0x7fc04f03bde8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7fc04efecc93] -> dovecot/doveadm-server(main+0x11b) [0x7fc04f7d494b] Apr 21 14:32:46 knutejohnson dovecot: dsync-local(knute): Fatal: master: service(doveadm): child 6668 killed with signal 6 (core dumped) -- Knute Johnson From edgar at pettijohn-web.com Fri Apr 22 00:53:54 2016 From: edgar at pettijohn-web.com (Edgar Pettijohn) Date: Thu, 21 Apr 2016 19:53:54 -0500 Subject: Setting up replication? In-Reply-To: <571947ED.10609@knutejohnson.com> References: <56F309FD.6030704@knutejohnson.com> <5718BAA0.1030908@kronometrix.org> <57190521.2020407@knutejohnson.com> <571947ED.10609@knutejohnson.com> Message-ID: <57197622.4020203@pettijohn-web.com> On 04/21/16 16:36, Knute Johnson wrote: > On 4/21/2016 12:01, Timo Sirainen wrote: >> On 21 Apr 2016, at 19:51, Knute Johnson >> wrote: >>> On 4/21/2016 04:33, Aropalo Tommi wrote: >>>>> I'm trying to set up replication between two servers and I've hit a >>>>> snag. I have two users and am using mbox files. If anybody has a >>>>> sample config file for a simple system like mine I would really be >>>>> grateful to see it. >>>>> Thanks, >>>>> The error I'm getting is: >>>>> Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >>>>> user nobody: Initialization failed: Namespace '': >>>>> mkdir(/nonexistent/mail) failed: Permission denied >>>>> (euid=65534(nobody) >>>>> egid=65534(nogroup)) >>>>> Mar 23 14:07:31 knute2 dovecot: doveadm(192.168.3.100,nobody): Error: >>>>> dsync-server: User init failed >>>>> Mar 23 14:07:31 knute2 dovecot: doveadm(nobody): Error: sync: >>>>> Failed >to >>>>> start dsync-server command: 75 >>>>> knute at knute2:/etc/dovecot/conf.d $ sudo doveadm user '*' >>>>> nobody >>>>> knute >>>>> penny >>>> You can add to conf.d/10-mail.conf >>>> >>>> first_valid_uid = 1000 >>>> last_valid_uid = 2000 >>>> >>>> You have nobody uid 65534 so make last_valid_uid less than you have in >>>> your /etc/passwd. Same thing with the first_valid_uid just pick first >>>> uid after users start in your /etc/passwd >>>> >>>>> I don't know why the user 'nobody' shows up here? nobody is in the >>>>> /etc/passwd file but he has no group. >>> I really appreciate the response to my post as it is the only one I >>> have gotten but that doesn't really solve the problem, in fact it >>> generates even more errors: >>> >>> Apr 21 09:44:19 knute5 dovecot: doveadm(nobody): Error: sync: Failed >>> to start dsync-server command: 75 >>> Apr 21 09:44:34 knute5 dovecot: doveadm(216.240.58.140,nobody): >>> Error: user nobody: Mail access for users with UID 65534 not >>> permitted (see first_valid_uid in config file, uid from userdb lookup). >>> Apr 21 09:44:34 knute5 dovecot: doveadm(216.240.58.140,nobody): >>> Error: dsync-server: User init failed >>> >>> Do you know if there is a guide somewhere on how to set up >>> replication? I would really like to get this to work. >> Replication attempts to replicate all the users returned by userdb >> iteration. So you need to make sure that: >> >> doveadm user '*' >> >> doesn't return any extra users you don't want replicated, such has >> "nobody". Setting the first_valid_uid and last_valid_uid to exclude >> the unwanted users should have solved this problem (verify that the >> above command doesn't return "nobody"). I think the problem you have >> now is simply that replicator already remembered the "nobody" user >> and doesn't get rid of it automatically. So remove it with: >> >> doveadm replicator remove nobody > > Thanks, running doveadm replicator remove after setting the first/last > uid did solve that issue. Maybe you would take a look at the other > errors I'm getting? Nothing has changed in the configurations from > the previous posts in this thread. If you need any more information > please let me know. Thanks! > > dovecot version 2.2.13 > > Apr 21 14:30:19 knute5 dovecot: dsync-server(penny): Panic: file > mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == > F_RDLCK || mbox->mbox_lock_type != F_RDLCK) > Apr 21 14:30:19 knute5 dovecot: dsync-server(penny): Fatal: master: > service(doveadm): child 2417 killed with signal 6 (core dumps disabled) > Apr 21 14:30:58 knute5 dovecot: dsync-local(knute): Error: > read(knutejohnson.com) failed: Connection reset by peer > Apr 21 14:30:59 knute5 dovecot: dsync-local(penny): Panic: file > mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == > F_RDLCK || mbox->mbox_lock_type != F_RDLCK) > Apr 21 14:30:59 knute5 dovecot: dsync-local(penny): Fatal: master: > service(doveadm): child 2424 killed with signal 6 (core dumps disabled) > http://wiki.dovecot.org/MboxLocking > dovecot version 2.2.9 > > Apr 21 14:30:58 knutejohnson dovecot: dsync-server(knute): Fatal: > master: service(doveadm): child 6631 killed with signal 6 (core dumped) > Apr 21 14:30:59 knutejohnson dovecot: dsync-server(penny): Error: > read(knute5.frazmtn.com) failed: EOF > Apr 21 14:32:45 knutejohnson dovecot: imap-login: Login: user=, > method=PLAIN, rip=192.168.3.5, lip=216.240.58.140, mpid=6667, TLS, > session= > Apr 21 14:32:46 knutejohnson dovecot: dsync-local(knute): Panic: file > mbox-lock.c: line 799 (mbox_lock): assertion failed: (lock_type == > F_RDLCK || mbox->mbox_lock_type != F_RDLCK) > Apr 21 14:32:46 knutejohnson dovecot: dsync-local(knute): Error: Raw > backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x5e271) [0x7fc04f02c271] > -> /usr/lib/dovecot/libdovecot.so.0(+0x5e34e) [0x7fc04f02c34e] -> > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fc04efe7a9e] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mbox_lock+0xcf) > [0x7fc04f2e2c2f] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mbox_save_begin+0x5f8) > [0x7fc04f2e45b8] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_begin+0x43) > [0x7fc04f307813] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x69) > [0x7fc04f2ff979] -> > /usr/lib/dovecot/modules/lib15_notify_plugin.so(+0x22ae) > [0x7fc04e8032ae] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0x54) > [0x7fc04f3078d4] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_move+0x15) > [0x7fc04f307985] -> dovecot/doveadm-server(+0x20e4f) [0x7fc04f7e6e4f] > -> dovecot/doveadm-server(+0x2181b) [0x7fc04f7e781b] -> > dovecot/doveadm-server(dsync_mailbox_import_changes_finish+0x172) > [0x7fc04f7e9802] -> > dovecot/doveadm-server(dsync_brain_sync_mails+0x6bd) [0x7fc04f7e5add] > -> dovecot/doveadm-server(dsync_brain_run+0x523) [0x7fc04f7e1f93] -> > dovecot/doveadm-server(+0x1c270) [0x7fc04f7e2270] -> > dovecot/doveadm-server(+0x2de60) [0x7fc04f7f3e60] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) > [0x7fc04f03c247] -> /usr/lib > dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) [0x7fc04f03cfd7] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fc04f03bde8] -> > dovecot/doveadm-server(+0x198fd) [0x7fc04f7df8fd] -> > dovecot/doveadm-server(+0xebeb) [0x7fc04f7d4beb] -> > dovecot/doveadm-server(+0x184d3) [0x7fc04f7de4d3] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x27) > [0x7fc04f03c247] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xd7) > [0x7fc04f03cfd7] -> /usr/lib/dovecot/libdoveco .so.0(io_loop_run+0x38) > [0x7fc04f03bde8] -> > /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7fc04efecc93] -> dovecot/doveadm-server(main+0x11b) [0x7fc04f7d494b] > Apr 21 14:32:46 knutejohnson dovecot: dsync-local(knute): Fatal: > master: service(doveadm): child 6668 killed with signal 6 (core dumped) > From oliver at riesen.org Fri Apr 22 05:38:27 2016 From: oliver at riesen.org (Oliver Riesen-Mallmann) Date: Fri, 22 Apr 2016 07:38:27 +0200 Subject: UTF-8 encoded folders on filesystem In-Reply-To: References: <2635ED99-F760-439A-83D1-006E050D034A@iki.fi> <5718AFF0.10003@riesen.org> Message-ID: <5719B8D3.6080604@riesen.org> Hi Timo, >> Documentation doesn't mention this setting... >> http://wiki.dovecot.org/MailLocation > > Updated. Thanks! Regards Oliver From mfoley at ohprs.org Fri Apr 22 06:07:24 2016 From: mfoley at ohprs.org (Mark Foley) Date: Fri, 22 Apr 2016 02:07:24 -0400 Subject: Looking for NTLM config example Message-ID: <201604220607.u3M67ODM006995@mail.hprs.local> Now that I am running Thunderbird on Linux and away from Windows/Outlook, I'd like to take another run at setting up NTLM authentication from Thunderbird to my Samba4 AC/DC. With the help of the samba maillist folks I was able to set up NTLM authentication for domain user login. I should be able to do the same for email! But, I need help. I went to http://wiki2.dovecot.org/Authentication/Mechanisms/NTLM and got lost immediately. Are "authenticaion submethods" synonymous with "password schemes"? The 7th line down says, "NTLM password scheme is required for NTLM, NTLM2 and NTLMv2.", but in the referenced link I found no reference to "NTLM password scheme". The links http://wiki2.dovecot.org/Authentication/Mechanisms/NTLM and http://wiki2.dovecot.org/Authentication/PasswordSchemes, tell you what the 4 NTLM authentication submethods are, tells you what password schemes are, tells you what the NTLM client/server handshake is, but doesn't actually tell you how to configure dovecot config files. I'm much more interested in the "how to" than in: "NTLMv2: server and client nonce, MITM can't force downgrade" ... whatever that means. Anyway, probably it's my lack of understanding terminology. I don't even know what a "nonce" is. But, I learn well from examples! Can somone please give me a sample 10-auth.conf for NTML and any other supporting settings or configs I need? My current/working dovecot settings, which have been running perfectly for well over a year now, are: $ dovecot -n # 2.2.15: /usr/local/etc/dovecot/dovecot.conf # OS: Linux 3.10.17 x86_64 Slackware 14.1 auth_debug_passwords = yes auth_mechanisms = plain login auth_verbose = yes auth_verbose_passwords = plain disable_plaintext_auth = no info_log_path = /var/log/dovecot_info mail_location = maildir:~/Maildir passdb { driver = shadow } protocols = imap ssl_cert = , rip=192.168.0.58, lip=98.102.63.107, session= On Thunderbird I got the error, "Sending of the message failed. The Outlgoing server (SMTP) my.server.name does not support the selected authentication method. Please change the 'Autnentication method' in 'Account Settings | Outgoing Server (SMTP)'." Clearly, something is configured wrong, but I've no clue what. Can I get some advice? THX --Mark From miha.vrhovnik at cordia.si Fri Apr 22 06:13:58 2016 From: miha.vrhovnik at cordia.si (Miha Vrhovnik) Date: Fri, 22 Apr 2016 08:13:58 +0200 Subject: Thunderbird version 45 no longer can login via SSL In-Reply-To: <57193C6C.50408@colostate.edu> References: <57193C6C.50408@colostate.edu> Message-ID: On 2016-04-21 22:47, CJ Keist wrote: > All, > Just ran into issue with the latest Thunderbird release today, > version 45.0. This version will no longer login to our dovecot 1.2.17 > version. I now this is old version but wanting to know if there is > anyone finding a solution to this? > > Right now our work around is to reinstall Thunderbird version 38.7.2 > > Thanks... I'm going to guess, but TB 45 probably disables some old ciphers. Which are probably the only ones your ancient openssl an dovecot support. REgards, M From oe8bck at oevsv.at Fri Apr 22 09:05:49 2016 From: oe8bck at oevsv.at (Christof Bodner) Date: Fri, 22 Apr 2016 11:05:49 +0200 Subject: Aborted login (auth failed) Message-ID: <5719E96D.6090400@oevsv.at> Hi, My SSL auth got invalid, so I updated my SSL configuration (Apache works) This ist the log: --- Apr 22 11:01:55 rosi dovecot: imap-login: Debug: SSL: elliptic curve secp384r1 will be used for ECDH and ECDHE key exchanges Apr 22 11:01:55 rosi dovecot: imap-login: Debug: SSL: elliptic curve secp384r1 will be used for ECDH and ECDHE key exchanges Apr 22 11:01:55 rosi dovecot: auth: Debug: auth client connected (pid=3466) Apr 22 11:01:55 rosi dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=a5AlFA8x3gAAAAAAAAAAAAAAAAAAAAAB#011lip=::1#011rip=::1#011lport=143#011rport=48350#011resp= Apr 22 11:01:55 rosi dovecot: auth-worker(3460): Debug: pam(test,::1): lookup service=dovecot Apr 22 11:01:55 rosi dovecot: auth-worker(3460): Debug: pam(test,::1): #1/1 style=1 msg=Password: Apr 22 11:01:57 rosi dovecot: auth-worker(3460): pam(test,::1): pam_authenticate() failed: Authentication failure (password mismatch?) Apr 22 11:01:59 rosi dovecot: auth: Debug: client passdb out: FAIL#0111#011user=test Apr 22 11:01:59 rosi dovecot: imap-login: Aborted login (auth failed, 1 attempts in 4 secs): user=, method=PLAIN, rip=::1, lip=::1, secured, session= --- A login via SSH is working, What could be the reason for the login fail? This is my config: --- # 2.2.9: /etc/dovecot/dovecot.conf # OS: Linux 3.13.0-85-generic x86_64 Ubuntu 14.04.4 LTS auth_debug = yes auth_verbose = yes mail_location = mbox:~/mail:INBOX=/var/mail/%u namespace { hidden = yes inbox = yes list = no location = mbox:~/mail:INBOX=/var/mail/%u prefix = "#mbox/" separator = / type = private } passdb { driver = pam } plugin { sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = " imap pop3" service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } sl_ca = Landesverband K?rnten Christof Bodner, OE8BCK Bertha-von-Suttnerstra?e 6/4 9500 Villach ---------------------------------------------------------------- email: mailto:oe8bck at oevsv.at Tel.: +43-650-7215383 --------------------------------------------------------------------- GnuPG public key: 0x7204CB8C Fingerprint 4065 0716 9A15 E26B 2286 9F04 FD3B 74E9 7204 CB8C --------------------------------------------------------------------- -------------- next part -------------- A non-text attachment was scrubbed... Name: Raute_OeVSV.gif Type: image/gif Size: 12268 bytes Desc: not available URL: From gedalya at gedalya.net Fri Apr 22 10:33:16 2016 From: gedalya at gedalya.net (Gedalya) Date: Fri, 22 Apr 2016 06:33:16 -0400 Subject: lda_original_recipient_header overrides RCPT TO? Message-ID: <5719FDEC.5060800@gedalya.net> Hi all, The example config says: # Header where the original recipient address (SMTP's RCPT TO: address) is taken # from if not available elsewhere. With dovecot-lda -a parameter overrides this. # A commonly used header for this is X-Original-To. #lda_original_recipient_header = I'm using dovecot 2.2.19 The "if not available elsewhere" bit seems to hold true for LDA, but not for LMTP. That is to say, if the value I want used is passed with LDA using the -a option, and another one I want ignored is passed in the header specified in this option, it works correctly and I have the address detail in sieve. However when using LMTP and the desired value is passed as RCPT TO, and this option is defined, and such a header exists -- its value seems to take effect, and is matched by sieve as the envelope address. From gedalya at gedalya.net Fri Apr 22 10:44:35 2016 From: gedalya at gedalya.net (Gedalya) Date: Fri, 22 Apr 2016 06:44:35 -0400 Subject: recipient delimiter translation with exim In-Reply-To: <56FDFAE2.10709@gedalya.net> References: <20160331234204.Horde.o7122bVubxclp-3DtFIpaso@mail.patrickdk.com> <56FDFAE2.10709@gedalya.net> Message-ID: <571A0093.7080209@gedalya.net> In case anyone is interested: Say I want to allow multiple recipient delimiters, possibly more than one character long, and dovecot is configured to use the + sign. In my case I decided to also allow the following: ".-" "__" and ".." My last router in exim is mysql_user and the one before that is mysql_alias. I added the following before mysql_alias: suffix_translate: debug_print = "R: suffix_translate for $local_part@$domain" driver = redirect domains = +virtual_domains local_part_suffix = .-* : __* : ..* data = ${quote_local_part:$local_part${sg{$local_part_suffix}{\N^(\.-|__|\.\.)\N}{+}}}@$domain # the following is an "optimization" or just a way to make the debug output less tedious. It prevents # exim from going all the way back to the first router with the new address redirect_router = mysql_alias In the dovecot_lmtp transport, I added the rcpt_include_affixes option. With LDA, use the -a flag as follows: -a $local_part$local_part_suffix@$domain With LMTP, using the envelope_to_add option and configuring dovecot to use it with the lda_original_recipient_header option, I get an Envelope-To header populated with the original recipient, and dovecot uses that one for some reason. See my other message posted on this list. From skdovecot at smail.inf.fh-brs.de Fri Apr 22 12:01:48 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 22 Apr 2016 14:01:48 +0200 (CEST) Subject: Aborted login (auth failed) In-Reply-To: <5719E96D.6090400@oevsv.at> References: <5719E96D.6090400@oevsv.at> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 22 Apr 2016, Christof Bodner wrote: > Apr 22 11:01:55 rosi dovecot: auth: Debug: client in: > AUTH#0111#011PLAIN#011service=imap#011secured#011session=a5AlFA8x3gAAAAAAAAAAAAAAAAAAAAAB#011lip=::1#011rip=::1#011lport=143#011rport=48350#011resp= > Apr 22 11:01:55 rosi dovecot: auth-worker(3460): Debug: pam(test,::1): > lookup service=dovecot > Apr 22 11:01:55 rosi dovecot: auth-worker(3460): Debug: pam(test,::1): > #1/1 style=1 msg=Password: > Apr 22 11:01:57 rosi dovecot: auth-worker(3460): pam(test,::1): > pam_authenticate() failed: Authentication failure (password mismatch?) it says failure, are you sure that PAM uses the same backends for Dovecot and SSH? > A login via SSH is working, What could be the reason for the login fail? - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVxoSrHz1H7kL/d9rAQJ54Qf8DumBO/FuQcky+kO9rln2I7mS8FNdXepU B6CRjP8JABmxIz6m48ntgPbUZVEztA9ApAfCw6iRLPaCf/NFnia3m1vQeyku49K9 jujF5beVlOsg+HFuttZ4mgTZs2cMnSJaVhzs2NHZtdCMKLzgrC0x5+rm62/VUKsy EONqpKm8h9lMXhWkFAkA+jpEocgLsdeY0TFcHeCTRirI2dsqNPQ7ifUPg6EtE3pK ccUL+doe5huZAMtc4JOSZmpGVOvmEmL4ig7Duk+9GmSptZ/7I3jHvOR1yNMaq3sb buFT5I7FHhP1Avxp6GY/+nTYhPQ+IRu7+aMBdq3vJgWaZyANv7mHLg== =MsiI -----END PGP SIGNATURE----- From giovanni at giovannisfois.net Fri Apr 22 12:17:30 2016 From: giovanni at giovannisfois.net (Giovanni S. Fois) Date: Fri, 22 Apr 2016 14:17:30 +0200 Subject: push-notification plugin and imap-metadata permissions Message-ID: <571A165A.3050108@giovannisfois.net> Ultra short version: Why cant I set the following mailbox metadata key? /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify Let me explain the context: I'm using the Dovecot version 2.23.1, but the same happens for the 2.2.22 The push-notification plugin is supposed to send out a notification whenever a mailbox get a new email message. In order to tell if a mailbox is enabled to send out the notification, the plugin looks out for the following mailbox metadata key: /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify If the key is set then everything is OK and the notification is sent, otherwise the action is skipped. If I try to setup the metadata key by hand (telnet as the user over the imap port): setmetadata INBOX (/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") I get the error message: "Internal mailbox attributes cannot be accessed" Digging in the Dovecot 2.2.22 sources i found that: This string is from lib-imap-storage/imap-metadata.c - line 36 - Dovecot 2.2.22 The message is triggered by the following condition - same file - line 125 - Dovecot 2.2.22 if (strncmp(*key_r, MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT, strlen(MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT)) == 0) { So the path pvt/server appears to be forbidden. But, in the file lib-storage/mailbox-attribute.h we can read the following comment: /* User can get/set all non-pvt/ attributes and also pvt/server/ (but not pvt/server/pvt/) attributes. */ And, after said comment there is the definition of the macro MAILBOX_ATTRIBUTE_KEY_IS_USER_ACCESSIBLE(key) which has the same basic function of the condition in imap-metadata.c , but in this case the same imap key is seen as accessible. Now my questions: Can we use a negated version of MAILBOX_ATTRIBUTE_KEY_IS_USER_ACCESSIBLE(key) in imap-metadata? How can the push-notification plugin work out-of-the-box without changes and recompilation? Thank you for your valuable time and forgive me if I'm posing a dumb question. Best wishes, Giovanni S. Fois From teemu.huovila at dovecot.fi Fri Apr 22 12:57:54 2016 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Fri, 22 Apr 2016 15:57:54 +0300 Subject: push-notification plugin and imap-metadata permissions In-Reply-To: <571A165A.3050108@giovannisfois.net> References: <571A165A.3050108@giovannisfois.net> Message-ID: <571A1FD2.7070708@dovecot.fi> On 22.04.2016 15:17, Giovanni S. Fois wrote: > Ultra short version: > > Why cant I set the following mailbox metadata key? > /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify Why do you want to set it there? Have you tried setting it on some mailbox path? > > Let me explain the context: > > I'm using the Dovecot version 2.23.1, but the same happens for the 2.2.22 > > The push-notification plugin is supposed to send out a notification whenever > a mailbox get a new email message. > > In order to tell if a mailbox is enabled to send out the notification, the plugin > looks out for the following mailbox metadata key: > /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify > > If the key is set then everything is OK and the notification is sent, otherwise the > action is skipped. > > If I try to setup the metadata key by hand (telnet as the user over the imap port): > setmetadata INBOX (/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") > > I get the error message: "Internal mailbox attributes cannot be accessed" > > Digging in the Dovecot 2.2.22 sources i found that: > > This string is from lib-imap-storage/imap-metadata.c - line 36 - Dovecot 2.2.22 > The message is triggered by the following condition - same file - line 125 - Dovecot 2.2.22 > > if (strncmp(*key_r, MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT, > strlen(MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT)) == 0) { > > So the path pvt/server appears to be forbidden. > > But, in the file lib-storage/mailbox-attribute.h we can read the following comment: > > /* User can get/set all non-pvt/ attributes and also pvt/server/ > (but not pvt/server/pvt/) attributes. */ > > And, after said comment there is the definition of the macro MAILBOX_ATTRIBUTE_KEY_IS_USER_ACCESSIBLE(key) > which has the same basic function of the condition in imap-metadata.c , but in this case > the same imap key is seen as accessible. > > Now my questions: > > Can we use a negated version of MAILBOX_ATTRIBUTE_KEY_IS_USER_ACCESSIBLE(key) in imap-metadata? > How can the push-notification plugin work out-of-the-box without changes and recompilation? > > Thank you for your valuable time and forgive me if I'm posing a dumb question. Please see instructions at http://oxpedia.org/wiki/index.php?title=AppSuite:OX_Mail#Setup_of_the_Dovecot_Push In case the problem is not resolved, do attach your doveconf -n output to the next mail. br, Teemu > > Best wishes, > Giovanni S. Fois From giovanni at giovannisfois.net Fri Apr 22 13:29:17 2016 From: giovanni at giovannisfois.net (Giovanni S. Fois) Date: Fri, 22 Apr 2016 15:29:17 +0200 Subject: push-notification plugin and imap-metadata permissions In-Reply-To: <571A1FD2.7070708@dovecot.fi> References: <571A165A.3050108@giovannisfois.net> <571A1FD2.7070708@dovecot.fi> Message-ID: <571A272D.7060200@giovannisfois.net> [cut] On 04/22/2016 02:57 PM, Teemu Huovila wrote: > Why cant I set the following mailbox metadata key? > /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify > Why do you want to set it there? Have you tried setting it on some mailbox path? Do you mean by editing directly the metadata file instead of accessing it with an Imap command? The answer to this question is that I don't have the direct access to the physical mailboxes. >> Let me explain the context: >> >> I'm using the Dovecot version 2.23.1, but the same happens for the 2.2.22 >> >> The push-notification plugin is supposed to send out a notification whenever >> a mailbox get a new email message. >> >> In order to tell if a mailbox is enabled to send out the notification, the plugin >> looks out for the following mailbox metadata key: >> /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify >> >> If the key is set then everything is OK and the notification is sent, otherwise the >> action is skipped. >> >> If I try to setup the metadata key by hand (telnet as the user over the imap port): >> setmetadata INBOX (/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") >> >> I get the error message: "Internal mailbox attributes cannot be accessed" >> >> Digging in the Dovecot 2.2.22 sources i found that: >> >> This string is from lib-imap-storage/imap-metadata.c - line 36 - Dovecot 2.2.22 >> The message is triggered by the following condition - same file - line 125 - Dovecot 2.2.22 >> >> if (strncmp(*key_r, MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT, >> strlen(MAILBOX_ATTRIBUTE_PREFIX_DOVECOT_PVT)) == 0) { >> >> So the path pvt/server appears to be forbidden. >> >> But, in the file lib-storage/mailbox-attribute.h we can read the following comment: >> >> /* User can get/set all non-pvt/ attributes and also pvt/server/ >> (but not pvt/server/pvt/) attributes. */ >> >> And, after said comment there is the definition of the macro MAILBOX_ATTRIBUTE_KEY_IS_USER_ACCESSIBLE(key) >> which has the same basic function of the condition in imap-metadata.c , but in this case >> the same imap key is seen as accessible. >> >> Now my questions: >> >> Can we use a negated version of MAILBOX_ATTRIBUTE_KEY_IS_USER_ACCESSIBLE(key) in imap-metadata? >> How can the push-notification plugin work out-of-the-box without changes and recompilation? >> >> Thank you for your valuable time and forgive me if I'm posing a dumb question. > Please see instructions at http://oxpedia.org/wiki/index.php?title=AppSuite:OX_Mail#Setup_of_the_Dovecot_Push > In case the problem is not resolved, do attach your doveconf -n output to the next mail. I have read the instructions, and enabled the metadata options and enabled the lmtp and lda parts as stated in the instructions. I understand that the instructions talk about the Dovecot "http-notify" plugin, which I suppose is the old name of the push_notification plugin. I understand that the Ox Appsuite Mail uses the following imap key "/private/vendor/vendor.dovecot/http-notify" instead of the one declared by the plugin. I'm not using the OX Appsuite Mail, I just need to get out the notifications out of the plugin towards some url of mine which will take care of the message. In order to get there I need to write said metadata key in the INBOX folders metadata . I know I could write my own plugin or I could recompile the push_notification plugin after changing the key. The problem with this is that my sysadmin wants to install and keep everything updated using only original packages. Attached to this email you will find the output of the dovecot -n command. I'll be grateful for any hint and suggestion. Thank you for your time and patience. Giovanni -------------- next part -------------- # 2.2.23.1 (b1f5a4f): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.13 (93c6eee) # OS: Linux 3.2.0-4-amd64 x86_64 Debian 7.10 auth_debug = yes auth_default_realm = mydomain.it auth_master_user_separator = * auth_mechanisms = cram-md5 digest-md5 plain auth_realms = mydomain.it auth_username_format = %Ln at mydomain.it auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no dotlock_use_excl = no imap_capability = IMAP4rev1 UIDPLUS NAMESPACE QUOTA CHILDREN SORT ID imap_client_workarounds = delay-newmail tb-extra-mailbox-sep tb-lsub-flags imap_id_log = * listen = * mail_attribute_dict = file:%h/Maildir/dovecot-attributes mail_debug = yes mail_fsync = always mail_gid = 9999 mail_location = sdbox:~/dbox:ALT=/mbx_alt/%5.2h_t2/%12.6h%u mail_plugins = quota stats notify mail_uid = 9999 managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vacation-seconds editheader mmap_disable = yes namespace inbox { inbox = yes location = mailbox Draft { auto = subscribe special_use = \Drafts } mailbox Sent { auto = subscribe special_use = \Sent } mailbox Spam { auto = subscribe special_use = \Junk } mailbox Trashcan { auto = subscribe special_use = \Trash } prefix = separator = / } passdb { args = /etc/dovecot/master-users driver = passwd-file master = yes pass = yes } passdb { args = nopassword=y driver = static } plugin { push_notification_driver = ox:url=http://mydomain.it/push_notify.php quota = dict:User quota::redis:host=10.39.117.15:port=6400 quota_grace = 10M quota_rule = *:storage=10G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u sieve = file:~/sieve;active=~/.dovecot.sieve sieve_before = file:~/sieve/sender_blacklist.sieve sieve_before2 = file:~/sieve/interceptor.sieve sieve_before3 = file:~/sieve/forward_vacation.sieve sieve_extensions = +vacation +vacation-seconds +editheader sieve_vacation_default_period = 1h sieve_vacation_max_period = 30d sieve_vacation_min_period = 60s stats_refresh = 30 secs stats_track_cmds = yes } protocols = imap pop3 lmtp sieve service imap-login { inet_listener imap { address = 10.39.117.15 port = 143 } service_count = 0 } service imap-postlogin { executable = script-login -d /etc/dovecot/postlogin.sh imap user = $default_internal_user } service imap { executable = imap imap-postlogin } service lmtp { inet_listener lmtp { address = 10.39.117.15 port = 24 } } service managesieve-login { inet_listener sieve { port = 4190 } service_count = 1 vsz_limit = 64 M } service pop-postlogin { executable = script-login -d /etc/dovecot/postlogin.sh pop3 user = $default_internal_user } service pop3-login { inet_listener pop3 { address = 10.39.117.15 port = 110 } } service pop3 { executable = pop3 pop-postlogin } service stats { fifo_listener stats-mail { mode = 0600 user = doveuser } } ssl = no stats_memory_limit = 64 M submission_host = director-1.mydomain.it userdb { args = /etc/dovecot/conf.d/dovecot-dict-auth.conf.ext driver = dict } protocol lmtp { mail_plugins = quota stats notify sieve notify push_notification } protocol lda { mail_plugins = quota stats notify notify push_notification } protocol imap { imap_metadata = yes mail_plugins = quota stats notify imap_quota imap_stats } protocol sieve { mail_max_userip_connections = 100 } From cj.keist at colostate.edu Fri Apr 22 16:44:11 2016 From: cj.keist at colostate.edu (cjay) Date: Fri, 22 Apr 2016 10:44:11 -0600 Subject: Thunderbird version 45 no longer can login via SSL (UPDATE) In-Reply-To: <57193C6C.50408@colostate.edu> References: <57193C6C.50408@colostate.edu> Message-ID: Problem solved. I had my cipher list too restricted. I went back to the default: Was: MEDIUM:!LOW:!SSLv2 now its: ALL:!LOW:!SSLv2:!EXP:!aNULL Thunderbird version 45 is happy now. We are in process of migrating over to Office 365, so just have to keep this server happy for a few more months. -- C. J. Keist Email: cj.keist at colostate.edu Systems Group Manager Solaris 10 OS (SAI) Engineering Network Services Phone: 970-491-0630 College of Engineering, CSU Ft. Collins, CO 80523-1301 All I want is a chance to prove 'Money can't buy happiness' On 04/21/2016 14:47, CJ Keist wrote: > All, > Just ran into issue with the latest Thunderbird release today, > version 45.0. This version will no longer login to our dovecot 1.2.17 > version. I now this is old version but wanting to know if there is > anyone finding a solution to this? > > Right now our work around is to reinstall Thunderbird version 38.7.2 > > Thanks... From dovecot at knutejohnson.com Fri Apr 22 17:17:52 2016 From: dovecot at knutejohnson.com (Knute Johnson) Date: Fri, 22 Apr 2016 10:17:52 -0700 Subject: Setting up replication? In-Reply-To: <57197622.4020203@pettijohn-web.com> References: <56F309FD.6030704@knutejohnson.com> <5718BAA0.1030908@kronometrix.org> <57190521.2020407@knutejohnson.com> <571947ED.10609@knutejohnson.com> <57197622.4020203@pettijohn-web.com> Message-ID: On 4/21/2016 17:53, Edgar Pettijohn wrote: > > http://wiki.dovecot.org/MboxLocking Thanks Edgar, I hadn't seen that page before. I've tried every combination of locking but still get the same errors. I would love to see somebody's config files that has this working on a Ubuntu server. Thanks, -- Knute Johnson From trashcan at ellael.org Fri Apr 22 18:32:02 2016 From: trashcan at ellael.org (Michael Grimm) Date: Fri, 22 Apr 2016 20:32:02 +0200 Subject: Setting up replication? In-Reply-To: <56F72F39.6090402@knutejohnson.com> References: <56F309FD.6030704@knutejohnson.com> <56F40DC7.7000309@knutejohnson.com> <56F72F39.6090402@knutejohnson.com> Message-ID: Knute Johnson wrote: > I disabled replication and don't really know where to go from here. Can anybody give me a hand? From what I have seen in this thread your configuration looks ok to me. IIRC, you have two users, only. And, IIRC, the mbox format isn't really suited for replication. Thus, I do recommend to migrate to another mailbox format like mdbox or sdbox. Migration can be achieved by dsync. You will find examples in the archives of this mailing list. Good luck, Michael From oe8bck at oevsv.at Fri Apr 22 18:51:27 2016 From: oe8bck at oevsv.at (Christof Bodner) Date: Fri, 22 Apr 2016 20:51:27 +0200 Subject: Aborted login (auth failed) In-Reply-To: References: <5719E96D.6090400@oevsv.at> Message-ID: <571A72AF.30709@oevsv.at> Hi, --- ssh -v -l test 10.0.1.117 debug1: Next authentication method: password test at 10.0.1.117's password: debug1: Authentication succeeded (password). Authenticated to 10.0.1.117 ([10.0.1.117]:22). debug1: channel 0: new [client-session] --- $ telnet localhost 143 Trying ::1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN] Dovecot (Ubuntu) ready. a1 LOGIN test 12345 a1 NO [ALERT] Password: --- Apr 22 20:40:11 rosi dovecot: imap-login: Debug: SSL: elliptic curve secp384r1 will be used for ECDH and ECDHE key exchanges Apr 22 20:40:11 rosi dovecot: imap-login: Debug: SSL: elliptic curve secp384r1 will be used for ECDH and ECDHE key exchanges Apr 22 20:40:11 rosi dovecot: auth: Debug: auth client connected (pid=11154) Apr 22 20:40:18 rosi dovecot: auth: Debug: client in: AUTH#0111#011PLAIN#011service=imap#011secured#011session=012XKBcxmgAAAAAAAAAAAAAAAAAAAAAB#011lip=::1#011rip=::1#011lport=143#011rport=48794#011resp= Apr 22 20:40:18 rosi dovecot: auth-worker(11158): Debug: Loading modules from directory: /usr/lib/dovecot/modules/auth Apr 22 20:40:18 rosi dovecot: auth-worker(11158): Debug: Module loaded: /usr/lib/dovecot/modules/auth/libdriver_mysql.so Apr 22 20:40:18 rosi dovecot: auth-worker(11158): Debug: pam(test,::1): lookup service=dovecot Apr 22 20:40:18 rosi dovecot: auth-worker(11158): Debug: pam(test,::1): #1/1 style=1 msg=Password: Apr 22 20:40:20 rosi dovecot: auth-worker(11158): pam(test,::1): pam_authenticate() failed: Authentication failure (password mismatch?) Apr 22 20:40:22 rosi dovecot: auth: Debug: client passdb out: FAIL#0111#011user=test#011reason=Password: --- The PAM configuration is the same: --- $ cat /etc/pam.d/login ... # Standard Un*x account and session @include common-account @include common-session @include common-password ... --- $ cat /etc/pam.d/dovecot #%PAM-1.0 @include common-auth @include common-account @include common-session @include common-password --- So I'm quite sure that PAM uses the same backends. Any other ideas? KR, Christof Am 2016-04-22 14:01, schrieb Steffen Kaiser: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 22 Apr 2016, Christof Bodner wrote: > >> Apr 22 11:01:55 rosi dovecot: auth: Debug: client in: >> AUTH#0111#011PLAIN#011service=imap#011secured#011session=a5AlFA8x3gAAAAAAAAAAAAAAAAAAAAAB#011lip=::1#011rip=::1#011lport=143#011rport=48350#011resp= >> >> Apr 22 11:01:55 rosi dovecot: auth-worker(3460): Debug: pam(test,::1): >> lookup service=dovecot >> Apr 22 11:01:55 rosi dovecot: auth-worker(3460): Debug: pam(test,::1): >> #1/1 style=1 msg=Password: >> Apr 22 11:01:57 rosi dovecot: auth-worker(3460): pam(test,::1): >> pam_authenticate() failed: Authentication failure (password mismatch?) > > it says failure, are you sure that PAM uses the same backends for > Dovecot and SSH? > >> A login via SSH is working, What could be the reason for the login fail? > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVxoSrHz1H7kL/d9rAQJ54Qf8DumBO/FuQcky+kO9rln2I7mS8FNdXepU > B6CRjP8JABmxIz6m48ntgPbUZVEztA9ApAfCw6iRLPaCf/NFnia3m1vQeyku49K9 > jujF5beVlOsg+HFuttZ4mgTZs2cMnSJaVhzs2NHZtdCMKLzgrC0x5+rm62/VUKsy > EONqpKm8h9lMXhWkFAkA+jpEocgLsdeY0TFcHeCTRirI2dsqNPQ7ifUPg6EtE3pK > ccUL+doe5huZAMtc4JOSZmpGVOvmEmL4ig7Duk+9GmSptZ/7I3jHvOR1yNMaq3sb > buFT5I7FHhP1Avxp6GY/+nTYhPQ+IRu7+aMBdq3vJgWaZyANv7mHLg== > =MsiI > -----END PGP SIGNATURE----- -- --------------------------------------------------------------------- Landesverband K?rnten Christof Bodner, OE8BCK Pestalozzistzra?e 11/6 9500 Villach ---------------------------------------------------------------- email: mailto:oe8bck at oevsv.at Tel.: +43-650-7215383 --------------------------------------------------------------------- GnuPG public key: 8A265334 Fingerprint CF71 08D2 18B8 A824 37A5 B80E 0888 37E1 8A26 5334 --------------------------------------------------------------------- -------------- next part -------------- A non-text attachment was scrubbed... Name: Raute_OeVSV.gif Type: image/gif Size: 12268 bytes Desc: not available URL: From tss at iki.fi Fri Apr 22 19:07:54 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 22 Apr 2016 22:07:54 +0300 Subject: push-notification plugin and imap-metadata permissions In-Reply-To: <571A165A.3050108@giovannisfois.net> References: <571A165A.3050108@giovannisfois.net> Message-ID: <6B9D781F-16EC-4E6F-B127-AC4E4B2A3B0E@iki.fi> On 22 Apr 2016, at 15:17, Giovanni S. Fois wrote: > > In order to tell if a mailbox is enabled to send out the notification, the plugin > looks out for the following mailbox metadata key: > /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify > > If the key is set then everything is OK and the notification is sent, otherwise the > action is skipped. > > If I try to setup the metadata key by hand (telnet as the user over the imap port): > setmetadata INBOX (/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") > > I get the error message: "Internal mailbox attributes cannot be accessed" Server metadata is set with: a SETMETADATA "" (/private/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") Which should internally map into the INBOX's /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify. From olfway at gmail.com Fri Apr 22 19:50:05 2016 From: olfway at gmail.com (Pavel Volkovitskiy) Date: Fri, 22 Apr 2016 22:50:05 +0300 Subject: UTF-8 encoded folders on filesystem In-Reply-To: <2635ED99-F760-439A-83D1-006E050D034A@iki.fi> References: <2635ED99-F760-439A-83D1-006E050D034A@iki.fi> Message-ID: On Thu, Apr 21, 2016 at 1:30 PM, Timo Sirainen wrote: > On 21 Apr 2016, at 10:37, Pavel Volkovitskiy wrote: > > > > I wonder if that possible to have utf-8 encoded folders on filesystem > with > > dovecot? > > > > ?May be this feature planned already?? > > mail_location = ...:UTF-8 > > ?Thanks!? -- Pavel From joelz at pobox.com Fri Apr 22 22:26:25 2016 From: joelz at pobox.com (Joel Roth) Date: Fri, 22 Apr 2016 12:26:25 -1000 Subject: Progress messages Message-ID: <20160422222625.GA14021@sprite> Hi Dovecot maintainers, I'm maintainer of Net::IMAP::Client, a perl IMAP client library.[1] I've had two bug reports related to Dovecot's in-progress messages.[2,3] While patches have been submitted to resolve both of these bugs, I would like to minimize the possibilty of future breakage. Hence the following questions: 1. Which parts of the RFC are relevant to the in-progress messages? 2. Do you have a list of all of Dovecot's in-progress messages? 3. If, in future, other in-progress messages may be added, can you provide a standard syntax that I may use to strip them from the reply stream. Finally, please CC replies to me, as I am not joined to the list. Thank you for your attention. Joel 1. https://metacpan.org/pod/Net::IMAP::Client 2. https://rt.cpan.org/Public/Bug/Display.html?id=84623 3. https://rt.cpan.org/Public/Bug/Display.html?id=113489 -- Joel Roth From tss at iki.fi Fri Apr 22 23:57:28 2016 From: tss at iki.fi (Timo Sirainen) Date: Sat, 23 Apr 2016 02:57:28 +0300 Subject: Progress messages In-Reply-To: <20160422222625.GA14021@sprite> References: <20160422222625.GA14021@sprite> Message-ID: <06A9DEE1-872E-40B0-9353-9E921ECA7CFE@iki.fi> On 23 Apr 2016, at 01:26, Joel Roth wrote: > > Hi Dovecot maintainers, > > I'm maintainer of Net::IMAP::Client, a perl IMAP client > library.[1] > > I've had two bug reports related to Dovecot's in-progress > messages.[2,3] > > While patches have been submitted to resolve both of these > bugs, I would like to minimize the possibilty of future > breakage. Hence the following questions: > > 1. Which parts of the RFC are relevant to the in-progress messages? > > 2. Do you have a list of all of Dovecot's in-progress messages? > > 3. If, in future, other in-progress messages may be added, > can you provide a standard syntax that I may use > to strip them from the reply stream. IMAP server is free to send any untagged replies to the client at any time. The IMAP clients should parse the wanted information from the received untagged replies and ignore the rest. It sounds like your IMAP library is doing exactly the opposite by treating any unexpected untagged replies as errors. Here's an excerpt from the RFC: Certain server data MUST be recorded by the client when it is received; this is noted in the description of that data. Such data conveys critical information which affects the interpretation of all subsequent commands and responses (e.g., updates reflecting the creation or destruction of messages). Other server data SHOULD be recorded for later reference; if the client does not need to record the data, or if recording the data has no obvious purpose (e.g., a SEARCH response when no SEARCH command is in progress), the data SHOULD be ignored. > 2. https://rt.cpan.org/Public/Bug/Display.html?id=84623 Strictly speaking a SEARCH command can return multiple untagged SEARCH replies, all of which should be merged together.. Luckily there are no servers actually doing it (that I'm aware of) and I'm not planning on changing Dovecot to do that either. > 3. https://rt.cpan.org/Public/Bug/Display.html?id=113489 This isn't enough. There are other untagged replies that can be sent. Dovecot can also send "* NO .." while it's waiting for locks. I'm also wondering how your client will behave when receiving unsolicited FETCH replies caused by other concurrent clients. For example this can happen: x uid fetch 1:* internaldate * 1 FETCH (UID 1 INTERNALDATE "22-Apr-2016 20:41:08 +0300") * 2 FETCH (UID 2 INTERNALDATE "22-Apr-2016 20:41:08 +0300") * 3 FETCH (UID 3 INTERNALDATE "22-Apr-2016 20:41:08 +0300") * 2 FETCH (FLAGS (\Seen)) * 4 EXISTS x OK Fetch completed (0.001 + 0.000 secs). Looks like Dovecot currently sends all these unsolicited responses after the requested replies, but that's not required by RFC. I'm not planning on changing it though, except that enabling NOTIFY extension can cause them to happen at any time. Also, I assume your library doesn't try to use message sequence numbers for anything and in general doesn't try to keep track of the latest mailbox state? Because that would require tracking the EXPUNGE/EXISTS/FETCH replies, which could happen as a result of most of the IMAP commands (except EXPUNGE has restrictions). Also a few links about writing IMAP clients: http://imapwiki.org/ClientImplementation http://dovecot.org/imap-client-coding-howto.html http://dovecot.org/client-commandments.txt From giovanni at giovannisfois.net Sat Apr 23 07:01:27 2016 From: giovanni at giovannisfois.net (giovanni at giovannisfois.net) Date: Sat, 23 Apr 2016 09:01:27 +0200 Subject: push-notification plugin and imap-metadata permissions In-Reply-To: <6B9D781F-16EC-4E6F-B127-AC4E4B2A3B0E@iki.fi> References: <571A165A.3050108@giovannisfois.net> <6B9D781F-16EC-4E6F-B127-AC4E4B2A3B0E@iki.fi> Message-ID: <571B1DC7.2070102@giovannisfois.net> On 2016-04-22 09:07 PM, Timo Sirainen wrote: > On 22 Apr 2016, at 15:17, Giovanni S. Fois wrote: >> In order to tell if a mailbox is enabled to send out the notification, the plugin >> looks out for the following mailbox metadata key: >> /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify >> >> If the key is set then everything is OK and the notification is sent, otherwise the >> action is skipped. >> >> If I try to setup the metadata key by hand (telnet as the user over the imap port): >> setmetadata INBOX (/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") >> >> I get the error message: "Internal mailbox attributes cannot be accessed" > Server metadata is set with: > > a SETMETADATA "" (/private/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") > > Which should internally map into the INBOX's /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify. > I am sorry, but this is not working. As you suggested I have launched the imap commands: a setmetadata "" (/private/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") b getmetadata "" "/private/vendor/vendor.dovecot/http-notify" c getmetadata "INBOX" "/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify" the 'b' command returns a sort of json with the correct result the 'c' command returns NIL By the way, hardcoding the key as "/private/vendor/vendor.dovecot/http-notify" and recompiling the plugin has the effect to bring the system on the expected course. Thank you again for your time and kind support. Have a good weekend, Giovanni From andrew.mcglashan at affinityvision.com.au Sat Apr 23 13:20:12 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Sat, 23 Apr 2016 23:20:12 +1000 Subject: Maildir P flag? Message-ID: Hi, I use Thunderbird with a mailredirect addon. It used to show me which emails were redirected. I believe it used the "P" Maildiir flag for this status. Now it seems that none of my email store has any file with a flag of P. Is this something that dovecot may have adjusted with my mail store? And if so, why? If not, any ideas where I might look for the next "culprit"? ;-) Thanks AndrewM -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 195 bytes Desc: OpenPGP digital signature URL: From andrew.mcglashan at affinityvision.com.au Sat Apr 23 18:27:47 2016 From: andrew.mcglashan at affinityvision.com.au (Andrew McGlashan) Date: Sun, 24 Apr 2016 04:27:47 +1000 Subject: Redirect indicator issue in Maildir flag seems to be an issue [missing?] Message-ID: <9a1ecd04-4067-5134-df37-7ee563631554@affinityvision.com.au> Hi, I've got an issue with the latest Thunderbird, although I'm not sure this is when the problem started (version 45.0) it has an add-on "mailredirect (version 0.8.7)". In the past I've been able to redirect mail (bounce them) and I get a nice little green arrow like indicator (in TB) to show that I redirected the particular email. Now, that green arrow appears briefly, then it goes away and I can no longer tell by looking at my email list if the email has, in fact, been bounced or not. I suspect it is dovecot on the Debian server: dovecot-common 1:2.1.7-7+deb7u1 dovecot-core 1:2.1.7-7+deb7u1 dovecot-imapd 1:2.1.7-7+deb7u1 dovecot-pop3d 1:2.1.7-7+deb7u1 It isn't just Thunderbird though, as I just tried to redirect using a Squirrelmail plugin, and it gives me the same problem; so I don't think it is at the MUA end of the deal. It /may/ be that TB is setting the flag and resetting it or dovecot is resetting it.... Any ideas? Nobody else has seen this yet? Thanks AndrewM -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 195 bytes Desc: OpenPGP digital signature URL: From juri at koschikode.com Sat Apr 23 19:45:10 2016 From: juri at koschikode.com (Juri Haberland) Date: Sat, 23 Apr 2016 21:45:10 +0200 Subject: Redirect indicator issue in Maildir flag seems to be an issue [missing?] In-Reply-To: <9a1ecd04-4067-5134-df37-7ee563631554@affinityvision.com.au> References: <9a1ecd04-4067-5134-df37-7ee563631554@affinityvision.com.au> Message-ID: <571BD0C6.6000405@koschikode.com> On 23.04.2016 20:27, Andrew McGlashan wrote: > Hi, Hi Andrew, > I've got an issue with the latest Thunderbird, although I'm not sure > this is when the problem started (version 45.0) it has an add-on > "mailredirect (version 0.8.7)". > > In the past I've been able to redirect mail (bounce them) and I get a > nice little green arrow like indicator (in TB) to show that I > redirected the particular email. I use the redirect mail plugin as well, even though with currently with Thunderbird 38.6.0 on Linux (Ubuntu) together with Dovecot 2.2.23 and I don't see this problem. The only thing that I see is that with Squirrelmail I never get this little green arrow (or a 'b' at the end of the filename (using maildir)). So it's either the new Thunderbird, or the old Dovecot... Isn't much of a help, but a data point at least... Cheers, Juri From bill-dovecot at carpenter.org Sat Apr 23 21:50:33 2016 From: bill-dovecot at carpenter.org (WJCarpenter) Date: Sat, 23 Apr 2016 14:50:33 -0700 Subject: expunging messages doesn't update maildirsize In-Reply-To: <5716E6CD.6050101@carpenter.org> References: <5716E6CD.6050101@carpenter.org> Message-ID: <571BEE29.4080008@carpenter.org> On 04/19/2016 07:17 PM, WJCarpenter wrote: > Is it by design that dovecot doesn't update maildirsize immediately > when messages are expunged? If yes, why? Replying to my own question since I figured it out. Local config glitch, not a dovecot bug or design fault. I should have mentioned that I don't use dovecot's local delivery agent. Updates to maildirsize for newly arriving messages is done by exim. Boring details follow. They become interesting details if you are having the same problem. :-) I use the SQL backend for keeping track of user data, including quota values. Consequently, I have configured 3 very similar (but not identical) SQL queries for that user data. One is in my exim config, and two (password_query and user_query) are in my dovecot-sql.conf. Those of you familiar with dovecot's SQL queries will know that the password_query can also return values that would ordinarily be looked up via user_query, the motivation being that user_query can often be skipped completely. The dovecot 2.2.9 release broke that userdb prefetch feature (it was fixed soon after, but I am using my distribution's dovecot version [Ubuntu 14.04], which is stuck at 2.2.9). Even though userdb prefetch doesn't work and both passdb and userdb queries are both done every time, my user_query is just a clone of my password_query in anticipation of the day when I can get rid of user_query. It's the cloning of the query where things went wrong. In the password_query, the prefetched user quota value is returned as "userdb_quota". In the user_query, it's returned as "quota". When I cloned the query, I neglected to change "userdb_quota" to "quota" in my select list. (That's a bummer, because I did correctly change "userdb_home" to "home" in my select list, so I must've known I should do it.) The net is that dovecot did the password_query and got the correct value for the user quota. It then ignored that (due to the prefetch bug) and did the user_query. The user_query reported the user quota with the wrong field name, and dovecot figured there was no quota for that user (which means /every/ user). Once I fixed my 7-character configuration mistake, it started working correctly. For the sake of brevity, I've left out the parts where I went down a bunch of blind alleys before finding the correct solution. :-) From corneliuscharlie1 at gmail.com Sun Apr 24 01:44:45 2016 From: corneliuscharlie1 at gmail.com (Cornelius Charlie) Date: Sun, 24 Apr 2016 03:44:45 +0200 Subject: Strange search behavior Message-ID: Hello, I experienced a strange behavior in the way dovecot is performing searches, I only experienced this exact issue with the flag "seen". If I perform this command: UID SORT (SIZE) UTF-8 FLAGGED SEEN Dovecot return every seen messages even if the message is not "flagged'. This is only happening when there is no unseen messages in the mailbox, if there is at least one, this is working properly. Any though ? Thanks. From jerry at seibercom.net Sun Apr 24 11:42:45 2016 From: jerry at seibercom.net (Jerry) Date: Sun, 24 Apr 2016 07:42:45 -0400 Subject: Moving to as new server Message-ID: <20160424074245.000046d4@seibercom.net> I will shortly have to replace the OS on my machine. For various reasons, I will not be able to use a program like ?imapsync? to transfer my documents to a new server. All of the mail folders on my present PC are stored under ?/var/mail/vmail?. If I copied all of the folders under ?vmail? and moved them to the new PC, would Dovecot be able to access them normally? Dovecot would not be running while I moved the files. Thanks From ebroch at whitehorsetc.com Sun Apr 24 14:22:21 2016 From: ebroch at whitehorsetc.com (Eric) Date: Sun, 24 Apr 2016 08:22:21 -0600 Subject: Moving to as new server In-Reply-To: <20160424074245.000046d4@seibercom.net> References: <20160424074245.000046d4@seibercom.net> Message-ID: <09bc72c8-c6ba-713d-2336-9f4fd9f5013f@whitehorsetc.com> I use 'rsync' as a failover tool, never a problem. On 4/24/2016 5:42 AM, Jerry wrote: > I will shortly have to replace the OS on my machine. For various > reasons, I will not be able to use a program like ?imapsync? to > transfer my documents to a new server. All of the mail folders on my > present PC are stored under ?/var/mail/vmail?. If I copied all of the > folders under ?vmail? and moved them to the new PC, would Dovecot be > able to access them normally? Dovecot would not be running while I > moved the files. > > Thanks From aki.tuomi at dovecot.fi Mon Apr 25 06:32:57 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Mon, 25 Apr 2016 09:32:57 +0300 Subject: Strange search behavior In-Reply-To: References: Message-ID: <571DBA19.7090806@dovecot.fi> On 24.04.2016 04:44, Cornelius Charlie wrote: > Hello, > > I experienced a strange behavior in the way dovecot is performing searches, > I only experienced this exact issue with the flag "seen". > > If I perform this command: > > UID SORT (SIZE) UTF-8 FLAGGED SEEN > > Dovecot return every seen messages even if the message is not "flagged'. > > This is only happening when there is no unseen messages in the mailbox, if > there is at least one, this is working properly. > > Any though ? > > Thanks. Hi! Can you provide version information and your doveconf -n? --- Aki Tuomi Dovecot Oy From skdovecot at smail.inf.fh-brs.de Mon Apr 25 07:28:48 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Mon, 25 Apr 2016 09:28:48 +0200 (CEST) Subject: Moving to as new server In-Reply-To: <20160424074245.000046d4@seibercom.net> References: <20160424074245.000046d4@seibercom.net> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Sun, 24 Apr 2016, Jerry wrote: > I will shortly have to replace the OS on my machine. For various > reasons, I will not be able to use a program like ?imapsync? to > transfer my documents to a new server. All of the mail folders on my > present PC are stored under ?/var/mail/vmail?. If I copied all of the > folders under ?vmail? and moved them to the new PC, would Dovecot be > able to access them normally? Dovecot would not be running while I > moved the files. if the access permissions and Dovecot config keeps the same, there should be no problem. - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVx3HMHz1H7kL/d9rAQJzfwf+NHI7/dDP7PY5091RuihDW+fLj0by6gqk OfuG+N+DHBq3gmuuFKKWm0IsbAwHCjz+oOQQjNuYOXJqk0meLLXzlDbihlZlXMRk wmBa+Fm7Cseuo6Pp+ALYUAbZRoV4gprYfy99+H3cmA9ycjjgR8wO0K+rYS2nivGH fb3xF9YVl3hnZtLGTFzMgTFTmGQF0uPrWgylmLaAMY5XFUx9nt4DwTzrOvIRvfzl 5qAbJYNpDPQoFRUd7tqEyn+UpTIFFqbgPZbSNY/2SkTom5crzhhpDkx1kBxwYhnS ryEazZTO3c1YhgkAZH4Ab7kypAcXRbqWzU56DRvWwnLvpnAysyCaUQ== =Glxy -----END PGP SIGNATURE----- From teemu.huovila at dovecot.fi Mon Apr 25 08:51:30 2016 From: teemu.huovila at dovecot.fi (Teemu Huovila) Date: Mon, 25 Apr 2016 11:51:30 +0300 Subject: push-notification plugin and imap-metadata permissions In-Reply-To: <571B1DC7.2070102@giovannisfois.net> References: <571A165A.3050108@giovannisfois.net> <6B9D781F-16EC-4E6F-B127-AC4E4B2A3B0E@iki.fi> <571B1DC7.2070102@giovannisfois.net> Message-ID: <571DDA92.3000301@dovecot.fi> On 23.04.2016 10:01, giovanni at giovannisfois.net wrote: > > > On 2016-04-22 09:07 PM, Timo Sirainen wrote: >> On 22 Apr 2016, at 15:17, Giovanni S. Fois wrote: >>> In order to tell if a mailbox is enabled to send out the notification, the plugin >>> looks out for the following mailbox metadata key: >>> /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify >>> >>> If the key is set then everything is OK and the notification is sent, otherwise the >>> action is skipped. >>> >>> If I try to setup the metadata key by hand (telnet as the user over the imap port): >>> setmetadata INBOX (/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") >>> >>> I get the error message: "Internal mailbox attributes cannot be accessed" >> Server metadata is set with: >> >> a SETMETADATA "" (/private/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") >> >> Which should internally map into the INBOX's /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify. >> > > I am sorry, but this is not working. > As you suggested I have launched the imap commands: > > a setmetadata "" (/private/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") > b getmetadata "" "/private/vendor/vendor.dovecot/http-notify" > c getmetadata "INBOX" "/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify" > > the 'b' command returns a sort of json with the correct result > the 'c' command returns NIL After command "a", I think you should have gotten the push notification. The getmetadata imap command is not supposed to be able to access the path with /pvr/server/ in it. It is used for internal mapping only. Since command "b" returned the data, I would say the metadata is correctly set. br, Teemu Huovila > > By the way, hardcoding the key as "/private/vendor/vendor.dovecot/http-notify" and recompiling the plugin > has the effect to bring the system on the expected course. > > Thank you again for your time and kind support. > > Have a good weekend, > Giovanni From taropalo at kronometrix.org Mon Apr 25 09:39:51 2016 From: taropalo at kronometrix.org (Aropalo Tommi) Date: Mon, 25 Apr 2016 12:39:51 +0300 Subject: Setting up replication? In-Reply-To: References: <56F309FD.6030704@knutejohnson.com> <5718BAA0.1030908@kronometrix.org> <57190521.2020407@knutejohnson.com> <571947ED.10609@knutejohnson.com> <57197622.4020203@pettijohn-web.com> Message-ID: <571DE5E7.6090000@kronometrix.org> On 22/04/16 20:17, Knute Johnson wrote: > On 4/21/2016 17:53, Edgar Pettijohn wrote: >> >> http://wiki.dovecot.org/MboxLocking > > Thanks Edgar, I hadn't seen that page before. I've tried every > combination of locking but still get the same errors. > > I would love to see somebody's config files that has this working on a > Ubuntu server. > > Thanks, > Hi Knute, here are my dovecot config's. It seems to be somehow sometimes for me. I am not expert of dovecot just started few weeks ago. I have been playing around and I am not sure what makes mine to work. I have 2 similar configured servers. Config's are not identical. I had problem with notification "Error: open(/var/run/dovecot/replication-notify-fifo) failed: Permission denied." Still not working perfectly. Replication worked when I used that users UID in "service aggregator" and "unix_listener replication-notify." Then the other user was failing .... I am using only imap part and haven't test other protocols if they work or not. The other protocols like pop and sieve came by default. I didn't bother to remove them. #doveadm sync -A remote:u15dove2 command will sync things but I still have some problems. Hopefully this might get you to correct track. One more thing. I copied root's ssh keys as authorized_keys so I can ssh -lroot other machine without password and visa verse. So sorry no perfect solution yet avail .... Linux u15dove1 4.2.0-16-generic #19-Ubuntu SMP Thu Oct 8 15:35:06 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux root at u15dove1:/etc/dovecot# cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=15.10 DISTRIB_CODENAME=wily DISTRIB_DESCRIPTION="Ubuntu 15.10" u15dove1 doveconf: root at u15dove1:/etc/dovecot# doveconf -n # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.2.0-16-generic x86_64 Ubuntu 15.10 auth_mechanisms = plain login dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u first_valid_uid = 1000 last_valid_uid = 2000 mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { mail_replica = remote:root at u15dove2 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service aggregator { fifo_listener replication-notify-fifo { user = postfix } unix_listener replication-notify { user = postfix } } service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 mail_plugins = " notify replication" } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } u15dove2 config: root at u15dove2:/etc/dovecot# doveconf -n # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.2.0-16-generic x86_64 Ubuntu 15.10 auth_mechanisms = plain login dsync_remote_cmd = ssh -l%{login} %{host} doveadm dsync-server -u%u first_valid_uid = 1000 last_valid_uid = 2000 mail_location = maildir:~/Maildir managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { driver = pam } plugin { mail_replica = remote:root at u15dove1 sieve = ~/.dovecot.sieve sieve_dir = ~/sieve } protocols = imap pop3 sieve service aggregator { fifo_listener replication-notify-fifo { user = root } unix_listener replication-notify { user = root } } service auth { unix_listener /var/spool/postfix/private/dovecot-auth { group = postfix mode = 0660 user = postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0666 } } ssl_cert = was automatically rejected:%n%r } protocol imap { imap_client_workarounds = delay-newmail mail_max_userip_connections = 10 } protocol pop3 { mail_max_userip_connections = 10 pop3_client_workarounds = outlook-no-nuls oe-ns-eoh } From tobster at brain-force.ch Mon Apr 25 10:48:11 2016 From: tobster at brain-force.ch (Tobi) Date: Mon, 25 Apr 2016 12:48:11 +0200 Subject: Kernel panic in dovecot-ee-lmtp on Debian 8 Message-ID: <571DF5EB.5080004@brain-force.ch> Hi list I just realized that that I don not receive all mails in my mailbox (running dovecot-ee 2.2.23.1-1 on Debian 8). On my frontend servers (running postfix) the queue fills up with mails that cannot be delivered via lmtp to my backend servers. The error message on the frontend is "lost connection with backend while sending data" When I checked the logs on the backend server I found upon every delivery attempt kernel panics Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Panic: epoll_ctl(del, 18) failed: Bad file descriptor Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x85dee) [0x7faa19225dee] -> /usr/lib/dovecot/libdovecot.so.0(+0x85edc) [0x7faa19225edc] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7faa191ca5be] -> /usr/lib/dovecot/libdovecot.so.0(+0x9afc1) [0x7faa1923afc1] -> /usr/lib/dovecot/libdovecot.so.0(+0x994af) [0x7faa192394af] -> /usr/lib/dovecot/libdovecot.so.0(+0xa5eda) [0x7faa19245eda] -> /usr/lib/dovecot/libdovecot.so.0(+0xa4566) [0x7faa19244566] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_destroy+0xe) [0x7faa192446ee] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x7e44b) [0x7faa17d3a44b] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x7ea14) [0x7faa17d3aa14] -> /usr/lib/dovecot/libdovecot.so.0(+0xa6d88) [0x7faa19246d88] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7faa19239c6c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7faa1923b0d1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7faa19239cf5] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7faa19239e98] -> /usr/lib/dovecot/libdovecot-sieve.so.0(program_client_run+0xe8) [0x7faa17d3b308] -> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x45b8) [0x7faa15d855b8] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0x7c) [0x7faa17cfa2ac] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_run+0x2b) [0x7faa17cfa4cb] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x519e0) [0x7faa17d0d9e0] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x47) [0x7faa17d0e567] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x3b6b) [0x7faa17f73b6b] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x49) [0x7faa197e5849] -> dovecot/lmtp() [0x4064b3] -> dovecot/lmtp() [0x406cb4] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x4c) [0x7faa19239c6c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x101) [0x7faa1923b0d1] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) [0x7faa19239cf5] Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Fatal: master: service(lmtp): child 32081 killed with signal 6 (core dumps disabled) the weird thing is that this is not concerning all incoming mails. From time to time the frontends can deliver messages to my backends. I just tested it with a mail from work. It arrived via a frontend that has other mails in queue that could not be delivered so far. Does anyone have an idea where I could look for the root cause of this panic messages? Thanks a lot tobi From leithner at itronic.at Mon Apr 25 12:47:39 2016 From: leithner at itronic.at (Harald Leithner) Date: Mon, 25 Apr 2016 14:47:39 +0200 Subject: IX Out of Order? Message-ID: <93768d0a-6fe7-4971-6734-b0bf41468824@itronic.at> Hi, It seams that ix.dovecot.fi has not build a new version since 2016-04-19 20:03 regards, -- Harald Leithner ITronic Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner at itronic.at | itronic.at From stephan at rename-it.nl Mon Apr 25 13:16:55 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 25 Apr 2016 15:16:55 +0200 Subject: IX Out of Order? In-Reply-To: <93768d0a-6fe7-4971-6734-b0bf41468824@itronic.at> References: <93768d0a-6fe7-4971-6734-b0bf41468824@itronic.at> Message-ID: <571E18C7.1030500@rename-it.nl> Oops. Turned off package composer for maintenance, but didn't turn it back on. It is building now..... Op 25-4-2016 om 14:47 schreef Harald Leithner: > Hi, > > It seams that ix.dovecot.fi has not build a new version since > 2016-04-19 20:03 > > regards, > > From tss at iki.fi Mon Apr 25 16:01:27 2016 From: tss at iki.fi (Timo Sirainen) Date: Mon, 25 Apr 2016 19:01:27 +0300 Subject: Kernel panic in dovecot-ee-lmtp on Debian 8 In-Reply-To: <571DF5EB.5080004@brain-force.ch> References: <571DF5EB.5080004@brain-force.ch> Message-ID: <549F3530-986E-40C0-BCBC-712BB82395D1@iki.fi> On 25 Apr 2016, at 13:48, Tobi wrote: > > Hi list > > I just realized that that I don not receive all mails in my mailbox > (running dovecot-ee 2.2.23.1-1 on Debian 8). On my frontend servers > (running postfix) the queue fills up with mails that cannot be delivered > via lmtp to my backend servers. The error message on the frontend is > "lost connection with backend while sending data" > When I checked the logs on the backend server I found upon every > delivery attempt kernel panics > > Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Panic: epoll_ctl(del, 18) > failed: Bad file descriptor > Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Error: Raw backtrace: Can you get a core dump and gdb backtrace? See http://dovecot.org/bugreport.html#coredumps > /usr/lib/dovecot/libdovecot-sieve.so.0(program_client_run+0xe8) > [0x7faa17d3b308] -> > /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x45b8) [0x7faa15d855b8] > -> > /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0x7c) > [0x7faa17cfa2ac] -> > > the weird thing is that this is not concerning all incoming mails. From > time to time the frontends can deliver messages to my backends. I just > tested it with a mail from work. It arrived via a frontend that has > other mails in queue that could not be delivered so far. > > Does anyone have an idea where I could look for the root cause of this > panic messages? Looks like somehow caused by sieve extprograms. From stephan at rename-it.nl Mon Apr 25 16:46:50 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 25 Apr 2016 18:46:50 +0200 Subject: Kernel panic in dovecot-ee-lmtp on Debian 8 In-Reply-To: <549F3530-986E-40C0-BCBC-712BB82395D1@iki.fi> References: <571DF5EB.5080004@brain-force.ch> <549F3530-986E-40C0-BCBC-712BB82395D1@iki.fi> Message-ID: <571E49FA.9080009@rename-it.nl> Op 25-4-2016 om 18:01 schreef Timo Sirainen: > On 25 Apr 2016, at 13:48, Tobi wrote: >> Hi list >> >> I just realized that that I don not receive all mails in my mailbox >> (running dovecot-ee 2.2.23.1-1 on Debian 8). On my frontend servers >> (running postfix) the queue fills up with mails that cannot be delivered >> via lmtp to my backend servers. The error message on the frontend is >> "lost connection with backend while sending data" >> When I checked the logs on the backend server I found upon every >> delivery attempt kernel panics >> >> Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Panic: epoll_ctl(del, 18) >> failed: Bad file descriptor >> Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Error: Raw backtrace: > Can you get a core dump and gdb backtrace? See http://dovecot.org/bugreport.html#coredumps > >> /usr/lib/dovecot/libdovecot-sieve.so.0(program_client_run+0xe8) >> [0x7faa17d3b308] -> >> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x45b8) [0x7faa15d855b8] >> -> >> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0x7c) >> [0x7faa17cfa2ac] -> >> >> the weird thing is that this is not concerning all incoming mails. From >> time to time the frontends can deliver messages to my backends. I just >> tested it with a mail from work. It arrived via a frontend that has >> other mails in queue that could not be delivered so far. >> >> Does anyone have an idea where I could look for the root cause of this >> panic messages? > Looks like somehow caused by sieve extprograms. Probably this bug: https://git.dovecot.net/pigeonhole/core/commit/a95b0579b89c13fb3ee5700e76cbe6a4a3e898e0 Fixed for upcoming release. Regards, Stephan. From michael.slusarz at dovecot.fi Mon Apr 25 18:28:14 2016 From: michael.slusarz at dovecot.fi (Michael Slusarz) Date: Mon, 25 Apr 2016 12:28:14 -0600 (MDT) Subject: Kernel panic in dovecot-ee-lmtp on Debian 8 In-Reply-To: <571E49FA.9080009@rename-it.nl> References: <571DF5EB.5080004@brain-force.ch> <549F3530-986E-40C0-BCBC-712BB82395D1@iki.fi> <571E49FA.9080009@rename-it.nl> Message-ID: <646491873.1231.1461608894265@appsuite-dev.open-xchange.com> Fixed -- Publicly accessible link to commit: https://github.com/dovecot/pigeonhole/commit/a95b0579b89c13fb3ee5700e76cbe6a4a3e898e0 > On April 25, 2016 at 10:46 AM Stephan Bosch wrote: > > > > > Op 25-4-2016 om 18:01 schreef Timo Sirainen: > > On 25 Apr 2016, at 13:48, Tobi wrote: > >> Hi list > >> > >> I just realized that that I don not receive all mails in my mailbox > >> (running dovecot-ee 2.2.23.1-1 on Debian 8). On my frontend servers > >> (running postfix) the queue fills up with mails that cannot be delivered > >> via lmtp to my backend servers. The error message on the frontend is > >> "lost connection with backend while sending data" > >> When I checked the logs on the backend server I found upon every > >> delivery attempt kernel panics > >> > >> Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Panic: epoll_ctl(del, 18) > >> failed: Bad file descriptor > >> Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Error: Raw backtrace: > > Can you get a core dump and gdb backtrace? See http://dovecot.org/bugreport.html#coredumps > > > >> /usr/lib/dovecot/libdovecot-sieve.so.0(program_client_run+0xe8) > >> [0x7faa17d3b308] -> > >> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x45b8) [0x7faa15d855b8] > >> -> > >> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0x7c) > >> [0x7faa17cfa2ac] -> > >> > >> the weird thing is that this is not concerning all incoming mails. From > >> time to time the frontends can deliver messages to my backends. I just > >> tested it with a mail from work. It arrived via a frontend that has > >> other mails in queue that could not be delivered so far. > >> > >> Does anyone have an idea where I could look for the root cause of this > >> panic messages? > > Looks like somehow caused by sieve extprograms. > > Probably this bug: > > https://git.dovecot.net/pigeonhole/core/commit/a95b0579b89c13fb3ee5700e76cbe6a4a3e898e0 > > Fixed for upcoming release. > > Regards, > > Stephan. From stephan at rename-it.nl Mon Apr 25 19:49:05 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Mon, 25 Apr 2016 21:49:05 +0200 Subject: Kernel panic in dovecot-ee-lmtp on Debian 8 In-Reply-To: <646491873.1231.1461608894265@appsuite-dev.open-xchange.com> References: <571DF5EB.5080004@brain-force.ch> <549F3530-986E-40C0-BCBC-712BB82395D1@iki.fi> <571E49FA.9080009@rename-it.nl> <646491873.1231.1461608894265@appsuite-dev.open-xchange.com> Message-ID: <571E74B1.8020506@rename-it.nl> Op 4/25/2016 om 8:28 PM schreef Michael Slusarz: > Fixed -- Publicly accessible link to commit: > > https://github.com/dovecot/pigeonhole/commit/a95b0579b89c13fb3ee5700e76cbe6a4a3e898e0 > Oh, oops. :) >> On April 25, 2016 at 10:46 AM Stephan Bosch wrote: >> >> >> >> >> Op 25-4-2016 om 18:01 schreef Timo Sirainen: >>> On 25 Apr 2016, at 13:48, Tobi wrote: >>>> Hi list >>>> >>>> I just realized that that I don not receive all mails in my mailbox >>>> (running dovecot-ee 2.2.23.1-1 on Debian 8). On my frontend servers >>>> (running postfix) the queue fills up with mails that cannot be delivered >>>> via lmtp to my backend servers. The error message on the frontend is >>>> "lost connection with backend while sending data" >>>> When I checked the logs on the backend server I found upon every >>>> delivery attempt kernel panics >>>> >>>> Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Panic: epoll_ctl(del, 18) >>>> failed: Bad file descriptor >>>> Apr 25 12:33:36 mbox1 dovecot: lmtp(REDACTED): Error: Raw backtrace: >>> Can you get a core dump and gdb backtrace? See http://dovecot.org/bugreport.html#coredumps >>> >>>> /usr/lib/dovecot/libdovecot-sieve.so.0(program_client_run+0xe8) >>>> [0x7faa17d3b308] -> >>>> /usr/lib/dovecot/modules/sieve/lib90_sieve_extprograms_plugin.so(+0x45b8) [0x7faa15d855b8] >>>> -> >>>> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0x7c) >>>> [0x7faa17cfa2ac] -> >>>> >>>> the weird thing is that this is not concerning all incoming mails. From >>>> time to time the frontends can deliver messages to my backends. I just >>>> tested it with a mail from work. It arrived via a frontend that has >>>> other mails in queue that could not be delivered so far. >>>> >>>> Does anyone have an idea where I could look for the root cause of this >>>> panic messages? >>> Looks like somehow caused by sieve extprograms. >> Probably this bug: >> >> https://git.dovecot.net/pigeonhole/core/commit/a95b0579b89c13fb3ee5700e76cbe6a4a3e898e0 >> >> Fixed for upcoming release. >> >> Regards, >> >> Stephan. From hs at schlittermann.de Mon Apr 25 22:00:54 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Tue, 26 Apr 2016 00:00:54 +0200 Subject: doveadm backup 2.2.23 ignores -u, but reads USER environment? Message-ID: <20160425220054.GX14754@jumper.schlittermann.de> Hi, during a migration (cyrus -> dovecot) we ran into trouble? using 'doveadm backup' with 2.2.9. So I built 2.2.22 and 2.2.23, but they expose quite different behaviour. 2.2.22 seems to work at least partially, but 2.2.23 complains about a non existing user (root?). The command I'm running is: doveadm -o pop3_uidl_format=%v.%u \ -o imapc_master_user=cyrus -o imapc_password=* -o imapc_host=* \ -o mail_fsync=never \ -o imapc_ssl_verify=no -o imapc_ssl=imaps -o imapc_port=993 \ backup -f -u heiko -R imapc: Using 2.2.9 or 2.2.22 it works, using 2.2.23 "-u ?" is ignored and I've to pass the user via the USER environment. But according to the manpage of doveadm-sync -u user/mask Run the command only for the given user. It's also possible to use '*' and '?' wildcards (e.g. -u *@example.org). When neither the -A option, nor the -F file option, nor the -u user was specified, the command will be executed with the environment of the currently logged in user. Interestingly enough -u 'heiko*' works fine, even with USER=root. So the environment doesn't seem to override -u ? always. Maybe an important side note: the user 'heiko' doesn't exist as a local system user, he is known via LDAP only. And for e.g. 'doveadm quota -u heiko' it works as expected, even with 2.2.23. ?) solved meanwhile by using -o mail_plugins= as the quota plugin seems to crash 'doveadm backup' Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From tobster at brain-force.ch Tue Apr 26 07:24:28 2016 From: tobster at brain-force.ch (Tobi) Date: Tue, 26 Apr 2016 09:24:28 +0200 Subject: Kernel panic in dovecot-ee-lmtp on Debian 8 In-Reply-To: <549F3530-986E-40C0-BCBC-712BB82395D1@iki.fi> References: <571DF5EB.5080004@brain-force.ch> <549F3530-986E-40C0-BCBC-712BB82395D1@iki.fi> Message-ID: <571F17AC.1050302@brain-force.ch> Am 25.04.2016 um 18:01 schrieb Timo Sirainen: > > Can you get a core dump and gdb backtrace? See http://dovecot.org/bugreport.html#coredumps > I tried to send the mail yesterday with the backtrace and the coredump. But it was too big for this list :-) So here the backtrace attached and the coredump as tar.gz on my webpage: https://brain-force.ch/wp-content/uploads/2016/04/core.dump_.tar.gz Hopefully it helps > > Looks like somehow caused by sieve extprograms. > the only external script that I have running on my dovecot is gpgit (https://gitlab.com/mikecardwell/gpgit) which I implemented like plugin { sieve_plugins = sieve_extprograms sieve_extensions = +vnd.dovecot.filter sieve_filter_bin_dir = /etc/dovecot/sieve-filters } and ln -s /path/to/gpgit/gpgit.pl /etc/dovecot/sieve-filters/gpgit Best Regards tobi -------------- next part -------------- (gdb) bt full #0 0x00007f44c7dc0067 in raise () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #1 0x00007f44c7dc1448 in abort () from /lib/x86_64-linux-gnu/libc.so.6 No symbol table info available. #2 0x00007f44c81bbde6 in ?? () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #3 0x00007f44c81bbedc in ?? () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #4 0x00007f44c81605be in i_panic () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #5 0x00007f44c81d0fc1 in io_loop_handle_remove () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #6 0x00007f44c81cf4af in ?? () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #7 0x00007f44c81dbeda in ?? () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #8 0x00007f44c81da566 in ?? () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #9 0x00007f44c81da6ee in o_stream_destroy () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #10 0x00007f44c6cd044b in program_client_close_output (pclient=pclient at entry=0x1fe7f70) at program-client.c:54 ret = 1 #11 0x00007f44c6cd0a14 in program_client_program_output (pclient=0x1fe7f70) at program-client.c:215 input = output = 0x1fd5330 data = size = 33378920 ret = #12 0x00007f44c81dcd88 in ?? () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #13 0x00007f44c81cfc6c in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #14 0x00007f44c81d10d1 in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #15 0x00007f44c81cfcf5 in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #16 0x00007f44c81cfe98 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #17 0x00007f44c6cd1308 in program_client_run (pclient=0x1fe7f70) at program-client.c:510 ret = 0 #18 0x00007f44c4d1b5b8 in cmd_filter_operation_execute (renv=0x1fe5548, address=0x1fe3593) at cmd-filter.c:190 mail = 0x1fa1300 this_ext = 0x1fa1300 is_test = 0 args_list = 0x1efafd0 error = SIEVE_ERROR_NONE pname = 0x1efaf48 program_name = 0x1fe3593 "gpgit" args = 0x1efb068 newmsg = 0x0 sprog = 0x1fd36d0 ret = 1 #19 0x00007f44c6c902ac in sieve_interpreter_operation_execute (interp=0x1fe54f0) at sieve-interpreter.c:870 _data_stack_cur_id = 4 op = 0x7f44c4f1fa40 result = 1 oprtn = 0x1fe55d8 address = 0x1fe5590 #20 sieve_interpreter_continue (interp=interp at entry=0x1fe54f0, interrupted=interrupted at entry=0x0) at sieve-interpreter.c:908 renv = 0x1fe5548 address = 0x1fe5590 ret = 1 #21 0x00007f44c6c9049a in sieve_interpreter_start (interp=interp at entry=0x1fe54f0, result=, interrupted=interrupted at entry=0x0) at sieve-interpreter.c:939 ext_count = i = ---Type to continue, or q to quit--- #22 0x00007f44c6c904cb in sieve_interpreter_run (interp=0x1fe54f0, result=0x1fe6500) at sieve-interpreter.c:950 ret = 0 #23 0x00007f44c6ca39e0 in sieve_run (sbin=0x1fdf4d0, result=result at entry=0x7ffde7386f80, msgdata=0x7ffde7387060, senv=0x7ffde7387140, ehandler=, flags=) at sieve.c:343 interp = 0x1fe54f0 ret = 0 #24 0x00007f44c6ca4567 in sieve_execute (sbin=, msgdata=, senv=, exec_ehandler=, action_ehandler=0x1fd54f0, flags=, keep=0x0) at sieve.c:552 result = 0x1fe6500 ret = #25 0x00007f44c6f09b6b in lda_sieve_singlescript_execute (srctx=) at lda-sieve-plugin.c:449 action_ehandler = 0x1fd54f0 sbin = 0x1fdf4d0 mdctx = 0x7ffde73872d0 script = 0x1fd31f0 cpflags = SIEVE_COMPILE_FLAG_NOGLOBAL error = SIEVE_ERROR_NONE #26 lda_sieve_execute (storage_r=, srctx=) at lda-sieve-plugin.c:865 msgdata = {mail = 0x1fa1300, return_path = 0x1f36fd8 "Neuigkeiten at PCP.CH", orig_envelope_to = 0x1f37260 "tobster at brain-force.ch", final_envelope_to = 0x1f37260 "tobster at brain-force.ch", auth_user = 0x1fa5c18 "tobster at brain-force.ch", id = 0x1fa1c80 "<1724304819.2560055.1461552436159.JavaMail.WEB03$@10.100.8.5>"} estatus = {last_storage = 0x0, message_saved = 0, message_forwarded = 0, tried_default_save = 0, keep_original = 0, store_failed = 0} mdctx = 0x7ffde73872d0 svinst = 0x0 scriptenv = {user = 0x1fa5b20, default_mailbox = 0x40986a "INBOX", postmaster_address = 0x1f355f0 "postmaster at brain-force.ch", mailbox_autocreate = false, mailbox_autosubscribe = false, script_context = 0x7ffde73872d0, smtp_start = 0x7f44c6f08740 , smtp_add_rcpt = 0x7f44c6f08730 , smtp_send = 0x7f44c6f08720 , smtp_finish = 0x7f44c6f08700 , duplicate_check = 0x7f44c6f086c0 , duplicate_mark = 0x7f44c6f086e0 , duplicate_flush = 0x7f44c6f086b0 , reject_mail = 0x7f44c6f086a0 , exec_status = 0x7ffde7387050, trace_stream = 0x0, trace_config = { level = SIEVE_TRLVL_NONE, flags = 0}} #27 lda_sieve_deliver_mail (mdctx=0x1fd31f0, storage_r=0x1b83) at lda-sieve-plugin.c:926 _data_stack_cur_id = 3 srctx = {svinst = 0x1fcf4c0, mdctx = 0x7ffde73872d0, home_dir = 0x1fa7d30 "/home/vmail/brain-force.ch/tobster", scripts = 0x1efae68, script_count = 1, user_script = 0x1fd31f0, main_script = 0x1fd31f0, msgdata = 0x7ffde7387060, scriptenv = 0x7ffde7387140, user_ehandler = 0x1fd29d0, master_ehandler = 0x1fd28c0, action_ehandler = 0x0, userlog = 0x1efaee8 "/home/vmail/brain-force.ch/tobster/.dovecot.sieve.log"} svenv = {hostname = 0x1f98ce0 "mbox1.brain-force.ch", domainname = 0x0, base_dir = 0x1fa6f00 "/var/run/dovecot/", username = 0x1fa5c18 "tobster at brain-force.ch", home_dir = 0x1fa7d30 "/home/vmail/brain-force.ch/tobster", temp_dir = 0x1fa7ff0 "/tmp", flags = SIEVE_FLAG_HOME_RELATIVE, location = SIEVE_ENV_LOCATION_MDA, delivery_phase = SIEVE_DELIVERY_PHASE_DURING} i = 0 ret = 1 #28 0x00007f44c877b849 in mail_deliver () from /usr/lib/dovecot/libdovecot-lda.so.0 No symbol table info available. #29 0x00000000004064b3 in ?? () No symbol table info available. #30 0x0000000000406cb4 in ?? () No symbol table info available. #31 0x00007f44c81cfc6c in io_loop_call_io () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #32 0x00007f44c81d10d1 in io_loop_handler_run_internal () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #33 0x00007f44c81cfcf5 in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #34 0x00007f44c81cfe98 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #35 0x00007f44c81660e3 in master_service_run () from /usr/lib/dovecot/libdovecot.so.0 No symbol table info available. #36 0x0000000000404cb5 in main () No symbol table info available. From giovanni at giovannisfois.net Tue Apr 26 10:04:41 2016 From: giovanni at giovannisfois.net (Giovanni S. Fois) Date: Tue, 26 Apr 2016 12:04:41 +0200 Subject: push-notification plugin and imap-metadata permissions [SOLVED] In-Reply-To: <571DDA92.3000301@dovecot.fi> References: <571A165A.3050108@giovannisfois.net> <6B9D781F-16EC-4E6F-B127-AC4E4B2A3B0E@iki.fi> <571B1DC7.2070102@giovannisfois.net> <571DDA92.3000301@dovecot.fi> Message-ID: <571F3D39.5030300@giovannisfois.net> On 04/25/2016 10:51 AM, Teemu Huovila wrote: > > On 23.04.2016 10:01, giovanni at giovannisfois.net wrote: >> >> On 2016-04-22 09:07 PM, Timo Sirainen wrote: >>> On 22 Apr 2016, at 15:17, Giovanni S. Fois wrote: >>>> In order to tell if a mailbox is enabled to send out the notification, the plugin >>>> looks out for the following mailbox metadata key: >>>> /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify >>>> >>>> If the key is set then everything is OK and the notification is sent, otherwise the >>>> action is skipped. >>>> >>>> If I try to setup the metadata key by hand (telnet as the user over the imap port): >>>> setmetadata INBOX (/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") >>>> >>>> I get the error message: "Internal mailbox attributes cannot be accessed" >>> Server metadata is set with: >>> >>> a SETMETADATA "" (/private/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") >>> >>> Which should internally map into the INBOX's /private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify. >>> >> I am sorry, but this is not working. >> As you suggested I have launched the imap commands: >> >> a setmetadata "" (/private/vendor/vendor.dovecot/http-notify "user=myuser at mydomain.com") >> b getmetadata "" "/private/vendor/vendor.dovecot/http-notify" >> c getmetadata "INBOX" "/private/vendor/vendor.dovecot/pvt/server/vendor/vendor.dovecot/http-notify" >> >> the 'b' command returns a sort of json with the correct result >> the 'c' command returns NIL > After command "a", I think you should have gotten the push notification. The getmetadata imap command is not supposed to be able to access the path with /pvr/server/ in it. It is used for internal mapping only. Since command "b" returned the data, I would say the metadata is correctly set. > > br, > Teemu Huovila I was wrong. Trying to get it up and working I had polluted the mailbox metadata with spurious keys and values. After a full removal of the metadata keys everything is working as described by you. Thank you for your attention and support Greetings, Giovanni S. Fois From Burak.Seydioglu at servicenow.com Tue Apr 26 01:04:50 2016 From: Burak.Seydioglu at servicenow.com (Burak Seydioglu) Date: Tue, 26 Apr 2016 01:04:50 +0000 Subject: doveadm-server segfaults when searching or expunging with the -A flag Message-ID: Hello, I have an openldap backend that contains a large number of users and serves passdb and userdb requests. I was trying to work around the pop3 deletion issue that I had reported earlier (http://www.dovecot.org/list/dovecot/2016-April/103973.html) with the pop3_deleted_flag setting so I updated my configuration and created some background jobs to expunge deleted emails. However, doveadm-server segfaults when running search or expunge commands with the -A flag: doveadm search mailbox INBOX KEYWORD '$Pop3Deleted' -A doveadm expunge mailbox INBOX KEYWORD '$Pop3Deleted' -A ###################################### gdb /usr/libexec/dovecot/doveadm-server /var/crash/core-doveadm-server-11-0-0-2589-1461628665 #0 o_stream_cork (stream=0x0) at ostream.c:141 #1 0x0000000000430193 in server_connection_output (conn=0xfe10e0) at server-connection.c:126 #2 0x00007fcde9fc80c7 in plain_flush_callback (sstream=0xfdacf0) at ostream-openssl.c:180 #3 0x00007fcdeb6f9929 in stream_send_io (fstream=0xfe65e0) at ostream-file.c:482 #4 0x00007fcdeb6ebceb in io_loop_call_io (io=0xfdb110) at ioloop.c:564 #5 0x00007fcdeb6ed2e7 in io_loop_handler_run_internal (ioloop=) at ioloop-epoll.c:220 #6 0x00007fcdeb6ebd95 in io_loop_handler_run (ioloop=0xfdf4b0) at ioloop.c:612 #7 0x00007fcdeb6ebf38 in io_loop_run (ioloop=0xfdf4b0) at ioloop.c:588 #8 0x000000000041f542 in dsync_connect_tcp (ctx=0xfc7d70, mail_set=, target=, ssl=true, error_r=0x7ffde6127020) at doveadm-dsync.c:806 #9 0x000000000041ff95 in parse_location (_ctx=0xfc7d70, service_user=, error_r=0x7ffde6127020) at doveadm-dsync.c:837 #10 cmd_dsync_prerun (_ctx=0xfc7d70, service_user=, error_r=0x7ffde6127020) at doveadm-dsync.c:903 #11 0x00000000004205f2 in doveadm_mail_next_user (ctx=0xfc7d70, cctx=, error_r=0x7ffde6127020) at doveadm-mail.c:383 #12 0x000000000043151f in doveadm_mail_cmd_server_run (conn=0xfc3950) at client-connection.c:183 #13 doveadm_cmd_handle (conn=0xfc3950) at client-connection.c:266 #14 client_handle_command (conn=0xfc3950) at client-connection.c:330 #15 client_connection_input (conn=0xfc3950) at client-connection.c:444 #16 0x00007fcdeb6ebceb in io_loop_call_io (io=0xfc34f0) at ioloop.c:564 #17 0x00007fcdeb6ed2e7 in io_loop_handler_run_internal (ioloop=) at ioloop-epoll.c:220 #18 0x00007fcdeb6ebd95 in io_loop_handler_run (ioloop=0xf90780) at ioloop.c:612 #19 0x00007fcdeb6ebf38 in io_loop_run (ioloop=0xf90780) at ioloop.c:588 #20 0x00007fcdeb684753 in master_service_run (service=0xf90620, callback=) at master-service.c:640 #21 0x0000000000433897 in main (argc=1, argv=0xf903a0) at main.c:126 ###################################### Dovecot version ###################################### dovecot --version 2.2.23 (806d709) ###################################### doveconf -n ###################################### # 2.2.23 (806d709): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-573.22.1.el6.x86_64 x86_64 CentOS release 6.7 (Final) auth_debug = yes auth_mechanisms = plain login auth_verbose = yes base_dir = /var/run/dovecot/ disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it first_valid_uid = 89 last_valid_uid = 89 login_greeting = Dovecot ready on mda01.dc1.domain.com. login_trusted_networks = 127.0.0.1 mail_debug = yes mail_gid = 89 mail_plugins = " notify replication" mail_uid = 89 mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/conf.d/dovecot-ldap-passdb.conf.ext driver = ldap } plugin { mail_replica = tcps:mdareplica:12345 } pop3_deleted_flag = $POP3Deleted protocols = pop3 lmtp replication_full_sync_interval = 3 hours replication_max_conns = 20 service aggregator { fifo_listener replication-notify-fifo { group = postfix mode = 0640 user = postfix } unix_listener replication-notify { group = postfix mode = 0640 user = postfix } } service auth { unix_listener auth { mode = 0660 } } service doveadm { inet_listener { port = 12345 ssl = yes } } service lmtp { process_min_avail = 10 unix_listener lmtp { group = postfix mode = 0640 user = postfix } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = postfix mode = 0640 user = postfix } } ssl_cert = References: Message-ID: <571F697A.6020904@sissa.it> Same problem here: Apr 26 15:01:37 posta-01 dovecot: lmtp(2432): Error: net_connect_unix(/var/run/dovecot/anvil) failed: Permission denied # ls -l /var/run/dovecot/anvil srw------- 1 root root 0 Apr 26 15:08 /var/run/dovecot/anvil but I don't use 'lmtp_rcpt_check_quota'. Marco On 2016-04-07 14:39, Tom Sommer wrote: > On 2016-04-07 13:41, Tom Sommer wrote: >> I've set lmtp_user_concurrency_limit to 5 and now LMTP throws this at >> me for every delivery: >> >> Apr 07 13:38:33 lmtp(4434): Error: >> net_connect_unix(/var/run/dovecot/anvil) failed: Permission denied >> >> ls -l /var/run/dovecot/anvil >> srw------- 1 root root 0 Apr 7 13:32 /var/run/dovecot/anvil >> >> If I set lmtp_user_concurrency_limit to 0, the error goes away. > > Hrm, if I disable lmtp_rcpt_check_quota, then the error goes away as > well. Very confusing. > -- Marco Giunta - ITCS SysAdmin Via Bonomea, 265 34136 - Trieste, Italy Tel: +39-040-3787-503 Fax: +39-040-3787-244 From leithner at itronic.at Tue Apr 26 15:03:34 2016 From: leithner at itronic.at (Harald Leithner) Date: Tue, 26 Apr 2016 17:03:34 +0200 Subject: ACL List uses wrong namespace for permissions Message-ID: <8def996d-e6df-3957-5085-03758e473b81@itronic.at> Hi, I'm using dovecot 2.2.devel (11c704a) with lazyexpunge and shared Mailboxes, this seams to work since the latest patch. There is only one problem creating the correct dovecot-acl-list, if I login as the normal user that has set permissions for another user everything is ok. If I login with the same user but with a modified roundcube that uses the #EXPUNGED Namespace as root, dovecot overrides the correct dovecot-acl-list with an empty version. I think this is the most interesting part of the log: 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: fs: root=/srv/storage1/vmail/company/628, index=, indexpvt=, control=, inbox=, alt= 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl: initializing backend with data: vfile 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl: acl username = user at company.at 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl: owner = 1 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl vfile: Global ACLs disabled 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: Namespace : type=private, prefix=#EXPUNGED/, sep=, inbox=no, hidden=yes, list=no, subscriptions=no location=mdbox:/srv/storage1/vmail/company/628:MAILBOXDIR=expunged 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: fs: root=/srv/storage1/vmail/company/628, index=, indexpvt=, control=, inbox=, alt= 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl: initializing backend with data: vfile 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl: acl username = user at company.at 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl: owner = 1 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl vfile: Global ACLs disabled 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: Namespace : type=shared, prefix=#Users/%u/, sep=/, inbox=no, hidden=no, list=children, subscriptions=yes location=mdbox:/srv/storage1/vmail%h 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: shared: root=/var/run/dovecot, index=, indexpvt=, control=, inbox=, alt= 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl vfile: file /srv/storage1/vmail/company/628/mailboxes/dovecot-acl not found 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: Namespace : Using permissions from /srv/storage1/vmail/company/628: mode=0700 gid=default 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl vfile: file /srv/storage1/vmail/company/628/mailboxes/Drafts/dbox-Mails/dovecot-acl not found 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl vfile: file /srv/storage1/vmail/company/628/expunged/dovecot-acl not found 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: Namespace #EXPUNGED/: Using permissions from /srv/storage1/vmail/company/628: mode=0700 gid=default 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl vfile: file /srv/storage1/vmail/company/628/expunged/INBOX/dbox-Mails/dovecot-acl not found 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl vfile: file /srv/storage1/vmail/company/628/expunged/INBOX/test/dbox-Mails/dovecot-acl not found 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Debug: acl vfile: reading file /srv/storage1/vmail/company/628/mailboxes/INBOX/dbox-Mails/dovecot-acl 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Logged out in=178 out=870 2016-04-26T16:49:26+02:00 mailstore1 dovecot: imap(user at company.at): Logged out in=315 out=27172 regards, -- Harald Leithner ITronic Wiedner Hauptstra?e 120/5.1, 1050 Wien, Austria Tel: +43-1-545 0 604 Mobil: +43-699-123 78 4 78 Mail: leithner at itronic.at | itronic.at From tss at iki.fi Tue Apr 26 15:20:00 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 18:20:00 +0300 Subject: v2.2.24 released Message-ID: http://dovecot.org/releases/2.2/dovecot-2.2.24.tar.gz http://dovecot.org/releases/2.2/dovecot-2.2.24.tar.gz.sig This should be a good release. :) * doveconf now warns if it sees a global setting being changed when the same setting was already set inside some filters. (A common mistake has been adding more plugins to a global mail_plugins setting after it was already set inside protocol { .. }, which caused the global setting to be ignored for that protocol.) * LMTP proxy: Increased default timeout 30s -> 125s. This makes it less likely to reach the timeout and cause duplicate deliveries. * LMTP and indexer now append ":suffix" to session IDs to make it unique for the specific user's delivery. (Fixes duplicate session ID warnings in stats process.) + Added dict-ldap for performing read-only LDAP dict lookups. + lazy-expunge: All mails can be saved to a single specified mailbox. + mailbox { autoexpunge } supports now wildcards in mailbox names. + doveadm HTTP API: Added support for proxy commands + imapc: Reconnect when getting disconnected in non-selected state. + imapc: Added imapc_features=modseq to access MODSEQs/HIGHESTMODSEQ. This is especially useful for incremental dsync. + doveadm auth/user: Auth lookup performs debug logging if -o auth_debug=yes is given to doveadm. + Added passdb/userdb { auth_verbose=yes|no } setting. + Cassandra: Added user, password, num_threads, connect_timeout and request_timeout settings. + doveadm user -e : Print with %variables expanded. - Huge header lines could have caused Dovecot to use too much memory (depending on config and used IMAP commands). (Typically this would result in only the single user's process dying with out of memory due to reaching service { vsz_limit } - not a global DoS). - dsync: Detect and handle invalid/stale -s state string better. - dsync: Fixed crash caused by specific mailbox renames - auth: Auth cache is now disabled passwd-file. It was unnecessary and it broke %variables in extra fields. - fts-tika: Don't crash if it returns 500 error - dict-redis: Fixed timeout handling - SEARCH INTHREAD was crashing - stats: Only a single fifo_listeners was supported, making it impossible to use both auth_stats=yes and mail stats plugin. - SSL errors were logged in separate "Stacked error" log lines instead of as part of the disconnection reason. - MIME body parser didn't handle properly when a child MIME part's --boundary had the same prefix as the parent. From ricardo at wenn.com Tue Apr 26 15:31:43 2016 From: ricardo at wenn.com (Ricardo Branco) Date: Tue, 26 Apr 2016 16:31:43 +0100 Subject: doveadm search when using solr problems Message-ID: <1b3ec6b9-83cb-a979-fd96-e52a7c1d708c@wenn.com> Is there a way when using doveadm to search a users mailbox to disable using solr plugin (without changing config file). We have found that solr does not work well with certain search types and reverting to non solr searching works much better. From ricardo at wenn.com Tue Apr 26 15:35:05 2016 From: ricardo at wenn.com (Ricardo Branco) Date: Tue, 26 Apr 2016 16:35:05 +0100 Subject: Solr with shared mailboxes Message-ID: <4049af77-a39b-b848-71b2-227ec04d7a3d@wenn.com> We have multiple logins assigned to single mailboxes, so we can give one login to different devices. Does this cause a problem with mailbox guids in solr or is the ID stored within the indexes and not related to username. From tss at iki.fi Tue Apr 26 15:43:58 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 18:43:58 +0300 Subject: doveadm search when using solr problems In-Reply-To: <1b3ec6b9-83cb-a979-fd96-e52a7c1d708c@wenn.com> References: <1b3ec6b9-83cb-a979-fd96-e52a7c1d708c@wenn.com> Message-ID: <3CA94B2D-6EF5-4D7E-A96F-B81CCDEB7AB2@iki.fi> On 26 Apr 2016, at 18:31, Ricardo Branco wrote: > > Is there a way when using doveadm to search a users mailbox to disable using solr plugin (without changing config file). > > We have found that solr does not work well with certain search types and reverting to non solr searching works much better. doveadm -o plugin/fts= search ... From tss at iki.fi Tue Apr 26 15:45:59 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 18:45:59 +0300 Subject: Solr with shared mailboxes In-Reply-To: <4049af77-a39b-b848-71b2-227ec04d7a3d@wenn.com> References: <4049af77-a39b-b848-71b2-227ec04d7a3d@wenn.com> Message-ID: <9AD270F3-BAA1-44D5-BBA6-B7AF24C649A6@iki.fi> On 26 Apr 2016, at 18:35, Ricardo Branco wrote: > > We have multiple logins assigned to single mailboxes, so we can give one login to different devices. > > Does this cause a problem with mailbox guids in solr or is the ID stored within the indexes and not related to username. It causes Solr indexes to be duplicated. There should always be a single unique userID for a user. You can map the login username to userID by returning "user" in passdb and userdb lookups. If you want to preserve the login username in logs, you can use %{auth_user} in mail_log_prefix and login_log_format_elements. From corneliuscharlie1 at gmail.com Tue Apr 26 15:56:22 2016 From: corneliuscharlie1 at gmail.com (Cornelius Charlie) Date: Tue, 26 Apr 2016 17:56:22 +0200 Subject: Strange search behavior In-Reply-To: <571DBA19.7090806@dovecot.fi> References: <571DBA19.7090806@dovecot.fi> Message-ID: Hello, Unfortunately, the dovecot instance doesn't belong to me and I have no way to get the configuration. However, if that can help I've been able to reproduce this behavior on every dovecot installations I've tried. 2016-04-25 8:32 GMT+02:00 Aki Tuomi : > > > On 24.04.2016 04:44, Cornelius Charlie wrote: > > Hello, > > > > I experienced a strange behavior in the way dovecot is performing > searches, > > I only experienced this exact issue with the flag "seen". > > > > If I perform this command: > > > > UID SORT (SIZE) UTF-8 FLAGGED SEEN > > > > Dovecot return every seen messages even if the message is not "flagged'. > > > > This is only happening when there is no unseen messages in the mailbox, > if > > there is at least one, this is working properly. > > > > Any though ? > > > > Thanks. > Hi! > > Can you provide version information and your doveconf -n? > > --- > Aki Tuomi > Dovecot Oy > From tss at iki.fi Tue Apr 26 16:07:47 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 19:07:47 +0300 Subject: Strange search behavior In-Reply-To: References: <571DBA19.7090806@dovecot.fi> Message-ID: <2C678E76-C64A-4541-B08F-F7468E254D1E@iki.fi> On 26 Apr 2016, at 18:56, Cornelius Charlie wrote: > > Hello, > > Unfortunately, the dovecot instance doesn't belong to me and I have no way > to get the configuration. > However, if that can help I've been able to reproduce this behavior on > every dovecot installations I've tried. This is fixed in the just-released v2.2.24. > > 2016-04-25 8:32 GMT+02:00 Aki Tuomi : > >> >> >> On 24.04.2016 04:44, Cornelius Charlie wrote: >>> Hello, >>> >>> I experienced a strange behavior in the way dovecot is performing >> searches, >>> I only experienced this exact issue with the flag "seen". >>> >>> If I perform this command: >>> >>> UID SORT (SIZE) UTF-8 FLAGGED SEEN >>> >>> Dovecot return every seen messages even if the message is not "flagged'. >>> >>> This is only happening when there is no unseen messages in the mailbox, >> if >>> there is at least one, this is working properly. >>> >>> Any though ? >>> >>> Thanks. >> Hi! >> >> Can you provide version information and your doveconf -n? >> >> --- >> Aki Tuomi >> Dovecot Oy >> From corneliuscharlie1 at gmail.com Tue Apr 26 16:18:44 2016 From: corneliuscharlie1 at gmail.com (Cornelius Charlie) Date: Tue, 26 Apr 2016 18:18:44 +0200 Subject: Strange search behavior In-Reply-To: <2C678E76-C64A-4541-B08F-F7468E254D1E@iki.fi> References: <571DBA19.7090806@dovecot.fi> <2C678E76-C64A-4541-B08F-F7468E254D1E@iki.fi> Message-ID: Hello, Perfect, thanks a lot ! From tss at iki.fi Tue Apr 26 16:20:10 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 19:20:10 +0300 Subject: Possible to use Doveadm for a time range deletion In-Reply-To: References: Message-ID: <13FB83CA-E7F6-4167-925C-42074785CB1B@iki.fi> On 15 Apr 2016, at 17:42, Kenneth Ulrich wrote: > > Hello All, > > I was wondering if it s possible to remove emails between a time range. > > For example, End Users have emails dating back to Aug 2000. He would like > all emails deleted between the time stamp of 07/2014 to 07/2015 yet keep > any emails outside of this area. > > I've ran into some similar examples, but nothing definite. I think something like: doveadm expunge -u user at domain since 2014-07-01 before 2015-07-01 Check first that this looks right: doveadm fetch -u user at domain date.sent since 2014-07-01 before 2015-07-01 From ricardo at wenn.com Tue Apr 26 16:26:16 2016 From: ricardo at wenn.com (Ricardo Branco) Date: Tue, 26 Apr 2016 17:26:16 +0100 Subject: Solr with shared mailboxes In-Reply-To: <9AD270F3-BAA1-44D5-BBA6-B7AF24C649A6@iki.fi> References: <4049af77-a39b-b848-71b2-227ec04d7a3d@wenn.com> <9AD270F3-BAA1-44D5-BBA6-B7AF24C649A6@iki.fi> Message-ID: We are using passwd-file (http://wiki2.dovecot.org/AuthDatabase/PasswdFile). Do you mean passing 'user=XXX' in the extra fields, normalizing this across all the shared accounts? Timo Sirainen wrote on 26/04/2016 16:45: > On 26 Apr 2016, at 18:35, Ricardo Branco wrote: >> We have multiple logins assigned to single mailboxes, so we can give one login to different devices. >> >> Does this cause a problem with mailbox guids in solr or is the ID stored within the indexes and not related to username. > It causes Solr indexes to be duplicated. There should always be a single unique userID for a user. You can map the login username to userID by returning "user" in passdb and userdb lookups. If you want to preserve the login username in logs, you can use %{auth_user} in mail_log_prefix and login_log_format_elements. From ricardo at wenn.com Tue Apr 26 16:29:05 2016 From: ricardo at wenn.com (Ricardo Branco) Date: Tue, 26 Apr 2016 17:29:05 +0100 Subject: doveadm search when using solr problems In-Reply-To: <3CA94B2D-6EF5-4D7E-A96F-B81CCDEB7AB2@iki.fi> References: <1b3ec6b9-83cb-a979-fd96-e52a7c1d708c@wenn.com> <3CA94B2D-6EF5-4D7E-A96F-B81CCDEB7AB2@iki.fi> Message-ID: <5671a4f5-fce3-2125-137a-8dbe82e6a3f6@wenn.com> thanks, the results are certianly better this error shows, i suspect it is fine and just a side affect of the override to turn off solr doveadm(user at domain.com): Error: fts: Failed to initialize backend '': Unknown backend Timo Sirainen wrote on 26/04/2016 16:43: > On 26 Apr 2016, at 18:31, Ricardo Branco wrote: >> Is there a way when using doveadm to search a users mailbox to disable using solr plugin (without changing config file). >> >> We have found that solr does not work well with certain search types and reverting to non solr searching works much better. > doveadm -o plugin/fts= search ... From jtam.home at gmail.com Tue Apr 26 18:09:40 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 26 Apr 2016 11:09:40 -0700 (PDT) Subject: Subject: Re: v2.2.24 released In-Reply-To: References: Message-ID: Timo Sirainen wrote: > - auth: Auth cache is now disabled passwd-file. It was unnecessary and > it broke %variables in extra fields. So settings like auth_cache_size = 65536 auth_cache_ttl = 86400 auth_cache_negative_ttl = 600 are ignored/useless, and passwd-file auth lookups always results in file read operation? Joseph Tam From tss at iki.fi Tue Apr 26 18:10:26 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 21:10:26 +0300 Subject: doveadm search when using solr problems In-Reply-To: <5671a4f5-fce3-2125-137a-8dbe82e6a3f6@wenn.com> References: <1b3ec6b9-83cb-a979-fd96-e52a7c1d708c@wenn.com> <3CA94B2D-6EF5-4D7E-A96F-B81CCDEB7AB2@iki.fi> <5671a4f5-fce3-2125-137a-8dbe82e6a3f6@wenn.com> Message-ID: On 26 Apr 2016, at 19:29, Ricardo Branco wrote: > > thanks, the results are certianly better > > this error shows, i suspect it is fine and just a side affect of the override to turn off solr > > doveadm(user at domain.com): Error: fts: Failed to initialize backend '': Unknown backend Doesn't really matter, but fixed: https://github.com/dovecot/core/commit/4ad29d803f7383a553efcc6f6663dbec89b48bd0 > > > Timo Sirainen wrote on 26/04/2016 16:43: >> On 26 Apr 2016, at 18:31, Ricardo Branco wrote: >>> Is there a way when using doveadm to search a users mailbox to disable using solr plugin (without changing config file). >>> >>> We have found that solr does not work well with certain search types and reverting to non solr searching works much better. >> doveadm -o plugin/fts= search ... From tss at iki.fi Tue Apr 26 18:11:31 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 21:11:31 +0300 Subject: Solr with shared mailboxes In-Reply-To: References: <4049af77-a39b-b848-71b2-227ec04d7a3d@wenn.com> <9AD270F3-BAA1-44D5-BBA6-B7AF24C649A6@iki.fi> Message-ID: <88FA4371-C4C2-459E-B27B-6B60F8A6A0B2@iki.fi> On 26 Apr 2016, at 19:26, Ricardo Branco wrote: > > We are using passwd-file (http://wiki2.dovecot.org/AuthDatabase/PasswdFile). > > Do you mean passing 'user=XXX' in the extra fields, normalizing this across all the shared accounts? Yes. Make sure you'll get the XXX user returned in the first line with: doveadm auth lookup foo at example.com doveadm user foo at example.com > > > Timo Sirainen wrote on 26/04/2016 16:45: >> On 26 Apr 2016, at 18:35, Ricardo Branco wrote: >>> We have multiple logins assigned to single mailboxes, so we can give one login to different devices. >>> >>> Does this cause a problem with mailbox guids in solr or is the ID stored within the indexes and not related to username. >> It causes Solr indexes to be duplicated. There should always be a single unique userID for a user. You can map the login username to userID by returning "user" in passdb and userdb lookups. If you want to preserve the login username in logs, you can use %{auth_user} in mail_log_prefix and login_log_format_elements. From tss at iki.fi Tue Apr 26 18:14:32 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 21:14:32 +0300 Subject: Subject: Re: v2.2.24 released In-Reply-To: References: Message-ID: On 26 Apr 2016, at 21:09, Joseph Tam wrote: > > Timo Sirainen wrote: > >> - auth: Auth cache is now disabled passwd-file. It was unnecessary and >> it broke %variables in extra fields. > > So settings like > > auth_cache_size = 65536 > auth_cache_ttl = 86400 > auth_cache_negative_ttl = 600 > > are ignored/useless, and passwd-file auth lookups always results in file read > operation? passwd-files are always read fully into memory. The file's timestamp is checked once a second to see if anything has changed and if so the file is reloaded. So basically they're already cached with perfect TTL settings. From hf at spg.tu-darmstadt.de Tue Apr 26 18:52:10 2016 From: hf at spg.tu-darmstadt.de (Hauke Fath) Date: Tue, 26 Apr 2016 20:52:10 +0200 Subject: v2.2.24 released In-Reply-To: References: Message-ID: <20160426205210808701.304a2122@spg.tu-darmstadt.de> On Tue, 26 Apr 2016 18:20:00 +0300, Timo Sirainen wrote: > This should be a good release. :) Would this release address the "reappearing emails" issue that 2.2.23 introduced? Cheerio, hauke -- The ASCII Ribbon Campaign Hauke Fath () No HTML/RTF in email Institut f?r Nachrichtentechnik /\ No Word docs in email TU Darmstadt Respect for open standards Ruf +49-6151-16-21344 From jtam.home at gmail.com Tue Apr 26 19:04:52 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Tue, 26 Apr 2016 12:04:52 -0700 (PDT) Subject: Subject: Re: v2.2.24 released In-Reply-To: References: Message-ID: On Tue, 26 Apr 2016, Timo Sirainen wrote: >>> - auth: Auth cache is now disabled passwd-file. It was unnecessary and >>> it broke %variables in extra fields. >> >> So settings like >> >> auth_cache_size = 65536 >> auth_cache_ttl = 86400 >> auth_cache_negative_ttl = 600 >> >> are ignored/useless, and passwd-file auth lookups always results in file read >> operation? > > passwd-files are always read fully into memory. The file's timestamp > is checked once a second to see if anything has changed and if so the > file is reloaded. So basically they're already cached with perfect TTL > settings. OK, thanks. I will comment these settings out since they're not useful. Joseph Tam From tss at iki.fi Tue Apr 26 20:36:25 2016 From: tss at iki.fi (Timo Sirainen) Date: Tue, 26 Apr 2016 23:36:25 +0300 Subject: v2.2.24 released In-Reply-To: <20160426205210808701.304a2122@spg.tu-darmstadt.de> References: <20160426205210808701.304a2122@spg.tu-darmstadt.de> Message-ID: On 26 Apr 2016, at 21:52, Hauke Fath wrote: > > On Tue, 26 Apr 2016 18:20:00 +0300, Timo Sirainen wrote: >> This should be a good release. :) > > Would this release address the "reappearing emails" issue that 2.2.23 > introduced? I guess you're talking about replication. I'm not aware of any specific change in v2.2.23 that could have even potentially caused it. I also don't know how I could reproduce it. Can you use git bisect to find out the specific change that broke it? The only thing I remember even remotely related to this is https://github.com/dovecot/core/commit/950a6e61d6c2dac961ce031bdd8b2895bc32b827 but that was supposed to only fix things and I can't think of how it might break things. One possibility is that nothing broke this in v2.2.23. I've heard about the same issue for a long time. Maybe you just suddenly started having this problem now and it would have happened even with the old Dovecot version. From stephan at rename-it.nl Tue Apr 26 21:07:51 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 26 Apr 2016 23:07:51 +0200 Subject: help with sieve In-Reply-To: <05e460dc32514b8690ff0ce5ea01abfc@paulkoppen.com> References: <05e460dc32514b8690ff0ce5ea01abfc@paulkoppen.com> Message-ID: <571FD8A7.9060203@rename-it.nl> Op 3/31/2016 om 1:15 AM schreef dovecot at paulkoppen.com: > Dear Dovecot / Pigeonhole community, > > I have a very specific issue, but trying to solve this for a full day, > I am now getting so bold from pulling my hairs out, I thought it was > time I asked for help. I hope this is a good place for that. > > At my hosting provider, who have been extremely helpful by the way but > are not specifically skilled in Sieve, I have a catch-all address set > up: *@domain.org (where * is literal), with a sieve script to control > how messages are forwarded. Currently my rules are of the form: > > if address :localpart :is ["To","Cc","Bcc"] ["name1", "name2", ...] { > ... } > > This works most of the time, but sometimes the messages are not > directly addressed to me and so they slip through the filters. I > figured that using envelope would solve this, so I require envelope > and then do: > > if envelope :localpart :is "To" ["name1", "name2", ...] { ... } > > But this fails. After endlessly trying different combinations I > figured out that the reason for failure is that the envelope believes > the "To" is actually "*@domain.org", so it is never going to match any > of the names. However, the following test succeeds: > > if header :contains "Envelope-To" "name1@" { ... } > > From this I deduce that a previous script has already done the > conversion from name1 to *, and at the point where my sieve script is > run the envelope picks up the *@domain.org address, leaving the > Envelope-To header for what it is. But I am new to this. > > Is that likely to be the case? Is it a common sieve set-up? And most > importantly, is there a better way around the issue than testing > header :contains? That seems rather bizarre. As you say, it is probably caused by whatever precedes Sieve processing. You can post your MTA and any other relevant config here and perhaps someone can help you. Regards, Stephan. From stephan at rename-it.nl Tue Apr 26 21:10:20 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 26 Apr 2016 23:10:20 +0200 Subject: managesieve proxying not working In-Reply-To: <2016040323132626647431@itsnow.com> References: <2016040313143543089320@itsnow.com> <57012554.1070000@rename-it.nl> <2016040322324096562925@itsnow.com> <57012DBB.4080203@rename-it.nl> <2016040323132626647431@itsnow.com> Message-ID: <571FD93C.4060202@rename-it.nl> Op 4/3/2016 om 5:13 PM schreef Hawk Chen: > I'm using roundcube webmail managesieve plugin. Webmail can login managesieve to a specific mailstore successfully without proxying. Because I have mutiple mailstores, I have to use proxying to redirect the correct mailstores just as imap/pop3. > > ???? Stephan Bosch > ????? 2016-04-03 22:50 > ???? Hawk Chen; dovecot > ??? Re: ??: Re: managesieve proxying not working Can you try this? http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting Regards, Stephan. > > > Op 3-4-2016 om 16:32 schreef Hawk Chen: >> Stephan, >> >> Imap/pop shows proxying in mail log, but managesieve differs. >> >> Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): started proxying to 10.1.4.6:110: user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= >> Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): disconnecting 218.82.239.224 (Disconnected by server): user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= > > What Sieve client are you using? It looks as though it never even tries > to authenticate. You try this manually: > > http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting > > Regards, > > Stephan > > >> Regards, >> Hawk >> >> *????* Stephan Bosch >> *?????* 2016-04-03 22:14 >> *????* Hawk Chen ; dovecot >> >> *???* Re: managesieve proxying not working >> Op 3-4-2016 om 7:14 schreef Hawk Chen: >> > Hi, >> > >> > I'm setting up the directors for proxying pop3/imap/lmtp/sieve. >> pop3/imap/lmtp proxying work fine, but sieve not working. The >> error messages in maillog look not using proxying but local passdb. >> > >> > Error message: >> > Apr 03 12:09:25 managesieve-login: Info: Aborted login (no auth >> attempts in 0 secs): user=<>, rip=10.1.1.4, lip=10.1.1.201, >> session=<+SIcx4wvRQAKAQEE> >> > >> > sql in /etc/dovecot/dovecot-sql.conf.ext: >> > password_query = SELECT NULL as password, host, 'Y' as >> nopassword, 'Y' as proxy FROM mailbox WHERE username = '%u' AND >> active='1' >> You can turn on auth_debug and show what it logs. Do you see any >> differences with imap/pop? >> Regards, >> Stephan. >> From reganyelcich at gmail.com Tue Apr 26 21:26:31 2016 From: reganyelcich at gmail.com (=?utf-8?Q?Regan_Jel=C4=8Di=C4=87?=) Date: Wed, 27 Apr 2016 09:26:31 +1200 Subject: apt pinning specific dovecot version Message-ID: <50EFB9C2-73FF-4DC7-B1C4-DD7DCA6B6847@gmail.com> I currently have the dovecot-core package from wheezy-backports pinned on one of my servers to version '2.2.9', which has been working great. I now want to upgrade that to the newest version under wheezy-backports which is: dovecot-core (1:2.2.13-11~bpo70+1) but I can't figure out how to get do it. I've tried a few different formats of the name but apt-get update then apt-get dost-upgrade doesn't pick up the new version - it ignores it when trying to do an update. This is what I've got in my apt preferences and pin files... /etc/apt/preferences Explanation: Stop ALL wheezy-backports updating system. Package: * Pin: release a=wheezy-backports,n=wheezy-backports Pin-Priority: 100 /etc/apt/preferences.d/dovecot.pref Explanation: Promote wheezy-backports version of Dovecot only Package: dovecot-core /2\.2\.9/ Pin: release a=wheezy-backports Pin-Priority: 500 Can anyone advise how I get it to pull the newer version?? Thanks, From gedalya at gedalya.net Tue Apr 26 21:34:35 2016 From: gedalya at gedalya.net (Gedalya) Date: Tue, 26 Apr 2016 17:34:35 -0400 Subject: apt pinning specific dovecot version In-Reply-To: <50EFB9C2-73FF-4DC7-B1C4-DD7DCA6B6847@gmail.com> References: <50EFB9C2-73FF-4DC7-B1C4-DD7DCA6B6847@gmail.com> Message-ID: <571FDEEB.3060408@gedalya.net> On 04/26/2016 05:26 PM, Regan Jel?i? wrote: > I currently have the dovecot-core package from wheezy-backports pinned on one of my servers to version '2.2.9', which has been working great. I now want to upgrade that to the newest version under wheezy-backports which is: > > dovecot-core (1:2.2.13-11~bpo70+1) > but I can't figure out how to get do it. I've tried a few different formats of the name but apt-get update then apt-get dost-upgrade doesn't pick up the new version - it ignores it when trying to do an update. > > This is what I've got in my apt preferences and pin files... > > /etc/apt/preferences > > Explanation: Stop ALL wheezy-backports updating system. > Package: * > Pin: release a=wheezy-backports,n=wheezy-backports > Pin-Priority: 100 > /etc/apt/preferences.d/dovecot.pref > > Explanation: Promote wheezy-backports version of Dovecot only > Package: dovecot-core /2\.2\.9/ > Pin: release a=wheezy-backports > Pin-Priority: 500 > Can anyone advise how I get it to pull the newer version?? > > Thanks, Have you tried something like: apt-get --only-upgrade -twheezy-backports install dovecot-core dovecot-imapd .... From stephan at rename-it.nl Tue Apr 26 21:50:20 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Tue, 26 Apr 2016 23:50:20 +0200 Subject: Released Pigeonhole v0.4.14 for Dovecot v2.2.24. Message-ID: <571FE29C.30001@rename-it.nl> Hello Dovecot users, The most important feature that this new release adds is the IMAPSIEVE capability, which allows executing Sieve scripts at IMAP events. It also adds the ability to obtain trace logs from Sieve execution at actual delivery (or from IMAP), rather than only using the sieve-test command line tool. This release also fixes a bug in the Sieve extprograms plugin that has been bothering a few people for a while now. Changelog v0.4.14: * The address test now allows specifying the X-Original-To header. + Implemented the Sieve imapsieve extension and its IMAP counterpart (RFC 6785) as a set of plugins. This allows running Sieve scripts at IMAP activity, rather than at delivery. There are also facilities for the familiar sieve_before/sieve_after administrator scripts. A user script is defined for a mailbox using an IMAP METADATA entry, whereas administrator scripts are configured using mailbox matching rules defined in the plugin settings. + Adjusted the Sieve ihave extension to allow capability tests to be performed at runtime. This way, scripts can be written that work both at delivery and from IMAP. + Implemented support for runtime trace debugging. This means that detailed information about which commands, actions and tests are performed is written to a file. That file is created in the configured directory, but only if that directory exists. This way, a particular user can be easily singled out for debugging. This works much like the Dovecot rawlog facility. The trace output is identical to what is produced using sieve-test with its "-t" command line option. + Added a "sieve_user_email" setting that configures the user's primary email address. This is mainly useful to have a user email address available in IMAP, where envelope data is unavailable. + Implemented the dovecot-specific "vnd.dovecot.report" extension. This allows sending report messages in the Message Abuse Reporting Format (RFC 5965). - extprograms plugin: Fixed epoll() panic caused by closing the output FD before the output stream. - Made sure that the local part of a mail address is encoded properly using quoted string syntax when it is not a dot-atom. The release is available as follows: http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.14.tar.gz http://pigeonhole.dovecot.org/releases/2.2/dovecot-2.2-pigeonhole-0.4.14.tar.gz.sig Refer to http://pigeonhole.dovecot.org and the Dovecot v2.x wiki for more information. Have fun testing this release and don't hesitate to notify me when there are any problems. Regards, -- Stephan Bosch stephan at rename-it.nl From Ron at Cleven.com Wed Apr 27 02:58:24 2016 From: Ron at Cleven.com (Ron Cleven) Date: Tue, 26 Apr 2016 21:58:24 -0500 (CDT) Subject: dovecot Digest, Vol 156, Issue 44 In-Reply-To: References: Message-ID: <00723746-f6af-3b50-2869-c587e8f636b8@Cleven.com> > On 26 Apr 2016, at 21:52, Hauke Fath wrote: >> > >> >On Tue, 26 Apr 2016 18:20:00 +0300, Timo Sirainen wrote: >>> >>This should be a good release.:) >> > >> >Would this release address the "reappearing emails" issue that 2.2.23 >> >introduced? > I guess you're talking about replication. I'm not aware of any specific change in v2.2.23 that could have even potentially caused it. I also don't know how I could reproduce it. Can you use git bisect to find out the specific change that broke it? > > The only thing I remember even remotely related to this ishttps://github.com/dovecot/core/commit/950a6e61d6c2dac961ce031bdd8b2895bc32b827 but that was supposed to only fix things and I can't think of how it might break things. > > One possibility is that nothing broke this in v2.2.23. I've heard about the same issue for a long time. Maybe you just suddenly started having this problem now and it would have happened even with the old Dovecot version. I was (perhaps one of) the people who reported "reappearing emails" with 2.2.10 in the context of Maildir with replication under CentOS 7. I had spent a great deal of time making it reproducible, difficult because there was a timing element. In that context, 2.2.23 absolutely fixed the problem which was absolutely related to a timing issue with replication. If I remember right, this person was reporting a similar-sounding problem, but it did not involve replication and was not under CentOS 7. Creating a script that reproduces the problem is an important first step. Good luck. From aki.tuomi at dovecot.fi Wed Apr 27 04:59:58 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Wed, 27 Apr 2016 07:59:58 +0300 (EEST) Subject: apt pinning specific dovecot version In-Reply-To: <571FDEEB.3060408@gedalya.net> References: <50EFB9C2-73FF-4DC7-B1C4-DD7DCA6B6847@gmail.com> <571FDEEB.3060408@gedalya.net> Message-ID: <985370716.2908.1461733198829@appsuite-dev.open-xchange.com> > On April 27, 2016 at 12:34 AM Gedalya wrote: > > > On 04/26/2016 05:26 PM, Regan Jel?i? wrote: > > I currently have the dovecot-core package from wheezy-backports pinned on one of my servers to version '2.2.9', which has been working great. I now want to upgrade that to the newest version under wheezy-backports which is: > > > > dovecot-core (1:2.2.13-11~bpo70+1) > > but I can't figure out how to get do it. I've tried a few different formats of the name but apt-get update then apt-get dost-upgrade doesn't pick up the new version - it ignores it when trying to do an update. > > > > This is what I've got in my apt preferences and pin files... > > > > /etc/apt/preferences > > > > Explanation: Stop ALL wheezy-backports updating system. > > Package: * > > Pin: release a=wheezy-backports,n=wheezy-backports > > Pin-Priority: 100 > > /etc/apt/preferences.d/dovecot.pref > > > > Explanation: Promote wheezy-backports version of Dovecot only > > Package: dovecot-core /2\.2\.9/ > > Pin: release a=wheezy-backports > > Pin-Priority: 500 > > Can anyone advise how I get it to pull the newer version?? > > > > Thanks, > > Have you tried something like: > apt-get --only-upgrade -twheezy-backports install dovecot-core dovecot-imapd .... Have you tried removing dovecot.pref? --- Aki Tuomi From hs at schlittermann.de Wed Apr 27 07:37:52 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Wed, 27 Apr 2016 09:37:52 +0200 Subject: Crash: setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) Message-ID: <20160427073752.GC14754@jumper.schlittermann.de> Hi, Using 2.2.9 (ubuntu 14.04 LTS) and sending the following command, the server crashes when I try to delete an annotation: ? login ? C: 2 setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) Apr 27 09:29:16 backend1 dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=6651, secured Apr 27 09:29:16 backend1 dovecot: imap(heiko): Fatal: master: service(imap): child 6651 killed with signal 11 (core dumped) Sending a real value it works: ? login ? C: 2 setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" "27") S: 2 OK Completed. Is this a known bug that is fixed in later releases? Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From hs at schlittermann.de Wed Apr 27 08:00:53 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Wed, 27 Apr 2016 10:00:53 +0200 Subject: Crash: setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) In-Reply-To: <20160427073752.GC14754@jumper.schlittermann.de> References: <20160427073752.GC14754@jumper.schlittermann.de> Message-ID: <20160427080053.GD14754@jumper.schlittermann.de> Hi, > ? login ? > C: 2 setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) > > Apr 27 09:29:16 backend1 dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=6651, secured > Apr 27 09:29:16 backend1 dovecot: imap(heiko): Fatal: master: service(imap): child 6651 killed with signal 11 (core dumped) This doesn't seem to be dovecot core's fault, it's probably crashing in the METADATA plugin. Does anybody else use it? Is it alive as a project? (Last Update of the mercurial repository http://hg.dovecot.org/dovecot-metadata-plugin was 2013 . Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From aki.tuomi at dovecot.fi Wed Apr 27 08:06:35 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Wed, 27 Apr 2016 11:06:35 +0300 Subject: Crash: setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) In-Reply-To: <20160427080053.GD14754@jumper.schlittermann.de> References: <20160427073752.GC14754@jumper.schlittermann.de> <20160427080053.GD14754@jumper.schlittermann.de> Message-ID: <5720730B.1010501@dovecot.fi> On 27.04.2016 11:00, Heiko Schlittermann wrote: > Hi, > >> ? login ? >> C: 2 setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) >> >> Apr 27 09:29:16 backend1 dovecot: imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=6651, secured >> Apr 27 09:29:16 backend1 dovecot: imap(heiko): Fatal: master: service(imap): child 6651 killed with signal 11 (core dumped) > This doesn't seem to be dovecot core's fault, it's probably > crashing in the METADATA plugin. Does anybody else use it? > > Is it alive as a project? (Last Update of the mercurial repository > http://hg.dovecot.org/dovecot-metadata-plugin was 2013 . > > > Best regards from Dresden/Germany > Viele Gr??e aus Dresden > Heiko Schlittermann Hi! We no longer use mercurial as VCS. And metadata has been moved as core feature, and is no longer a plugin. Please see https://github.com/dovecot/core Aki From hs at schlittermann.de Wed Apr 27 09:11:27 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Wed, 27 Apr 2016 11:11:27 +0200 Subject: Crash: setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) In-Reply-To: <5720730B.1010501@dovecot.fi> References: <20160427073752.GC14754@jumper.schlittermann.de> <20160427080053.GD14754@jumper.schlittermann.de> <5720730B.1010501@dovecot.fi> Message-ID: <20160427091127.GE14754@jumper.schlittermann.de> Hi Aki, Aki Tuomi (Mi 27 Apr 2016 10:06:35 CEST): > We no longer use mercurial as VCS. And metadata has been moved as core > feature, and is no longer a plugin. Please see > https://github.com/dovecot/core Thank you. But it seems, for 2.2.9 I'm out of luck and on my own? I cloned the above repo and did $ grep -ri 'annotat\(e\|ion\)' * src/imap/cmd-notify.c: "MessageNew", "MessageExpunge", "FlagChange", "AnnotationChange", src/imap/cmd-notify.c: /* if FlagChange or AnnotationChange is specified, src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE)) != 0 && src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE)) != 0) src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE | src/imap/imap-notify.h: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE = 0x08, src/imap/imap-notify.h: (IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE | \ src/plugins/acl/acl-attributes.c: retrieve private or shared mailbox annotations on a mailbox on which Shouldn't I get a bit more. Or is the handling of the SETANNOTATION/ANNOTATION command well hidden? Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From stephan at rename-it.nl Wed Apr 27 09:32:23 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Wed, 27 Apr 2016 11:32:23 +0200 Subject: Crash: setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) In-Reply-To: <20160427091127.GE14754@jumper.schlittermann.de> References: <20160427073752.GC14754@jumper.schlittermann.de> <20160427080053.GD14754@jumper.schlittermann.de> <5720730B.1010501@dovecot.fi> <20160427091127.GE14754@jumper.schlittermann.de> Message-ID: <57208727.4080401@rename-it.nl> Op 4/27/2016 om 11:11 AM schreef Heiko Schlittermann: > Hi Aki, > > Aki Tuomi (Mi 27 Apr 2016 10:06:35 CEST): >> We no longer use mercurial as VCS. And metadata has been moved as core >> feature, and is no longer a plugin. Please see >> https://github.com/dovecot/core > Thank you. But it seems, for 2.2.9 I'm out of luck and on my own? > I cloned the above repo and did > > $ grep -ri 'annotat\(e\|ion\)' * > > src/imap/cmd-notify.c: "MessageNew", "MessageExpunge", "FlagChange", "AnnotationChange", > src/imap/cmd-notify.c: /* if FlagChange or AnnotationChange is specified, > src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE)) != 0 && > src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE)) != 0) > src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE | > src/imap/imap-notify.h: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE = 0x08, > src/imap/imap-notify.h: (IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE | \ > src/plugins/acl/acl-attributes.c: retrieve private or shared mailbox annotations on a mailbox on which > > > Shouldn't I get a bit more. Or is the handling of the > SETANNOTATION/ANNOTATION command well hidden? Those commands are part of the IMAP ANNOTATE capability (RFC 5257 or based on an older draft like draft-daboo-imap-annotatemore-08). Only the IMAP METADATA capability (RFC 5464) is currently implemented in Dovecot core. I haven't heard of anyone porting the ANNOTATE part of that old plugin to a recent Dovecot. Regards, Stephan. From hs at schlittermann.de Wed Apr 27 09:36:27 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Wed, 27 Apr 2016 11:36:27 +0200 Subject: [SOLVED] Crash: setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) In-Reply-To: <20160427073752.GC14754@jumper.schlittermann.de> References: <20160427073752.GC14754@jumper.schlittermann.de> Message-ID: <20160427093627.GF14754@jumper.schlittermann.de> Hi, just for the records. The dovecot-metadata-plugin found on http://hg.dovecot.org/dovecot-metadata-plugin (not in use anymore?) needs one change to make it compile on Ubuntu 14.04 and probably other current compilers. And a 2nd change that avoids a crash on deleting an annotation. I need this plugin with a dovecot 2.2.9 to store mailbox annotations (expiry information imported/migrated from a cyrus server, to be more precise). If dovecot provides ANNOTATION capabilities on it's own, I missed it... Please correct me, if I'm wrong. In a current clone of dovecot-core I do not find any traces that indicate support for ANNOATION. But again, I may be wrong, as I do often. changeset: 237:219c13a7696d bookmark: hs12 tag: tip user: Heiko Schlittermann date: Wed Apr 27 11:27:14 2016 +0200 summary: Check the Value before using strlen() diff -r 79ce82ce7279 -r 219c13a7696d src/metadata-backend.c --- a/src/metadata-backend.c Wed Apr 27 10:37:11 2016 +0200 +++ b/src/metadata-backend.c Wed Apr 27 11:27:14 2016 +0200 @@ -130,7 +130,7 @@ if (!metadata_entry_is_valid(entry)) return -METADATA_ERROR_INVALID; - if (strlen(metadata_entry_get_value(entry)) > muser->set->maxsize) + if (entry->value && strlen(metadata_entry_get_value(entry)) > muser->set->maxsize) return -METADATA_ERROR_TOOLARGE; if (count_entries(muser) > muser->set->maxentries) return -METADATA_ERROR_TOOMANY; changeset: 236:79ce82ce7279 user: Heiko Schlittermann date: Wed Apr 27 10:37:11 2016 +0200 summary: make it compile diff -r b6df1381bb79 -r 79ce82ce7279 src/imap-metadata-plugin.c --- a/src/imap-metadata-plugin.c Sun Oct 27 12:50:20 2013 +0100 +++ b/src/imap-metadata-plugin.c Wed Apr 27 10:37:11 2016 +0200 @@ -448,7 +448,7 @@ } -static bool +bool cmd_getmetadata(struct client_command_context *cmd) { int maxsize = 0, depth = 0; @@ -739,7 +739,7 @@ } -static bool +bool cmd_setmetadata(struct client_command_context *cmd) { const struct imap_arg *args; if (!client_read_args(cmd, 0, 0, &args)) -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From hs at schlittermann.de Wed Apr 27 09:41:25 2016 From: hs at schlittermann.de (Heiko Schlittermann) Date: Wed, 27 Apr 2016 11:41:25 +0200 Subject: Crash: setannotation Trash "/vendor/cmu/cyrus-imapd/expire" ("value.shared" NIL) In-Reply-To: <57208727.4080401@rename-it.nl> References: <20160427073752.GC14754@jumper.schlittermann.de> <20160427080053.GD14754@jumper.schlittermann.de> <5720730B.1010501@dovecot.fi> <20160427091127.GE14754@jumper.schlittermann.de> <57208727.4080401@rename-it.nl> Message-ID: <20160427094125.GG14754@jumper.schlittermann.de> Hi, Stephan Bosch (Mi 27 Apr 2016 11:32:23 CEST): ? > Op 4/27/2016 om 11:11 AM schreef Heiko Schlittermann: > > src/imap/cmd-notify.c: "MessageNew", "MessageExpunge", "FlagChange", "AnnotationChange", > > src/imap/cmd-notify.c: /* if FlagChange or AnnotationChange is specified, > > src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE)) != 0 && > > src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE)) != 0) > > src/imap/cmd-notify.c: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE | > > src/imap/imap-notify.h: IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE = 0x08, > > src/imap/imap-notify.h: (IMAP_NOTIFY_EVENT_ANNOTATION_CHANGE | \ > > src/plugins/acl/acl-attributes.c: retrieve private or shared mailbox annotations on a mailbox on which > > > > > > Shouldn't I get a bit more. Or is the handling of the > > SETANNOTATION/ANNOTATION command well hidden? > > Those commands are part of the IMAP ANNOTATE capability (RFC 5257 or > based on an older draft like draft-daboo-imap-annotatemore-08). Only the > IMAP METADATA capability (RFC 5464) is currently implemented in Dovecot > core. > > I haven't heard of anyone porting the ANNOTATE part of that old plugin > to a recent Dovecot. The old dovecot-metadata-plugin compiles? and runs with 2.2.9, it compiles with 2.2.23, 2.2.22. (I haven't checked if it runs, though). ?) with some small change found in a previous post. The binary Ubuntu 14.04 package doesn't work, it's not compatible with the Dovecot cure they provide. I'd like to see the ANNOTATE capability in recent dovecot versions, it makes migrations from cyrus environments more easy (e.g. some SquirrelMail plugin uses ANNOTATE to attach expiry information to the mailboxes). Best regards from Dresden/Germany Viele Gr??e aus Dresden Heiko Schlittermann -- SCHLITTERMANN.de ---------------------------- internet & unix support - Heiko Schlittermann, Dipl.-Ing. (TU) - {fon,fax}: +49.351.802998{1,3} - gnupg encrypted messages are welcome --------------- key ID: F69376CE - ! key id 7CBF764A and 972EAC9F are revoked since 2015-01 ------------ - -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 473 bytes Desc: Digital signature URL: From mail at tomsommer.dk Wed Apr 27 11:56:54 2016 From: mail at tomsommer.dk (Tom Sommer) Date: Wed, 27 Apr 2016 13:56:54 +0200 Subject: Option to not add "Received" header ? In-Reply-To: <8C78E220-8BE1-4717-976D-BAAC8AC37661@iki.fi> References: <55114A32.4090201@coppint.com> <8C78E220-8BE1-4717-976D-BAAC8AC37661@iki.fi> Message-ID: On 2016-03-21 15:00, Timo Sirainen wrote: > On 21 Mar 2016, at 22:08, Tom Sommer wrote: >> >> On 2015-03-24 12:27, Florent B wrote: >> >>> I use Dovecot in lmtp mode to receive mails. >>> I would like an option to tell Dovecot to not add a "Reveived" header >>> on >>> each server (I use a director, so Director also adds this header). >> >> I would love this as well. > > How about the other way around: Does anybody want Dovecot LMTP to add > a Received header? dovecot-lda doesn't. And proxy/director logs > nowadays about what goes through them. Dovecot itself doesn't check > the Received headers in any way for looping or other purposes. Maybe > Dovecot v2.3 shouldn't add any Received headers at all? I'm good with this as well, as long as there is a way to not have them. Would love it sooner than 2.3 though ;) Thanks. From bra at fsn.hu Wed Apr 27 12:54:31 2016 From: bra at fsn.hu (Nagy, Attila) Date: Wed, 27 Apr 2016 14:54:31 +0200 Subject: WP8/Windows 10 mail app can't login, tries double auth Message-ID: <5720B687.20609@fsn.hu> Hi, Are there anybody who could make WP8 (and W10 desktop clients it seems) devices working with Dovecot's POP3 server? The conversation looks like this: S +OK ready C CAPA S +OK S CAPA S TOP S UIDL S RESP-CODES S PIPELINING S AUTH-RESP-CODE S USER S SASL PLAIN S . C AUTH S +OK S PLAIN S . C AUTH PLAIN S + C References: <93768d0a-6fe7-4971-6734-b0bf41468824@itronic.at> <571E18C7.1030500@rename-it.nl> Message-ID: Stephan Bosch, Mon, 25 Apr 2016 15:16:55 +0200: > Oops. Turned off package composer for maintenance, but didn't turn it > back on. > > It is building now..... Is there something to turn on to build packages in /debian/pool/wheezy-auto/dovecot-2.2 ? Or don't you provide packages for wheezy anymore? > Op 25-4-2016 om 14:47 schreef Harald Leithner: >> Hi, >> >> It seams that ix.dovecot.fi has not build a new version since >> 2016-04-19 20:03 -- Regards mks From oquidave at gmail.com Wed Apr 27 14:51:19 2016 From: oquidave at gmail.com (David Okwii) Date: Wed, 27 Apr 2016 17:51:19 +0300 Subject: Creating Dovecot Master user throws "Username character disallowed by auth_username_chars : 0x2a " error Message-ID: Hello, Am trying to create a master user on dovecot. However, it throws dovecot: auth: plain(?,127.0.0.1): Username character disallowed by auth_username_chars: 0x2a (username: loginuser*master) ". #telnet localhost 143 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN 1 login loginuser*master mypassword 1 NO [AUTHENTICATIONFAILED] Authentication failed. # log output dovecot: auth: plain(?,127.0.0.1): Username character disallowed by auth_username_chars: 0x64 (username: master) # cat passwd.master master:{SHA}LORtG60Uqg2bPSlOB8PW2cLI0TE= #And here's the output of my dovecot -n # 2.0.16: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 8.2-RELEASE amd64 auth_master_user_separator = * disable_plaintext_auth = no mail_location = maildir:~/Maildir namespace { inbox = yes location = prefix = INBOX. separator = . type = private } passdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } passdb { args = /usr/local/etc/dovecot/passwd.master driver = passwd-file master = yes } protocols = imap pop3 service auth { client_limit = 6000 } service imap { process_limit = 2048 vsz_limit = 1256 M } service pop3 { process_limit = 2048 } userdb { args = /usr/local/etc/dovecot/dovecot-sql.conf driver = sql } protocol pop3 { pop3_uidl_format = UID%u-%v } I don't know what am doing wrong. Any help would be welcome. Thanks -- Thanks & regards, David Okwii, Mobile(default): +256-791-040-262 Christ in me the Hope of Glory(Col.1:27) From bra at fsn.hu Wed Apr 27 19:38:12 2016 From: bra at fsn.hu (Nagy, Attila) Date: Wed, 27 Apr 2016 21:38:12 +0200 Subject: WP8/Windows 10 mail app can't login, tries double auth In-Reply-To: <5720B687.20609@fsn.hu> References: <5720B687.20609@fsn.hu> Message-ID: <57211524.9060704@fsn.hu> On 04/27/16 14:54, Nagy, Attila wrote: > > The only solution here seems to be giving back -ERR to the client's > AUTH command, which makes it try USER instead. > I'm not aware of any configuration options which makes this possible. Or a client workaround option to allow any USER/PASS combination after a successful AUTH (however I haven't tried whether the client accepts it, or in this phase it's internal state is completely flawed). From hawk_chen at itsnow.com Thu Apr 28 10:40:27 2016 From: hawk_chen at itsnow.com (hawk_chen at itsnow.com) Date: Thu, 28 Apr 2016 18:40:27 +0800 Subject: managesieve proxying not working References: <2016040313143543089320@itsnow.com>, <57012554.1070000@rename-it.nl>, <2016040322324096562925@itsnow.com>, <57012DBB.4080203@rename-it.nl>, <2016040323132626647431@itsnow.com>, <571FD93C.4060202@rename-it.nl> Message-ID: <2016042818402704321818@itsnow.com> Stephan, I configured the frontend director with ssl enforced but the internal mailstore supports tls and plain. I changed roundcube mail managesieve configuration and the sieve proxying works. $config['managesieve_usetls'] = true; Thanks a lot. Hawk From: Stephan Bosch Date: 2016-04-27 05:10 To: Hawk Chen; dovecot Subject: Re: managesieve proxying not working Op 4/3/2016 om 5:13 PM schreef Hawk Chen: > I'm using roundcube webmail managesieve plugin. Webmail can login managesieve to a specific mailstore successfully without proxying. Because I have mutiple mailstores, I have to use proxying to redirect the correct mailstores just as imap/pop3. > > ???? Stephan Bosch > ????? 2016-04-03 22:50 > ???? Hawk Chen; dovecot > ??? Re: ??: Re: managesieve proxying not working Can you try this? http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting Regards, Stephan. > > > Op 3-4-2016 om 16:32 schreef Hawk Chen: >> Stephan, >> >> Imap/pop shows proxying in mail log, but managesieve differs. >> >> Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): started proxying to 10.1.4.6:110: user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= >> Apr 03 03:21:04 pop3-login: Info: proxy(hawk_chen at itsnow.com): disconnecting 218.82.239.224 (Disconnected by server): user=, method=PLAIN, rip=218.82.239.224, lip=183.131.52.136, TLS, session= > > What Sieve client are you using? It looks as though it never even tries > to authenticate. You try this manually: > > http://wiki2.dovecot.org/Pigeonhole/ManageSieve/Troubleshooting > > Regards, > > Stephan > > >> Regards, >> Hawk >> >> *????* Stephan Bosch >> *?????* 2016-04-03 22:14 >> *????* Hawk Chen ; dovecot >> >> *???* Re: managesieve proxying not working >> Op 3-4-2016 om 7:14 schreef Hawk Chen: >> > Hi, >> > >> > I'm setting up the directors for proxying pop3/imap/lmtp/sieve. >> pop3/imap/lmtp proxying work fine, but sieve not working. The >> error messages in maillog look not using proxying but local passdb. >> > >> > Error message: >> > Apr 03 12:09:25 managesieve-login: Info: Aborted login (no auth >> attempts in 0 secs): user=<>, rip=10.1.1.4, lip=10.1.1.201, >> session=<+SIcx4wvRQAKAQEE> >> > >> > sql in /etc/dovecot/dovecot-sql.conf.ext: >> > password_query = SELECT NULL as password, host, 'Y' as >> nopassword, 'Y' as proxy FROM mailbox WHERE username = '%u' AND >> active='1' >> You can turn on auth_debug and show what it logs. Do you see any >> differences with imap/pop? >> Regards, >> Stephan. >> From adam at totalseoservices.co.uk Thu Apr 28 14:18:32 2016 From: adam at totalseoservices.co.uk (Adam Joesbury) Date: Thu, 28 Apr 2016 15:18:32 +0100 Subject: Doveadm Replicator problem with PAM passdb Message-ID: <0dde01d1a158$d81c91c0$8855b540$@totalseoservices.co.uk> Hi Everyone, We are running two CentOS 7.2 servers with Sendmail 8.14.7 V10 and Dovecot 2.2.10 installed on both and are trying to configure Master-Master Replication using doveadm replicator. We are using system users with PAM authentication but are receiving the following fatal error when dsync tries to run: doveadm(user): Fatal: /var/run/dovecot/auth-userdb: Configured passdbs don't support crentials lookups (to see if user is proxied, because doveadm_port is set). Please could someone confirm whether it is possible to configure replication using PAM passdb as the above error seems to suggest it isn't but we have come across various people online who seem to have it working. I don't know whether we need to create a master user or whether we need to create a separate password file with a directory of all of our user's passwords? We do have all the user passwords as they are only internal accounts that we are servicing. Thanks in advance Output of dovecot -n: # 2.2.10: /etc/dovecot/dovecot.conf # OS: Linux 3.10.0-327.13.1.el7.x86_64 x86_64 CentOS Linux release 7.2.1511 (Core) auth_mechanisms = plain login auth_socket_path = /var/run/dovecot/auth-userdb doveadm_password = secret doveadm_port = 12345 login_greeting = POP3-IMAP server ready. mail_location = maildir:~/Maildir mail_plugins = " notify replication" mbox_write_locks = fcntl namespace inbox { inbox = yes location = mailbox "Deleted Items" { auto = subscribe special_use = \Trash } mailbox Drafts { auto = subscribe special_use = \Drafts } mailbox "Junk E-mail" { auto = subscribe special_use = \Junk } mailbox Sent { auto = subscribe special_use = \Sent } prefix = } passdb { args = session=yes setcred=yes failure_show_msg=yes dovecot driver = pam } plugin { mail_replica = tcp:VMAILSERVER1:12345 } pop3_client_workarounds = outlook-no-nuls oe-ns-eoh service aggregator { fifo_listener replication-notify-fifo { mode = 0666 } unix_listener replication-notify { mode = 0666 } } service auth { unix_listener auth-userdb { mode = 0777 } } service doveadm { inet_listener { port = 12345 } } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { mode = 0600 } } ssl_ca = Hi, Since recently, there's a long delay when deleting any message from my inbox folder. This affects deleting and moving messages, but only the inbox of a single mailbox. The delay is a few seconds. Other operations work instantly. The server is Ubuntu 14.04 running Dovecot version "1:2.2.9-1ubuntu2". The filesystem is local ext4. My MUA is Thunderbird on Windows, latest version, connecting with IMAP. What could be the cause for this extreme delay? Yves Goergen http://unclassified.software From jtam.home at gmail.com Thu Apr 28 19:27:12 2016 From: jtam.home at gmail.com (Joseph Tam) Date: Thu, 28 Apr 2016 12:27:12 -0700 (PDT) Subject: WP8/Windows 10 mail app can't login, tries double auth In-Reply-To: References: Message-ID: Attila Nagy writes: > Are there anybody who could make WP8 (and W10 desktop clients it seems) > devices working with Dovecot's POP3 server? > > The conversation looks like this: > S +OK ready > C CAPA > S +OK > S CAPA > S TOP > S UIDL > S RESP-CODES > S PIPELINING > S AUTH-RESP-CODE > S USER > S SASL PLAIN > S . > C AUTH > S +OK > S PLAIN > S . > C AUTH PLAIN > S + > C S +OK[space] > C USER username > S -ERR unimplemented > > First I thought the extra space after that OK causes this, but removing > it changed nothing. > > So these devices try to log in with AUTH PLAIN, then even after a > successful login they want to log in again with USER, which gets rejected. I dimly remember some Windows clients preferring either "LOGIN" or "PLAIN" style mechanism. Have you tried allowing "LOGIN" style authentication? auth_mechanisms = plain login Joseph Tam From aki.tuomi at dovecot.fi Fri Apr 29 06:05:32 2016 From: aki.tuomi at dovecot.fi (Aki Tuomi) Date: Fri, 29 Apr 2016 09:05:32 +0300 Subject: Long delays when deleting a message in inbox In-Reply-To: <5aa5ebb5-9adf-a5b2-3938-477f717c5cc7@unclassified.de> References: <5aa5ebb5-9adf-a5b2-3938-477f717c5cc7@unclassified.de> Message-ID: <5722F9AC.6030706@dovecot.fi> On 28.04.2016 20:54, Yves Goergen wrote: > Hi, > > Since recently, there's a long delay when deleting any message from my > inbox folder. This affects deleting and moving messages, but only the > inbox of a single mailbox. The delay is a few seconds. Other > operations work instantly. > > The server is Ubuntu 14.04 running Dovecot version "1:2.2.9-1ubuntu2". > The filesystem is local ext4. My MUA is Thunderbird on Windows, latest > version, connecting with IMAP. > > What could be the cause for this extreme delay? > > Yves Goergen > http://unclassified.software Have you looked at your logs? Aki From bra at fsn.hu Fri Apr 29 06:39:01 2016 From: bra at fsn.hu (Nagy, Attila) Date: Fri, 29 Apr 2016 08:39:01 +0200 Subject: WP8/Windows 10 mail app can't login, tries double auth In-Reply-To: References: Message-ID: <57230185.9010200@fsn.hu> On 04/28/16 21:27, Joseph Tam wrote: > Attila Nagy writes: > >> Are there anybody who could make WP8 (and W10 desktop clients it seems) >> devices working with Dovecot's POP3 server? >> >> The conversation looks like this: >> S +OK ready >> C CAPA >> S +OK >> S CAPA >> S TOP >> S UIDL >> S RESP-CODES >> S PIPELINING >> S AUTH-RESP-CODE >> S USER >> S SASL PLAIN >> S . >> C AUTH >> S +OK >> S PLAIN >> S . >> C AUTH PLAIN >> S + >> C > S +OK[space] >> C USER username >> S -ERR unimplemented >> >> First I thought the extra space after that OK causes this, but removing >> it changed nothing. >> >> So these devices try to log in with AUTH PLAIN, then even after a >> successful login they want to log in again with USER, which gets >> rejected. > > I dimly remember some Windows clients preferring either "LOGIN" or > "PLAIN" > style mechanism. Have you tried allowing "LOGIN" style authentication? > > auth_mechanisms = plain login Yes, the effect was the same I remember. From Ralf.Hildebrandt at charite.de Fri Apr 29 09:28:47 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 29 Apr 2016 11:28:47 +0200 Subject: Recent update causes segfault in proxy mode Message-ID: <20160429092847.GH557@charite.de> I'm using the auto builds (2:2.2.24-1~auto+3) for Ubuntu/Debian. The recent upgrade to 2.2.24 cause the follwoing error to appear: I can log in to a mailbox via dovecot I can delete emails Upon expunge, dovecot crashes: Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142514, msgid=, size=10086 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142519, msgid=, size=1232 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142520, msgid=, size=1232 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142521, msgid=, size=1240 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142522, msgid=, size=1239 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142523, msgid=, size=1239 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142524, msgid=, size=6662 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142525, msgid=, size=5342 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142527, msgid=, size=9718 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142528, msgid=, size=3019 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142529, msgid=, size=7625 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142530, msgid=, size=31900 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142531, msgid=, size=4827 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142532, msgid=, size=4096 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142533, msgid=, size=7100 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142534, msgid=, size=4422 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142535, msgid=, size=10856 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142536, msgid=, size=13305 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142574, msgid=, size=3113 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142575, msgid=, size=4155 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142576, msgid=, size=5114 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): expunge: box=INBOX, uid=142577, msgid=, size=3266 Apr 29 11:05:30 mproxy dovecot: imap(hildeb): Fatal: master: service(imap): child 12393 killed with signal 11 (core dumped) Unfortunately, I'm not getting a backtrace :( -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From Ralf.Hildebrandt at charite.de Fri Apr 29 09:42:12 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 29 Apr 2016 11:42:12 +0200 Subject: Recent update causes segfault in proxy mode In-Reply-To: <20160429092847.GH557@charite.de> References: <20160429092847.GH557@charite.de> Message-ID: <20160429094212.GJ557@charite.de> * Ralf Hildebrandt : > Apr 29 11:05:30 mproxy dovecot: imap(hildeb): Fatal: master: service(imap): child 12393 killed with signal 11 (core dumped) > > Unfortunately, I'm not getting a backtrace :( Got a core dump, but I need to find out where to get the debug symbols for the packages on http://xi.dovecot.fi/debian/ ... -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From Ralf.Hildebrandt at charite.de Fri Apr 29 09:46:25 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 29 Apr 2016 11:46:25 +0200 Subject: Recent update causes segfault in proxy mode In-Reply-To: <20160429092847.GH557@charite.de> References: <20160429092847.GH557@charite.de> Message-ID: <20160429094625.GK557@charite.de> * Ralf Hildebrandt : > Unfortunately, I'm not getting a backtrace :( got it: # gdb /usr/lib/dovecot/imap 16784 GNU gdb (Ubuntu 7.11-0ubuntu1) 7.11 Copyright (C) 2016 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/lib/dovecot/imap...Reading symbols from /usr/lib/debug/.build-id/5a/15dc6951744d026af424747e7b72a4fb550c6b.debug...done. done. Attaching to program: /usr/lib/dovecot/imap, process 16784 ptrace: No such process. [New LWP 16784] Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. #0 buffer_delete (_buf=0x0, pos=0, size=0) at buffer.c:213 213 buffer.c: No such file or directory. (gdb) bt full #0 buffer_delete (_buf=0x0, pos=0, size=0) at buffer.c:213 buf = 0x0 end_size = #1 0x00007febcad5407e in array_delete_i (count=1, idx=1992, array=0x7febcd4b7b68) at ../../../../src/lib/array.h:200 No locals. #2 imapc_untagged_expunge (reply=, mbox=0x7febcd4b77f0) at imapc-mailbox.c:473 msgmap = 0x7febcd4b9320 lseq = 3444200800 uid = 142578 rseq = 1993 #3 0x00007febcad56632 in imapc_storage_client_untagged_cb (reply=0x7ffe117d5500, context=0x7febcd483080) at imapc-storage.c:204 mcb__foreach_end = 0x7febcd4b7f48 client = 0x7febcd483080 mbox = 0x7febcd4b77f0 cb = mcb = 0x7febcd4b7f28 #4 0x00007febcad5c90a in imapc_connection_input_untagged (conn=conn at entry=0x7febcd4a5560) at imapc-connection.c:1144 imap_args = 0x7febcd4a9b08 data = size = 140650738261000 name = 0x7febcd4a9c08 "EXPUNGE" value = parser = 0x7febcd4a57b0 reply = {name = 0x7febcd4a9c08 "EXPUNGE", num = 1993, args = 0x7febcd4a9b08, file_args = 0x7febcd4a7470, file_args_count = 0, resp_text_key = 0x0, resp_text_value = 0x0, untagged_box_context = 0x7febcd4b77f0} ret = #5 0x00007febcad5e7d9 in imapc_connection_input_one (conn=0x7febcd4a5560) at imapc-connection.c:1398 tag = 0x7febcd4a9bf8 "*" ret = -1 #6 imapc_connection_input_pending (conn=0x7febcd4a5560) at imapc-connection.c:1766 _data_stack_cur_id = 6 ret = 1 conn = 0x7febcd4a5560 #7 0x00007febcad5e82a in imapc_connection_input (conn=0x7febcd4a5560) at imapc-connection.c:1438 errstr = str = ret = #8 0x00007febcaa5905c in io_loop_call_io (io=0x7febcd4bd3d0) at ioloop.c:564 ioloop = 0x7febcd4babc0 t_id = 5 __FUNCTION__ = "io_loop_call_io" #9 0x00007febcaa5a4c1 in io_loop_handler_run_internal (ioloop=ioloop at entry=0x7febcd4babc0) at ioloop-epoll.c:220 ctx = 0x7febcd4bac90 io = tv = {tv_sec = 299, tv_usec = 999605} events_count = msecs = ret = 1 i = 0 j = call = __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007febcaa590e5 in io_loop_handler_run (ioloop=ioloop at entry=0x7febcd4babc0) at ioloop.c:612 No locals. #11 0x00007febcaa59288 in io_loop_run (ioloop=0x7febcd4babc0) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #12 0x00007febcad59b7a in imapc_client_run_pre (client=0x7febcd483250, client=0x7febcd483250) at imapc-client.c:173 connp = 0x7febcd4833e8 prev_ioloop = 0x7febcd467740 #13 imapc_client_run (client=0x7febcd483250) at imapc-client.c:192 No locals. #14 0x00007febcad575e0 in imapc_mailbox_run_nofetch (mbox=mbox at entry=0x7febcd4b77f0) at imapc-storage.c:143 No locals. #15 0x00007febcad57612 in imapc_mailbox_run (mbox=mbox at entry=0x7febcd4b77f0) at imapc-storage.c:137 No locals. #16 0x00007febcad59178 in imapc_sync_index (ctx=0x7febcd4bd010) at imapc-sync.c:405 mbox = 0x7febcd4b77f0 sync_rec = {uid1 = 142578, uid2 = 142578, type = MAIL_INDEX_SYNC_TYPE_EXPUNGE, add_flags = 254 '\376', remove_flags = 127 '\177', keyword_idx = 0, guid_128 = "^kK\r2U\277\357\225`\030\220\257\330\a\t"} seq1 = 1993 seq2 = 1993 #17 imapc_sync_begin (force=, ctx_r=, mbox=0x7febcd4b77f0) at imapc-sync.c:481 ctx = sync_flags = ret = #18 imapc_sync (mbox=0x7febcd4b77f0) at imapc-sync.c:537 sync_ctx = force = #19 imapc_mailbox_sync_init (box=0x7febcd4b77f0, flags=MAILBOX_SYNC_FLAG_FIX_INCONSISTENT) at imapc-sync.c:590 mbox = 0x7febcd4b77f0 list = changes = false ret = #20 0x00007febcad0da7b in mailbox_sync_init (box=0x7febcd4b77f0, flags=MAILBOX_SYNC_FLAG_FIX_INCONSISTENT) at mail-storage.c:1672 _data_stack_cur_id = 4 ctx = #21 0x00007febcad0dbc7 in mailbox_sync (box=, flags=, flags at entry=(unknown: 0)) at mail-storage.c:1720 ctx = 0x7febcd4b39e0 status = {sync_delayed_expunges = 1} #22 0x00007febcb44656f in cmd_close (cmd=0x7febcd4b39e0) at cmd-close.c:31 client = 0x7febcd4a7e20 mailbox = 0x7febcd4b77f0 storage = 0x7febcd4a8630 errstr = tagged_reply = 0x7febcb462c39 "OK Close completed." error = MAIL_ERROR_NONE __FUNCTION__ = "cmd_close" #23 0x00007febcb452e4d in command_exec (cmd=cmd at entry=0x7febcd4b39e0) at imap-commands.c:180 hook = 0x7febcd468100 finished = cmd_start_timeval = {tv_sec = 1461922706, tv_usec = 948134} cmd_start_bytes_in = 5370 cmd_start_bytes_out = 106277 __FUNCTION__ = "command_exec" #24 0x00007febcb451212 in client_command_input (cmd=0x7febcd4b39e0) at imap-client.c:960 client = 0x7febcd4a7e20 command = __FUNCTION__ = "client_command_input" #25 0x00007febcb451665 in client_handle_next_command (remove_io_r=, client=0x7febcd4a7e20) at imap-client.c:1060 No locals. #26 client_handle_input (client=0x7febcd4a7e20) at imap-client.c:1072 _data_stack_cur_id = 3 remove_io = false handled_commands = false client = 0x7febcd4a7e20 #27 0x00007febcb451767 in client_continue_pending_input (client=0x7febcd4a7e20) at imap-client.c:893 ---Type to continue, or q to quit--- No locals. #28 0x00007febcb451bc0 in client_input (client=0x7febcd4a7e20) at imap-client.c:1138 cmd = 0xe4031 output = 0x0 bytes = 86 __FUNCTION__ = "client_input" #29 0x00007febcaa5905c in io_loop_call_io (io=0x7febcd4a78b0) at ioloop.c:564 ioloop = 0x7febcd467740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #30 0x00007febcaa5a4c1 in io_loop_handler_run_internal (ioloop=ioloop at entry=0x7febcd467740) at ioloop-epoll.c:220 ctx = 0x7febcd469250 io = tv = {tv_sec = 1739, tv_usec = 992335} events_count = msecs = ret = 1 i = 0 j = call = __FUNCTION__ = "io_loop_handler_run_internal" #31 0x00007febcaa590e5 in io_loop_handler_run (ioloop=ioloop at entry=0x7febcd467740) at ioloop.c:612 No locals. #32 0x00007febcaa59288 in io_loop_run (ioloop=0x7febcd467740) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #33 0x00007febca9eee63 in master_service_run (service=0x7febcd4675e0, callback=) at master-service.c:640 No locals. #34 0x00007febcb444b32 in main (argc=1, argv=0x7febcd467390) at main.c:460 set_roots = {0x7febcb66e700 , 0x7febcb20d400 , 0x0} login_set = {auth_socket_path = 0x7febcd45f048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x7febcb45e9d0 , failure_callback = 0x7febcb45e2e0 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 auth_socket_path = 0x7febcb46734e "auth-master" c = -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From m at sys4.de Fri Apr 29 09:46:58 2016 From: m at sys4.de (Marc Schiffbauer) Date: Fri, 29 Apr 2016 11:46:58 +0200 Subject: Recent update causes segfault in proxy mode In-Reply-To: <20160429094212.GJ557@charite.de> References: <20160429092847.GH557@charite.de> <20160429094212.GJ557@charite.de> Message-ID: <20160429094658.GO9395@schiffbauer.net> * Ralf Hildebrandt schrieb am 29.04.16 um 11:42 Uhr: > * Ralf Hildebrandt : > > > Apr 29 11:05:30 mproxy dovecot: imap(hildeb): Fatal: master: service(imap): child 12393 killed with signal 11 (core dumped) > > > > Unfortunately, I'm not getting a backtrace :( > > Got a core dump, but I need to find out where to get the debug symbols > for the packages on http://xi.dovecot.fi/debian/ ... dovecot-dbg ? -- [*] sys4 AG http://sys4.de, +49 (89) 30 90 46 64 Franziskanerstra?e 15, 81669 M?nchen Sitz der Gesellschaft: M?nchen, Amtsgericht M?nchen: HRB 199263 Vorstand: Patrick Ben Koetter, Marc Schiffbauer Aufsichtsratsvorsitzender: Florian Kirstein From cajeptha at gmail.com Fri Apr 29 09:58:00 2016 From: cajeptha at gmail.com (Carl A Jeptha) Date: Fri, 29 Apr 2016 11:58:00 +0200 Subject: Changing Password Schemes Message-ID: <57233028.7000201@gmail.com> Good Day, I have been following this tutorial without much luck - http://wiki2.dovecot.org/HowTo/ConvertPasswordSchemes#CA-26af2b83a43b8100522c57565773f605c21f2f27_1 It is obvious to me that I am not following the instructions correctly and need to be shown what I am misunderstanding. I have an old postfix + dovecot + Roundcube mailserver (mail.domain.Tld). Server clock is loosing time and adjusting it causes dovecot to kill itself, we cannot install more memory, bigger hard-drives, etc. I have built a new server box (mail2.domain.Tld) With Postfix + dovecot + Roundcube. This server is functioning, with a client's new domain, and my personal domain. it's password system is SHA512-CRYPT. I have imported the users from the old server over to the new server. I have created a new column "plain_pass" for the plain passwords. I will be using imapsync to transfer the mail folders from the one server to the other, but will not proceed until I fix this issue. # 2.2.18: /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.8 (0c4ae064f307+) # OS: Linux 4.2.0-35-generic x86_64 Ubuntu 15.10 ext4 auth_mechanisms = plain login first_valid_gid = 8 first_valid_uid = 150 last_valid_gid = 8 last_valid_uid = 150 listen = * mail_gid = mail mail_location = maildir:/var/vmail/%d/%n mail_uid = vmail namespace inbox { inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Junk { special_use = \Junk } mailbox Sent { special_use = \Sent } mailbox "Sent Messages" { special_use = \Sent } mailbox Trash { special_use = \Trash } prefix = } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } plugin { quota_grace = 10%% quota_rule = *:storage=1G quota_rule2 = Trash:storage=+100M quota_warning = storage=95%% quota-warning 95 %u quota_warning2 = storage=80%% quota-warning 80 %u } postmaster_address = postmaster at airnet.ca protocols = imap pop3 lmtp lmtp pop3 service auth { unix_listener /var/spool/postfix/private/auth { group = postfix mode = 0666 user = postfix } unix_listener auth-userdb { group = mail mode = 0666 user = vmail } } service imap-login { inet_listener imap { port = 143 } inet_listener imaps { port = 993 ssl = yes } } service imap-postlogin { executable = script-login /usr/local/etc/popafter.sh user = $default_internal_user } service imap { executable = imap imap-postlogin } service pop3-login { inet_listener pop3 { port = 110 } inet_listener pop3s { port = 995 ssl = yes } } service pop3-postlogin { executable = script-login /usr/local/etc/popafter.sh user = $default_internal_user } service pop3 { executable = pop3 pop3-postlogin } ssl_cert = Config: # 2.2.devel (2dc8e2d): /etc/dovecot/dovecot.conf # Pigeonhole version 0.4.devel (850d80b) # OS: Linux 3.13.0-77-generic x86_64 Ubuntu 16.04 LTS auth_mechanisms = plain login default_vsz_limit = 1 G imapc_host = email.charite.de imapc_port = 993 imapc_ssl = imaps imapc_ssl_verify = no listen = *,:: mail_gid = imapproxy mail_home = /home/imapproxy/%u mail_location = imapc:~/imapc mail_plugins = mail_log notify mail_uid = imapproxy passdb { args = host=email.charite.de port=993 ssl=imaps default_fields = userdb_imapc_user=%u userdb_imapc_password=%w userdb_imapc_host=email.charite.de userdb_imapc_ssl=imaps userdb_imapc_port=993 driver = imap } plugin { sieve = file:~/sieve;active=~/.dovecot.sieve } protocols = imap service auth { inet_listener { address = 127.0.0.1 port = 12345 } } ssl = required ssl_ca = #1 0x00007f5729a7507e in array_delete_i (count=1, idx=125, array=0x7f572c12bbb8) at ../../../../src/lib/array.h:200 No locals. #2 imapc_untagged_expunge (reply=, mbox=0x7f572c12b840) at imapc-mailbox.c:473 msgmap = 0x7f572c146ed0 lseq = 739349904 uid = 51497 rseq = 126 #3 0x00007f5729a77632 in imapc_storage_client_untagged_cb ( reply=0x7ffdc857e400, context=0x7f572c0f7080) at imapc-storage.c:204 mcb__foreach_end = 0x7f572c12bf98 client = 0x7f572c0f7080 mbox = 0x7f572c12b840 cb = mcb = 0x7f572c12bf78 #4 0x00007f5729a7d90a in imapc_connection_input_untagged ( conn=conn at entry=0x7f572c119590) at imapc-connection.c:1144 imap_args = 0x7f572c11db38 data = size = 140012378250296 name = 0x7f572c11dc38 "EXPUNGE" value = parser = 0x7f572c119710 reply = {name = 0x7f572c11dc38 "EXPUNGE", num = 126, args = 0x7f572c11db38, file_args = 0x7f572c11b4c0, file_args_count = 0, resp_text_key = 0x0, resp_text_value = 0x0, untagged_box_context = 0x7f572c12b840} ret = #5 0x00007f5729a7f7d9 in imapc_connection_input_one (conn=0x7f572c119590) at imapc-connection.c:1398 tag = 0x7f572c11dc28 "*" ret = -1 #6 imapc_connection_input_pending (conn=0x7f572c119590) at imapc-connection.c:1766 _data_stack_cur_id = 6 ret = 1 conn = 0x7f572c119590 #7 0x00007f5729a7f82a in imapc_connection_input (conn=0x7f572c119590) at imapc-connection.c:1438 errstr = str = ret = #8 0x00007f572977a05c in io_loop_call_io (io=0x7f572c132740) at ioloop.c:564 ioloop = 0x7f572c136c10 t_id = 5 __FUNCTION__ = "io_loop_call_io" #9 0x00007f572977b4c1 in io_loop_handler_run_internal ( ioloop=ioloop at entry=0x7f572c136c10) at ioloop-epoll.c:220 ctx = 0x7f572c138dd0 io = tv = {tv_sec = 299, tv_usec = 999778} events_count = msecs = ret = 1 i = 0 j = call = __FUNCTION__ = "io_loop_handler_run_internal" #10 0x00007f572977a0e5 in io_loop_handler_run ( ioloop=ioloop at entry=0x7f572c136c10) at ioloop.c:612 No locals. #11 0x00007f572977a288 in io_loop_run (ioloop=0x7f572c136c10) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #12 0x00007f5729a7ab7a in imapc_client_run_pre (client=0x7f572c0f7250, client=0x7f572c0f7250) at imapc-client.c:173 connp = 0x7f572c0f73e8 prev_ioloop = 0x7f572c0db740 #13 imapc_client_run (client=0x7f572c0f7250) at imapc-client.c:192 No locals. #14 0x00007f5729a785e0 in imapc_mailbox_run_nofetch ( mbox=mbox at entry=0x7f572c12b840) at imapc-storage.c:143 No locals. #15 0x00007f5729a78612 in imapc_mailbox_run (mbox=mbox at entry=0x7f572c12b840) at imapc-storage.c:137 No locals. #16 0x00007f5729a7a178 in imapc_sync_index (ctx=0x7f572c132140) at imapc-sync.c:405 mbox = 0x7f572c12b840 sync_rec = {uid1 = 51497, uid2 = 51497, type = MAIL_INDEX_SYNC_TYPE_EXPUNGE, add_flags = 4 '\004', remove_flags = 0 '\000', keyword_idx = 6315, guid_128 = "^kK\r2U\277\357\225`\030\220\257\330\a\t"} seq1 = 126 seq2 = 126 #17 imapc_sync_begin (force=, ctx_r=, mbox=0x7f572c12b840) at imapc-sync.c:481 ctx = sync_flags = ret = #18 imapc_sync (mbox=0x7f572c12b840) at imapc-sync.c:537 sync_ctx = force = #19 imapc_mailbox_sync_init (box=0x7f572c12b840, flags=MAILBOX_SYNC_FLAG_EXPUNGE) at imapc-sync.c:590 mbox = 0x7f572c12b840 list = changes = false ret = #20 0x00007f5729a2ea7b in mailbox_sync_init (box=box at entry=0x7f572c12b840, flags=flags at entry=MAILBOX_SYNC_FLAG_EXPUNGE) at mail-storage.c:1672 _data_stack_cur_id = 4 ctx = #21 0x00007f572a17e102 in imap_sync_init (client=client at entry=0x7f572c11be50, box=, imap_flags=IMAP_SYNC_FLAG_SAFE, flags=MAILBOX_SYNC_FLAG_EXPUNGE) at imap-sync.c:229 __FUNCTION__ = "imap_sync_init" #22 0x00007f572a17ef97 in cmd_sync_client (sync_cmd=0x7f572c127a90) at imap-sync.c:737 ctx = flags = client = 0x7f572c11be50 imap_flags = no_newmail = #23 cmd_sync_delayed_real (client=0x7f572c11be50) at imap-sync.c:856 cmd = first_expunge = first_nonexpunge = #24 cmd_sync_delayed (client=client at entry=0x7f572c11be50) at imap-sync.c:864 _data_stack_cur_id = 3 #25 0x00007f572a1726d8 in client_handle_input (client=0x7f572c11be50) at imap-client.c:1088 remove_io = handled_commands = client = 0x7f572c11be50 #26 0x00007f572a172b65 in client_input (client=0x7f572c11be50) at imap-client.c:1119 cmd = 0x27284 output = 0x7f572c11d080 bytes = 153 __FUNCTION__ = "client_input" #27 0x00007f572977a05c in io_loop_call_io (io=0x7f572c1198c0) at ioloop.c:564 ioloop = 0x7f572c0db740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #28 0x00007f572977b4c1 in io_loop_handler_run_internal ( ioloop=ioloop at entry=0x7f572c0db740) at ioloop-epoll.c:220 ctx = 0x7f572c0dd250 io = tv = {tv_sec = 1739, tv_usec = 992115} events_count = msecs = ret = 1 i = 0 j = call = __FUNCTION__ = "io_loop_handler_run_internal" #29 0x00007f572977a0e5 in io_loop_handler_run ( ioloop=ioloop at entry=0x7f572c0db740) at ioloop.c:612 No locals. #30 0x00007f572977a288 in io_loop_run (ioloop=0x7f572c0db740) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #31 0x00007f572970fe63 in master_service_run (service=0x7f572c0db5e0, callback=) at master-service.c:640 No locals. #32 0x00007f572a165b32 in main (argc=1, argv=0x7f572c0db390) at main.c:460 set_roots = {0x7f572a38f700 , 0x7f5729f2e400 , 0x0} login_set = {auth_socket_path = 0x7f572c0d3048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x7f572a17f9d0 , failure_callback = 0x7f572a17f2e0 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 auth_socket_path = 0x7f572a18834e "auth-master" c = ----- End forwarded message ----- -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From tss at iki.fi Fri Apr 29 11:36:26 2016 From: tss at iki.fi (Timo Sirainen) Date: Fri, 29 Apr 2016 14:36:26 +0300 Subject: Backtrace:dovecot/imap In-Reply-To: <20160429113134.GL557@charite.de> References: <20160429113134.GL557@charite.de> Message-ID: <6B5995DE-3DAF-4361-AF46-E234F4565859@iki.fi> On 29 Apr 2016, at 14:31, Ralf Hildebrandt wrote: > > #0 buffer_delete (_buf=0x0, pos=0, size=0) at buffer.c:213 > #0 buffer_delete (_buf=0x0, pos=0, size=0) at buffer.c:213 > buf = 0x0 > end_size = > #1 0x00007f5729a7507e in array_delete_i (count=1, idx=125, > array=0x7f572c12bbb8) at ../../../../src/lib/array.h:200 > No locals. > #2 imapc_untagged_expunge (reply=, mbox=0x7f572c12b840) > at imapc-mailbox.c:473 > msgmap = 0x7f572c146ed0 > lseq = 739349904 > uid = 51497 > rseq = 126 Oh, imapc expunges were broken when imapc_features didn't have "modseq". https://github.com/dovecot/core/commit/de8fc9d21460bf0369d671e9ba9361592379a7c5 From CMarcus at Media-Brokers.com Fri Apr 29 13:00:41 2016 From: CMarcus at Media-Brokers.com (Charles Marcus) Date: Fri, 29 Apr 2016 09:00:41 -0400 Subject: Changing Password Schemes In-Reply-To: <57233028.7000201@gmail.com> References: <57233028.7000201@gmail.com> Message-ID: <36c11eea-438e-a1ea-4eb6-b8675c706f22@Media-Brokers.com> On 4/29/2016 5:58 AM, Carl A Jeptha wrote: > I have an old postfix + dovecot + Roundcube mailserver > (mail.domain.Tld). Server clock is loosing time and adjusting it causes > dovecot to kill itself, we cannot install more memory, bigger > hard-drives, etc. > > I have built a new server box Well, doesn't directly address your question/issue, but... You know you can fix the server clock problem without building a new server, right? From skdovecot at smail.inf.fh-brs.de Fri Apr 29 13:02:33 2016 From: skdovecot at smail.inf.fh-brs.de (Steffen Kaiser) Date: Fri, 29 Apr 2016 15:02:33 +0200 (CEST) Subject: Changing Password Schemes In-Reply-To: <57233028.7000201@gmail.com> References: <57233028.7000201@gmail.com> Message-ID: -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Fri, 29 Apr 2016, Carl A Jeptha wrote: > Good Day, > I have been following this tutorial without much luck - > http://wiki2.dovecot.org/HowTo/ConvertPasswordSchemes#CA-26af2b83a43b8100522c57565773f605c21f2f27_1 > > It is obvious to me that I am not following the instructions correctly and > need to be shown what I am misunderstanding. > > I have an old postfix + dovecot + Roundcube mailserver (mail.domain.Tld). > Server clock is loosing time and adjusting it causes dovecot to kill itself, > we cannot install more memory, bigger hard-drives, etc. > > I have built a new server box (mail2.domain.Tld) With Postfix + dovecot + > Roundcube. This server is functioning, with a client's new domain, and my > personal domain. it's password system is SHA512-CRYPT. > > I have imported the users from the old server over to the new server. I have > created a new column "plain_pass" for the plain passwords. > > I will be using imapsync to transfer the mail folders from the one server to > the other, but will not proceed until I fix this issue. Actually, _what_ issue? > # 2.2.18: /etc/dovecot/dovecot.conf > # Pigeonhole version 0.4.8 (0c4ae064f307+) > # OS: Linux 4.2.0-35-generic x86_64 Ubuntu 15.10 ext4 > auth_mechanisms = plain login > first_valid_gid = 8 > first_valid_uid = 150 > last_valid_gid = 8 > last_valid_uid = 150 > listen = * > mail_gid = mail > mail_location = maildir:/var/vmail/%d/%n > mail_uid = vmail > namespace inbox { > inbox = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > quota_grace = 10%% > quota_rule = *:storage=1G > quota_rule2 = Trash:storage=+100M > quota_warning = storage=95%% quota-warning 95 %u > quota_warning2 = storage=80%% quota-warning 80 %u > } > postmaster_address = postmaster at airnet.ca > protocols = imap pop3 lmtp lmtp pop3 > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > group = mail > mode = 0666 > user = vmail > } > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service imap-postlogin { > executable = script-login /usr/local/etc/popafter.sh > user = $default_internal_user > } > service imap { > executable = imap imap-postlogin > } > service pop3-login { > inet_listener pop3 { > port = 110 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > service pop3-postlogin { > executable = script-login /usr/local/etc/popafter.sh > user = $default_internal_user > } > service pop3 { > executable = pop3 pop3-postlogin > } > ssl_cert = ssl_cipher_list = > ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA > ssl_dh_parameters_length = 2048 > ssl_key = ssl_prefer_server_ciphers = yes > ssl_protocols = !SSLv2 !SSLv3 > userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > > -- ------------ You have a good day now, en mag jou m?re ook so wees, Carl A > Jeptha > - -- Steffen Kaiser -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEVAwUBVyNbaXz1H7kL/d9rAQIbnQgAyiX9368WmhyTfTY38YfNWTXW/UW/b/0t PqyEPx/DLLLW60aSkA0NqJa0nKzsoHip8GQfO/ZY3fqdTdep2rW4NbZW6o8/rFwW dmNTarux25w7dNvRGWrGZiXTnGAlwQtnJTr8wuwqi2JILqPoh1dL1Ubo90ABTERv G8q2NXgtD4m0a2aJqmyMXRmep8ocMy3IEIg8JZ/xJtmL86d4bP7kagI2yP7viIUx EY9JSazl/u6iVIrI6jFDuFUfzAs4dr+wcQHhAM0sY8mFUVYFsdjqxCbytLy39q4O zyj66UNAGR5yAnXAlADJ7G1fIghskFBa82p/t8QCX9VNSvOnuklqGQ== =Q4iK -----END PGP SIGNATURE----- From cajeptha at gmail.com Fri Apr 29 13:04:56 2016 From: cajeptha at gmail.com (Carl A Jeptha) Date: Fri, 29 Apr 2016 15:04:56 +0200 Subject: Changing Password Schemes In-Reply-To: <36c11eea-438e-a1ea-4eb6-b8675c706f22@Media-Brokers.com> References: <57233028.7000201@gmail.com> <36c11eea-438e-a1ea-4eb6-b8675c706f22@Media-Brokers.com> Message-ID: <57235BF8.2010807@gmail.com> Yes, but the machine is very old, can't more memory (maxed out) hard drive size maxed out. But we cannot keep on going plain text password saved in the database, that is asking for trouble to happen, which (touch wood) has not happened yet. ------------ You have a good day now, en mag jou m?re ook so wees, Carl A Jeptha On 2016-04-29 15:00, Charles Marcus wrote: > On 4/29/2016 5:58 AM, Carl A Jeptha wrote: >> I have an old postfix + dovecot + Roundcube mailserver >> (mail.domain.Tld). Server clock is loosing time and adjusting it causes >> dovecot to kill itself, we cannot install more memory, bigger >> hard-drives, etc. >> >> I have built a new server box > Well, doesn't directly address your question/issue, but... > > You know you can fix the server clock problem without building a new > server, right? From cajeptha at gmail.com Fri Apr 29 13:07:35 2016 From: cajeptha at gmail.com (Carl A Jeptha) Date: Fri, 29 Apr 2016 15:07:35 +0200 Subject: Changing Password Schemes In-Reply-To: References: <57233028.7000201@gmail.com> Message-ID: <57235C97.3060008@gmail.com> converting the passwords in the database from clear/plain text to SHA512-CRYPT ------------ You have a good day now, en mag jou m?re ook so wees, Carl A Jeptha On 2016-04-29 15:02, Steffen Kaiser wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > On Fri, 29 Apr 2016, Carl A Jeptha wrote: > >> Good Day, >> I have been following this tutorial without much luck - >> http://wiki2.dovecot.org/HowTo/ConvertPasswordSchemes#CA-26af2b83a43b8100522c57565773f605c21f2f27_1 >> >> It is obvious to me that I am not following the instructions >> correctly and need to be shown what I am misunderstanding. >> >> I have an old postfix + dovecot + Roundcube mailserver >> (mail.domain.Tld). Server clock is loosing time and adjusting it >> causes dovecot to kill itself, we cannot install more memory, bigger >> hard-drives, etc. >> >> I have built a new server box (mail2.domain.Tld) With Postfix + >> dovecot + Roundcube. This server is functioning, with a client's new >> domain, and my personal domain. it's password system is SHA512-CRYPT. >> >> I have imported the users from the old server over to the new server. >> I have created a new column "plain_pass" for the plain passwords. >> >> I will be using imapsync to transfer the mail folders from the one >> server to the other, but will not proceed until I fix this issue. > > Actually, _what_ issue? > >> # 2.2.18: /etc/dovecot/dovecot.conf >> # Pigeonhole version 0.4.8 (0c4ae064f307+) >> # OS: Linux 4.2.0-35-generic x86_64 Ubuntu 15.10 ext4 >> auth_mechanisms = plain login >> first_valid_gid = 8 >> first_valid_uid = 150 >> last_valid_gid = 8 >> last_valid_uid = 150 >> listen = * >> mail_gid = mail >> mail_location = maildir:/var/vmail/%d/%n >> mail_uid = vmail >> namespace inbox { >> inbox = yes >> location = >> mailbox Drafts { >> special_use = \Drafts >> } >> mailbox Junk { >> special_use = \Junk >> } >> mailbox Sent { >> special_use = \Sent >> } >> mailbox "Sent Messages" { >> special_use = \Sent >> } >> mailbox Trash { >> special_use = \Trash >> } >> prefix = >> } >> passdb { >> args = /etc/dovecot/dovecot-sql.conf.ext >> driver = sql >> } >> plugin { >> quota_grace = 10%% >> quota_rule = *:storage=1G >> quota_rule2 = Trash:storage=+100M >> quota_warning = storage=95%% quota-warning 95 %u >> quota_warning2 = storage=80%% quota-warning 80 %u >> } >> postmaster_address = postmaster at airnet.ca >> protocols = imap pop3 lmtp lmtp pop3 >> service auth { >> unix_listener /var/spool/postfix/private/auth { >> group = postfix >> mode = 0666 >> user = postfix >> } >> unix_listener auth-userdb { >> group = mail >> mode = 0666 >> user = vmail >> } >> } >> service imap-login { >> inet_listener imap { >> port = 143 >> } >> inet_listener imaps { >> port = 993 >> ssl = yes >> } >> } >> service imap-postlogin { >> executable = script-login /usr/local/etc/popafter.sh >> user = $default_internal_user >> } >> service imap { >> executable = imap imap-postlogin >> } >> service pop3-login { >> inet_listener pop3 { >> port = 110 >> } >> inet_listener pop3s { >> port = 995 >> ssl = yes >> } >> } >> service pop3-postlogin { >> executable = script-login /usr/local/etc/popafter.sh >> user = $default_internal_user >> } >> service pop3 { >> executable = pop3 pop3-postlogin >> } >> ssl_cert = > ssl_cipher_list = >> ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA >> ssl_dh_parameters_length = 2048 >> ssl_key = > ssl_prefer_server_ciphers = yes >> ssl_protocols = !SSLv2 !SSLv3 >> userdb { >> driver = prefetch >> } >> userdb { >> args = /etc/dovecot/dovecot-sql.conf.ext >> driver = sql >> } >> >> -- ------------ You have a good day now, en mag jou m?re ook so wees, >> Carl A Jeptha >> > > - -- Steffen Kaiser > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1 > > iQEVAwUBVyNbaXz1H7kL/d9rAQIbnQgAyiX9368WmhyTfTY38YfNWTXW/UW/b/0t > PqyEPx/DLLLW60aSkA0NqJa0nKzsoHip8GQfO/ZY3fqdTdep2rW4NbZW6o8/rFwW > dmNTarux25w7dNvRGWrGZiXTnGAlwQtnJTr8wuwqi2JILqPoh1dL1Ubo90ABTERv > G8q2NXgtD4m0a2aJqmyMXRmep8ocMy3IEIg8JZ/xJtmL86d4bP7kagI2yP7viIUx > EY9JSazl/u6iVIrI6jFDuFUfzAs4dr+wcQHhAM0sY8mFUVYFsdjqxCbytLy39q4O > zyj66UNAGR5yAnXAlADJ7G1fIghskFBa82p/t8QCX9VNSvOnuklqGQ== > =Q4iK > -----END PGP SIGNATURE----- From Ralf.Hildebrandt at charite.de Fri Apr 29 13:20:41 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 29 Apr 2016 15:20:41 +0200 Subject: Backtrace:dovecot/imap In-Reply-To: <6B5995DE-3DAF-4361-AF46-E234F4565859@iki.fi> References: <20160429113134.GL557@charite.de> <6B5995DE-3DAF-4361-AF46-E234F4565859@iki.fi> Message-ID: <20160429132041.GM557@charite.de> * Timo Sirainen : > Oh, imapc expunges were broken when imapc_features didn't have > "modseq". > https://github.com/dovecot/core/commit/de8fc9d21460bf0369d671e9ba9361592379a7c5 Fixed, thanks! -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From dovecot-e51 at deemzed.uk Fri Apr 29 13:49:47 2016 From: dovecot-e51 at deemzed.uk (Dave) Date: Fri, 29 Apr 2016 14:49:47 +0100 Subject: Password database extra fields and SQL Message-ID: <5723667B.1080005@deemzed.uk> Hi everyone, first post to the list, be gentle with me! Perhaps I'm missing something here, but it appears to me that many password database extra fields currently aren't much use inside SQL queries? All boolean fields like nologin/nodelay/nopassword are set if the column is present in the returned query, regardless of value (including NULL) For example, say you have a query like: password_query = SELECT hash AS password, NULLIF(active = 1, 'y') AS nologin FROM users WHERE name = '%u' Then nologin will always be set for this account, there's no realistic way to toggle the flag. Has anyone come across any workarounds for this problem that don't sacrifice efficiency by performing multiple lookups? I was considering what would happen if dovecot treated NULL fields as not present, but that immediately conflicts with advice to set password to NULL to satisfy the field requirement on nopassword. Any thoughts? -- Dave From idefix at fechner.net Fri Apr 29 13:57:32 2016 From: idefix at fechner.net (Matthias Fechner) Date: Fri, 29 Apr 2016 15:57:32 +0200 Subject: Password database extra fields and SQL In-Reply-To: <5723667B.1080005@deemzed.uk> References: <5723667B.1080005@deemzed.uk> Message-ID: <032d993f-3b40-41dc-88df-710de575f072@fechner.net> Am 29.04.2016 um 15:49 schrieb Dave: > > For example, say you have a query like: > > password_query = SELECT hash AS password, NULLIF(active = 1, 'y') AS > nologin FROM users WHERE name = '%u' why not using a logic like this to block users that are not active: password_query = SELECT username as user, password as password, \ homedir AS userdb_home, maildir AS userdb_mail, \ concat('*:bytes=', quota) as userdb_quota_rule, uid as userdb_uid, gid as userdb_gid \ FROM mailbox \ WHERE username = '%Lu' AND active = '1' \ AND ( access_restriction = 'ALL' OR LOCATE( '%Us', access_restriction ) > 0 ) Gru? Matthias -- "Programming today is a race between software engineers striving to build bigger and better idiot-proof programs, and the universe trying to produce bigger and better idiots. So far, the universe is winning." -- Rich Cook From me at mgaito.net Fri Apr 29 14:25:41 2016 From: me at mgaito.net (Matteo Gaito Test Account) Date: Fri, 29 Apr 2016 16:25:41 +0200 (CEST) Subject: more info about deleting users In-Reply-To: <260988049.76859.1461938117118.JavaMail.open-xchange@popper07.register.it> References: <260988049.76859.1461938117118.JavaMail.open-xchange@popper07.register.it> Message-ID: <1821159830.78070.1461939941971.JavaMail.open-xchange@popper07.register.it> Hi, i've search a lot in order to find a way to delete account by dovecot but i found only this way http://dovecot.org/list/dovecot/2011-November/079273.html It's possible today delete a maildir remotely with doveadm or with dovecot api? Thanks Matteo From dovecot-e51 at deemzed.uk Fri Apr 29 14:26:30 2016 From: dovecot-e51 at deemzed.uk (Dave) Date: Fri, 29 Apr 2016 15:26:30 +0100 Subject: Password database extra fields and SQL In-Reply-To: <032d993f-3b40-41dc-88df-710de575f072@fechner.net> References: <5723667B.1080005@deemzed.uk> <032d993f-3b40-41dc-88df-710de575f072@fechner.net> Message-ID: <57236F16.3020805@deemzed.uk> On 29/04/2016 14:57, Matthias Fechner wrote: > Am 29.04.2016 um 15:49 schrieb Dave: >> >> For example, say you have a query like: >> >> password_query = SELECT hash AS password, NULLIF(active = 1, 'y') AS >> nologin FROM users WHERE name = '%u' > > why not using a logic like this to block users that are not active: ... > WHERE username = '%Lu' AND active = '1' \ ... Hi Matthias, that's the logic I'm currently using, but being unable to use nologin means having no simple way to communicate that the account is explicitly locked rather than auth failed / not present. It seems a bit of a hack! It also doesn't help with other boolean fields, current or future. For example nodelay would be useful if it could be selectively set on query for, say, webmail access. -- Dave From gfinch at ldmltd.ca Fri Apr 29 14:32:37 2016 From: gfinch at ldmltd.ca (Gregory Finch) Date: Fri, 29 Apr 2016 07:32:37 -0700 Subject: Password database extra fields and SQL In-Reply-To: <5723667B.1080005@deemzed.uk> References: <5723667B.1080005@deemzed.uk> Message-ID: <898c215c-4584-85f0-b4a0-6f673b6d58d6@ldmltd.ca> On 2016-04-29 6:49 AM, Dave wrote: > > Hi everyone, > > first post to the list, be gentle with me! > > Perhaps I'm missing something here, but it appears to me that many > password database extra fields currently aren't much use inside SQL > queries? > > All boolean fields like nologin/nodelay/nopassword are set if the > column is present in the returned query, regardless of value > (including NULL) > > For example, say you have a query like: > > password_query = SELECT hash AS password, NULLIF(active = 1, 'y') AS > nologin FROM users WHERE name = '%u' > > Then nologin will always be set for this account, there's no realistic > way to toggle the flag. > > Has anyone come across any workarounds for this problem that don't > sacrifice efficiency by performing multiple lookups? > > I was considering what would happen if dovecot treated NULL fields as > not present, but that immediately conflicts with advice to set > password to NULL to satisfy the field requirement on nopassword. Any > thoughts? > My password query works as follows with PostgreSQL and dovecot 20140806 (don't remember what version that is): password_query = SELECT userid AS username, passwd AS password, case when send=true then null else true end as nologin FROM users WHERE userid='%n' The "send" column is what I use to determine if "nologin" should be set. Greg -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 819 bytes Desc: OpenPGP digital signature URL: From Ralf.Hildebrandt at charite.de Fri Apr 29 15:22:52 2016 From: Ralf.Hildebrandt at charite.de (Ralf Hildebrandt) Date: Fri, 29 Apr 2016 17:22:52 +0200 Subject: segfault in imap "Warning: Timeout leak: 0x7fd584e8e050 (line 399)" Message-ID: <20160429152252.GO557@charite.de> Corresponding log entry: Apr 29 17:14:07 mproxy dovecot: imap(v******d): copy from INBOX: box=Trash, uid=512, msgid=, size=error Apr 29 17:14:07 mproxy dovecot: imap(v******d): expunge: box=INBOX, uid=3322, msgid=, size=22485 Apr 29 17:14:19 mproxy dovecot: imap(v******d): copy from INBOX: box=Trash, uid=513, msgid=, size=error Apr 29 17:14:19 mproxy dovecot: imap(v******d): expunge: box=INBOX, uid=3288, msgid=, size=60236 Apr 29 17:14:19 mproxy dovecot: imap(v******d): Warning: Timeout leak: 0x7fd584e8e050 (line 399) Apr 29 17:14:19 mproxy dovecot: imap(v******d): Connection closed (IDLE running for 0.043 + waiting input for 6654.979 secs, 2 B in + 10+10 B out, state=wait-input) in=7582 out=5928297 Apr 29 17:14:19 mproxy dovecot: imap(v******d): Fatal: master: service(imap): child 30554 killed with signal 11 (core dumped) Backtrace: Reading symbols from /usr/lib/dovecot/imap...Reading symbols from /usr/lib/debug/.build-id/5a/15dc6951744d026af424747e7b72a4fb550c6b.debug...done. done. [New LWP 30554] Core was generated by `dovecot/imap'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x00007fd584b8daa7 in timeout_remove (_timeout=0x7fd5875b5048) at ioloop.c:307 #0 0x00007fd584b8daa7 in timeout_remove (_timeout=0x7fd5875b5048) at ioloop.c:307 timeout = 0x7fd5875b8720 ioloop = 0x0 #1 0x00007fd584e8df0b in imapc_client_mailbox_close ( _box=_box at entry=0x7fd5875b3b38) at imapc-client.c:362 box = 0x7fd5875b5030 connp = #2 0x00007fd584e8c3af in imapc_mailbox_close (box=0x7fd5875b3850) at imapc-storage.c:651 mbox = 0x7fd5875b3850 #3 0x00007fd584e411aa in mailbox_close (box=0x7fd5875b5048) at mail-storage.c:1242 No locals. #4 0x00007fd584e41233 in mailbox_free (_box=_box at entry=0x7fd5875a3f00) at mail-storage.c:1262 box = 0x7fd5875b3850 #5 0x00007fd585584f74 in client_default_destroy (client=0x7fd5875a3e60, reason=) at imap-client.c:367 cmd = 0x0 #6 0x00007fd584b8e06c in io_loop_call_io (io=0x7fd5875a18d0) at ioloop.c:564 ioloop = 0x7fd587563740 t_id = 2 __FUNCTION__ = "io_loop_call_io" #7 0x00007fd584b8f4d1 in io_loop_handler_run_internal ( ioloop=ioloop at entry=0x7fd587563740) at ioloop-epoll.c:220 ctx = 0x7fd587565250 io = tv = {tv_sec = 4, tv_usec = 738842} events_count = msecs = ret = 1 i = 0 j = call = __FUNCTION__ = "io_loop_handler_run_internal" #8 0x00007fd584b8e0f5 in io_loop_handler_run ( ioloop=ioloop at entry=0x7fd587563740) at ioloop.c:612 No locals. #9 0x00007fd584b8e298 in io_loop_run (ioloop=0x7fd587563740) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #10 0x00007fd584b23e63 in master_service_run (service=0x7fd5875635e0, callback=) at master-service.c:640 No locals. #11 0x00007fd585577b32 in main (argc=1, argv=0x7fd587563390) at main.c:460 set_roots = {0x7fd5857a1700 , 0x7fd585340400 , 0x0} login_set = {auth_socket_path = 0x7fd58755b048 "\001", postlogin_socket_path = 0x0, postlogin_timeout_secs = 60, callback = 0x7fd5855919d0 , failure_callback = 0x7fd5855912e0 , request_auth_token = 1} service_flags = storage_service_flags = username = 0x0 auth_socket_path = 0x7fd58559a34e "auth-master" c = -- Ralf Hildebrandt Gesch?ftsbereich IT | Abteilung Netzwerk Charit? - Universit?tsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebrandt at charite.de | http://www.charite.de From bill at KnoxvilleChristian.org Fri Apr 29 19:20:19 2016 From: bill at KnoxvilleChristian.org (Bill Shirley) Date: Fri, 29 Apr 2016 15:20:19 -0400 Subject: Changing Password Schemes In-Reply-To: <57235C97.3060008@gmail.com> References: <57233028.7000201@gmail.com> <57235C97.3060008@gmail.com> Message-ID: <5723B3F3.2040307@KnoxvilleChristian.org> Looks like an SQL update would do this: UPDATE `users` SET `passwd_SHA512` = SHA2(`passwd_clear`, 512); Bill On 4/29/2016 9:07 AM, Carl A Jeptha wrote: > converting the passwords in the database from clear/plain text to SHA512-CRYPT > > ------------ > You have a good day now, en mag jou m?re ook so wees, > > Carl A Jeptha > > On 2016-04-29 15:02, Steffen Kaiser wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA1 >> >> On Fri, 29 Apr 2016, Carl A Jeptha wrote: >> >>> Good Day, >>> I have been following this tutorial without much luck - >>> http://wiki2.dovecot.org/HowTo/ConvertPasswordSchemes#CA-26af2b83a43b8100522c57565773f605c21f2f27_1 >>> >>> It is obvious to me that I am not following the instructions correctly and need to be shown what I am misunderstanding. >>> >>> I have an old postfix + dovecot + Roundcube mailserver (mail.domain.Tld). Server clock is loosing time and adjusting it >>> causes dovecot to kill itself, we cannot install more memory, bigger hard-drives, etc. >>> >>> I have built a new server box (mail2.domain.Tld) With Postfix + dovecot + Roundcube. This server is functioning, with a >>> client's new domain, and my personal domain. it's password system is SHA512-CRYPT. >>> >>> I have imported the users from the old server over to the new server. I have created a new column "plain_pass" for the plain >>> passwords. >>> >>> I will be using imapsync to transfer the mail folders from the one server to the other, but will not proceed until I fix >>> this issue. >> >> Actually, _what_ issue? >> >>> # 2.2.18: /etc/dovecot/dovecot.conf >>> # Pigeonhole version 0.4.8 (0c4ae064f307+) >>> # OS: Linux 4.2.0-35-generic x86_64 Ubuntu 15.10 ext4 >>> auth_mechanisms = plain login >>> first_valid_gid = 8 >>> first_valid_uid = 150 >>> last_valid_gid = 8 >>> last_valid_uid = 150 >>> listen = * >>> mail_gid = mail >>> mail_location = maildir:/var/vmail/%d/%n >>> mail_uid = vmail >>> namespace inbox { >>> inbox = yes >>> location = >>> mailbox Drafts { >>> special_use = \Drafts >>> } >>> mailbox Junk { >>> special_use = \Junk >>> } >>> mailbox Sent { >>> special_use = \Sent >>> } >>> mailbox "Sent Messages" { >>> special_use = \Sent >>> } >>> mailbox Trash { >>> special_use = \Trash >>> } >>> prefix = >>> } >>> passdb { >>> args = /etc/dovecot/dovecot-sql.conf.ext >>> driver = sql >>> } >>> plugin { >>> quota_grace = 10%% >>> quota_rule = *:storage=1G >>> quota_rule2 = Trash:storage=+100M >>> quota_warning = storage=95%% quota-warning 95 %u >>> quota_warning2 = storage=80%% quota-warning 80 %u >>> } >>> postmaster_address = postmaster at airnet.ca >>> protocols = imap pop3 lmtp lmtp pop3 >>> service auth { >>> unix_listener /var/spool/postfix/private/auth { >>> group = postfix >>> mode = 0666 >>> user = postfix >>> } >>> unix_listener auth-userdb { >>> group = mail >>> mode = 0666 >>> user = vmail >>> } >>> } >>> service imap-login { >>> inet_listener imap { >>> port = 143 >>> } >>> inet_listener imaps { >>> port = 993 >>> ssl = yes >>> } >>> } >>> service imap-postlogin { >>> executable = script-login /usr/local/etc/popafter.sh >>> user = $default_internal_user >>> } >>> service imap { >>> executable = imap imap-postlogin >>> } >>> service pop3-login { >>> inet_listener pop3 { >>> port = 110 >>> } >>> inet_listener pop3s { >>> port = 995 >>> ssl = yes >>> } >>> } >>> service pop3-postlogin { >>> executable = script-login /usr/local/etc/popafter.sh >>> user = $default_internal_user >>> } >>> service pop3 { >>> executable = pop3 pop3-postlogin >>> } >>> ssl_cert = >> ssl_cipher_list = >>> ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA >>> ssl_dh_parameters_length = 2048 >>> ssl_key = >> ssl_prefer_server_ciphers = yes >>> ssl_protocols = !SSLv2 !SSLv3 >>> userdb { >>> driver = prefetch >>> } >>> userdb { >>> args = /etc/dovecot/dovecot-sql.conf.ext >>> driver = sql >>> } >>> >>> -- ------------ You have a good day now, en mag jou m?re ook so wees, Carl A Jeptha >>> >> >> - -- Steffen Kaiser >> -----BEGIN PGP SIGNATURE----- >> Version: GnuPG v1 >> >> iQEVAwUBVyNbaXz1H7kL/d9rAQIbnQgAyiX9368WmhyTfTY38YfNWTXW/UW/b/0t >> PqyEPx/DLLLW60aSkA0NqJa0nKzsoHip8GQfO/ZY3fqdTdep2rW4NbZW6o8/rFwW >> dmNTarux25w7dNvRGWrGZiXTnGAlwQtnJTr8wuwqi2JILqPoh1dL1Ubo90ABTERv >> G8q2NXgtD4m0a2aJqmyMXRmep8ocMy3IEIg8JZ/xJtmL86d4bP7kagI2yP7viIUx >> EY9JSazl/u6iVIrI6jFDuFUfzAs4dr+wcQHhAM0sY8mFUVYFsdjqxCbytLy39q4O >> zyj66UNAGR5yAnXAlADJ7G1fIghskFBa82p/t8QCX9VNSvOnuklqGQ== >> =Q4iK >> -----END PGP SIGNATURE----- From cajeptha at gmail.com Fri Apr 29 20:19:59 2016 From: cajeptha at gmail.com (Carl A Jeptha) Date: Fri, 29 Apr 2016 22:19:59 +0200 Subject: Changing Password Schemes In-Reply-To: <5723B3F3.2040307@KnoxvilleChristian.org> References: <57233028.7000201@gmail.com> <57235C97.3060008@gmail.com> <5723B3F3.2040307@KnoxvilleChristian.org> Message-ID: <5723C1EF.80104@gmail.com> Thanks for insight Bill, will look at that and report back. ------------ You have a good day now, en mag jou m?re ook so wees, Carl A Jeptha On 2016-04-29 21:20, Bill Shirley wrote: > Looks like an SQL update would do this: > UPDATE `users` > SET `passwd_SHA512` = SHA2(`passwd_clear`, 512); > > Bill > > On 4/29/2016 9:07 AM, Carl A Jeptha wrote: >> converting the passwords in the database from clear/plain text to >> SHA512-CRYPT >> >> ------------ >> You have a good day now, en mag jou m?re ook so wees, >> >> Carl A Jeptha >> >> On 2016-04-29 15:02, Steffen Kaiser wrote: >>> -----BEGIN PGP SIGNED MESSAGE----- >>> Hash: SHA1 >>> >>> On Fri, 29 Apr 2016, Carl A Jeptha wrote: >>> >>>> Good Day, >>>> I have been following this tutorial without much luck - >>>> http://wiki2.dovecot.org/HowTo/ConvertPasswordSchemes#CA-26af2b83a43b8100522c57565773f605c21f2f27_1 >>>> >>>> It is obvious to me that I am not following the instructions >>>> correctly and need to be shown what I am misunderstanding. >>>> >>>> I have an old postfix + dovecot + Roundcube mailserver >>>> (mail.domain.Tld). Server clock is loosing time and adjusting it >>>> causes dovecot to kill itself, we cannot install more memory, >>>> bigger hard-drives, etc. >>>> >>>> I have built a new server box (mail2.domain.Tld) With Postfix + >>>> dovecot + Roundcube. This server is functioning, with a client's >>>> new domain, and my personal domain. it's password system is >>>> SHA512-CRYPT. >>>> >>>> I have imported the users from the old server over to the new >>>> server. I have created a new column "plain_pass" for the plain >>>> passwords. >>>> >>>> I will be using imapsync to transfer the mail folders from the one >>>> server to the other, but will not proceed until I fix this issue. >>> >>> Actually, _what_ issue? >>> >>>> # 2.2.18: /etc/dovecot/dovecot.conf >>>> # Pigeonhole version 0.4.8 (0c4ae064f307+) >>>> # OS: Linux 4.2.0-35-generic x86_64 Ubuntu 15.10 ext4 >>>> auth_mechanisms = plain login >>>> first_valid_gid = 8 >>>> first_valid_uid = 150 >>>> last_valid_gid = 8 >>>> last_valid_uid = 150 >>>> listen = * >>>> mail_gid = mail >>>> mail_location = maildir:/var/vmail/%d/%n >>>> mail_uid = vmail >>>> namespace inbox { >>>> inbox = yes >>>> location = >>>> mailbox Drafts { >>>> special_use = \Drafts >>>> } >>>> mailbox Junk { >>>> special_use = \Junk >>>> } >>>> mailbox Sent { >>>> special_use = \Sent >>>> } >>>> mailbox "Sent Messages" { >>>> special_use = \Sent >>>> } >>>> mailbox Trash { >>>> special_use = \Trash >>>> } >>>> prefix = >>>> } >>>> passdb { >>>> args = /etc/dovecot/dovecot-sql.conf.ext >>>> driver = sql >>>> } >>>> plugin { >>>> quota_grace = 10%% >>>> quota_rule = *:storage=1G >>>> quota_rule2 = Trash:storage=+100M >>>> quota_warning = storage=95%% quota-warning 95 %u >>>> quota_warning2 = storage=80%% quota-warning 80 %u >>>> } >>>> postmaster_address = postmaster at airnet.ca >>>> protocols = imap pop3 lmtp lmtp pop3 >>>> service auth { >>>> unix_listener /var/spool/postfix/private/auth { >>>> group = postfix >>>> mode = 0666 >>>> user = postfix >>>> } >>>> unix_listener auth-userdb { >>>> group = mail >>>> mode = 0666 >>>> user = vmail >>>> } >>>> } >>>> service imap-login { >>>> inet_listener imap { >>>> port = 143 >>>> } >>>> inet_listener imaps { >>>> port = 993 >>>> ssl = yes >>>> } >>>> } >>>> service imap-postlogin { >>>> executable = script-login /usr/local/etc/popafter.sh >>>> user = $default_internal_user >>>> } >>>> service imap { >>>> executable = imap imap-postlogin >>>> } >>>> service pop3-login { >>>> inet_listener pop3 { >>>> port = 110 >>>> } >>>> inet_listener pop3s { >>>> port = 995 >>>> ssl = yes >>>> } >>>> } >>>> service pop3-postlogin { >>>> executable = script-login /usr/local/etc/popafter.sh >>>> user = $default_internal_user >>>> } >>>> service pop3 { >>>> executable = pop3 pop3-postlogin >>>> } >>>> ssl_cert = >>> ssl_cipher_list = >>>> ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:AES128-GCM-SHA256:AES256-GCM-SHA384:AES128-SHA256:AES256-SHA256:AES128-SHA:AES256-SHA:AES:CAMELLIA:DES-CBC3-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!MD5:!PSK:!aECDH:!EDH-DSS-DES-CBC3-SHA:!EDH-RSA-DES-CBC3-SHA:!KRB5-DES-CBC3-SHA >>>> ssl_dh_parameters_length = 2048 >>>> ssl_key = >>> ssl_prefer_server_ciphers = yes >>>> ssl_protocols = !SSLv2 !SSLv3 >>>> userdb { >>>> driver = prefetch >>>> } >>>> userdb { >>>> args = /etc/dovecot/dovecot-sql.conf.ext >>>> driver = sql >>>> } >>>> >>>> -- ------------ You have a good day now, en mag jou m?re ook so >>>> wees, Carl A Jeptha >>>> >>> >>> - -- Steffen Kaiser >>> -----BEGIN PGP SIGNATURE----- >>> Version: GnuPG v1 >>> >>> iQEVAwUBVyNbaXz1H7kL/d9rAQIbnQgAyiX9368WmhyTfTY38YfNWTXW/UW/b/0t >>> PqyEPx/DLLLW60aSkA0NqJa0nKzsoHip8GQfO/ZY3fqdTdep2rW4NbZW6o8/rFwW >>> dmNTarux25w7dNvRGWrGZiXTnGAlwQtnJTr8wuwqi2JILqPoh1dL1Ubo90ABTERv >>> G8q2NXgtD4m0a2aJqmyMXRmep8ocMy3IEIg8JZ/xJtmL86d4bP7kagI2yP7viIUx >>> EY9JSazl/u6iVIrI6jFDuFUfzAs4dr+wcQHhAM0sY8mFUVYFsdjqxCbytLy39q4O >>> zyj66UNAGR5yAnXAlADJ7G1fIghskFBa82p/t8QCX9VNSvOnuklqGQ== >>> =Q4iK >>> -----END PGP SIGNATURE----- From andreas.jobs at ruhr-uni-bochum.de Fri Apr 29 21:43:57 2016 From: andreas.jobs at ruhr-uni-bochum.de (Andreas Jobs) Date: Fri, 29 Apr 2016 23:43:57 +0200 Subject: Panic: file message-part-serialize.c: line 90 (part_serialize): assertion failed: (part->children == NULL) Message-ID: <20160429214357.GA7880@ruhr-uni-bochum.de> Hi, I just found this in my logs: Apr 29 11:05:20 lmtp(joerg.eggenstein at ruhr-uni-bochum.de): Panic: file message-part-serialize.c: line 90 (part_serialize): assertion failed: (part->children == NULL) Apr 29 11:05:20 lmtp(joerg.eggenstein at ruhr-uni-bochum.de): Error: Raw backtrace: /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9c7f9) [0x7fa88bfbf7f9] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9db92) [0x7fa88bfc0b92] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fa88bfbfb3f] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x8a1bf) [0x7fa88bfad1bf] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x8a163) [0x7fa88bfad163] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(message_part_serialize+0x27) [0x7fa88bfad20c] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(+0xccf29) [0x7fa88c327f29] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(+0xcdd01) [0x7fa88c328d01] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(index_mail_cache_parse_deinit+0xc9) [0x7fa88c32b236] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(dbox_save_end+0x1c4) [0x7fa88c2bed50] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(+0x5a6d5) [0x7fa88c2b56d5] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(mdbox_save_finish+0x18) [0x7fa88c2b5840] -> /usr/local/dovecot/lib/dovecot/lib10_quota_plugin.so(+0xe512) [0x7fa88b751512] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_save_finish+0xb4) [0x7fa88c298dee] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0x6c) [0x7fa88c28a757] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(mdbox_copy+0x85) [0x7fa88c2b601e] -> /usr/local/dovecot/lib/dovecot/lib10_quota_plugin.so(+0xe322) [0x7fa88b751322] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_copy+0xec) [0x7fa88c2990b4] -> /usr/local/dovecot/lib/dovecot/libdovecot-storage.so.0(mailbox_save_using_mail+0x34) [0x7fa88c29921a] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x51899) [0x7fa88b2b5899] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(+0x45bc5) [0x7fa88b2a9bc5] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0xbf) [0x7fa88b2aa250] -> /usr/local/dovecot/lib/dovecot/libdovecot-sieve.so.0(sieve_execute+0x7c) [0x7fa88b2c0597] -> /usr/local/dovecot/lib/dovecot/lib90_sieve_plugin.so(+0x32d8) [0x7fa88b53f2d8] -> /usr/local/dovecot/lib/dovecot/lib90_sieve_plugin.so(+0x40e1) [0x7fa88b5400e1] -> /usr/local/dovecot/lib/dovecot/lib90_sieve_plugin.so(+0x435c) [0x7fa88b54035c] -> /usr/local/dovecot/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0x68) [0x7fa88c5db90c] -> dovecot/lmtp [DATA 134.147.53.148 redacted at ruhr-uni-bochum.de](+0x92ea) [0x7fa88ca102ea] Apr 29 11:05:20 lmtp(redacted at ruhr-uni-bochum.de): Fatal: master: service(lmtp): child 12080 killed with signal 6 (core dumped) It looks like that this may be caused by a mail where there is the blank line after a part header missing: I attach Backtrace and configuration. --Andreas -- ! Andreas Jobs Network Operation Center ! ! Ruhr-Universitaet Bochum ! ! One Day I Will Find This Peer Guy and Then I Will Reset HIS Connection ! -------------- next part -------------- # 2.2.24 (a82c823): /usr/local/dovecot/etc/dovecot/dovecot.conf # Pigeonhole version 0.4.14 (099a97c) # OS: Linux 3.13.0-74-generic x86_64 Ubuntu 14.04.4 LTS auth_master_user_separator = * auth_worker_max_count = 50 dict { quota = mysql:/usr/local/dovecot/etc/dovecot-dict-mysql.conf } disable_plaintext_auth = no doveadm_password = # hidden, use -P to show it import_environment = TZ CORE_OUTOFMEM CORE_ERROR USER lda_mailbox_autocreate = yes lmtp_rcpt_check_quota = yes lock_method = flock log_path = /var/log/dovecot.log login_trusted_networks = 134.147.42.224/28 mail_access_groups = nofiles mail_fsync = never mail_location = mdbox:~/mdbox mail_plugins = " quota zlib mail_log notify virtual" managesieve_notify_capability = mailto managesieve_sieve_capability = fileinto envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date index ihave duplicate mime foreverypart extracttext vnd.dovecot.debug vnd.dovecot.filter mdbox_rotate_size = 5 M mmap_disable = yes namespace { hidden = no inbox = yes location = mailbox Drafts { special_use = \Drafts } mailbox Sent { special_use = \Sent } mailbox Trash { special_use = \Trash } mailbox UCE-TMP { special_use = \Junk } prefix = separator = / type = private } namespace restore { hidden = yes inbox = no list = children location = mdbox:/var/qmail/data/emptyreadonlymdbox/ prefix = "#RESTORE/" separator = / subscriptions = no type = private } passdb { args = /var/qmail/data/dovecot.disabled deny = yes driver = passwd-file } passdb { args = /usr/local/dovecot/etc/dovecot-auth-mysql.conf driver = sql } passdb { driver = pam } passdb { args = /usr/local/dovecot/etc/passwd.dovcot.master driver = passwd-file master = yes } plugin { antispam_allow_append_to_spam = yes antispam_backend = spool2dir antispam_spam = UCE-TMP;UCE-MELDEN antispam_spam_pattern_ignorecase = junk* antispam_spool2dir_notspam = /opt/rubmail/data/antispam/ham/ham-%%020lu-%u-%%05lu antispam_spool2dir_spam = /opt/rubmail/data/antispam/spam/spam-%%020lu-%u-%%05lu antispam_trash = Trash;Papierkorb antispam_trash_pattern_ignorecase = gel?scht*;gel&APY-scht*;deleted* mail_log_events = mailbox_delete mailbox_rename mailbox_create mail_log_fields = uid box msgid size quota = dict:User quota:%i:noenforcing:proxy::quota quota_over_flag_value = * quota_over_script = quota-warning mismatch %u sieve_extensions = -reject +vnd.dovecot.filter +vnd.dovecot.debug sieve_filter_bin_dir = /opt/rubmail/sieve_bin sieve_max_actions = 200 sieve_max_redirects = 200 sieve_plugins = sieve_extprograms sieve_quota_max_scripts = 10 stats_refresh = 30 secs stats_track_cmds = yes } protocols = pop3 imap lmtp sieve quota_full_tempfail = yes sendmail_path = /opt/rubmail/bin/sendmailwrapper.dovecot service auth { client_limit = 5300 user = root } service dict { process_limit = 5120 unix_listener dict { group = nofiles mode = 0666 } } service doveadm { inet_listener { port = 542 } vsz_limit = 512 M } service imap-hibernate { unix_listener imap-hibernate { group = mode = 0666 user = } } service imap-login { inet_listener imap { address = 10.21.8.21 port = 143 } process_min_avail = 4 service_count = 0 } service imap { drop_priv_before_exec = yes process_limit = 5120 vsz_limit = 1 G } service lmtp { executable = lmtp inet_listener lmtp { address = 10.21.8.21 port = 24 } process_limit = 50 } service managesieve-login { inet_listener sieve { address = 10.21.8.21 } } service pop3-login { inet_listener pop3 { address = 10.21.8.21 port = 110 } process_min_avail = 4 service_count = 0 } service pop3 { drop_priv_before_exec = yes process_limit = 2048 vsz_limit = 512 M } service postlogin { executable = script-login -d rawlog -t } service quota-warning { executable = script /opt/rubmail/bin/quota-warning.pl unix_listener quota-warning { group = nofiles mode = 0666 user = nobody } user = dovecot } service stats { fifo_listener stats-mail { group = nofiles mode = 0666 } unix_listener stats { mode = 0666 } } ssl = no stats_memory_limit = 512 M userdb { driver = prefetch } userdb { args = /usr/local/dovecot/etc/dovecot-mysql.conf driver = sql } verbose_proctitle = yes protocol lda { mail_fsync = optimized mail_plugins = " quota zlib mail_log notify virtual sieve" } protocol lmtp { mail_fsync = optimized mail_plugins = quota sieve } protocol imap { mail_max_userip_connections = 30 mail_plugins = " quota zlib mail_log notify virtual imap_quota imap_zlib antispam" } -------------- next part -------------- GNU gdb (Ubuntu 7.7.1-0ubuntu5~14.04.2) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: . Find the GDB manual and other documentation resources online at: . For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/local/dovecot/libexec/dovecot/lmtp...done. [New LWP 12080] Core was generated by `dovecot/lmtp'. Program terminated with signal SIGABRT, Aborted. #0 0x00007fa88bb94cc9 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 #0 0x00007fa88bb94cc9 in __GI_raise (sig=sig at entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 resultvar = 0 pid = 12080 selftid = 12080 #1 0x00007fa88bb980d8 in __GI_abort () at abort.c:89 save_stage = 2 act = {__sigaction_handler = {sa_handler = 0x7ffdac80a208, sa_sigaction = 0x7ffdac80a208}, sa_mask = {__val = {192, 65528, 8443530669362135150, 140361882767898, 140361919380704, 140361866058693, 140361919380760, 0, 140361919380704, 140727497564592, 140361880008349, 140361886185740, 140361919380704, 140727497564640, 140361879753968, 0}}, sa_flags = -1400856056, sa_restorer = 0x7fa88c012a48} sigs = {__val = {32, 0 }} #2 0x00007fa88bfbf848 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at failures.c:201 backtrace = 0x7fa88e583d18 "/usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9c7f9) [0x7fa88bfbf7f9] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0(+0x9db92) [0x7fa88bfc0b92] -> /usr/local/dovecot/lib/dovecot/libdovecot.so.0"... #3 0x00007fa88bfc0b92 in i_internal_fatal_handler (ctx=0x7ffdac80a270, format=0x7fa88c012a48 "file %s: line %d (%s): assertion failed: (%s)", args=0x7ffdac80a288) at failures.c:670 status = 0 #4 0x00007fa88bfbfb3f in i_panic (format=0x7fa88c012a48 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:275 ctx = {type = LOG_TYPE_PANIC, exit_status = 0, timestamp = 0x0, timestamp_usecs = 0} args = {{gp_offset = 40, fp_offset = 48, overflow_arg_area = 0x7ffdac80a360, reg_save_area = 0x7ffdac80a2a0}} #5 0x00007fa88bfad1bf in part_serialize (part=0x7fa88e5ead90, dest=0x7fa88e583890, children_count_r=0x7ffdac80a3e0) at message-part-serialize.c:90 count = 1 children_count = 0 children_offset = 84 root = false __FUNCTION__ = "part_serialize" #6 0x00007fa88bfad163 in part_serialize (part=0x7fa88e5eab30, dest=0x7fa88e583890, children_count_r=0x7ffdac80a41c) at message-part-serialize.c:82 count = 0 children_count = 0 children_offset = 36 root = false __FUNCTION__ = "part_serialize" #7 0x00007fa88bfad20c in message_part_serialize (part=0x7fa88e5eab30, dest=0x7fa88e583890) at message-part-serialize.c:104 children_count = 32680 #8 0x00007fa88c327f29 in index_mail_body_parsed_cache_message_parts (mail=0x7fa88e5ea320) at index-mail.c:681 _data_stack_cur_id = 6 _mail = 0x7fa88e5ea320 data = 0x7fa88e5ea498 cache_field = 12 decision = MAIL_CACHE_DECISION_TEMP buffer = 0x7fa88e583890 #9 0x00007fa88c328d01 in index_mail_parse_body_finish (mail=0x7fa88e5ea320, field=MAIL_CACHE_FLAGS, success=true) at index-mail.c:1034 parser_input = 0x0 error = 0x0 ret = 1 __FUNCTION__ = "index_mail_parse_body_finish" #10 0x00007fa88c32b236 in index_mail_cache_parse_deinit (_mail=0x7fa88e5ea320, received_date=1461920720, success=true) at index-mail.c:1957 mail = 0x7fa88e5ea320 #11 0x00007fa88c2bed50 in dbox_save_end (ctx=0x7fa88e5eeb00) at dbox-save.c:127 mdata = 0x7fa88e5eeb10 dbox_output = 0x7fa88e5f7d20 __FUNCTION__ = "dbox_save_end" #12 0x00007fa88c2b56d5 in mdbox_save_finish_write (_ctx=0x7fa88e5eeb00) at mdbox-save.c:200 ctx = 0x7fa88e5eeb00 mail = 0x7fa88e65bc28 #13 0x00007fa88c2b5840 in mdbox_save_finish (ctx=0x7fa88e5eeb00) at mdbox-save.c:230 ret = 32680 #14 0x00007fa88b751512 in quota_save_finish (ctx=0x7fa88e5eeb00) at quota-storage.c:288 qbox = 0x7fa88e65be30 #15 0x00007fa88c298dee in mailbox_save_finish (_ctx=0x7ffdac80a628) at mail-storage.c:2084 _data_stack_cur_id = 5 ctx = 0x7fa88e5eeb00 t = 0x7fa88e5e95e0 keywords = 0x0 pvt_flags = 0 copying_via_save = true ret = 32680 __FUNCTION__ = "mailbox_save_finish" #16 0x00007fa88c28a757 in mail_storage_copy (ctx=0x0, mail=0x7fa88e633180) at mail-copy.c:107 No locals. #17 0x00007fa88c2b601e in mdbox_copy (_ctx=0x7fa88e5eeb00, mail=0x7fa88e633180) at mdbox-save.c:427 ctx = 0x7fa88e5eeb00 save_mail = 0x7fa88e65bc28 src_mbox = 0x8 rec = {map_uid = 2894112400, save_date = 32765} guid_data = 0x7ffdac80a690 wanted_guid = "\260\246\200\254\375\177\000\000(\274e\216\250\177\000" #18 0x00007fa88b751322 in quota_copy (ctx=0x7fa88e5eeb00, mail=0x7fa88e633180) at quota-storage.c:227 t = 0x7fa88e5e95e0 qt = 0x7fa88e5ea270 qbox = 0x7fa88e65be30 #19 0x00007fa88c2990b4 in mailbox_copy (_ctx=0x7ffdac80a7a8, mail=0x7fa88e633180) at mail-storage.c:2154 _data_stack_cur_id = 4 ctx = 0x7fa88e5eeb00 t = 0x7fa88e5e95e0 keywords = 0x0 pvt_flags = 0 backend_mail = 0x7fa88e633180 ret = 32680 __FUNCTION__ = "mailbox_copy" #20 0x00007fa88c29921a in mailbox_save_using_mail (ctx=0x7ffdac80a7a8, mail=0x7fa88e633180) at mail-storage.c:2187 No locals. #21 0x00007fa88b2b5899 in act_store_execute (action=0x7fa88e65e020, aenv=0x7fa88e65dee8, tr_context=0x7fa88e65e088) at sieve-actions.c:585 trans = 0x7fa88e65e088 mail = 0x7fa88e633180 save_ctx = 0x0 keywords = 0x0 backends_equal = false status = 1 #22 0x00007fa88b2a9bc5 in sieve_result_transaction_execute (result=0x7fa88e65dec0, first=0x7fa88e65e020) at sieve-result.c:1153 act = 0x7fa88e65e020 rsef = 0x0 sef = 0x7fa88e65e020 rac = 0x7fa88e65e020 status = 1 #23 0x00007fa88b2aa250 in sieve_result_execute (result=0x7fa88e65dec0, keep=0x0, ehandler=0x7fa88e65b040, flags=SIEVE_EXECUTE_FLAG_NOGLOBAL) at sieve-result.c:1370 status = 1 result_status = -1905954768 first_action = 0x7fa88e65e020 last_action = 0x0 implicit_keep = true ret = 32680 #24 0x00007fa88b2c0597 in sieve_execute (sbin=0x7fa88e657030, msgdata=0x7ffdac80a9a0, senv=0x7ffdac80a9d0, exec_ehandler=0x7fa88e64b500, action_ehandler=0x7fa88e65b040, flags=SIEVE_EXECUTE_FLAG_NOGLOBAL, keep=0x0) at sieve.c:565 result = 0x7fa88e65dec0 ret = 1 #25 0x00007fa88b53f2d8 in lda_sieve_singlescript_execute (srctx=0x7ffdac80aac0) at lda-sieve-plugin.c:449 svinst = 0x7fa88e647f40 mdctx = 0x7ffdac80ac10 script = 0x7fa88e64bd20 user_script = true exec_ehandler = 0x7fa88e64b500 action_ehandler = 0x7fa88e65b040 sbin = 0x7fa88e657030 debug = false cpflags = SIEVE_COMPILE_FLAG_NOGLOBAL exflags = SIEVE_EXECUTE_FLAG_NOGLOBAL error = SIEVE_ERROR_NONE ret = 32680 #26 0x00007fa88b5400e1 in lda_sieve_execute (srctx=0x7ffdac80aac0, storage_r=0x7ffdac80aba8) at lda-sieve-plugin.c:856 mdctx = 0x7ffdac80ac10 svinst = 0x7fa88e647f40 msgdata = {mail = 0x7fa88e633180, return_path = 0x7fa88e593228 "root at ancientmariner.szoccer.com", orig_envelope_to = 0x7fa88e5934c0 "redacted at ruhr-uni-bochum.de", final_envelope_to = 0x7fa88e5934c0 "redacted at ruhr-uni-bochum.de", auth_user = 0x7fa88e5bdcf8 "redacted at ruhr-uni-bochum.de", id = 0x7fa88e59dc20 "<20160429072540135 at szoccer.com>"} scriptenv = {user = 0x7fa88e5bdc00, default_mailbox = 0x7fa88ca1314a "INBOX", postmaster_address = 0x7fa88e5ad510 "postmaster at ruhr-uni-bochum.de", mailbox_autocreate = true, mailbox_autosubscribe = false, script_context = 0x7ffdac80ac10, smtp_start = 0x7fa88b53e890 , smtp_add_rcpt = 0x7fa88b53e8c5 , smtp_send = 0x7fa88b53e8f6 , smtp_finish = 0x7fa88b53e91c , duplicate_check = 0x7fa88b53e998 , duplicate_mark = 0x7fa88b53e9e0 , duplicate_flush = 0x7fa88b53ea30 , reject_mail = 0x7fa88b53e95f , exec_status = 0x7ffdac80a990, trace_log = 0x0, trace_config = {level = SIEVE_TRLVL_NONE, flags = 0}} estatus = {last_storage = 0x7fa88e5c3040, message_saved = 0, message_forwarded = 0, tried_default_save = 1, keep_original = 0, store_failed = 0} trace_config = {level = SIEVE_TRLVL_NONE, flags = 0} trace_log = 0x0 debug = false ret = 32680 #27 0x00007fa88b54035c in lda_sieve_deliver_mail (mdctx=0x7ffdac80ac10, storage_r=0x7ffdac80aba8) at lda-sieve-plugin.c:920 _data_stack_cur_id = 3 srctx = {svinst = 0x7fa88e647f40, mdctx = 0x7ffdac80ac10, home_dir = 0x7fa88e5c0000 "/net/storage-6/home/37/eggenjb6", scripts = 0x7fa88e583768, script_count = 1, user_script = 0x7fa88e64bd20, main_script = 0x7fa88e64bd20, msgdata = 0x7ffdac80a9a0, scriptenv = 0x7ffdac80a9d0, user_ehandler = 0x7fa88e64b500, master_ehandler = 0x7fa88e64b3f0, action_ehandler = 0x0, userlog = 0x7fa88e5837e8 "/net/storage-6/home/37/eggenjb6/.dovecot.sieve.log"} debug = false svenv = {hostname = 0x7fa88e5aa300 "mbx4.mail.ruhr-uni-bochum.de", domainname = 0x0, base_dir = 0x7fa88e5bf0e0 "/var/run/dovecot", username = 0x7fa88e5bdcf8 "redacted at ruhr-uni-bochum.de", home_dir = 0x7fa88e5c0000 "/net/storage-6/home/37/eggenjb6", temp_dir = 0x7fa88e5c02a8 "/tmp", flags = SIEVE_FLAG_HOME_RELATIVE, location = SIEVE_ENV_LOCATION_MDA, delivery_phase = SIEVE_DELIVERY_PHASE_DURING} i = 2388214520 ret = 0 #28 0x00007fa88c5db90c in mail_deliver (ctx=0x7ffdac80ac10, storage_r=0x7ffdac80aba8) at mail-deliver.c:440 ret = 32680 #29 0x00007fa88ca102ea in client_deliver (client=0x7fa88e5ad0b0, rcpt=0x7fa88e593480, src_mail=0x7fa88e633180, session=0x7fa88e5a1ac0) at commands.c:878 dctx = {pool = 0x7fa88e5a1aa0, set = 0x7fa88e5aa2a0, session = 0x7fa88e5a1ac0, timeout_secs = 30, session_time_msecs = 42, delivery_time_started = {tv_sec = 1461920720, tv_usec = 838237}, dup_ctx = 0x7fa88e5e76e0, session_id = 0x7fa88e593210 "oEp/JlMjI1cwLwAAyCUETg", src_mail = 0x7fa88e633180, src_envelope_sender = 0x7fa88e593228 "root at ancientmariner.szoccer.com", dest_user = 0x7fa88e5bdc00, dest_addr = 0x7fa88e5934c0 "redacted at ruhr-uni-bochum.de", final_dest_addr = 0x7fa88e5934c0 "redacted at ruhr-uni-bochum.de", dest_mailbox_name = 0x7fa88ca1314a "INBOX", dest_mail = 0x0, var_expand_table = 0x0, tempfail_error = 0x0, tried_default_save = false, saved_mail = false, save_dest_mail = false, mailbox_full = false, dsn = false} storage = 0x0 input = 0x7fa88e5a8e90 mail_set = 0x7fa88e5a9250 lda_set = 0x7fa88e5aa2a0 ns = 0xe2790 set_parser = 0x7fa88e6376b0 delivery_time_started = {tv_sec = 1461920720, tv_usec = 838237} sets = 0x7fa88e583500 line = 0x7ffdac80ac10 "\240\032Z\216\250\177" error = 0x400 username = 0x7fa88e5820b0 "redacted at ruhr-uni-bochum.de" str = 0x7fa88e5833b8 mail_error = 2894113744 ret = 32765 __FUNCTION__ = "client_deliver" #30 0x00007fa88ca105aa in client_deliver_next (client=0x7fa88e5ad0b0, src_mail=0x7fa88e633180, session=0x7fa88e5a1ac0) at commands.c:923 rcpts = 0x7fa88e593280 count = 1 ret = 32680 #31 0x00007fa88ca109bf in client_input_data_write_local (client=0x7fa88e5ad0b0, input=0x7fa88e5a4a60) at commands.c:1019 session = 0x7fa88e5a1ac0 src_mail = 0x7fa88e633180 old_uid = 29337 first_uid = 4294967295 __FUNCTION__ = "client_input_data_write_local" #32 0x00007fa88ca10ea1 in client_input_data_write (client=0x7fa88e5ad0b0) at commands.c:1154 input = 0x7fa88e5a4a60 #33 0x00007fa88ca112c5 in client_input_data_handle (client=0x7fa88e5ad0b0) at commands.c:1249 data = 0x7fa88e5aa67c "" size = 664 ret = -1 #34 0x00007fa88ca112fe in client_input_data (client=0x7fa88e5ad0b0) at commands.c:1259 No locals. #35 0x00007fa88bfdc1e4 in io_loop_call_io (io=0x7fa88e5a4eb0) at ioloop.c:564 ioloop = 0x7fa88e58a720 t_id = 2 __FUNCTION__ = "io_loop_call_io" #36 0x00007fa88bfde5dc in io_loop_handler_run_internal (ioloop=0x7fa88e58a720) at ioloop-epoll.c:220 ctx = 0x7fa88e590340 events = 0x7fa88e591f10 event = 0x7fa88e591f10 list = 0x7fa88e5931b0 io = 0x7fa88e5a4eb0 tv = {tv_sec = 299, tv_usec = 999238} events_count = 5 msecs = 300000 ret = 1 i = 0 j = 0 call = true __FUNCTION__ = "io_loop_handler_run_internal" #37 0x00007fa88bfdc38a in io_loop_handler_run (ioloop=0x7fa88e58a720) at ioloop.c:612 No locals. #38 0x00007fa88bfdc2d8 in io_loop_run (ioloop=0x7fa88e58a720) at ioloop.c:588 __FUNCTION__ = "io_loop_run" #39 0x00007fa88bf4b89d in master_service_run (service=0x7fa88e58a5c0, callback=0x7fa88ca0c195 ) at master-service.c:640 No locals. #40 0x00007fa88ca0c48d in main (argc=1, argv=0x7fa88e58a390) at main.c:127 set_roots = {0x7fa88c7e0740 , 0x7fa88cc15740 , 0x0} service_flags = (MASTER_SERVICE_FLAG_KEEP_CONFIG_OPEN | MASTER_SERVICE_FLAG_USE_SSL_SETTINGS) storage_service_flags = (MAIL_STORAGE_SERVICE_FLAG_DISALLOW_ROOT | MAIL_STORAGE_SERVICE_FLAG_USERDB_LOOKUP | MAIL_STORAGE_SERVICE_FLAG_TEMP_PRIV_DROP | MAIL_STORAGE_SERVICE_FLAG_NO_LOG_INIT | MAIL_STORAGE_SERVICE_FLAG_NO_IDLE_TIMEOUT | MAIL_STORAGE_SERVICE_FLAG_AUTOEXPUNGE) c = -1 From cajeptha at gmail.com Fri Apr 29 23:03:06 2016 From: cajeptha at gmail.com (Carl A Jeptha) Date: Fri, 29 Apr 2016 19:03:06 -0400 Subject: Changing Password Schemes In-Reply-To: <5723B3F3.2040307@KnoxvilleChristian.org> References: <57233028.7000201@gmail.com> <57235C97.3060008@gmail.com> <5723B3F3.2040307@KnoxvilleChristian.org> Message-ID: <5723E82A.1080804@gmail.com> Hi Bill, using PHPMYAdmin: UPDATE 'mailbox' SET 'password' = SHA2 ('clearpwd',512); {UPDATE 'the users table' SET 'cryptic password column' = SHA2 ('clear text password column',512);} gives this error: #1064 - You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '[`clearpwd`512] FROM `mailbox` WHERE `password` <> SHA2 [ `clearpwd` OR 512' at line 1 ------------ You have a good day now, en mag jou m?re ook so wees, Carl A Jeptha On 2016-04-29 15:20, Bill Shirley wrote: > UPDATE `users` > SET `passwd_SHA512` = SHA2(`passwd_clear`, 512); -------------- next part -------------- A non-text attachment was scrubbed... Name: dot.gif Type: image/gif Size: 43 bytes Desc: not available URL: From gedalya at gedalya.net Fri Apr 29 23:14:53 2016 From: gedalya at gedalya.net (Gedalya) Date: Fri, 29 Apr 2016 19:14:53 -0400 Subject: Changing Password Schemes In-Reply-To: <5723B3F3.2040307@KnoxvilleChristian.org> References: <57233028.7000201@gmail.com> <57235C97.3060008@gmail.com> <5723B3F3.2040307@KnoxvilleChristian.org> Message-ID: <5723EAED.2060007@gedalya.net> That's not SHA512-CRYPT. That's just a simple sha512 of the password, without salt. A SHA512-CRYPT password will be generated with: printf "1234\n1234" | doveadm pw -s SHA512-CRYPT or: doveadm pw -s SHA512-CRYPT -p 1234 or: mkpasswd -m sha-512 1234 (without the "{SHA512-CRYPT}" prefix) What exactly is the difficulty you are having with converting the passwords? What database engine are you using? On 04/29/2016 03:20 PM, Bill Shirley wrote: > Looks like an SQL update would do this: > UPDATE `users` > SET `passwd_SHA512` = SHA2(`passwd_clear`, 512); > > Bill > > On 4/29/2016 9:07 AM, Carl A Jeptha wrote: >> converting the passwords in the database from clear/plain text to SHA512-CRYPT From pruimj at gmail.com Sat Apr 30 03:48:20 2016 From: pruimj at gmail.com (Jason Pruim) Date: Fri, 29 Apr 2016 23:48:20 -0400 Subject: Unable to get mail? Message-ID: Hey everyone, I'm not sure I'm on the right list for this one... I have a postfix/dovecot install that was running fine on amazon web services that all of a sudden stopped receiving mail... In my mail log all I get is this: Apr 30 03:16:26 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Connection closed in=595 out=1459 Apr 30 03:16:31 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=68.105.170.121, lip=172.31.28.46, mpid=31865, TLS, session= Apr 30 03:16:33 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=68.105.170.121, lip=172.31.28.46, mpid=31867, TLS, session= Apr 30 03:16:34 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=97 out=440 Apr 30 03:16:38 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=68.105.170.121, lip=172.31.28.46, mpid=31869, TLS, session= Apr 30 03:19:14 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=408 out=1385 Apr 30 03:19:14 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=847 out=3067 Apr 30 03:20:25 ip-172-31-28-46 postfix/postfix-script[3891]: stopping the Postfix mail system Apr 30 03:20:25 ip-172-31-28-46 postfix/master[31225]: terminating on signal 15 Apr 30 03:20:25 ip-172-31-28-46 postfix/postfix-script[3963]: starting the Postfix mail system Apr 30 03:20:25 ip-172-31-28-46 postfix/master[3964]: daemon started -- version 2.6.6, configuration /etc/postfix Apr 30 03:20:44 ip-172-31-28-46 dovecot: master: Warning: Killed with signal 15 (by pid=3977 uid=0 code=kill) Apr 30 03:20:44 ip-172-31-28-46 dovecot: imap: Server shutting down. in=472 out=1366 Apr 30 03:20:45 ip-172-31-28-46 dovecot: master: Dovecot v2.2.10 starting up for imap, pop3, lmtp (core dumps disabled) Apr 30 03:21:17 ip-172-31-28-46 dovecot: imap-login: Aborted login (no auth attempts in 9 secs): user=<>, rip=68.105.170.121, lip=172.31.28.46, session= Apr 30 03:24:30 ip-172-31-28-46 postfix/postfix-script[4141]: stopping the Postfix mail system Apr 30 03:24:30 ip-172-31-28-46 postfix/master[3964]: terminating on signal 15 Apr 30 03:24:30 ip-172-31-28-46 dovecot: master: Warning: Killed with signal 15 (by pid=4147 uid=0 code=kill) Apr 30 03:25:28 ip-172-31-28-46 postfix/postfix-script[2761]: starting the Postfix mail system Apr 30 03:25:28 ip-172-31-28-46 postfix/master[2762]: daemon started -- version 2.6.6, configuration /etc/postfix Apr 30 03:26:22 ip-172-31-28-46 dovecot: master: Dovecot v2.2.10 starting up for imap, pop3, lmtp (core dumps disabled) Apr 30 03:27:03 ip-172-31-28-46 dovecot: imap-login: Aborted login (no auth attempts in 6 secs): user=<>, rip=68.105.170.121, lip=172.31.28.46, session= Apr 30 03:27:36 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=68.105.170.121, lip=172.31.28.46, mpid=3001, TLS, session= Apr 30 03:27:54 ip-172-31-28-46 dovecot: imap-login: Aborted login (auth failed, 1 attempts in 2 secs): user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured, session= Apr 30 03:28:06 ip-172-31-28-46 dovecot: imap-login: Aborted login (auth failed, 1 attempts in 6 secs): user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured, session= Apr 30 03:28:10 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3008, secured, session= Apr 30 03:28:10 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=29 out=466 Apr 30 03:28:10 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3011, secured, session= Apr 30 03:28:10 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=44 out=538 Apr 30 03:28:11 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3014, secured, session= Apr 30 03:28:11 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=314 out=6899 Apr 30 03:28:12 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3017, secured, session= Apr 30 03:28:12 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=209 out=816 Apr 30 03:29:12 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3024, secured, session= Apr 30 03:29:12 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=91 out=872 Apr 30 03:30:12 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3027, secured, session=<9r6GYKsxsAB/AAAB> Apr 30 03:30:12 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=91 out=872 Apr 30 03:31:13 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3037, secured, session= Apr 30 03:31:13 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=91 out=872 Apr 30 03:32:14 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3043, secured, session= Apr 30 03:32:14 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=91 out=872 Apr 30 03:33:17 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3051, secured, session= Apr 30 03:33:17 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=91 out=872 Apr 30 03:34:17 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3057, secured, session= Apr 30 03:34:17 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=91 out=872 Apr 30 03:35:18 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3063, secured, session= Apr 30 03:35:18 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=91 out=872 Apr 30 03:35:29 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3066, secured, session= Apr 30 03:35:29 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=32 out=449 Apr 30 03:35:29 ip-172-31-28-46 dovecot: imap-login: Login: user=< beth at primelashdiva.info>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, mpid=3069, secured, session= Apr 30 03:35:29 ip-172-31-28-46 dovecot: imap(beth at primelashdiva.info): Disconnected: Logged out in=44 out=538 Apr 30 03:36:41 ip-172-31-28-46 postfix/postfix-script[3424]: stopping the Postfix mail system Apr 30 03:36:41 ip-172-31-28-46 postfix/master[2762]: terminating on signal 15 Apr 30 03:36:42 ip-172-31-28-46 postfix/postfix-script[3496]: starting the Postfix mail system Apr 30 03:36:42 ip-172-31-28-46 postfix/master[3497]: daemon started -- version 2.6.6, configuration /etc/postfix Apr 30 03:36:48 ip-172-31-28-46 dovecot: master: Warning: Killed with signal 15 (by pid=3509 uid=0 code=kill) Apr 30 03:36:48 ip-172-31-28-46 dovecot: imap: Server shutting down. in=586 out=1464 Apr 30 03:36:49 ip-172-31-28-46 dovecot: master: Dovecot v2.2.10 starting up for imap, pop3, lmtp (core dumps disabled) Apr 30 03:37:05 ip-172-31-28-46 dovecot: imap-login: Aborted login (no auth attempts in 6 secs): user=<>, rip=52.37.99.183, lip=172.31.28.46, session=<9D4ueasxaAA0JWO3> Apr 30 03:37:35 ip-172-31-28-46 dovecot: imap-login: Aborted login (no auth attempts in 8 secs): user=<>, rip=68.105.170.121, lip=172.31.28.46, session= Apr 30 03:41:46 ip-172-31-28-46 dovecot: imap-login: Aborted login (tried to use disallowed plaintext auth): user=<>, rip=68.105.170.121, lip=172.31.28.46, session= [ec2-user at ip-172-31-28-46 log]$ I'm not even sure where to go to start looking... Any pointers? Thanks Everyone! From cajeptha at gmail.com Sat Apr 30 08:02:09 2016 From: cajeptha at gmail.com (Carl A Jeptha) Date: Sat, 30 Apr 2016 10:02:09 +0200 Subject: Changing Password Schemes In-Reply-To: <5723EAED.2060007@gedalya.net> References: <57233028.7000201@gmail.com> <57235C97.3060008@gmail.com> <5723B3F3.2040307@KnoxvilleChristian.org> <5723EAED.2060007@gedalya.net> Message-ID: <57246681.70208@gmail.com> The database is MySQL. ------------ You have a good day now, en mag jou m?re ook so wees, Carl A Jeptha On 2016-04-30 01:14, Gedalya wrote: > That's not SHA512-CRYPT. That's just a simple sha512 of the password, without salt. > > A SHA512-CRYPT password will be generated with: > > printf "1234\n1234" | doveadm pw -s SHA512-CRYPT > > or: > > doveadm pw -s SHA512-CRYPT -p 1234 > > or: > > mkpasswd -m sha-512 1234 > > (without the "{SHA512-CRYPT}" prefix) > > What exactly is the difficulty you are having with converting the passwords? > What database engine are you using? > > > On 04/29/2016 03:20 PM, Bill Shirley wrote: >> Looks like an SQL update would do this: >> UPDATE `users` >> SET `passwd_SHA512` = SHA2(`passwd_clear`, 512); >> >> Bill >> >> On 4/29/2016 9:07 AM, Carl A Jeptha wrote: >>> converting the passwords in the database from clear/plain text to SHA512-CRYPT From cajeptha at gmail.com Sat Apr 30 08:05:15 2016 From: cajeptha at gmail.com (Carl A Jeptha) Date: Sat, 30 Apr 2016 10:05:15 +0200 Subject: Changing Password Schemes In-Reply-To: <5723EAED.2060007@gedalya.net> References: <57233028.7000201@gmail.com> <57235C97.3060008@gmail.com> <5723B3F3.2040307@KnoxvilleChristian.org> <5723EAED.2060007@gedalya.net> Message-ID: <5724673B.80108@gmail.com> Sorry for double reply, but this what a password looks like in the "hashed" password column: {SHA512-CRYPT}$6$wEn1UFuiMzl9OSjd$Vh/PZ95WDID1GwI2 ------------ You have a good day now, en mag jou m?re ook so wees, On 2016-04-30 01:14, Gedalya wrote: > That's not SHA512-CRYPT. That's just a simple sha512 of the password, without salt. > > A SHA512-CRYPT password will be generated with: > > printf "1234\n1234" | doveadm pw -s SHA512-CRYPT > > or: > > doveadm pw -s SHA512-CRYPT -p 1234 > > or: > > mkpasswd -m sha-512 1234 > > (without the "{SHA512-CRYPT}" prefix) > > What exactly is the difficulty you are having with converting the passwords? > What database engine are you using? > > > On 04/29/2016 03:20 PM, Bill Shirley wrote: >> Looks like an SQL update would do this: >> UPDATE `users` >> SET `passwd_SHA512` = SHA2(`passwd_clear`, 512); >> >> Bill >> >> On 4/29/2016 9:07 AM, Carl A Jeptha wrote: >>> converting the passwords in the database from clear/plain text to SHA512-CRYPT From tss at iki.fi Sat Apr 30 11:27:56 2016 From: tss at iki.fi (Timo Sirainen) Date: Sat, 30 Apr 2016 14:27:56 +0300 Subject: Panic: file message-part-serialize.c: line 90 (part_serialize): assertion failed: (part->children == NULL) In-Reply-To: <20160429214357.GA7880@ruhr-uni-bochum.de> References: <20160429214357.GA7880@ruhr-uni-bochum.de> Message-ID: <466B42DA-4CC4-4A1A-B2C8-ADDABFD2DC04@iki.fi> On 30 Apr 2016, at 00:43, Andreas Jobs wrote: > > Hi, > > I just found this in my logs: > > Apr 29 11:05:20 lmtp(joerg.eggenstein at ruhr-uni-bochum.de): Panic: file message-part-serialize.c: line 90 (part_serialize): assertion failed: (part->children == NULL) > It looks like that this may be caused by a mail where there is the blank > line after a part header missing: Thanks, this should fix it not to crash: https://github.com/dovecot/core/commit/12fd7a30563f3256642070ef9528dda0d089cb41 From andreas.jobs at ruhr-uni-bochum.de Sat Apr 30 12:23:25 2016 From: andreas.jobs at ruhr-uni-bochum.de (Andreas Jobs) Date: Sat, 30 Apr 2016 14:23:25 +0200 Subject: Panic: file message-part-serialize.c: line 90 (part_serialize): assertion failed: (part->children == NULL) In-Reply-To: <466B42DA-4CC4-4A1A-B2C8-ADDABFD2DC04@iki.fi> References: <20160429214357.GA7880@ruhr-uni-bochum.de> <466B42DA-4CC4-4A1A-B2C8-ADDABFD2DC04@iki.fi> Message-ID: <20160430122325.GD9544@ruhr-uni-bochum.de> On Sat, Apr 30, 2016 at 02:27:56PM +0300, Timo Sirainen wrote: > Thanks, this should fix it not to crash: > https://github.com/dovecot/core/commit/12fd7a30563f3256642070ef9528dda0d089cb41 Yes, it does. Thank you. --Andreas -- ! Andreas Jobs Network Operation Center ! ! Ruhr-Universitaet Bochum ! ! One Day I Will Find This Peer Guy and Then I Will Reset HIS Connection ! From patrickdk at patrickdk.com Sat Apr 30 12:58:42 2016 From: patrickdk at patrickdk.com (Patrick Domack) Date: Sat, 30 Apr 2016 08:58:42 -0400 Subject: Changing Password Schemes In-Reply-To: <5724673B.80108@gmail.com> References: <57233028.7000201@gmail.com> <57235C97.3060008@gmail.com> <5723B3F3.2040307@KnoxvilleChristian.org> <5723EAED.2060007@gedalya.net> <5724673B.80108@gmail.com> Message-ID: <20160430085842.Horde.sQtUxgU5ss6qUhV_CpiayCe@mail.patrickdk.com> This looks good, except it is truncated, it should be something like 95chars long, Is your hash column set to 128 or up around there or larger? Quoting Carl A Jeptha : > Sorry for double reply, but this what a password looks like in the > "hashed" password column: > {SHA512-CRYPT}$6$wEn1UFuiMzl9OSjd$Vh/PZ95WDID1GwI2 > > ------------ > You have a good day now, en mag jou m?re ook so wees, > > On 2016-04-30 01:14, Gedalya wrote: >> That's not SHA512-CRYPT. That's just a simple sha512 of the >> password, without salt. >> >> A SHA512-CRYPT password will be generated with: >> >> printf "1234\n1234" | doveadm pw -s SHA512-CRYPT >> >> or: >> >> doveadm pw -s SHA512-CRYPT -p 1234 >> >> or: >> >> mkpasswd -m sha-512 1234 >> >> (without the "{SHA512-CRYPT}" prefix) >> >> What exactly is the difficulty you are having with converting the passwords? >> What database engine are you using? >> >> >> On 04/29/2016 03:20 PM, Bill Shirley wrote: >>> Looks like an SQL update would do this: >>> UPDATE `users` >>> SET `passwd_SHA512` = SHA2(`passwd_clear`, 512); >>> >>> Bill >>> >>> On 4/29/2016 9:07 AM, Carl A Jeptha wrote: >>>> converting the passwords in the database from clear/plain text to >>>> SHA512-CRYPT From stephan at rename-it.nl Sat Apr 30 13:45:31 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 30 Apr 2016 15:45:31 +0200 Subject: Setting lmtp_user_concurrency_limit causes anvil permission error In-Reply-To: References: Message-ID: <5724B6FB.9010406@rename-it.nl> Op 4/7/2016 om 2:39 PM schreef Tom Sommer: > On 2016-04-07 13:41, Tom Sommer wrote: >> I've set lmtp_user_concurrency_limit to 5 and now LMTP throws this at >> me for every delivery: >> >> Apr 07 13:38:33 lmtp(4434): Error: >> net_connect_unix(/var/run/dovecot/anvil) failed: Permission denied >> >> ls -l /var/run/dovecot/anvil >> srw------- 1 root root 0 Apr 7 13:32 /var/run/dovecot/anvil >> >> If I set lmtp_user_concurrency_limit to 0, the error goes away. > > Hrm, if I disable lmtp_rcpt_check_quota, then the error goes away as > well. Very confusing. This probably fixes it: https://github.com/dovecot/core/commit/6de95f63d4590814354fa5e35e92946c58d4562e Regards, Stephan. From tss at iki.fi Sat Apr 30 17:22:31 2016 From: tss at iki.fi (Timo Sirainen) Date: Sat, 30 Apr 2016 20:22:31 +0300 Subject: more info about deleting users In-Reply-To: <1821159830.78070.1461939941971.JavaMail.open-xchange@popper07.register.it> References: <260988049.76859.1461938117118.JavaMail.open-xchange@popper07.register.it> <1821159830.78070.1461939941971.JavaMail.open-xchange@popper07.register.it> Message-ID: <5A263A73-CABE-4BF3-AF07-8C3165D2CCD9@iki.fi> On 29 Apr 2016, at 17:25, Matteo Gaito Test Account wrote: > > Hi, > > i've search a lot in order to find a way to delete account by dovecot but i > found only this way > > http://dovecot.org/list/dovecot/2011-November/079273.html > > It's possible today delete a maildir remotely with doveadm or with dovecot api? It would be difficult to write such a command to find all the files and database entries without explicitly adding such deletion-code to every plugin that writes something somewhere, which seems like an unnecessary large amount of work. Since it couldn't work for all installations anyway, I'd rather not make something that maybe works in some installations. What I am planning though is to make it possible to add external scripts that can get executed via doveadm/API. This would allow writing a script that deletes all of user's data and there could be some example scripts as well. From tss at iki.fi Sat Apr 30 17:24:05 2016 From: tss at iki.fi (Timo Sirainen) Date: Sat, 30 Apr 2016 20:24:05 +0300 Subject: Recent update causes segfault in proxy mode In-Reply-To: <20160429094625.GK557@charite.de> References: <20160429092847.GH557@charite.de> <20160429094625.GK557@charite.de> Message-ID: <7997823B-AF76-4782-9E06-C33AED2A860B@iki.fi> On 29 Apr 2016, at 12:46, Ralf Hildebrandt wrote: > > * Ralf Hildebrandt : > >> Unfortunately, I'm not getting a backtrace :( > > got it: > > #1 0x00007febcad5407e in array_delete_i (count=1, idx=1992, array=0x7febcd4b7b68) at ../../../../src/lib/array.h:200 > No locals. > #2 imapc_untagged_expunge (reply=, mbox=0x7febcd4b77f0) at imapc-mailbox.c:473 Fixed by https://github.com/dovecot/core/commit/de8fc9d21460bf0369d671e9ba9361592379a7c5 From stephan at rename-it.nl Sat Apr 30 18:41:31 2016 From: stephan at rename-it.nl (Stephan Bosch) Date: Sat, 30 Apr 2016 20:41:31 +0200 Subject: issues with doveadm sieve commands In-Reply-To: <7A7AB430-525E-4BBF-90C5-AACC6973CBC5@ellael.org> References: <7A7AB430-525E-4BBF-90C5-AACC6973CBC5@ellael.org> Message-ID: <5724FC5B.3010308@rename-it.nl> Op 4/10/2016 om 2:49 PM schreef Michael Grimm: > Hi > > This is dovecot-pigeonhole 0.4.13 and dovecot 2.2.23 at FBSD 10.3-STABLE. > > I am used to run doveadm sieve commands for some time now whenever updating a sieve script. > > Recently those commands fail with a user set explicitly, e.g.: > > mail> doveadm sieve list -u test > doveadm(root): Error: User doesn't exist > > When asking for all users, I do not run into any error: > > mail> doveadm sieve list -u '*' > user1 default ACTIVE > [snip] > test default ACTIVE > > mail> doveadm sieve list -A > user1 default ACTIVE > [snip] > test default ACTIVE > > That is true for all doveadm sieve commands, but other will work, like: > > mail> doveadm user -u test > userdb: test > user : test > mail : mdbox:/?path-to-maildir--/test > > Hmm, any idea what is going on? I do not know when those commands stopped to work, I didn't try to update my sieve scripts for some time now. I believe something like this was fixed in Dovecot itself. At least I cannot reproduce this with the latest releases. Can you try those? Regards, Stephan. From cajeptha at gmail.com Sat Apr 30 18:52:13 2016 From: cajeptha at gmail.com (Carl A Jeptha) Date: Sat, 30 Apr 2016 20:52:13 +0200 Subject: Changing Password Schemes In-Reply-To: <20160430085842.Horde.sQtUxgU5ss6qUhV_CpiayCe@mail.patrickdk.com> References: <57233028.7000201@gmail.com> <57235C97.3060008@gmail.com> <5723B3F3.2040307@KnoxvilleChristian.org> <5723EAED.2060007@gedalya.net> <5724673B.80108@gmail.com> <20160430085842.Horde.sQtUxgU5ss6qUhV_CpiayCe@mail.patrickdk.com> Message-ID: <5724FEDD.1070705@gmail.com> Sorry not truncated: {SHA512-CRYPT}$6$wEn1UFuiMzl9OSjd$Vh/PZ95WDID1GwI02QWAQNNfY5.Rk9zcSetYTgRfo4SPKf8qzMXsruvvS8uaSUidlvwDTLLSr3cVsQx2e6cu2/ ------------ You have a good day now, en mag jou m?re ook so wees, Carl A Jeptha On 2016-04-30 14:58, Patrick Domack wrote: > This looks good, except it is truncated, it should be something like > 95chars long, Is your hash column set to 128 or up around there or > larger? > > > Quoting Carl A Jeptha : > >> Sorry for double reply, but this what a password looks like in the >> "hashed" password column: >> {SHA512-CRYPT}$6$wEn1UFuiMzl9OSjd$Vh/PZ95WDID1GwI2 >> >> ------------ >> You have a good day now, en mag jou m?re ook so wees, >> >> On 2016-04-30 01:14, Gedalya wrote: >>> That's not SHA512-CRYPT. That's just a simple sha512 of the >>> password, without salt. >>> >>> A SHA512-CRYPT password will be generated with: >>> >>> printf "1234\n1234" | doveadm pw -s SHA512-CRYPT >>> >>> or: >>> >>> doveadm pw -s SHA512-CRYPT -p 1234 >>> >>> or: >>> >>> mkpasswd -m sha-512 1234 >>> >>> (without the "{SHA512-CRYPT}" prefix) >>> >>> What exactly is the difficulty you are having with converting the >>> passwords? >>> What database engine are you using? >>> >>> >>> On 04/29/2016 03:20 PM, Bill Shirley wrote: >>>> Looks like an SQL update would do this: >>>> UPDATE `users` >>>> SET `passwd_SHA512` = SHA2(`passwd_clear`, 512); >>>> >>>> Bill >>>> >>>> On 4/29/2016 9:07 AM, Carl A Jeptha wrote: >>>>> converting the passwords in the database from clear/plain text to >>>>> SHA512-CRYPT From aki.tuomi at dovecot.fi Sat Apr 30 18:53:19 2016 From: aki.tuomi at dovecot.fi (aki.tuomi at dovecot.fi) Date: Sat, 30 Apr 2016 21:53:19 +0300 (EEST) Subject: issues with doveadm sieve commands In-Reply-To: <5724FC5B.3010308@rename-it.nl> References: <7A7AB430-525E-4BBF-90C5-AACC6973CBC5@ellael.org> <5724FC5B.3010308@rename-it.nl> Message-ID: <417480260.1155.1462042401063@appsuite-dev.open-xchange.com> > On April 30, 2016 at 9:41 PM Stephan Bosch wrote: > > > Op 4/10/2016 om 2:49 PM schreef Michael Grimm: > > Hi > > > > This is dovecot-pigeonhole 0.4.13 and dovecot 2.2.23 at FBSD 10.3-STABLE. > > > > I am used to run doveadm sieve commands for some time now whenever updating a sieve script. > > > > Recently those commands fail with a user set explicitly, e.g.: > > > > mail> doveadm sieve list -u test > > doveadm(root): Error: User doesn't exist > > > > When asking for all users, I do not run into any error: > > > > mail> doveadm sieve list -u '*' > > user1 default ACTIVE > > [snip] > > test default ACTIVE > > > > mail> doveadm sieve list -A > > user1 default ACTIVE > > [snip] > > test default ACTIVE > > > > That is true for all doveadm sieve commands, but other will work, like: > > > > mail> doveadm user -u test > > userdb: test > > user : test > > mail : mdbox:/?path-to-maildir--/test > > > > Hmm, any idea what is going on? I do not know when those commands stopped to work, I didn't try to update my sieve scripts for some time now. > > I believe something like this was fixed in Dovecot itself. At least I > cannot reproduce this with the latest releases. Can you try those? > > Regards, > > Stephan. There is an unfortunate bug in 2.2.23 doveadm in which mail commands ignore -u parameter. It is fixed in 2.2.24. You can use env USER=username doveadm sieve to work around it. --- Aki Tuomi From trashcan at ellael.org Sat Apr 30 18:59:46 2016 From: trashcan at ellael.org (Michael Grimm) Date: Sat, 30 Apr 2016 20:59:46 +0200 Subject: issues with doveadm sieve commands In-Reply-To: <417480260.1155.1462042401063@appsuite-dev.open-xchange.com> References: <7A7AB430-525E-4BBF-90C5-AACC6973CBC5@ellael.org> <5724FC5B.3010308@rename-it.nl> <417480260.1155.1462042401063@appsuite-dev.open-xchange.com> Message-ID: <938C603A-EF6D-4A55-AE79-BB126D22098E@ellael.org> aki.tuomi at dovecot.fi wrote: >> On April 30, 2016 at 9:41 PM Stephan Bosch wrote: >> Op 4/10/2016 om 2:49 PM schreef Michael Grimm: >>> Recently those commands fail with a user set explicitly, e.g.: >>> >>> mail> doveadm sieve list -u test >>> doveadm(root): Error: User doesn't exist >> I believe something like this was fixed in Dovecot itself. At least I >> cannot reproduce this with the latest releases. Can you try those? > There is an unfortunate bug in 2.2.23 doveadm in which mail commands ignore -u parameter. It is fixed in 2.2.24. Yes, I can confirm that 2.2.24 fixed that issue for me. Thanks and regards, Michael From dogz.tw at gmail.com Sat Apr 30 21:32:42 2016 From: dogz.tw at gmail.com (Dogz) Date: Sun, 1 May 2016 05:32:42 +0800 Subject: Dovecot (LDAP) get the quota limitation from windows Active directory Message-ID: Hi, I can't get the quota limitation from windows AD, I did read the dovecot wiki like http://wiki2.dovecot.org/Quota/Configuration and search from google, but failed. *doveadm -D quota get -u dogz:* ... doveadm(dogz): Debug: auth input: dogz at mail.com home=/vmail/dogz/ mail=maildir:/vmail/dogz/Maildir/ uid=500 gid=500 mobile=quota_rule=*:storage=M ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ doveadm(dogz): Debug: changed username to dogz at mail.com doveadm(dogz): Debug: Added userdb setting: mail=maildir:/vmail/dogz/Maildir/ doveadm(dogz): Debug: Added userdb setting: plugin/mobile=quota_rule=*:storage=M ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ doveadm(dogz): Debug: Effective uid=1000, gid=1000, home=/vmail/dogz/ ... Quota name Type Value Limit % User quota STORAGE 72 - 0 User quota MESSAGE 82 - 0 *ldapsearch -x -h 192.168.90.20 -b dc=mail,dc=com -D cn=ldapquery,cn=users,dc=mail,dc=com -W '(&(mail=*dogz at mail.com*))'* ... objectClass: top objectClass: person objectClass: organizationalPerson objectClass: user ... maxStorage: 500 ... sAMAccountName: dogz ... mail: dogz at mail.com mobile: 200 carLicense: 2 My configuration files are as follwing */etc/dovecot/dovecot-ldap.conf :* .... scope = subtree deref = never user_filter = (&(objectCategory=person)(|(mail=%Lu)(otherIpPhone=%Lu))(!(userAccountControl:1.2.840.113556.1.4.803:=2))) pass_filter = (&(objectCategory=person)(|(mail=%Lu)(otherIpPhone=%Lu))(!(userAccountControl:1.2.840.113556.1.4.803:=2))) #PS: I don't know why I can't use otherMailbox to be the alias, but I can use otherIpPhone field successfully. user_attrs = =home=/vmail/%Ln/, =mail=maildir:/vmail/%Ln/Maildir/, =uid=1000, =gid=1000, =mobile=quota_rule=*:storage=%$M ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ default_pass_scheme = CRYPT pass_attrs = userPassword=password */etc/dovecot/conf.d/auth-ldap.conf.ext* auth_username_format = %Lu passdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf } userdb { driver = ldap args = /etc/dovecot/dovecot-ldap.conf } */etc/dovecot/conf.d/90-quota.conf:* ... plugin { #quota = dict:user::proxy::quota #quota2 = dict:domain:%d:proxy::quota_domain #quota_rule = *:storage=102400 #quota2_rule = *:storage=1048576 #quota = dict:User quota::file:%h/Maildir/dovecot-quota quota = dict:User quota::file:~/Maildir/dovecot-quota } I also tried different form as following, but still can't work it out, please help me and thank you in advance. user_attrs = =home=/vmail/%Ln/, =mail=maildir:/vmail/%Ln/Maildir/, =quota_rule=*:storage=%{ldap:mobile}M or user_attrs = =home=/vmail/%Ln/, =mail=maildir:/vmail/%Ln/Maildir/, =mobile=quota_rule=*:storage=%{ldap:mobile}M Is there any information I should provide? Please advise me and thank you in advance. -- Best Regards, Dogz