[Dovecot] Dovecot broken with newer OpenSSL
After updating my system from OpenSSL 0.9.8j to 0.9.8k Dovecot has stopped functioning properly with TLS sessions. The version of Dovecot does not seem to matter as I tried 1.1.11 - 1.1.14. Other programs using SSL/TLS such as Postfix and lightty still work fine when built with the newer release of OpenSSL. The IMAP client doesn't matter. For the time being I have gone back to .13 linked against older OpenSSL.
In the logs I see messages like the following...
dovecot: Apr 16 23:12:18 Info: imap-login: Disconnected (no auth attempts): rip=2001:470:b01e:3:216:41ff:fe17:6933, lip=2001:470:1d:8c::2, TLS handshaking: Disconnected
On Apr 17, 2009, at 12:18 AM, Brad wrote:
In the logs I see messages like the following...
dovecot: Apr 16 23:12:18 Info: imap-login: Disconnected (no auth
attempts): rip=2001:470:b01e:3:216:41ff:fe17:6933, lip=2001:470:1d:8c::2, TLS handshaking: Disconnected
Anything else if you set verbose_ssl=yes?
On Friday 17 April 2009 00:25:26 Timo Sirainen wrote:
On Apr 17, 2009, at 12:18 AM, Brad wrote:
In the logs I see messages like the following...
dovecot: Apr 16 23:12:18 Info: imap-login: Disconnected (no auth attempts): rip=2001:470:b01e:3:216:41ff:fe17:6933, lip=2001:470:1d:8c::2, TLS handshaking: Disconnected
Anything else if you set verbose_ssl=yes?
I have that set in my config already and the answer is no. Let me know if there is anything else I can do that might provide more details even if it means applying a patch or anything to add any additional logging.
On Apr 17, 2009, at 12:32 AM, Brad wrote:
On Friday 17 April 2009 00:25:26 Timo Sirainen wrote:
On Apr 17, 2009, at 12:18 AM, Brad wrote:
In the logs I see messages like the following...
dovecot: Apr 16 23:12:18 Info: imap-login: Disconnected (no auth attempts): rip=2001:470:b01e:3:216:41ff:fe17:6933, lip=2001:470:1d:8c::2, TLS handshaking: Disconnected
Anything else if you set verbose_ssl=yes?
I have that set in my config already and the answer is no. Let me know if there is anything else I can do that might provide more details
even if it means applying a patch or anything to add any additional logging.
I don't really have any idea then. verbose_ssl=yes makes Dovecot log
everything OpenSSL tells it. And I can't really think of what Dovecot
would do differently than all the other servers. I guess the first
thing I'd have to know is if this is specific to your installation,
OpenBSD or if it's broken in all OpenSSL 0.9.8j versions in all
systems..
On Friday 17 April 2009 00:39:05 Timo Sirainen wrote:
On Apr 17, 2009, at 12:32 AM, Brad wrote:
On Friday 17 April 2009 00:25:26 Timo Sirainen wrote:
On Apr 17, 2009, at 12:18 AM, Brad wrote:
In the logs I see messages like the following...
dovecot: Apr 16 23:12:18 Info: imap-login: Disconnected (no auth attempts): rip=2001:470:b01e:3:216:41ff:fe17:6933, lip=2001:470:1d:8c::2, TLS handshaking: Disconnected
Anything else if you set verbose_ssl=yes?
I have that set in my config already and the answer is no. Let me know if there is anything else I can do that might provide more details even if it means applying a patch or anything to add any additional logging.
I don't really have any idea then. verbose_ssl=yes makes Dovecot log everything OpenSSL tells it. And I can't really think of what Dovecot would do differently than all the other servers. I guess the first thing I'd have to know is if this is specific to your installation, OpenBSD or if it's broken in all OpenSSL 0.9.8j versions in all systems..
I'll do some more testing tomorrow and see if I can reproduce the same issue on another system. Maybe even a completely clean install if I have the time.
Timo Sirainen wrote:
On Apr 17, 2009, at 12:18 AM, Brad wrote:
In the logs I see messages like the following...
dovecot: Apr 16 23:12:18 Info: imap-login: Disconnected (no auth attempts): rip=2001:470:b01e:3:216:41ff:fe17:6933, lip=2001:470:1d:8c::2, TLS handshaking: Disconnected
Anything else if you set verbose_ssl=yes?
same problem here on OpenBSD 4.5-current (GENERIC) #28: Wed Apr 15 04:56:04 MDT 2009 deraadt@sparc64.openbsd.org:/usr/src/sys/arch/sparc64/compile/GENERIC
with "OpenSSL 0.9.8k 25 Mar 2009" and Dovecot 1.1.14 from ports
log with verbose_ssl=yes:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
hope that helps
Timo Sirainen wrote:
On Apr 17, 2009, at 12:18 AM, Brad wrote:
In the logs I see messages like the following...
dovecot: Apr 16 23:12:18 Info: imap-login: Disconnected (no auth attempts): rip=2001:470:b01e:3:216:41ff:fe17:6933, lip=2001:470:1d:8c::2, TLS handshaking: Disconnected
Anything else if you set verbose_ssl=yes?
same problem here on OpenBSD 4.5-current (GENERIC) #28: Wed Apr 15 04:56:04 MDT 2009 deraadt@sparc64.openbsd.org:/usr/src/sys/arch/sparc64/compile/GENERIC
with "OpenSSL 0.9.8k 25 Mar 2009" and Dovecot 1.1.14 from ports
log with verbose_ssl=yes:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
hope that helps
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or set it to 0 to disable the limit).
On Saturday 18 April 2009 16:31:10 Timo Sirainen wrote:
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or set it to 0 to disable the limit).
I am not seeing the bit about SSL_accept() and setting login_process_size to 0 does not help.
Brad wrote:
On Saturday 18 April 2009 16:31:10 Timo Sirainen wrote:
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or set it to 0 to disable the limit).
I am not seeing the bit about SSL_accept() and setting login_process_size to 0 does not help.
same here and the imap-login-prozess eat much cpu-power
Christian Rueger wrote:
Brad wrote:
On Saturday 18 April 2009 16:31:10 Timo Sirainen wrote:
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or set it to 0 to disable the limit).
I am not seeing the bit about SSL_accept() and setting login_process_size to 0 does not help.
same here and the imap-login-prozess eat much cpu-power
today i enable tracing for the imap-process with
login_process_size = 0 login_processes_count = 1
starting thunderbird on the client-side and wait until it timeout ktrace is attached
On Sunday 19 April 2009 00:47:20 Brad wrote:
On Saturday 18 April 2009 16:31:10 Timo Sirainen wrote:
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or set it to 0 to disable the limit).
I am not seeing the bit about SSL_accept() and setting login_process_size to 0 does not help.
Another thing I forgot to mention... I had someone else do some testing with two 32-bit systems (i386) and he was not able to reproduce the issue. I haven't had a chance to double check this but I will tomorrow. So this is starting to look like it is specific to 64-bit systems. I am using amd64 here.
On Sunday 19 April 2009 03:42:03 Brad wrote:
On Sunday 19 April 2009 00:47:20 Brad wrote:
On Saturday 18 April 2009 16:31:10 Timo Sirainen wrote:
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or se it to 0 to disable the limit).
I am not seeing the bit about SSL_accept() and setting login_process_size to 0 does not help.
Another thing I forgot to mention... I had someone else do some testing with two 32-bit systems (i386) and he was not able to reproduce the issue. I haven't had a chance to double check this but I will tomorrow. So this is starting to look like it is specific to 64-bit systems. I am using amd64 here.
Even weirder I have found Windows systems running Thunderbird at least can establish a TLS session fine.
From another OpenBSD system..
$ openssl s_client -connect mail.comstyle.com:143 -starttls imap CONNECTED(00000004) depth=0 /C=CA/ST=Ontario/L=Toronto/O=ComStyle/OU=IMAP server/CN=mail.comstyle.com/emailAddress=postmaster@comstyle.com verify error:num=18:self signed certificate verify return:1 depth=0 /C=CA/ST=Ontario/L=Toronto/O=ComStyle/OU=IMAP server/CN=mail.comstyle.com/emailAddress=postmaster@comstyle.com verify return:1 20082:error:05066066:Diffie-Hellman routines:COMPUTE_KEY:invalid public key:/usr/src/lib/libssl/src/crypto/dh/dh_key.c:216: 20082:error:14098005:SSL routines:SSL3_SEND_CLIENT_KEY_EXCHANGE:DH lib:/usr/src/lib/libssl/src/ssl/s3_clnt.c:2109:
Brad wrote:
On Sunday 19 April 2009 03:42:03 Brad wrote:
On Sunday 19 April 2009 00:47:20 Brad wrote:
On Saturday 18 April 2009 16:31:10 Timo Sirainen wrote:
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or se it to 0 to disable the limit).
I am not seeing the bit about SSL_accept() and setting login_process_size to 0 does not help.
Another thing I forgot to mention... I had someone else do some testing with two 32-bit systems (i386) and he was not able to reproduce the issue. I haven't had a chance to double check this but I will tomorrow. So this is starting to look like it is specific to 64-bit systems. I am using amd64 here.
Even weirder I have found Windows systems running Thunderbird at least can establish a TLS session fine.
From another OpenBSD system..
$ openssl s_client -connect mail.comstyle.com:143 -starttls imap CONNECTED(00000004) depth=0 /C=CA/ST=Ontario/L=Toronto/O=ComStyle/OU=IMAP server/CN=mail.comstyle.com/emailAddress=postmaster@comstyle.com verify error:num=18:self signed certificate verify return:1 depth=0 /C=CA/ST=Ontario/L=Toronto/O=ComStyle/OU=IMAP server/CN=mail.comstyle.com/emailAddress=postmaster@comstyle.com verify return:1 20082:error:05066066:Diffie-Hellman routines:COMPUTE_KEY:invalid public key:/usr/src/lib/libssl/src/crypto/dh/dh_key.c:216: 20082:error:14098005:SSL routines:SSL3_SEND_CLIENT_KEY_EXCHANGE:DH lib:/usr/src/lib/libssl/src/ssl/s3_clnt.c:2109:
The GNUTLS CLI client and NSS (Thunderbird - also tested on OpenBSD) seem to be fine establishing a TLS session.
Hi,
Am 18.04.2009 22:31, schrieb Timo Sirainen:
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or set it to 0 to disable the limit).
just updated to the lastest sparc64 OpenBSD snapshot and am now getting those messages too:
Jul 20 20:34:37 warden dovecot: imap-login: Disconnected (no auth attempts): rip=172.16.94.70, lip=80.237.235.10, TLS handshaking: SS L_accept() failed: error:03078041:bignum routines:BN_EXPAND_INTERNAL:malloc failure Jul 20 20:34:38 warden dovecot: imap-login: Disconnected (no auth attempts): rip=80.237.136.4, lip=80.237.235.10, TLS handshaking: SS L_accept() failed: error:03078041:bignum routines:BN_EXPAND_INTERNAL:malloc failure
However, deleting the ssl-parameters.dat file and restarting dovecot fixed the issue.
Michael
On Monday 20 July 2009 15:15:29 Michael wrote:
Hi,
Am 18.04.2009 22:31, schrieb Timo Sirainen:
On Sat, 2009-04-18 at 22:26 +0200, Christian Rueger wrote:
dovecot: imap-login: Disconnected (no auth attempts): rip=Y.Y.Y.Y, lip=X.X.X.X, TLS handshaking: SSL_accept() failed: error:0307F041:bignum routines:BNRAND:malloc failure
Oh. malloc() failed? See if increasing login_process_size helps (or set it to 0 to disable the limit).
just updated to the lastest sparc64 OpenBSD snapshot and am now getting those messages too:
Jul 20 20:34:37 warden dovecot: imap-login: Disconnected (no auth attempts): rip=172.16.94.70, lip=80.237.235.10, TLS handshaking: SS L_accept() failed: error:03078041:bignum routines:BN_EXPAND_INTERNAL:malloc failure Jul 20 20:34:38 warden dovecot: imap-login: Disconnected (no auth attempts): rip=80.237.136.4, lip=80.237.235.10, TLS handshaking: SS L_accept() failed: error:03078041:bignum routines:BN_EXPAND_INTERNAL:malloc failure
However, deleting the ssl-parameters.dat file and restarting dovecot fixed the issue.
Michael
Timo,
Any idea why deleting the ssl-parameters.dat file helps? Should users have to delete this file when upgrading between OpenSSL versions?
On Jul 27, 2009, at 8:02 PM, Brad wrote:
Jul 20 20:34:38 warden dovecot: imap-login: Disconnected (no auth attempts): rip=80.237.136.4, lip=80.237.235.10, TLS handshaking: SS L_accept() failed: error:03078041:bignum routines:BN_EXPAND_INTERNAL:malloc failure
However, deleting the ssl-parameters.dat file and restarting dovecot fixed the issue.
Timo,
Any idea why deleting the ssl-parameters.dat file helps? Should
users have to delete this file when upgrading between OpenSSL versions?
I guess because the file is generated from some internal OpenSSL
structures that change between versions.. I guess it would be possible
to somehow detect that the format has changed, but until people start
complaining more about this I think I'm too lazy to figure it out :)
participants (5)
-
Brad
-
Christian Rueger
-
Christian Rueger
-
Michael
-
Timo Sirainen