[Dovecot] Compiling with SSL

I have Dovecot 1.0.9 running right now and I'm looking to upgrade but at the same time re-compile with SSL support. Dovecot's been working great for me so far. When I try to compile I keep getting this at the end:

Building with SSL support ........... : no Building with IPv6 support .......... : yes Building with pop3 server ........... : yes

This is what my configure line looks like:

./configure --prefix=/usr/local/dovecot --with-pop3d --with-ssl=openssl --with-ssldir=/usr/local/vps/sharedssl/openssl --with-passwd-file

Am I not doing something right? Am I reading the configuration setup wrong? Any help would be great!

Thanks.