1.0.15 gone, can't start version 2

On advice/recommendation received on this list, I removed version 1.0.15 with:

rm -rf /usr/local/dovecot

However, now that I have version 2 properly installed, configured, and ready to start testing with Postfix, it appears the old version is still in /usr/local/sbin, /usr/local/include, /usr/local/libexec, /usr/local/lib and /usr/local/shared/doc. Thinking that anything in /usr/local is something that was installed s a result of having built it from source (which 1.0.15 definitely was), should these also be removed?