Ok, so if anyone runs into a problem where dovecot reports

chdir(/home/BLAH) failed with uid NNN: Permission denied

in Fedora Core 4 or otherwise, it seems to be a SELinux problem.  Turn OFF SELinux and the problem goes away.