I hate that I have to re-download all my email (about 300Mb) every time my mail server's SSL certificate changes. It changes every year when the old one expires. And today we've moved to a different server, which means going through it all again. Grrr.
No wonder most people just retrieve their email in cleartext.