Our surprise find, Migadu is a little-known Swiss email hosting provider which delivers unbelievable price/performance value along with top-notch security. It lacks fancy features but does the job of email hosting with guaranteed privacy at the cheapest plan of $4/user/month. One may also go for Runbox and Amazon Work Mail, but it was outside the scope of this article.
A dedicated server will likely cost you more than $100 per month; it's definitely not cheap web hosting. The benefit? Your website lives on a server all by its lonesome, so it takes advantage of the server's full resources. You'll probably need to handle firewalls, updates, and maintenance yourself, however, unless you opt for a managed server, which costs even more money.