Are the Ads Slowing down my Site?

Ads will always slow down the loading of a site, but there are many other things that can do the same thing. How do you tell what slowdowns are worth it for revenue, and which ones can be improved?