80k After Hours cover image

80k After Hours

Highlights: #163 – Toby Ord on the perils of maximising the good that you do

Oct 25, 2023
Toby Ord discusses the trade-offs of maximizing one metric and the risks of optimizing AI. We explore the concept of moral trade and the impact of virtue as a multiplier on projects. Also, learn about a collection of restored and unseen Earth photographs from the Apollo program.
27:23

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Relentlessly optimizing for maximum good eventually diminishes returns and can sacrifice other important factors like achievements or freedom.
  • Considering moral uncertainty and adopting a cautious approach helps avoid extreme actions and encourages robust decision-making in specific situations.

Deep dives

The Perils of Maximization

Toby Orr discusses the perils of trying to maximize the amount of good one can do. He explains that while initially increasing efforts to optimize can lead to significant gains, the returns eventually diminish as the best opportunities are used up. Additionally, when considering moral uncertainty and trade-offs between different moral theories, the trade-offs become steeper and can lead to sacrificing other important factors such as achievements or freedom. He uses the example of trying to become a good athlete, where relentlessly optimizing only for faster running times can lead to detrimental effects on relationships, career, and helping others.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner