Highlights: #163 – Toby Ord on the perils of maximising the good that you do
Oct 25, 2023
auto_awesome
Toby Ord discusses the trade-offs of maximizing one metric and the risks of optimizing AI. We explore the concept of moral trade and the impact of virtue as a multiplier on projects. Also, learn about a collection of restored and unseen Earth photographs from the Apollo program.
Relentlessly optimizing for maximum good eventually diminishes returns and can sacrifice other important factors like achievements or freedom.
Considering moral uncertainty and adopting a cautious approach helps avoid extreme actions and encourages robust decision-making in specific situations.
Deep dives
The Perils of Maximization
Toby Orr discusses the perils of trying to maximize the amount of good one can do. He explains that while initially increasing efforts to optimize can lead to significant gains, the returns eventually diminish as the best opportunities are used up. Additionally, when considering moral uncertainty and trade-offs between different moral theories, the trade-offs become steeper and can lead to sacrificing other important factors such as achievements or freedom. He uses the example of trying to become a good athlete, where relentlessly optimizing only for faster running times can lead to detrimental effects on relationships, career, and helping others.
How Moral Uncertainty Protects Against Utilitarianism
Toby Orr introduces the concept of moral uncertainty and explains how it provides protection against the potential harm of naïve utilitarianism. He highlights the importance of considering multiple moral theories and their potential clashes with our intuitions. By recognizing that we don't know which moral theory is correct, we can adopt a more cautious approach and find a best compromise between competing theories in specific situations. This helps avoid extreme actions dictated by a single theory and encourages more robust decision-making.
The Value of Moral Trade and Personal Character
Toby Orr explores the concepts of moral trade and personal character within the context of effective altruism. He discusses the potential benefits of engaging in moral trade, where individuals with different moral perspectives can find common ground and work together towards shared goals. He also emphasizes the importance of personal character in high-impact endeavors. While raw impact can vary widely based on the specific actions taken, character acts as a multiplier. Good character can amplify positive impact, while bad character can lead to significant harm. By focusing on improving character and seeking virtuous actions, individuals can enhance their contributions to projects and the well-being of those around them.
These aren't necessarily the most important, or even most entertaining parts of the interview — and if you enjoy this, we strongly recommend checking out the full episode: