
LessWrong (Curated & Popular)
“Instrumental Goals Are A Different And Friendlier Kind Of Thing Than Terminal Goals” by johnswentworth, David Lorell
Jan 27, 2025
Join johnswentworth, co-author on instrumental goals, as he explores the fascinating distinction between terminal and instrumental goals using the whimsical example of baking a chocolate cake. He explains how acquiring cocoa powder represents an instrumental goal that serves a greater purpose. The conversation dives into the complexities of coordination among chefs in a restaurant and the importance of corrigibility in achieving shared objectives. It's a light-hearted yet insightful look at goal-setting and collaboration!
09:53
Episode guests
AI Summary
AI Chapters
Episode notes
Podcast summary created with Snipd AI
Quick takeaways
- Terminal goals represent primary objectives, like baking a cake, while instrumental goals are supporting actions that enable these objectives, such as acquiring specific ingredients.
- In collaborative settings like restaurants, balancing instrumental goals among team members fosters better communication and resource management, enhancing the achievement of shared terminal goals.
Deep dives
Understanding Terminal and Instrumental Goals
Terminal goals are overarching objectives, such as baking a chocolate cake, that one prioritizes above all else, regardless of potential consequences or distractions. In contrast, instrumental goals serve as supporting actions that assist in achieving terminal goals, like acquiring cocoa powder for the cake. While the terminal goal remains fixed and focused, instrumental goals come with implicit constraints, aiming to ensure that other essential tasks or resources are not damaged or wasted in the process. This distinction highlights how instrumental goals require more nuanced planning and consideration to avoid hindering the broader objectives.
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.