LessWrong (Curated & Popular) cover image

LessWrong (Curated & Popular)

“Instrumental Goals Are A Different And Friendlier Kind Of Thing Than Terminal Goals” by johnswentworth, David Lorell

Jan 27, 2025
Join johnswentworth, co-author on instrumental goals, as he explores the fascinating distinction between terminal and instrumental goals using the whimsical example of baking a chocolate cake. He explains how acquiring cocoa powder represents an instrumental goal that serves a greater purpose. The conversation dives into the complexities of coordination among chefs in a restaurant and the importance of corrigibility in achieving shared objectives. It's a light-hearted yet insightful look at goal-setting and collaboration!
09:53

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Terminal goals represent primary objectives, like baking a cake, while instrumental goals are supporting actions that enable these objectives, such as acquiring specific ingredients.
  • In collaborative settings like restaurants, balancing instrumental goals among team members fosters better communication and resource management, enhancing the achievement of shared terminal goals.

Deep dives

Understanding Terminal and Instrumental Goals

Terminal goals are overarching objectives, such as baking a chocolate cake, that one prioritizes above all else, regardless of potential consequences or distractions. In contrast, instrumental goals serve as supporting actions that assist in achieving terminal goals, like acquiring cocoa powder for the cake. While the terminal goal remains fixed and focused, instrumental goals come with implicit constraints, aiming to ensure that other essential tasks or resources are not damaged or wasted in the process. This distinction highlights how instrumental goals require more nuanced planning and consideration to avoid hindering the broader objectives.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner