Forward Deployed

Forward Deployed, Episode 1: The Bitter Lesson

11 snips
Nov 3, 2025
Delve into the intriguing debate around Richard Sutton's Bitter Lesson, exploring whether LLMs truly embody its principles. Discover how Lance's journey from Stanford to the forefront of AI showcases the evolution of technology. Learn why forward deployed engineers are in high demand as companies seek practical AI solutions. The hosts also discuss the challenges of adopting AI in enterprises and the distinction between tool AI and agent AI, helping clarify the landscape for builders in the evolving tech world.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
INSIGHT

Computation Beats Human Shortcuts

  • The Bitter Lesson says general methods that leverage compute outperform hand-crafted shortcuts over time.
  • As models scale, human biases in domain-specific hacks often become bottlenecks rather than advantages.
INSIGHT

LLMs Carry Human Priors

  • Sutton argues LLMs aren't pure examples of the Bitter Lesson because training pipelines encode human priors.
  • Pretraining and RL fine-tuning inject many handcrafted decisions, so LLMs carry significant human bias.
ADVICE

Remove Scaffolding Before It Becomes Debt

  • When you add scaffolding around current models, plan to remove it as models improve to avoid technical debt.
  • Revisit assumptions frequently and be ready to rip out hacks that become bottlenecks.
Get the Snipd Podcast app to discover more snips from this episode
Get the app