Software Engineering Radio - the podcast for professional software developers cover image

Software Engineering Radio - the podcast for professional software developers

SE Radio 610: Phillip Carter on Observability for Large Language Models

Apr 3, 2024
Phillip Carter, Principal Product Manager at Honeycomb, discusses observability for large language models. They delve into how observability helps in testing, refining functionality, debugging, and enabling incremental development for LLMs. Carter offers tips on implementing observability and highlights current technology limitations.
01:05:06

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Observability is essential for testing non-unit-testable parts of large language models.
  • Observability-driven development helps refine functionality and debug large language models.

Deep dives

Overview of Observability in Software Development

Observability in software development allows for monitoring and understanding system behavior without directly changing the system. It involves gathering signals or telemetry at different stages of an application to analyze and troubleshoot issues. The goal is to determine what is happening, why it is happening, and to pinpoint specific factors influencing system behavior.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner