Phillip Carter is a Principal Product Manager at Honeycomb, which develops a software debugging product for distributed systems. Phillip recently published one of the most interesting blog posts I’ve read titled “All the Hard Stuff Nobody Talks About when Building Products with LLMs”. The post is excellent and everyone should give it a read. In this episode, we dive deep into what the hard stuff actually is, the pros and cons of Large Language Models (LLMs) and what teams need to think about when using LLMs in their products. We also talk about the real world results that come from shipping an LLM-enabled product, including the conversion increases that Honeycomb has seen as a result of Query Assistant and how the decision to use LLMs came about. For all the teams wondering how to use LLMs now, this is the episode for you.

Where to Find Phillip:

* LinkedIn: https://www.linkedin.com/in/phillip-carter-4714a135/

* Twitter: https://twitter.com/_cartermp

* Personal Website: https://phillipcarter.dev/

* Blog Post Referred to in Podcast: https://www.honeycomb.io/blog/hard-stuff-nobody-talks-about-llm

Where to Find Shomik:

* Twitter: https://twitter.com/shomikghosh21

* LinkedIn: https://www.linkedin.com/in/shomik-ghosh-a5a71319/

* Software Snack Bites Newsletter: https://www.shomik.substack.com

* Software Snack Bites Podcast: Apple Podcasts, Spotify, Google.

In this episode, we cover:

(00:49) - Phillip’s Background and What Honeycomb Does

Episode 1840: The Papers - Monday April 29th 2024