
Eugene Yan
Senior machine learning scientist at Amazon, discussing specific metrics used in LLM evaluation.
Best podcasts with Eugene Yan
Ranked by the Snipd community

20 snips
Jun 26, 2024 • 1h 30min
Episode 29: Lessons from a Year of Building with LLMs (Part 1)
Experts from Amazon, Hex, Modal, Parlance Labs, and UC Berkeley share lessons learned from working with Large Language Models. They discuss the importance of evaluation and monitoring in LLM applications, data literacy in AI, the fine-tuning dilemma, real-world insights, and the evolving roles of data scientists and AI engineers.

Jun 26, 2024 • 1h 15min
Episode 30: Lessons from a Year of Building with LLMs (Part 2)
Explore insights from Eugene Yan, Bryan Bischof, Charles Frye, Hamel Husain, and Shreya Shankar on building end-to-end systems with LLMs, the experimentation mindset for AI products, strategies for building trust in AI, the importance of data examination, and evaluation strategies for professionals. These lessons apply broadly to data science, machine learning, and product development.