Vanishing Gradients cover image

Vanishing Gradients

Episode 21: Deploying LLMs in Production: Lessons Learned

Nov 14, 2023
Guest Hamel Husain, a machine learning engineer, discusses the business value of large language models (LLMs) and generative AI. They cover common misconceptions, necessary skills, and techniques for working with LLMs. The podcast explores the challenges of working with ML software and chat GPT, the importance of data cleaning and analysis, and deploying LLMs in production with guardrails. They also discuss an AI-powered real estate CRM and optimizing marketing strategies through data analysis.
01:08:11

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Large language models (LLMs) have significant business value and generate interest beyond the tech industry.
  • Evaluating LLMs requires a multi-level approach, including rigorous testing, human evaluation, and feedback from real users.

Deep dives

The Excitement and Urgency Around Large Language Models and Generative AI

The podcast episode discusses the excitement and urgency around large language models (LLMs) and generative AI. The interviewee, Hamil Hussein, shares his enthusiasm for working with LLMs, highlighting that the investment and resources dedicated to this field are significant. He also emphasizes the newness of LLMs and the continuous learning required to work with them effectively. The podcast host, Hugo, agrees, mentioning that previous instability in the field prevented him from focusing on generative AI in the past, but now there is a sense of stability and understanding. They both recognize the importance of continuously evaluating LLMs, looking at data skeptically, and refining their understanding and skills in working with these models.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode