The MLOps Podcast 🔴 Live MLOps Podcast – Building, Deploying and Monitoring Large Language Models with Jinen Setpal
Sep 6, 2023
Jinen Setpal, ML Engineer at DagsHub, discusses building, deploying, and monitoring large language models. They explore the DPT chatbot project, evaluation methods, reducing hallucinations, improving inference speed, and monitoring language models in production.
Chapters
Transcript
Episode notes
1 2 3 4 5 6 7
Introduction
00:00 • 3min
The Impact of Chat GPT and Introducing DPT
02:48 • 3min
Retrieval Augmented Generation Models and Customization Approaches
05:44 • 24min
Challenges and Approaches for Addressing Hallucinations in Language Models
29:25 • 13min
Improving Inference Speed for Language Models
42:50 • 3min
Using Chatbots and Evaluating AI Models
46:18 • 21min
Monitoring Large Language Models in Production
01:07:19 • 4min