🔴 Live MLOps Podcast – Building, Deploying and Monitoring Large Language Models with Jinen Setpal
The MLOps Podcast
00:00
Monitoring Large Language Models in Production
This chapter focuses on the challenges of monitoring and evaluating the performance of language models, highlighting the lack of accurate evaluation techniques without human involvement and the semi-manual process of collecting prompts and model responses for evaluation.
Transcript
Play full episode
