AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Evolution of the LLM-EPI Monitoring Platform
I know that you all released an LLM-EPI monitoring product. Is there a whole new observability and tooling stack needed for AI? And if so, what are the main components and if not, you know? Yeah, well, first there is the, there is an observability stack needed period, right? So you do need to fold that in because that's just one more component you're using.And we'd say that's probably also a whole new set of use cases around MLOps or non-bide-decalled MLMOps. I think today it's changed quite a bit because MLMs are the killer app. He's trying to use them.