MLOps.community  cover image

Cost/Performance Optimization with LLMs [Panel]

MLOps.community

00:00

How to Monitor Bad Experiences

In most cases anytime we've seen an outlier, the solution is super simple it's just like, Oh, we didn't know about this weird behavior. And that's really easy but we no longer have that. I'd be interested to hear from others how they deal and labeling becomes too expensive as well if you need like GPT for for labeling then you know it's expensive again. So whether people have like some smart sampling techniques or maybe like pre filtering initially are their solutions out there for that It seems so nascent field to me that pretty much like all the tooling is just in the process of building.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app