AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
LangChain’s Harrison Chase on Building the Orchestration Layer for AI Agents
Training Data
Continuous Evaluation and Human Involvement in Testing
1min Snip
00:00
Summary
Transcript
Episode notes
Setting up evaluations in a way that may not always yield a 100% pass rate requires tracking progress over time to ensure improvement or at least no regression. Unlike software testing where results typically pass, incorporating human oversight in the testing process is crucial as humans can provide more reliable feedback compared to automated systems. The challenge lies in effectively involving humans in the testing process, a unique aspect compared to software testing.
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode