3min chapter

Brain Inspired cover image

BI 171 Mike Frank: Early Language and Cognition

Brain Inspired

CHAPTER

The Importance of Prediction in Language Model Evaluation

The truth is often more complicated because these models may vary widely in their behavior based on how you're asking the question, what materials are and so forth. And anecdote is not a data set. So I was suggesting that the minimal thing that you might want to do in evaluation is follow some psychology best practices like having a control group that is matched.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode