Brain Inspired cover image

BI 171 Mike Frank: Early Language and Cognition

Brain Inspired

CHAPTER

The Importance of Prediction in Language Model Evaluation

The truth is often more complicated because these models may vary widely in their behavior based on how you're asking the question, what materials are and so forth. And anecdote is not a data set. So I was suggesting that the minimal thing that you might want to do in evaluation is follow some psychology best practices like having a control group that is matched.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner