The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) cover image

Are Emergent Behaviors in LLMs an Illusion? with Sanmi Koyejo - #671

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

CHAPTER

Metrics and Emergence in LLMs

This chapter explores the interplay between linear and nonlinear metrics in analyzing emergent behaviors in large language models, stressing the importance of metric selection in shaping research interpretations. It highlights the complexities of 'emergentness' and calls for careful consideration of context when making claims about model behaviors in AI research.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner