From Our Neurons to Yours cover image

Neuroscience and AI: What artificial intelligence teaches us about the brain (and vice versa) | Surya Ganguli

From Our Neurons to Yours

CHAPTER

Data Efficiency, Error Reduction, and Scaling Laws in AI Systems

This chapter discusses the relationship between data efficiency, error reduction, and scaling laws in AI systems, emphasizing the diminishing returns of error reduction with increased data. It explores the importance of intelligently selecting non-random data subsets for exponential error reduction, compares wealth and height distributions, and delves into active learning and curiosity-driven learning in babies.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner