Future of Life Institute Podcast cover image

Lennart Heim on the AI Triad: Compute, Data, and Algorithms

Future of Life Institute Podcast

CHAPTER

The Limits of How Much Data Are Available Online?

We are reaching limits of how much data we have available online. It's unclear if the scaling laws can continue to the scale which we discovered there. Most of it is just like, probably not that good. Some of it might be better than others. So I think right now, I think reinforcement learning from human feedback is already such an example like actually quality matters.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner