AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Origin of the Scaling Laws
There's these curious scaling laws, and the question is when how do they come from, why, what is going on here? The idea is that natural selection has evolved networks to do that. We are a bunch of networks where circulatory systems, renal systems, respiratory systems, and bones, and neural systems, and so on. When you take these ideas and you put them into mathematics, all of these scaling laws come tumbling out. There is now a complete theory for understanding not just the origin of the scaling laws, but the way your networks work.