AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Predictability of Models Learning to Code
When does arithmetic come in place? When do models learn to code? Sometimes it's very abrupt. And so, many of these cases, at least, I don't know if in all of them, there's some continuous process going on behind the scenes. But actually, specific abilities are very hard to predict. It's kind of like you can predict statistical averages of the weather, but the weather on one particular day is very hard to predictions.