AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Scaling Models at Scales That Are Smaller
There's some benchmarks for which progress might need to be measured at minimum at certain scale. But what we've also seen is that you can sort of empirically analyze behavior of models at scales that are smaller, right. And these laws so far, these extrapolations have helped us safe compute and just get to a better place in terms of the science.