AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How Do We Think About Progress in Machine Learning?
Most of the episode we're going to be talking about investigating trends in machine learning. The two chief components that go into this recipe are like the amount of compute that is used to train these machine learning models, the amount of operations that are used to train them. And second,. the amount of data that goes into the models and the quality of this data. A third, after component that's related to this too is how our understanding of like how to combine compute and data evolves over time which is what I will call like algorithm improvements.