#60 – Jaime Sevilla on Trends in Machine Learning
Hear This Idea
Is There an Absolute Measuring of Performance Improvement?
The amount of computers being used to train machine learning systems is around 10 to the 24 floating political operations. That's like the biggest systems that we have today have been trained on around that month of compute. We're seeing many orders of magnitude's worth of improvement with doubling times between like six months in the year, right? You're just going to get that very quickly. Presumably that doesn't translate to orders of magnitude of improvement on kind of common sense measures of performance, right? Because that would be insane. But this is a misleading way of looking about it in a sense. For some of the, for some of these metrics, you're going to find that there is like a smooth
Remember Everything You Learn from Podcasts
