AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is It Bad That Some Experiments Are Expensive?
In the computational sciences and in machine learning, there are few things that we can do that make future comparisons against our work with smaller budgets easier. So one example of that might be, sure i train a model on all of the language data on the entire internet, right? But i can also evaluate that same model after training on a fraction of that data. And then a future researcher will be able to come up with a new idea, let's say they have a new model that they want to evaluate, and they can compare against some of those sort of smaller budget evaluations. That is what one way that we can help drive the overall cost by promoting that competition. Yes, super helpful.