Currents 087: Shivanshu Purohit on Open-Source Generative AI
The Jim Rutt Show
00:00
How to Squeeze Goodness and Usability Out of Less Total Computing
Aims to squeeze goodness and usability out of less total computation. We spent the last year basically training a whole suite of models from like models being as tiny as like 49 million parameter models up to like 13 billion parameters. And what we did was not just release all of them, we released the code as well so that people can do actual science with it. This is this idea that data is important and the actual architecture is important. Right? So essentially what you guys are trying to do, because you can't compete with for pure horsepower with Microsoft or Google, is how to squeeze goodness into less computing power.
Transcript
Play full episode
