Samuel Hammond: AI Revolution - Visible and Invisible
From the New World
00:00
Is There Going to Be Much More Decentralization?
There's a huge asymmetry between the cost of training these models, basically calibrating them to do things and the cost of actually using them. The next generation of AI models will have sparsity built in - I think GPT-4 is rumored to be building one. And there's people working on ways of taking these programs on your CPU or you could run it on your GPU. So we have another proof by example that intelligence can be incredibly compact and require very little energy.
Transcript
Play full episode
