AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is There Going to Be Much More Decentralization?
There's a huge asymmetry between the cost of training these models, basically calibrating them to do things and the cost of actually using them. The next generation of AI models will have sparsity built in - I think GPT-4 is rumored to be building one. And there's people working on ways of taking these programs on your CPU or you could run it on your GPU. So we have another proof by example that intelligence can be incredibly compact and require very little energy.