AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Azure and the Future of Artificial Intelligence
Inference could cost prohibitive as these models get bigger and bigger. Inference of better models will indeed become more expensive. It depends on how useful is it? Like, if it is more useful than it is expensive than it is not prohibitive. The question is, can neural net produce an answer good enough at this cost? Yes. But to give you an analogy, like suppose you want to talk to a lawyer, you have some case you or need some advice or something. You are perfectly happy to spend $500 an hour. And suddenly inference becomes very much non prohibitive.