161: Leveraging Generative AI Models with Hagay Lupesko
Programming Throwdown
00:00
The Cost of Open Source APIs
Using a free API and open AI is spending, you know, we talked about hundreds of thousands of dollars on keeping these GPU machines up even to do inference. You can get much better cost efficiency if you are serving your own model or either an open source model or a model you train. And there are some services that help you do that, including Mosaic ML. But it's much more cost efficient than actually using an external service that has a margin and whatnot.
Transcript
Play full episode
