161: Leveraging Generative AI Models with Hagay Lupesko
Programming Throwdown
The Cost of Open Source APIs
Using a free API and open AI is spending, you know, we talked about hundreds of thousands of dollars on keeping these GPU machines up even to do inference. You can get much better cost efficiency if you are serving your own model or either an open source model or a model you train. And there are some services that help you do that, including Mosaic ML. But it's much more cost efficient than actually using an external service that has a margin and whatnot.
00:00
Transcript
Play full episode
Remember Everything You Learn from Podcasts
Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
