MLOps.community  cover image

Building LLM Products Panel // LLMs in Production Conference Part II

MLOps.community

00:00

The Economic Components of Using APIs and Inference Calls

This chapter explores the economic aspect of using APIs and inference calls in building ML products, discussing the cost implications and the importance of prompt engineering. It also highlights the benefits of smaller models in reducing costs, and the advantage that larger incumbents have in terms of private data and capital.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app