AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Challenges of Transitioning to Running Own Models
The speakers discuss the challenges of transitioning from using closed APIs to running their own models, including infrastructure, workflow, and product concerns. They also touch on the complexities of optimizing latency, throughput, cost, privacy, security, and orchestrating models across different hardware and clouds.