Changelog Master Feed cover image

Changelog Master Feed

Self-hosting & scaling models (Practical AI #243)

Oct 31, 2023
41:09
Snipd AI
Tuhin, an expert in model deployment and monitoring at any scale, joins the show to discuss self-hosting open access models. They explore trends in tooling and usage of open access models, common use cases for integrating self-hosted models, and how the boom in generative AI has influenced the ecosystem.
Read more

Podcast summary created with Snipd AI

Quick takeaways

  • Base 10 offers a platform that simplifies model deployment with workflow management features.
  • Base 10 focuses on scalability, data privacy, and multi-cloud deployment to meet diverse user needs.

Deep dives

Base 10: Building Infrastructure for ML

Base 10 is a company that focuses on hosting machine learning models in a production-ready and scalable manner. They provide a platform that abstracts away the infrastructure complexities of running models, allowing engineers and data scientists to focus on their core work. Base 10 offers an open-source library called Trust, which enables users to easily package their models and deploy them with just a few lines of code. The platform also provides workflow management features, such as versioning, A/B testing, observability, and logging, making it easier for teams to iterate and manage their models in production.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode