The MLOps Podcast cover image

💬 MLOps for NLP Systems with Charlene Chambliss

The MLOps Podcast

00:00

How Do You Deploy Multiple Models in a Container?

It can be ideal to kind of deploy all the models in one container, if they'll actually fit. This is particularly important if you have something that's a real time application as opposed to like a long running processing pipe line. It also allows you to create more consistent inner faces between how you're sending and receiving data to the model servers.

Play episode from 41:12
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app