MLOps.community cover image

The Long Tail of ML Deployment // Tuhin Srivastava // #161

MLOps.community

00:00

The Benefits of Base 10 Architecture

I feel like you guys are an advocate for micro service based architecture. And I don't know if that's across the stack or just across the models itself, because across the models, I feel like you're ahead of your type. Why? Because now with LLM's, now everything is you have products built up on top of APIs. You can build a caching layer into base 10 but those serverless functions that do the caching and call the model also have their own API as well.

Play episode from 38:23
Transcript

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
 Get the app