AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How to Build a Platform to Serve Hundreds of Models
In addition to technologies, there are also people and processes. What skills do we need to build the platform to serve hundreds of models? Did you find an answer to this question, or you're still looking? In principle, it's a difficult one because it very much depends on the general organizational setup and fundamental beliefs of some organizations. So in my world, what I believe works well is the building, the deployment and the serving itself being in the hands of the team.