AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Risks of Launching a Large Language Model in Production
I'm curious in Galileo is there ways to identify the issues with say cost when it comes to training and inference yeah so cost is a metric that we've added into the LLM studio because it's very top of mind for people. You have seen a lot of players getting to large language models trying to put in production as you mentioned it's still early a lot of companies don't feel completely comfortable to put the models in front of millions of customers. The low risk ones are the ones where we seeing them go first which is great at least this is spreading the word that you can do this, then they start to launch first and then tweak later.