Making LLMs hallucinate less, how to diagnose ML models, from PM in Google AI to CEO of Galileo - Vikram Chatterji - The Data Scientist Show #066
The Data Scientist Show - Daliana Liu
00:00
The Risks of Launching a Large Language Model in Production
I'm curious in Galileo is there ways to identify the issues with say cost when it comes to training and inference yeah so cost is a metric that we've added into the LLM studio because it's very top of mind for people. You have seen a lot of players getting to large language models trying to put in production as you mentioned it's still early a lot of companies don't feel completely comfortable to put the models in front of millions of customers. The low risk ones are the ones where we seeing them go first which is great at least this is spreading the word that you can do this, then they start to launch first and then tweak later.
Transcript
Play full episode
