6min chapter

The Data Scientist Show cover image

Making LLMs hallucinate less, how to diagnose ML models, from PM in Google AI to CEO of Galileo - Vikram Chatterji - The Data Scientist Show #066

The Data Scientist Show

CHAPTER

The Risks of Launching a Large Language Model in Production

I'm curious in Galileo is there ways to identify the issues with say cost when it comes to training and inference yeah so cost is a metric that we've added into the LLM studio because it's very top of mind for people. You have seen a lot of players getting to large language models trying to put in production as you mentioned it's still early a lot of companies don't feel completely comfortable to put the models in front of millions of customers. The low risk ones are the ones where we seeing them go first which is great at least this is spreading the word that you can do this, then they start to launch first and then tweak later.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode