The Data Scientist Show - Daliana Liu cover image

Making LLMs hallucinate less, how to diagnose ML models, from PM in Google AI to CEO of Galileo - Vikram Chatterji - The Data Scientist Show #066

The Data Scientist Show - Daliana Liu

00:00

How to Measure Hallucination

Galileo's Hallus nation metric is a very simple metric to leverage. It also cost less to compute which is important because you want to be able to use metrics that are not expensive and if it's a very low value that that means that the model is potentially hallucinating. If chat GPD says that it doesn't agree with the output of this LLM that you're using then that could suggest a potential Hallus nation as well.

Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner
Get the app