DataFramed #329 Building Trust in AI Agents with Shane Murray, Senior Vice President of Digital Platform Analytics at Versant Media
50 snips
Nov 3, 2025 Shane Murray, a seasoned data executive and SVP at Versant Media, discusses the critical interplay between data quality and AI reliability. He shares cautionary tales of AI failures impacting reputations, highlighting essential data quality controls for successful implementations. Shane explains the concept of context engineering and the roles vital for developing trustworthy AI systems. He emphasizes that many AI hallucinations stem from poor data rather than just model flaws, advocating for rigorous data monitoring and clear accountability to build user trust.
AI Snips
Chapters
Books
Transcript
Episode notes
Mass Data Leak From A Chatbot
- Shane recounts a McDonald's chatbot leak that exposed 64 million job applicants due to a default password of "123456".
- He highlights reputational harm from such failures as a key risk for organizations.
LLMs Automate Paperwork At Scale
- Shane describes Pilot Travel using LLMs to extract data from photographed bills of lading and speed financial pipelines.
- He presents this as a prototypical, high-value automation use case for unstructured data.
AI Readiness Is Discovered By Building
- Shane: readiness is discovered by building — prototyping reveals real gaps in people, systems, and data.
- He stresses readiness spans reliable data, monitoring, and the ability to intervene when agents fail.
