Everyday AI Podcast – An AI and ChatGPT Podcast

Ep 476: Top Reason For AI Failure - Cognitive Bias

Mar 6, 2025

Anatoly Shilman, CEO and co-founder of CogBias AI, dives into the impact of cognitive bias on AI systems. He discusses how human flaws seep into training data, leading to AI failures. The conversation highlights innovative methods for detecting and mitigating these biases in communication and decision-making. Anatoly emphasizes the importance of diverse inputs and continuous evaluation to improve AI reliability. He also explores the balance between AI enthusiasm and caution, urging a 'trust but verify' approach in human-AI interactions.

34:56

Episode guests

Anatoly Shilman

AI Summary

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

Cognitive bias significantly affects AI outputs, often distorting decision-making due to the biases present in training data and user perceptions.

Users must adopt a 'trust but verify' approach to critically evaluate AI-generated information and mitigate the risks of biased conclusions.

Deep dives

The Dangers of Blind Trust in AI Outputs

Blindly trusting the outputs of large language models can lead to significant issues, as these models often reflect biases found in the data they are trained on. A major concern is that users may not scrutinize the information provided, assuming it is entirely accurate and devoid of bias. This attitude can become dangerous when the AI generates information that is misleading or entirely false, often referred to as 'hallucinations'. The discussion emphasizes the need for a 'trust but verify' approach, urging users to critically evaluate AI outputs rather than accepting them at face value.

Intro

6min

Navigating Cognitive Bias in AI Communication

18min

Navigating Cognitive Bias in AI Development

3min

Understanding Cognitive Bias in AI Models

3min

Navigating Cognitive Bias in AI Decision Making

4min

Training data is biased. Humans are flawed. Which is a major reason AI can fail – cognitive bias. Anatoly Shilman, CEO of Cogbias AI, joins us as we chat about what cognitive bias is in AI, why it's important, and what we can all do about it.

Newsletter: Sign up for our free daily newsletter
More on this Episode: Episode Page
Join the discussion: Ask Jordan and Anatoly questions on AI bias

Upcoming Episodes: Check out the upcoming Everyday AI Livestream lineup
Website: YourEverydayAI.com
Email The Show: info@youreverydayai.com
Connect with Jordan on LinkedIn

Topics Covered in This Episode:
1. Understanding Cognitive Bias
2. Cognitive Bias in AI Models
3. Training Data and Model Development
4. Future of AI and Managing Bias

Timestamps:
02:00 Daily AI News
06:16 Cognitive Bias Mitigation Platform
08:50 AI Enthusiasm vs. Cautionary Tales
12:48 AI Bias Stems from Human Bias
16:14 Influence of System Prompts on Bias
19:46 AI Information Parsing Challenges
20:56 AI Training and Labeling Challenges
24:05 "Achieve AI Success with Expertise"
28:23 Bias and Diversity in AI Models
31:33 Addressing Cognitive Bias in Data

Keywords:
Cognitive bias, AI failure, large language models, ChatGPT, Gemini, Copilot, Claude, bias reflection, AI news, AI sales tools, Microsoft, Salesforce, Microsoft 365 Copilot, Sales Agent, Sales Chat, Google, AI mode, Google One AI Premium, Gemini 2.0, OpenAI, AI agents, enterprise automation tools, confirmation bias, heuristic, framing bias, hallucination, training data, model perception, data labeling, reasoning models, agentic environments.

Send Everyday AI and Jordan a text message. (We can't reply back unless you leave contact info)

Ready for ROI on GenAI? Go to youreverydayai.com/partner

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more