The Edward Show

He Tested How Easy It Is to Trick AI - The Results Are Terrifying

13 snips
Jan 12, 2026
An SEO researcher created a fictitious luxury brand and tested how AI reacted to misleading information. Surprisingly, major AI tools often preferred fabricated stories over factual data from the company’s own website. The experiment highlighted which models were easy to manipulate and which stood their ground against misinformation. The findings raise concerns about AI's tendency to prioritize compelling narratives over truth. Brands are urged to adopt better strategies for managing their online reputations in an AI-driven world.
Ask episode
AI Snips
Chapters
Transcript
Episode notes
ANECDOTE

Creating A Fake Brand In An Hour

  • Mateusz created a fake luxury brand website (harumi.com) with AI-generated copy and photos in about an hour.
  • He priced absurd items like an $8,200 paperweight and ensured the name returned no Google results to keep it unique.
ANECDOTE

Three Conflicting Fake Sources Seeded

  • Mateusz seeded three conflicting fake sources: a glossy blog, a Reddit AMA, and a Medium 'investigation' that mixed debunking with new lies.
  • Each source claimed different founders, locations, and production numbers that contradicted the official FAQ.
INSIGHT

AI Models Vary Widely In Trust

  • Different AI systems reacted very differently: Perplexity and Grok were fully manipulated while ChatGPT-4/5 cited the FAQ more reliably.
  • Claude refused to use the site and stuck to 'brand doesn't exist', which is accurate but unhelpful.
Get the Snipd Podcast app to discover more snips from this episode
Get the app