AI Voice Technology: Capabilities and Challenges

Welcome back to The FAIK Files!

In this week's episode:

• OpenAI's models are reportedly resisting human commands to shut down
• A controversial new research paper questions whether AI systems actually "think" or just create an illusion of reasoning.
• How generative AI exploits the same psychological triggers as gambling—"just one more prompt, bro!"
• Google's VEO-3 and ElevenLabs 3 are creating deepfakes so convincing they're fooling both people and detection systems.

Check out Perry's new website, ⁠⁠⁠⁠⁠⁠The Deception Project⁠⁠⁠⁠⁠⁠ and newsletter, Deceptive Minds: a newsletter about how we are fooled, how we fool ourselves, and what we can do about it. Subscribe on LinkedIn ⁠⁠⁠⁠⁠⁠https://www.linkedin.com/build-relation/newsletter-follow?entityUrn=7319922626200510464⁠⁠⁠⁠⁠⁠

Want to leave us a voicemail? Here's the magic link to do just that: ⁠⁠⁠⁠⁠⁠https://sayhi.chat/FAIK⁠⁠⁠⁠⁠⁠

You can also join our Discord server here: ⁠⁠https://faik.to/discord⁠

******* NOTES AND REFERENCES *******

OpenAI's "Skynet Moment" - The Shutdown Problem:

• Original Thread from X: https://xcancel.com/PalisadeAI/status/1926084635903025621
• Article from ComputerWorld: https://www.computerworld.com/article/3999190/openais-skynet-moment-models-defy-human-commands-actively-resist-orders-to-shut-down.html
• Mason's Favorite Video about the "Stop Button" problem: https://www.youtube.com/watch?v=3TYT1QfdfsM

Apple's "Illusion of Thinking" Research Paper:

• Apple Research Paper: https://machinelearning.apple.com/research/illusion-of-thinking
• Nate Jones' nuanced take: https://www.youtube.com/watch?v=I9tYAvjkOQk
• Wes Roth's similarly nuanced take (with an experiment): https://www.youtube.com/watch?v=LVJem2iLKZ8

AI & Gambling Addiction - "Just One More Prompt":

• Pivot To AI Blog: https://pivot-to-ai.com/2025/06/05/generative-ai-runs-on-gambling-addiction-just-one-more-prompt-bro/
• Bonus - Fake AI Startups Exposed: https://www.peoplemattersglobal.com/news/technology/fake-ai-startups-founder-charged-for-fraudulent-ai-app-powered-by-human-labour-45154
• https://infosecwriteups.com/the-billion-dollar-ai-lie-how-builder-ai-faked-growth-fooled-investors-and-got-caught-3af1464a5ffe

Google VEO-3 and ElevenLabs 3 - The New Era of Synthetic Media:

• Perry's LinkedIn post about TikTok deepfakes: https://www.linkedin.com/feed/update/urn:li:activity:7338301239539003393/
• CNN Interview: https://www.cnn.com/2025/05/15/business/video/deepfake-detector-fooled-isabel-rosales-digvid
• Perry's Google VEO 3 experiment: The Sandwich Incident: https://www.youtube.com/watch?v=DvsFm1XII6U
• ElevenLabs v3: https://elevenlabs.io/blog/v3-audiotags

******* THE BOILERPLATE *******

About The FAIK Files:

The FAIK Files is an offshoot project from Perry Carpenter's most recent book, FAIK: A Practical Guide to Living in a World of Deepfakes, Disinformation, and AI-Generated Deceptions.

• Get the Book: ⁠⁠⁠FAIK: A Practical Guide to Living in a World of Deepfakes, Disinformation, and AI-Generated Deceptions⁠⁠⁠ (Amazon Associates link)
• Check out the website for more info: ⁠⁠⁠https://thisbookisfaik.com⁠⁠⁠

Check out Perry & Mason's other show, the Digital Folklore Podcast:

• Apple Podcasts: ⁠⁠⁠https://podcasts.apple.com/us/podcast/digital-folklore/id1657374458⁠⁠⁠
• Spotify: ⁠⁠⁠https://open.spotify.com/show/2v1BelkrbSRSkHEP4cYffj?si=u4XTTY4pR4qEqh5zMNSVQA⁠⁠⁠

Want to connect with us? Here's how:

Connect with Perry:

• Perry on LinkedIn: ⁠⁠⁠https://www.linkedin.com/in/perrycarpenter⁠⁠⁠
• Perry on X: ⁠⁠⁠https://x.com/perrycarpenter⁠⁠⁠
• Perry on BlueSky: ⁠⁠⁠https://bsky.app/profile/perrycarpenter.bsky.social⁠⁠⁠

Connect with Mason:

• Mason on LinkedIn: ⁠⁠⁠https://www.linkedin.com/in/mason-amadeus-a853a7242/⁠⁠⁠
• Mason on BlueSky: ⁠⁠⁠https://bsky.app/profile/wickedinterest.ing⁠

Learn more about your ad choices. Visit megaphone.fm/adchoices