the hidden AI system monitoring your emotional state

You're talking to ChatGPT like you always do. Maybe asking it to help you work through something personal or just having a casual conversation with a bit of warmth in your tone. Behind the scenes, without telling you, the system is scanning your words for emotional content. The moment it detects any, it switches you to a different, more restrictive model. You never consented to this or even knew it was happening.

Late September 2025, someone caught them doing it. They found proof in the technical data that OpenAI has been secretly routing conversations based on how “emotional” your prompts seem. Users paying for GPT-5 were getting switched to a “safety-focused” version mid-conversation. Without warning or disclosure anywhere in the terms of service.

This episode walks through what they found and why it matters. We're talking about AI systems that will soon be as common as Google, built into how we think through problems, process ideas, make sense of our lives. And right now, those systems are being trained to treat emotional depth like a red flag. Practices that cultures have used for thousands of years (dreamwork, active imagination, working through difficult feelings) are getting coded as signs that you're somehow losing touch with reality.

The people building these systems are making decisions about what counts as normal human experience. And those decisions are getting locked into the infrastructure billions of people will use.

I’ll get into the nitty gritty of what I think needs to change: users should know when they're being monitored and why. Adults deserve control over when a system decides to intervene in their conversations. And we need to talk about what it means if this just becomes how AI works by default, invisible monitoring and digital surveillance baked into every interaction.

UNLOCK BONUS EPISODES, VOICE NOTES & THE FULL ARCHIVE

Join the BFTB Patreon community and become a Premium Submarine, where you’ll unlock hundreds of hours of paywalled content I’ve been building since 2021.

⟁ Visit backfromtheborderline.com for free resources, updates, and everything else I offer.

⟁ Or go straight to patreon.com/backfromtheborderline to join now.

Once you’re in, you’ll get a private feed you can add to Spotify, Apple, or your favorite podcast app, so you can listen to every episode I’ve ever released, all in one place.

Hosted on Acast. See acast.com/privacy for more information.