MC 10/16: Facebook's Ex-Counterterrorism Lead on Moderating Terrorism
Oct 16, 2023
auto_awesome
Former Policy Director for counterterrorism and dangerous organizations at Facebook/Meta, Brian Fishman, discusses the history of terrorism online, challenges for platforms moderating terrorism, and the bad incentives created by political pressure.
Terrorist organizations' ability to innovate and adapt to new technologies presents challenges for platforms in moderating terrorism.
Content moderation is complex, as platforms need to balance creating a safe environment while also considering the complexities of political expression and distinguishing it from terrorist content.
Deep dives
Terrorist organizations adapt quickly to new circumstances
Terrorist organizations can quickly adapt to changes in their online presence. They create new accounts and rebuild networks even after takedowns. They operate across platforms, using different channels to communicate. Their ability to innovate and adopt new technologies poses challenges for platforms.
Platforms' historical response to terrorism on the internet
Terrorist utilization of the internet dates back to the 1980s and has evolved alongside technological advancements. While social media platforms only started seriously addressing terrorism, specifically ISIS content, about a decade ago, earlier instances of hosting platforms taking down extremist material exist. Since then, platforms have improved in dealing with terrorism but continue to face the challenge of adapting to evolving tactics.
Challenges in content moderation: balancing terrorism and political expression
Content moderation presents challenges when it comes to distinguishing between political expression and terrorist content. Platforms need to strike a balance between creating a safe environment and not whitewashing the real world's complexities. Legitimate political discussions are intertwined with specific terrorist actions, making it harder to define what content to allow or remove. The contextual decisions involved make it a challenging task, even for well-trained humans.
Political pressure on platforms: the case of European Commission's letters
The European Commission, through its letters to large platforms concerning illegal content and disinformation, has faced criticism for exerting political pressure. The letters lack performance standards and risk incentivizing platforms to take down more content without clear guidelines. The European Commission's approach risks creating a global backlash, as it appears to target mostly American platforms and may undermine the thoughtfulness of the Digital Services Act's regulation.
Alex and Evelyn talk to Brian Fishman, the former Policy Director for counterterrorism and dangerous organizations at Facebook/Meta, about the history of terrorism online, the challenges for platforms moderating terrorism, and the bad incentives created by misguided political pressure (looking at you, EU).
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode