Illicit, sexually explicit deepfakes are becoming a problem in schools
Oct 29, 2024
auto_awesome
Elizabeth Laird, Director of Equity in Civic Technology at the Center for Democracy and Technology, dives into the troubling rise of non-consensual deepfakes in schools. She discusses how generative AI is being improperly used by high school students to create explicit content, raising significant concerns for both victims and perpetrators. The conversation highlights the critical need for educational institutions to enhance policies, improve communication with parents, and educate students about digital citizenship to combat this growing crisis.
Generative AI tools are being misused by high school students to create non-consensual deepfakes, leading to significant peer victimization, especially among female students.
Schools struggle to address the deepfake issue effectively, focusing more on punishment than on prevention and support for affected victims.
Deep dives
The Rise of Non-Consensual Deepfakes in Schools
Generative AI tools, while offering innovative solutions, are being misused among high school students to create non-consensual intimate imagery, known as deepfakes. Approximately 39% of surveyed students acknowledged encountering an NCI, with 15% reporting firsthand knowledge of such images being shared. The issue is particularly troubling as it predominantly involves students both creating and being depicted in these deepfakes, highlighting a concerning trend of peer victimization. Female students are disproportionately affected, comprising a significant majority of those depicted in these harmful images.
School Responses and Parental Awareness
Schools face challenges in effectively addressing the deepfake problem, as most existing policies focus primarily on punishment rather than prevention and support for victims. Despite being legally obligated to foster a harassment-free environment, only a small percentage of schools provide resources for victims to remove harmful content from social media. Parents, while eager to educate their children about the dangers, often lack awareness of the prevalence and impacts of deepfakes in their local schools, indicating a disconnect in communication. It is crucial for parents to proactively engage with schools about prevention efforts and to speak with their children about the serious consequences associated with sharing or creating these images.
We know from various studies that young people are, unsurprisingly, using generative AI tools like chatbots and image generators, sometimes for homework, sometimes for fun and sometimes for malicious purposes. A recent survey from the Center for Democracy and Technology found that artificial intelligence is being used among high school students to create nonconsensual, illicit imagery — in other words, sexually explicit deepfakes. Marketplace’s Meghan McCarty Carino spoke with Elizabeth Laird, director of equity in civic technology at CDT, to learn more.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode