Exploring Legalities and Challenges of Detecting Deep Fake Abuse

2min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

Exploring the legal framework concerning child sexual abuse material, this chapter delves into the complexities of addressing computer-generated child pornography like deep fakes. The discussion emphasizes the difficulties in effectively detecting and removing illicit content, particularly in cases involving children.

Paris Marx is joined by Kat Tenbarge to discuss the proliferation of AI-generated, non-consensual sexual images, their impact on the victims, and the potential fallout for tech companies who helped make it all possible. Note there is some discussion of self-harm and suicide in this episode.

Kat Tenbarge is a tech and culture writer at NBC News.

Tech Won’t Save Us offers a critical perspective on tech, its worldview, and wider society with the goal of inspiring people to demand better tech and a better world. Support the show on Patreon.

The podcast is made in partnership with The Nation. Production is by Eric Wickham. Transcripts are by Brigitte Pawliw-Fry.

Also mentioned in this episode:

Kat has reported extensively on this issue, including stories about fake nude images of underage celebrities toping search engine results, nonconsensual deepfake porn showing up on Google and Bing too, Visa and Mastercard being used to fund the deepfake economy, and why plans for watermarking aren’t enough.
Another Body is a documentary that looks at the scale of the problem of non-consensual deepfake explicit images.
Microsoft’s Designer AI tool was used to create AI porn of Taylor Swift.
Middle and high schools in Seattle, Miami, and Beverley Hills are among those already facing the consequences of AI-generated and deepfake nude images.
In 2014, Jennifer Lawrence called the iCloud photo hack a “sex crime.”