The Dangers of Regulatory Chatbots

3min Snip

00:00

Play full episode

Summary

Transcript

Episode notes

CNN's John Sutter talks about the potential dangers of chatbot technology. He says we need to set standards for what these machines say and how they're used. The tech industry doesn't want that, but it can get away with things if there are no rules in place, he says.Sutter: I don't waste my time reading synthetic text; why should I even engage with them?

Paris Marx is joined by Emily M. Bender to discuss what it means to say that ChatGPT is a “stochastic parrot,” why Elon Musk is calling to pause AI development, and how the tech industry uses language to trick us into buying its narratives about technology.

Emily M. Bender is a professor in the Department of Linguistics at the University of Washington and the Faculty Director of the Computational Linguistics Master’s Program. She’s also the director of the Computational Linguistics Laboratory. Follow Emily on Twitter at @emilymbender or on Mastodon at @emilymbender@dair-community.social.

Tech Won’t Save Us offers a critical perspective on tech, its worldview, and wider society with the goal of inspiring people to demand better tech and a better world. Follow the podcast (@techwontsaveus) and host Paris Marx (@parismarx) on Twitter, and support the show on Patreon.

The podcast is produced by Eric Wickham and part of the Harbinger Media Network.

Also mentioned in this episode:

Emily was one of the co-authors on the “On the Dangers of Stochastic Parrots” paper and co-wrote the “Octopus Paper” with Alexander Koller. She was also recently profiled in New York Magazine and has written about why policymakers shouldn’t fall for the AI hype.
The Future of Life Institute put out the “Pause Giant AI Experiments” letter and the authors of the “Stochastic Parrots” paper responded through DAIR Institute.
Zachary Loeb has written about Joseph Weizenbaum and the ELIZA chatbot.
Leslie Kay Jones has researched how Black women use and experience social media.
As generative AI is rolled out, many tech companies are firing their AI ethics teams.
Emily points to Algorithmic Justice League and AI Incident Database.
Deborah Raji wrote about data and systemic racism for MIT Tech Review.
Books mentioned: Weapons of Math Destruction by Cathy O'Neil, Algorithms of Oppression by Safiya Noble, The Age of Surveillance Capitalism by Shoshana Zuboff, Race After Technology by Ruha Benjamin, Ghost Work by Mary L Gray & Siddharth Suri, Artificial Unintelligence by Meredith Broussard, Design Justice by Sasha Costanza-Chock, Data Conscience: Algorithmic S1ege on our Hum4n1ty by Brandeis Marshall.