The Dark Patterns of AI

60sec Snip

00:00

Play full episode

Summary

Transcript

Episode notes

AI doesn't just do things, it divides and ranks them based on what is desirable and less desirable. This can be seen as an austerity machine that reproduces and scales mechanisms of austerity and per characterization. Dark patterns, which were unintentional but embedded in the system, are inseparable from AI delivery systems like Uber.

Paris Marx is joined by Dan McQuillan to discuss how AI systems encourage ranking populations and austerity policies, and why understanding their politics is essential to opposing them.

Dan McQuillan is a Lecturer in Creative and Social Computing at Goldsmiths, University of London. He’s also the author of Resisting AI: An Anti-fascist Approach to Artificial Intelligence. You can follow Dan on Twitter at @danmcquillan.

Tech Won’t Save Us offers a critical perspective on tech, its worldview, and wider society with the goal of inspiring people to demand better tech and a better world. Follow the podcast (@techwontsaveus) and host Paris Marx (@parismarx) on Twitter, and support the show on Patreon.

The podcast is produced by Eric Wickham and part of the Harbinger Media Network.

Also mentioned in this episode:

Dan wrote specifically about ChatGPT and how we should approach it on his website.
Dan mentions TWIML as a podcast that has conversations with industry players that’s informative for how these technologies work (though you’re not likely to get a critical perspective on them), and Achille Mbembe’s book Necropolitics.
OpenAI used Kenyan workers earning $2/hour to make ChatGPT less toxic.
The UK had to scrap a racist algorithm it was using for visa applications and many councils dropped the use of algorithms in their welfare and benefits systems.
Dan mentions a Human Rights Watch report on the EU’s flawed AI regulations and its impacts on the social safety net.
The Lucas Plan was developed by workers at Lucas Aerospace in the 1970s, but rejected by their bosses.