Bias in A.I. and the Risks of Continued Development, with Dr. Joy Buolamwini
Dec 4, 2023
auto_awesome
Dr. Joy Buolamwini, computer scientist, warns about A.I. writing biases into algorithms and how it can regress civil rights progress. They discuss biases in AI, the coded gaze, harm caused by AI systems, and biases in facial recognition. They explore the risks of facial recognition in surveillance, policing, and weapons and the need for federal protections.
AI systems consistently fail to accurately detect darker-skinned individuals, leading to discriminatory outcomes, highlighting the need for more equitable data collection and rigorous testing to mitigate bias in AI technologies.
Federal regulations are necessary to enforce protections against algorithmic discrimination and ensure the safety and efficacy of AI systems, preventing discrepancies in AI regulation across different states and cities.
Deep dives
Bias in AI and Tech Products
Dr. Joy Bolamwini, a computer scientist and founder of the Algorithmic Justice League, discusses her research on bias in AI and tech products. She reveals how facial recognition systems consistently fail to accurately detect darker-skinned individuals, leading to discriminatory outcomes. She emphasizes the importance of examining the intersectionality of race and gender to understand biases in AI systems. The discussion highlights the need for more equitable data collection and rigorous testing to mitigate bias in AI technologies.
The Coded Gaze and AI Ethical Responsibility
Dr. Bolamwini introduces the concept of the coded gaze, drawing on concepts like the male gaze and white gaze, to emphasize who has the power to shape AI technologies and whose priorities and prejudices are embedded in them. She explains that while bias elimination may not be completely feasible, bias mitigation is possible through rigorous testing, equitable data collection, and questioning the societal impacts of AI. The conversation also touches upon AI's ethical responsibility in contexts such as war and surveillance.
Concerns about Privacy, Financial Bias, and International Implications
The podcast explores concerns about privacy issues related to facial recognition technology, particularly in the context of borders, migration, and financial sectors. Dr. Bolamwini highlights instances where AI systems amplify discrimination in mortgage approvals and calls for more awareness and regulation to prevent bias in financial products and services. The discussion includes references to AI's international implications, such as its use in warfare, the dehumanization caused by removing responsibility through automated systems, and the need for federal and state-level laws to protect individuals from algorithmic discrimination.
The Need for Federal Regulations and State-Level Laws
Dr. Bolamwini stresses the insufficiency of voluntary commitments and self-regulation by tech companies. She highlights the importance of federal regulations that enforce protections against algorithmic discrimination and ensure the safety and efficacy of AI systems. The podcast examines the impact of state-level laws, such as Illinois' Biometric Information Privacy Act, in deterring companies from violating privacy rights. It emphasizes the need for comprehensive protections at the federal level to prevent discrepancies in AI regulation across different states and cities.
This week on Notes from America, host Kai Wright talks with Dr. Joy Buolamwini, a computer scientist who uses art and research to illuminate the social implications of artificial intelligence. The self-described “poet of code” warns that A.I. could write the biases of today’s world into algorithms and even regress the progress of U.S. civil rights in everything from medicine to loan applications and police surveillance. Kai and Dr. Buolamwini take calls about listener fears around A.I. and address which concerns we should focus on. Plus, she shares her latest poem on the implications of A.I. in war as the crisis in the Middle East continues.
Tell us what you think. Instagram and X (Twitter):@noteswithkai. Email us atnotes@wnyc.org. Send us a voice message by recording yourself on your phone and emailing us, orrecord one here.
Notes from America airs live on Sundays at 6 p.m. ET. The podcast episodes are lightly edited from our live broadcasts.
Tell us what you think. We're @noteswithkai on Instagram and X (Twitter). Email us at notes@wnyc.org. Send us a voice message by recording yourself on your phone and emailing us, or record one here.
Notes from America airs live on Sundays at 6 p.m. ET. The podcast episodes are lightly edited from our live broadcasts.
Get the Snipd podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share & Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered podcast player
Listen to all your favourite podcasts with AI-powered features
Discover highlights
Listen to the best highlights from the podcasts you love and dive into the full episode