In this discussion, AI research scientist Margaret Mitchell, linguistics professor Emily M. Bender, and Vox's Seagal Samuel examine the unsettling consequences of AI. They delve into ethics and responsibility when AI causes harm, reflecting on real-world impacts on minority populations. The trio also tackles biases in technology, the challenges of emotional complexity in AI, and the urgent need for ethical oversight. Their candid insights stress the pressing concerns over AI's future and highlight the balance between innovation and societal responsibility.
Dr. Margaret Mitchell's experience with AI revealed how inappropriate responses from systems highlight the dangers of biased training data.
The divide between ethical AI researchers and industry leaders underscores the urgent need to address current harms over sensational future risks.
Deep dives
The Journey of AI Development
Dr. Margaret Mitchell shares her experiences as a pioneer in AI research, particularly in developing language models that convert images into descriptions. During her work at Microsoft around 2013, she encountered an alarming phenomenon where her AI system, when shown a tragic sequence of images from an explosion, deemed the view 'awesome.' This led to a realization about the unexpected and often inappropriate responses from AI, which she termed the 'everything is awesome problem.' Such errors highlighted the crucial necessity of scrutinizing the training data for AI systems, as biases in this data can produce dangerously inaccurate interpretations.
The Impact of Data Bias
Both Dr. Mitchell and Dr. Joy Boulamwini found that AI systems often performed poorly in recognizing faces, especially those of Black individuals, which they attributed to biased training data. Dr. Boulamwini experienced this firsthand when facial recognition software failed to recognize her dark skin while easily identifying lighter faces, a realization that led her to investigate the prevalent 'pale male data sets.' She discovered that these datasets largely consisted of images of white men, leading to systemic inaccuracies in AI applications, such as misidentifying public figures. This inequality in AI technology poses not only social consequences but also potential dangers, particularly in critical areas like law enforcement.
The Role of AI Ethics
As discussions around AI evolved, many researchers began to prioritize ethical considerations in AI development, particularly focusing on the implications of biased datasets. The release of the 'Gender Shades' paper, authored by Dr. Boulamwini and Dr. Gebru, received significant attention for revealing the inaccuracies of commercial facial recognition technologies and their disproportionate effects on people of color. Their findings prompted major companies to re-evaluate their AI systems and led to a pause in the sale of AI products that performed poorly. This growing awareness of ethical AI highlighted how critical it is to address concerns in the technology to avoid perpetuating societal inequalities.
Contrasting Views on AI Risks
The podcast delineates a divide between those focused on ethical implications of AI and those expressing fears regarding a potential AI apocalypse, primarily driven by industry leaders like Elon Musk. Ethical researchers, including Dr. Bender, criticized this fear-mongering, arguing that it distracts from immediate and tangible harms caused by AI systems in society today. While Musk and others call for halting AI development to prevent future catastrophes, ethicists contend that the fabric of current AI systems requires urgent care and regulation to address biases and inaccuracies. This stark contrast underscores a complex landscape in AI discourse, where immediate issues may be overshadowed by hyperbolic futuristic concerns.
When a robot does bad things, who is responsible? A group of technologists sounds the alarm about the ways AI is already harming us today. Are their concerns being taken seriously?
This is the second episode of our new four-part series about the stories shaping the future of AI.
Good Robot was made in partnership with Vox’s Future Perfect team. Episodes will be released on Wednesdays and Saturdays over the next two weeks.