Mystery AI Hype Theater 3000

Episode 13: Beware The Robo-Therapist (feat. Hannah Zeavin), June 8 2023

Sep 7, 2023

UC Berkeley scholar Hannah Zeavin discusses the National Eating Disorders Association's decision to replace their helpline with a chatbot, the history and significance of suicide hotlines, the importance of training for crisis support volunteers, workplace toxicity and the threat of job replacement, ethical concerns of sharing data with a for-profit, and the hype around AI services and concerns about relying on chatbots for financial advice.

01:00:53

Episode guests

Hannah Zeavin

AI Summary

Highlights

AI Chapters

Episode notes

Podcast summary created with Snipd AI

Quick takeaways

The datafication and automation of mental health services can disproportionately affect vulnerable populations.

The use of chat GPT in evaluating book submissions can lead to gatekeeping and exclusion of marginalized voices.

Relying solely on AI technology in legal proceedings can be risky as AI-generated citations may be rejected as fake.

Deep dives

Yokosuka city adopts chat GPT in administrative operations

The city of Yokosuka has officially adopted chat GPT in administrative operations after a successful trial period. It has been reported that the use of chat GPT has improved work efficiency and shortened business hours.

Exploring the Growth and Concerns of Crisis Text Line

03:10

Union Busting, Workplace Toxicity, and the Threat of Job Replacement

01:42

Introduction

2min

Replacing a helpline with a chatbot: The impact of automation in mental health care

4min

The History and Significance of Suicide Hotlines

7min

Training for Crisis Support Volunteers

15min

Union Busting, Workplace Toxicity, and the Threat of Job Replacement

2min

Ethical Concerns of Sharing Data with a For-Profit

20min

AI Hype, Adoption in Yokosuka, and Fake Precedent

10min

Emily and Alex talk to UC Berkeley scholar Hannah Zeavin about the case of the National Eating Disorders Association helpline, which tried to replace human volunteers with a chatbot--and why the datafication and automation of mental health services are an injustice that will disproportionately affect the already vulnerable.

Content note: This is a conversation that touches on mental health, people in crisis, and exploitation.

This episode was originally recorded on June 8, 2023. Watch the video version on PeerTube.

Hannah Zeavin is a scholar, writer, and editor whose work centers on the history of human sciences (psychoanalysis, psychology, and psychiatry), the history of technology and media, feminist science and technology studies, and media theory. Zeavin is an Assistant Professor of the History of Science in the Department of History and The Berkeley Center for New Media at UC Berkeley. She is the author of, "The Distance Cure: A History of Teletherapy."

References:

VICE: Eating Disorder Helpline Fires Staff, Transitions to Chatbot After Unionization

… and then pulls the chatbot.

NPR: Can an AI chatbot help people with eating disorders as well as another human?

Psychiatrist.com: NEDA suspends AI chatbot for giving harmful eating disorder advice

Politico: Suicide hotline shares data with for-profit spinoff, raising ethical questions

Danah Boyd: Crisis Text Line from my perspective.

Tech Workers Coalition: Chatbots can't care like we do.

Slate: Who's listening when you call a crisis hotline? Helplines and the carceral system.

Hannah Zeavin:

Check out future streams at on Twitch, Meanwhile, send us any AI Hell you see.

Our book, 'The AI Con,' comes out in May! Pre-order now.

Subscribe to our newsletter via Buttondown.

Bluesky: emilymbender.bsky.social
Mastodon: dair-community.social/@EmilyMBender

Alex

Music by Toby Menon.
Artwork by Naomi Pleasure-Park.
Production by Christie Taylor.

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.

Mystery AI Hype Theater 3000

Episode 13: Beware The Robo-Therapist (feat. Hannah Zeavin), June 8 2023

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

Deep dives

Yokosuka city adopts chat GPT in administrative operations

Publisher using chat GPT to evaluate book submissions

AI-generated precedent rejected by judge

JP Morgan develops chat GPT-like investment service

Professor accuses entire class of using chat GPT

Exploring the Growth and Concerns of Crisis Text Line

Union Busting, Workplace Toxicity, and the Threat of Job Replacement

Remember Everything You Learn from Podcasts