Episode 28: LLMs Are Not Human Subjects, March 4 2024

Mar 13, 2024

Alex and Emily discuss the use of large language models in social science research, critiquing the idea of replacing human subjects with LLMs. They explore algorithmic bias, concerns about monetizing text data, AI events gone wrong, fake quotes in news, and the impact of deep fakes on election integrity.

Ask episode

Chapters

Transcript

Episode notes

Introduction

00:00 • 2min

Comparison of Chat GPT to Crowd Workers for Text Annotation Tasks

01:32 • 13min

Exploring the Use of Language Models in Social Science Research

14:15 • 13min

Exploring Algorithmic Bias and Model Decomposition

26:55 • 23min

Ethical Concerns and Rush to Monetize Text Data

49:33 • 2min

AI Event Gone Wrong & Fake Quotes in News

51:51 • 6min

Navigating Election Misinformation and Deep Fakes in the Age of AI

57:57 • 3min