Machine Learning Street Talk (MLST) cover image

Machine Learning Street Talk (MLST)

Sayash Kapoor - How seriously should we take AI X-risk? (ICML 1/13)

Jul 28, 2024
Sayash Kapoor, a Ph.D. candidate at Princeton, dives deep into the complexities of assessing existential risks from AI. He argues that the reliability of probability estimates can mislead policymakers, drawing parallels to other fields of risk assessment. The discussion critiques utilitarian approaches in decision-making and the challenges with cognitive biases. Kapoor also highlights concerns around AI's rapid growth, pressures on education, and workplace dynamics, emphasizing the need for informed policies that balance technological advancement with societal impact.
49:42

Episode guests

Podcast summary created with Snipd AI

Quick takeaways

  • Governments are urged to take AI existential risks seriously despite the unreliable nature of risk probabilities due to speculative assessments.
  • The podcast highlights that current inductive and deductive probability estimation methods are inadequate for assessing AI risks without historical data.

Deep dives

Historical Perspective on Exponential Trends

The concept of exponential growth is often misunderstood, as exemplified by historical trends such as airplane speeds. In the late 1960s and early 1970s, the public's anticipation of space travel relied heavily on the notion that airplane speeds would continue to rise indefinitely. However, this assumption proved incorrect as speed advancements reached a saturation point, demonstrating that exponential trends can often revert to sigmoid patterns over time. Such historical insights remind us that overconfidence in continuous exponential growth can lead to significant setbacks and misconceptions.

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode