5min chapter

"Moment of Zen"  cover image

E16: AI open letter debate, "pausers", and what we're all scared of with AI with Anton Troynikov, Flo Crivello, and Nathan Labenz

"Moment of Zen"

CHAPTER

The Dangers of a Moratorium on ASI

I try to distinguish as much as possible the two questions of is it dangerous on the one hand and should we do anything about it on the other hand. I've seen nothing here that gives me optimism so even though I understand his concerns I'm like look man you've been working on this for 20 years why do you want six more months by the way? The people who were pursuing this kind of a gente glens on alignment were taken completely by surprise by the thing that GPT is these generative text models which don't which are not optimized to any goal in particular at all. There's tons of incentives here to defect we had better develop better levers, he says.

00:00

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.
App store bannerPlay store banner

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode