"Moment of Zen"  cover image

AI open letter debate, "pausers", and what we're all scared of with AI with Anton Troynikov, Flo Crivello, and Nathan Labenz

"Moment of Zen"

CHAPTER

The Dangers of a Moratorium on ASI

I try to distinguish as much as possible the two questions of is it dangerous on the one hand and should we do anything about it on the other hand. I've seen nothing here that gives me optimism so even though I understand his concerns I'm like look man you've been working on this for 20 years why do you want six more months by the way? The people who were pursuing this kind of a gente glens on alignment were taken completely by surprise by the thing that GPT is these generative text models which don't which are not optimized to any goal in particular at all. There's tons of incentives here to defect we had better develop better levers, he says.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner