AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
3min chapter
Hungry Hungry Hippos - H3
Deep Papers
Hungry Hippos - What Are the High Level Ideas Behind This H3 Layer?
Amitai Etzioni: I just wanted to ask a little bit on kind of like maybe some of the high level idea behind this H3 layer. And I'm also curious like how did, in particular what's novel about this work? Because you do mention like other people have been using state space models to do this kind of stuff. But obviously they haven't been able to perform as well on various language benchmarks. So I'm kind of curious like what aremaybe some of the new key ingredients that you guys found and added that maybe these work so well? Yeah. The, and part of this answer will kind of explain why it's a hungry, hungry hippo and
00:00
Transcript
Episode notes
Get the Snipd
podcast app
Unlock the knowledge in podcasts with the podcast player of the future.
AI-powered
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode
Save any
moment
Hear something you like? Tap your headphones to save it with AI-generated key takeaways
Share
& Export
Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more
AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Discover
highlights
Listen to the best highlights from the podcasts you love and dive into the full episode