Deep Papers cover image

Hungry Hungry Hippos - H3

Deep Papers

00:00

Introduction

Trie Dao and Dan Fu are computer science graduate students at Stanford. They're the authors behind the H3 paper, Hungry Hungry Hippos. It's a novel language modeling architecture that performs similarly if not better to transformers but has very impressive context length scaling properties.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app