Hungry Hungry Hippos

1

Introduction

00:00 • 3min

2

Can We Use State-Based Models in Language Modeling?

02:52 • 2min

3

Using State-Spaced Models in Language Modeling

05:19 • 3min

4

Using State Space Models in Machine Learning

07:57 • 2min

5

Using State Space Models to Model Long Sequences

10:23 • 3min

6

Can SSMs Do More Than Transformers?

13:19 • 3min

7

Can You Recall a Token?

16:37 • 2min

8

Is Hippo Campus a Good Idea?

18:14 • 2min

9

Hungry Hippos - What Are the High Level Ideas Behind This H3 Layer?

20:41 • 3min

10

Using Multiplier Interactions in RNN Modeling

23:14 • 2min

11

How Do You Measure the Extentivity of a Toy Task?

25:30 • 3min

12

H Three Language Models

28:25 • 3min

13

Is the Attention Layers Losing the Long Context Scaling Properties?

31:04 • 3min

14

Are Attention Layers Doing Great Things?

33:36 • 3min

15

What Are Some Product Applications?

36:13 • 3min

16

Is There a Future for AI Workflows?

39:00 • 3min

Hungry Hungry Hippos - H3