The Inside View

Irina Rish–AGI, Scaling and Alignment

Oct 18, 2022

01:26:06

Creator website

Highlights

AI Chapters

Episode notes

The Race to AI Systems With Better Capabilities Is Unstoppable

01:33

How to Predict Emergent Behaviors in AI Scaling Community

01:39

Is the AI Trying to Make Humanity Into Boxes?

01:45

Introduction

5min

Is AGI a Goal?

2min

How to Develop AI in a Child?

3min

How Was Deep Learning in 2012?

2min

Gatto - A Big Update for You?

4min

Is It Better to Build Generalist Agent or Not to Fine-Tune?

2min

Is AGI Forecasting Really Possible?

2min

What I Don't Expect to See in Five Years?

3min

Adaptive Models of Network Behavior

2min

10.

Scaling With the Data Is Not Just Power Law

3min

11.

Neural Scaling Laws Workshop

5min

12.

How Much Transfer Is Possible?

2min

13.

AI Alignment and Scaling Laws Workshop

2min

14.

The Race to AI Systems With Better Capabilities Is Unstoppable

2min

15.

AI Alignment and Scaling

6min

16.

AI Parenting for AI Alignment

2min

17.

Is It Better to Be Moral?

4min

18.

Will We Have a Multi-Agent AI?

2min

19.

Is the AI Trying to Make Humanity Into Boxes?

2min

20.

The Side Effects of Artificial Intelligence (AI)

2min

21.

The Loss-Lanscape

4min

22.

Using Functional Forms to Capture Nonlinearities?

2min

23.

How to Predict Emergent Behaviors in AI Scaling Community

2min

24.

Continuous Learning

2min

25.

How Much Scale Do You Need to Scale Both Data and the Model Size to Solve Continuous Learning?

3min

26.

Continual Learning

2min

27.

Is There a Human Behind the Model?

2min

28.

Doom Question

2min

29.

The Probability of Humanity Going Extinct

2min

30.

AI or AGI Good?

2min

31.

Will AGI Be Built ByDefault?

2min

32.

Are You Interested in Scaling and Alignment?

2min

33.

Will You Still Be Able to Study Scaling?

3min

34.

Is There Something That Can Change?

2min

35.

Is There a Bottleneck in Deep Learning?

2min

36.

Neural Scaling Workshop at New Reaps on December 2nd

3min

Irina Rish a professor at the Université de Montréal, a core member of Mila (Quebec AI Institute), and the organizer of the neural scaling laws workshop towards maximally beneficial AGI.

In this episode we discuss Irina's definition of Artificial General Intelligence, her takes on AI Alignment, AI Progress, current research in scaling laws, the neural scaling laws workshop she has been organizing, phase transitions, continual learning, existential risk from AI and what is currently happening in AI Alignment at Mila.

Transcript: theinsideview.ai/irina

Youtube: https://youtu.be/ZwvJn4x714s

OUTLINE

(00:00) Highlights

(00:30) Introduction

(01:03) Defining AGI

(03:55) AGI means augmented human intelligence

(06:20) Solving alignment via AI parenting

(09:03) From the early days of deep learning to general agents

(13:27) How Irina updated from Gato

(17:36) Building truly general AI within Irina's lifetime

(19:38) The least impressive thing that won't happen in five years

(22:36) Scaling beyond power laws

(28:45) The neural scaling laws workshop

(35:07) Why Irina does not want to slow down AI progress

(53:52) Phase transitions and grokking

(01:02:26) Does scale solve continual learning?

(01:11:10) Irina's probability of existential risk from AGI

(01:14:53) Alignment work at Mila

(01:20:08) Where will Mila get its compute from?

(01:27:04) With Great Compute Comes Great Responsibility

(01:28:51) The Neural Scaling Laws Workshop At NeurIPS

Get the Snipd
podcast app

Unlock the knowledge in podcasts with the podcast player of the future.

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

Save any
moment

Hear something you like? Tap your headphones to save it with AI-generated key takeaways

Share
& Export

Send highlights to Twitter, WhatsApp or export them to Notion, Readwise & more

AI-powered
podcast player

Listen to all your favourite podcasts with AI-powered features

Discover
highlights

Listen to the best highlights from the podcasts you love and dive into the full episode

The Inside View

Irina Rish–AGI, Scaling and Alignment

The Race to AI Systems With Better Capabilities Is Unstoppable

How to Predict Emergent Behaviors in AI Scaling Community

Is the AI Trying to Make Humanity Into Boxes?

Get the Snipdpodcast app

AI-poweredpodcast player

Discoverhighlights

Save anymoment

Share& Export

AI-poweredpodcast player

Discoverhighlights

Get the Snipd
podcast app

AI-powered
podcast player

Discover
highlights

Save any
moment

Share
& Export

AI-powered
podcast player

Discover
highlights