Hear This Idea

#60 – Jaime Sevilla on Trends in Machine Learning

14 snips
Mar 15, 2023
Ask episode
Chapters
Transcript
Episode notes
1
Introduction
00:00 • 2min
2
Is There a Problem That You're Currently Stuck On?
02:14 • 2min
3
EPOC - What's the Story Behind It?
04:08 • 2min
4
How Do We Think About Progress in Machine Learning?
05:47 • 2min
5
Compute Trends in Machine Learning
07:39 • 3min
6
How Much Compute Do Machine Learning Models Use?
10:10 • 2min
7
Machine Learning - What Do You Find?
11:47 • 2min
8
Using ML Models to Scale Up Machine Learning Systems
13:28 • 2min
9
Is Machine Learning Exponentially Faster?
15:11 • 2min
10
Is There an Absolute Measuring of Performance Improvement?
16:42 • 4min
11
Is There a Discontinuity in Metrics of Performance?
20:41 • 3min
12
Machine Learning Trends - Uh, What's the Estimation?
23:38 • 2min
13
Is There a Benchmark for Artificial Intelligence?
25:42 • 2min
14
Is the Growth of a Time Going to Slow Down?
27:19 • 3min
15
Machine Learning
29:49 • 2min
16
Scaling Up Performance of ML Models
31:39 • 3min
17
Is It Possible to Read All of English Wikipedia?
34:21 • 2min
18
Is There a Bottleneck in Machine Learning?
36:02 • 2min
19
Is There a Bottleneck in Data Processing?
38:00 • 2min
20
Is There a Higher Level of Performance in Large Language Models?
40:18 • 2min
21
How to Measure the Size of a Data Set?
41:49 • 3min
22
Algorithmic Progress for Computer Vision
44:31 • 2min
23
The Trends in Computing and Algorithmic Efficiency?
46:05 • 2min
24
The Improvements in Machine Learning Architectures
47:44 • 2min
25
How to Improve Machine Learning Models?
49:17 • 2min
26
Is There a Limitation in Machine Learning?
51:21 • 3min
27
The Future of Machine Learning?
54:33 • 2min
28
What Scaling Laws Are Saying?
56:15 • 2min
29
Three Takeaways From This Conversation
58:02 • 2min
30
Is There a Timeline for Transformative Artificial Intelligence?
01:00:00 • 2min
31
Are We Going to Have Like Less Powerful AI?
01:02:28 • 3min
32
Is There a Difference Between Training and Inference?
01:04:58 • 2min
33
Is There Really a Difference Between Training and Inference?
01:07:28 • 2min
34
The Efficiency of GPUs in ML Applications
01:09:09 • 2min
35
The Longest Training Run for Machine Learning?
01:11:11 • 2min
36
How Long Are the Training Runs for GBT Three?
01:13:08 • 2min
37
AI Augmented R&D
01:14:54 • 2min
38
Are There Any Like Ideas for Research Projects That Fall Into Epoche?
01:17:20 • 3min
39
What Kind of Beyond Epoch Scope Ideas Do You Have?
01:20:28 • 2min
40
Is There a Future for Artificial Intelligence?
01:22:09 • 2min
41
AI Art
01:24:37 • 2min
42
I Love the Energy to Photography
01:26:30 • 2min
43
Is There a Difference Between Art and Copyright?
01:28:30 • 2min