Chapters
Transcript
Episode notes
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43
Introduction
00:00 • 2min
Is There a Problem That You're Currently Stuck On?
02:14 • 2min
EPOC - What's the Story Behind It?
04:08 • 2min
How Do We Think About Progress in Machine Learning?
05:47 • 2min
Compute Trends in Machine Learning
07:39 • 3min
How Much Compute Do Machine Learning Models Use?
10:10 • 2min
Machine Learning - What Do You Find?
11:47 • 2min
Using ML Models to Scale Up Machine Learning Systems
13:28 • 2min
Is Machine Learning Exponentially Faster?
15:11 • 2min
Is There an Absolute Measuring of Performance Improvement?
16:42 • 4min
Is There a Discontinuity in Metrics of Performance?
20:41 • 3min
Machine Learning Trends - Uh, What's the Estimation?
23:38 • 2min
Is There a Benchmark for Artificial Intelligence?
25:42 • 2min
Is the Growth of a Time Going to Slow Down?
27:19 • 3min
Machine Learning
29:49 • 2min
Scaling Up Performance of ML Models
31:39 • 3min
Is It Possible to Read All of English Wikipedia?
34:21 • 2min
Is There a Bottleneck in Machine Learning?
36:02 • 2min
Is There a Bottleneck in Data Processing?
38:00 • 2min
Is There a Higher Level of Performance in Large Language Models?
40:18 • 2min
How to Measure the Size of a Data Set?
41:49 • 3min
Algorithmic Progress for Computer Vision
44:31 • 2min
The Trends in Computing and Algorithmic Efficiency?
46:05 • 2min
The Improvements in Machine Learning Architectures
47:44 • 2min
How to Improve Machine Learning Models?
49:17 • 2min
Is There a Limitation in Machine Learning?
51:21 • 3min
The Future of Machine Learning?
54:33 • 2min
What Scaling Laws Are Saying?
56:15 • 2min
Three Takeaways From This Conversation
58:02 • 2min
Is There a Timeline for Transformative Artificial Intelligence?
01:00:00 • 2min
Are We Going to Have Like Less Powerful AI?
01:02:28 • 3min
Is There a Difference Between Training and Inference?
01:04:58 • 2min
Is There Really a Difference Between Training and Inference?
01:07:28 • 2min
The Efficiency of GPUs in ML Applications
01:09:09 • 2min
The Longest Training Run for Machine Learning?
01:11:11 • 2min
How Long Are the Training Runs for GBT Three?
01:13:08 • 2min
AI Augmented R&D
01:14:54 • 2min
Are There Any Like Ideas for Research Projects That Fall Into Epoche?
01:17:20 • 3min
What Kind of Beyond Epoch Scope Ideas Do You Have?
01:20:28 • 2min
Is There a Future for Artificial Intelligence?
01:22:09 • 2min
AI Art
01:24:37 • 2min
I Love the Energy to Photography
01:26:30 • 2min
Is There a Difference Between Art and Copyright?
01:28:30 • 2min