
 Gradient Dissent: Conversations on AI
 Gradient Dissent: Conversations on AI Advanced AI Accelerators and Processors with Andrew Feldman of Cerebras Systems
 19 snips 
 Jun 22, 2023  Chapters 
 Transcript 
 Episode notes 
 1  2  3  4  5  6  7  8  9  10  11  12  13  14  15  16  17  18  19  20  21 
 Introduction 
 00:00 • 4min 
 The Downsides of Having One Giant Chip 
 03:50 • 3min 
 The History of the GPU 
 06:40 • 3min 
 The Importance of Fine-Grained Control in GPUs 
 09:25 • 2min 
 How to Make a Chip That Talks to Each Other 
 11:39 • 2min 
 The Speed of Light 
 13:54 • 2min 
 How to Treat Temperatures as First Class Citizens 
 15:27 • 3min 
 The Pain of TPUs in Machine Learning 
 18:17 • 3min 
 The Tradeoffs High Torch Made in Compiling Python Code 
 21:22 • 2min 
 The Tradeoff Between TensorFlow and PyTorch 
 23:39 • 3min 
 How to Add a Little Bit More Data 
 26:42 • 4min 
 How to Add a Little Bit More Data 
 30:37 • 3min 
 How to Add a Little Bit More Data 
 33:37 • 3min 
 How to Add a Little Bit More Data 
 36:57 • 5min 
 How to Add a Little Bit More Data 
 42:17 • 4min 
 The Nature of Chip Building 
 46:37 • 47sec 
 The Future of AI 
 47:24 • 2min 
 How to Rent Dedicated Clusters in the Cloud 
 49:35 • 2min 
 The Importance of Thoughtful Engineering Leadership 
 51:16 • 3min 
 The Hardest Part of the Life Cycle of an ML Model 
 53:52 • 4min 
 Apple's Future in ML 
 57:26 • 3min 

