AI-podden Breakthroughs in Efficient Deep Learning
Sep 22, 2023
Professor Mert Pilanci from Stanford University talks about his recent breakthroughs in machine learning. He discusses the challenges of training AI models, the limitations of gradient descent, and current trends in AI. He also explores different approaches to resolving deep learning issues and the potential of utilizing convex optimization for larger neural networks.
Chapters
Transcript
Episode notes
1 2 3 4 5 6
Introduction
00:00 • 3min
Training Challenges and Optimization Algorithms
02:48 • 27min
Misconceptions about the Limitations of Gradient Descent in Deep Learning
29:25 • 4min
Current Trends in AI and the Growing Use of Language Models
33:45 • 10min
Approaches to Understanding and Resolving Issues in Deep Learning
43:49 • 3min
Using Convex Optimization for Larger Neural Networks
46:39 • 3min