Robert Lange on NN Pruning and Collective Intelligence
Machine Learning Street Talk (MLST)
00:00
Pruning and Lottery Tickets in Neural Networks
This chapter explores the concept of pruning in neural networks, highlighting how it accelerates learning by focusing on relevant data. The conversation includes the innovative idea of 'super masks' and the implications of training techniques like binary masks and lottery tickets. Additionally, it discusses the complexities of neural network training dynamics, generalization across tasks, and the philosophical aspects of these approaches.
Transcript
Play full episode
