AXRP - the AI X-risk Research Podcast cover image

22 - Shard Theory with Quintin Pope

AXRP - the AI X-risk Research Podcast

CHAPTER

The Importance of Singular Learning Theory in Deep Learning

Singular learning theory is independent of specific local optimizers so it's just like basically accounting based argument about how many internal configurations does the system have that produce a given behavior. The noise based inductive bias towards flat basins is a thing on top of singular learning theory and other stochastic optimization methods such as SGD.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner