

38.2 - Jesse Hoogland on Singular Learning Theory
Nov 27, 2024
Jesse Hoogland, executive director of Timaeus and researcher in singular learning theory (SLT), shares fascinating insights on AI alignment. He dives into the concept of the refined local learning coefficient (LLC) and its role in uncovering new circuits in language models. The conversation also touches on the challenges of interpretability and model complexity. Hoogland emphasizes the importance of outreach efforts in disseminating research and fostering interdisciplinary collaboration to enhance understanding of AI safety.
Chapters
Transcript
Episode notes
1 2 3 4 5
Intro
00:00 • 2min
Exploring Singular Learning Theory and Outreach Efforts
01:50 • 2min
Exploring the Outreach and Concepts of Singular Learning Theory
04:11 • 4min
Understanding Model Complexity in SLT
08:17 • 6min
Exploring Multigram Circuits and Layer Coordination in Neural Models
14:06 • 4min