Eric Michaud on scaling, grokking and quantum interpretability
The Inside View
00:00
The Quantum Interpretability of Scaling Exponents
Eric: I thought this was useful to put out because like if it was true then like it would be very exciting. And just to be clear when you talk about like scaling exponents for parameters and like like data set size etc. We're talking about the sharpness of the straight line in a low block right. Yeah, it's the slope of the power law in the log log plot. So maybe maybe the discovery of the of the quanta in scaling is triggers and you feel the quantum interpretability. See you in the next book.
Transcript
Play full episode
