AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Is There a Parallel to Convolutional Nornesisid?
The work that i was describing is less focused on examining the contents of the information incoted in individual layers, though there is even more recent work ta does more of that with these more recent models. But this work takes approach, a behavior based approach, that says, art, let's just look at the model's behaviors in the task for which it was optimized and say, ar this is the fairest possible way to check what the model learned. So yes, this was one of the the clearest finding. The models did pretty well on certain things, very well on certain things. Probably the starkest finding was with respect to negation. You have sentences like, a robin