We Can Learn a Lot From Rodeta and Through Bigger Models

i think richard sutton said that most innovation would be in the scaling, or like hog scale models. And was pretty, his argument was pretty closhe to saying scal am is ald researchers uctuallyneed, and not like innovation a. So i disagree with that. I think what he specifically refers to there is the kind of future engineering that a was characteristic of earlier, a mashin learning models. We don't need to handcraft a features for this modal to learn from. We not need to distil human knowledge in a way that needs to be hart coated in these models as priors. It will always be more effective in the long run, to learn

Transcript

Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app