AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Importance of General Purpose Tools in Deep Learning
I'm curious if you have a perspective on that. It seems like many more tasks are narrow than people realize. One of the things that most impressed me about GP3 is that while you trained it to do just one thing, it was able to do many things as a consequence. I think what's happening here is that our intuitions about intelligence are not exactly perfect. But with the situation we are today with deep learning, we do have quite general purpose tools. If you want to get really good results on some tasks, if you can collect a large amount of data, you will in fact get very good results on this task.