AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Do You Think Knowledge Is Needed to Improve Long Form Video Understanding?
I completely agree that knowledge is called for and that knowledge can be quite sophisticated. I think the technology that we have right now with 3D convolutions over a couple of seconds of video, it's very much tailored to us short term video understanding. Not that long term understanding long term understanding requires notion of this notion of schemas that I talked about,. perhaps some notions of goals, intentionality, functionality, and so on and so forth. Now, how will we bring that in? So we could either revert back to the 70s and say, okay, I'm going to hand code in a script. Or we might try to learn it.