AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How Far Do You Take Your Interpretation of the Results?
One of my inspirations is that the brain is doing lots of stuff, especially as you're reading. And it's doing more than what we're currently training ore tat many language models are trained to do. So one thing we had tried was, can we in a multi task sort of way? Multi task learning has been shown to create better representations and produce models that are more accurate. We wed use sort of a multi task framework, except we usea reinforcement learning to constrain the representations. It showed that the if we constrained the representations to predict not only i the next word, but also the part of speech of the nextpert, actually ended up better. But in the future