AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
Masking a Training Time to Enhance Learning
Masking has been used to enable learning of language representations. The ability to find the right knowledge pieces for a given task increases with masking. We don't think that we've gottn quite at common sense, but in one of our papers, this masking was what was enabling you be show that when you do mask a training time, versus you don’t mask a training time. It doesn't just count how many words are overlapping. It looks at more of the evidence.