AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
The Masking Technique in Image Processing, Speech Processing and Text Processing
Lincoln: It does sound interesting. Did you get any sense of why the modality was no longer kind of a critical part of the pattern, i meanor any sense of how they've overcome that approach in this yes. They have a a sort of non learned representation of each of these types of data that they can put to te to a similar series of layers. And what they do is they sort of use this trick of masking, which is used kind of both in image processing, speech processing and text processing as a sort of way to learn the vector representation.