
Oriol Vinyals
Eye On A.I.
00:00
Retora Language Models
All the language models worthy n for from dip min and obvisly from many other laps, use transformers. Retora is actually a particular language mull that uses an extra, an additional idea. It expands a transformer with a large memory bank. In the coting example, we tried some of these ideas, because it natural to think a when you're cloting something. But in afacut in particular, it didn't help. So we just used the plane transformer there. Right? I see.
Transcript
Play full episode