AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
How Deep Learning Has Changed Over the Last 20 Years
Brett: How has the practice of deep learning changed over the last 20 years or so? Well, it's gotten a lot better recently, but that's because there's tens of thousands of researchers working on it. And now we have had the LLMs, which is basically what I've been aiming at since the start,. But I am calling mine SSMs because they're small syntax models. They are a million times cheaper to learn and a million times less energy to learn.