AI-powered
podcast player
Listen to all your favourite podcasts with AI-powered features
I Think It's a Good Idea to Do a Little Bit of Research on the Hardware Side of Things.
I think, first of all, just on the hardware side. What I've seen is that a lot of the most impactful research is done by folks who are deeply appreciating not just the mathematical algorithmic side but also what's possible to get maximum of the hardware today right where you're seeing this with transformers in particular. There's a lot of opportunity for folks to kind of build the next generation of algorithms, you know, with the hardware fully in mind. And then the last point I wanted to touch on was Andre's observation that, yeah, 2020 was really the years of the of the transformer.