Generally Intelligent cover image

Episode 26: Sugandha Sharma, MIT, on biologically inspired neural architectures, how memories can be implemented, and control theory

Generally Intelligent

00:00

How to Scale Large Scale Networks

The tricky part in practice is, as you said, right, like the modern networks that we use and deep learning are so big and so complicated. But I think there's a lot of interesting stuff to be down there still though. Right? So if if you can show that they are scalable, then then you can go back to the implementation level and think about how those computations may be implemented at the level.Yeah, I think that's fair, right? Yeah, we can do that. And I think, yeah, a lot of what we need to explore is what what is that like what kind of biases should we build in that are stable or that wouldn't restrict the scale

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app