How to Parallelize a Neural Network

There's this thing called mdelflaw, which says, you know, it tells you the maximum amount of speed up you can get on a problem that has certain serial steps that need to be done in sequence. And so parts of those problems that where you're gathering information, maybe like you see the world, like each point can be done in parallel. So for this camera, for example, in the camera, they have these sensors and in order to get the entire picture at once, they can process each point separately. When you go to merge them together, let's say you want to do some object recognition or some sort of decision procedure on this image, then there are certain

Transcript

Play full episode

Transcript

Episode notes

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!

Get the app