Programming Throwdown cover image

139: Scientific Python with Guido Imperiale

Programming Throwdown

CHAPTER

How Does Dask Scheduling Work?

The way dask works is, instead of saying, you load this huge data, sato this logic on each piece, and then aggregate. And then at the end, it's analyzing the sort of grap of operations, and its figuring out where it can break things up into pieces. E super cose suggests a recapse. See if i understand. Theses wor colld stipsin. How does that work witd desk? Because now the dast scheduler needs to tell these nodes, hey, you have to, you know, pip install gambit. Is not that simple.

00:00
Transcript
Play full episode

Remember Everything You Learn from Podcasts

Save insights instantly, chat with episodes, and build lasting knowledge - all powered by AI.
App store bannerPlay store banner