139: Scientific Python with Guido Imperiale
Programming Throwdown
00:00
How Does Dask Scheduling Work?
The way dask works is, instead of saying, you load this huge data, sato this logic on each piece, and then aggregate. And then at the end, it's analyzing the sort of grap of operations, and its figuring out where it can break things up into pieces. E super cose suggests a recapse. See if i understand. Theses wor colld stipsin. How does that work witd desk? Because now the dast scheduler needs to tell these nodes, hey, you have to, you know, pip install gambit. Is not that simple.
Transcript
Play full episode
