Talk Python To Me cover image

#392: Data Science from the Command Line

Talk Python To Me

00:00

Parallel Is a Tool That Will Parallelize Your Pipeline

New parallel is a command you can run on the terminal and it sounds like it does stuff in parallel that sounds amazing. It will be able to run jobs on multiple cores and even distribute them to other machines if you have those available right so michael you mentioned you're working on a server well if you can SSH into other servers as well you can leverage those That's something that new parallel can do the way it works is that you feed it a list of something could be a list of file names, URLs or log files for example.

Transcript
Play full episode

The AI-powered Podcast Player

Save insights by tapping your headphones, chat with episodes, discover the best highlights - and more!
App store bannerPlay store banner
Get the app