Spark ML

Some of the algorithms are not in common Python libraries that are in Spark ML or ML lib. XGBoost is native on Spark now, part of Spark DL package. You have random forest grading boosted trees and decision trees. There's just dozens of these esoteric models that don't exist in Spark ML live. It takes a lot of time and effort to reimplement that from scratch in a distributed system.