Choosing Spark ML vs Single Node Operation

The main reasons to stick with Spark libraries versus moving to a single node operation? It's really two aspects. One is your data volume. If you're predicting hundreds of gigabytes of data multiple times a day through a model, yeah, Spark ML is designed for that. The other aspect that can be incredibly important for choosing to use Spark ML lib is the algorithms that are there.