Learning Spark

Updated to include Spark 3.

0, this second edition teaches data engineers and data scientists how to leverage structure and unification in Spark for performing simple and complex data analytics and employing machine learning algorithms.

The book provides step-by-step walk-throughs, code snippets, and notebooks covering batch and streaming data analytics with Structured Streaming, building reliable data pipelines with Delta Lake, and developing machine learning pipelines with MLlib and MLflow.