Apache Spark™ has become the de facto engine for big data processing, powering workloads at some of the largest organizations in the world. Over the