Apache Spark​Apache ​Spark

Apache Spark

Utilize Apache Spark for data processing within Kestra pipelines.

This sub-group of plugins contains tasks for submitting Apache Spark jobs. Apache Spark is a multi-language engine for executing data engineering, data science, and machine learning jobs on distributed computing clusters.

Tasks

Was this page helpful?