"Managed Service for Apache Spark" is the new name for the product formerly known as "Dataproc on Compute Engine" (cluster deployment) and "Google Cloud Serverless for Apache Spark" (serverless deployment).

Managed Service for Apache Spark templates

To set up and run Managed Service for Apache Spark workloads and jobs, use Managed Service for Apache Spark templates on GitHub

Templates are provided in the following language and execution environments:

Airflow orchestration templates: Run Spark jobs from DAGs in Airflow.
Java templates: Run Spark batch workloads or jobs on Managed Service for Apache Spark or an existing Managed Service for Apache Spark cluster.
Python templates: Run PySpark batch workloads on Managed Service for Apache Spark.
Notebook templates: Run Spark jobs using Vertex AI notebooks.

Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.

Last updated 2026-08-13 UTC.

Managed Service for Apache Spark templates Stay organized with collections Save and categorize content based on your preferences.

Managed Service for Apache Spark templates