Managed Service for Apache Spark documentation

Read product documentation

Managed Service for Apache Spark on clusters lets you take advantage of open source data tools for batch processing, querying, streaming, and machine learning. Managed Service for Apache Spark automation helps you create clusters quickly, manage them easily, and save money by turning clusters off when you don't need them. With less time and money spent on administration, you can focus on your jobs and your data.

Use Managed Service for Apache Spark serverless to run Spark batch workloads without provisioning and managing your own cluster. Specify workload parameters, and then submit the workload to the Managed Service for Apache Spark service. The service will run the workload on a managed compute infrastructure, autoscaling resources as needed. Managed Service for Apache Spark charges apply only to the time when the workload is executing.

Go to the Managed Service for Apache Spark product page for more.

免费试用

Google Cloud新用户首次注册即可获得300美元赠金。此外，无论新老用户，均可免费使用20多款产品，积累动手实践经验。

免费试用

Google Cloud新用户首次注册即可获得300美元赠金。此外，无论新老用户，均可免费使用20多款产品，积累动手实践经验。

Documentation resources

Find quickstarts and guides, review key references, and get help with common issues.
Explore self-paced training, use cases, reference architectures, and code samples with examples of how to use and connect Google Cloud services.
Training
Training and tutorials

Submit Spark jobs to a running Google Kubernetes Engine cluster from the Dataproc Jobs API.

Training
Training and tutorials

This course features a combination of lectures, demos, and hands-on labs to create a Dataproc cluster, submit a Spark job, and then shut down the cluster.

Training
Training and tutorials

This course features a combination of lectures, demos, and hands-on labs to implement logistic regression using a machine learning library for Apache Spark running on a Dataproc cluster to develop a model for data from a multivariable dataset.

Use case
Use cases

Schedule workflows on Google Cloud.

Use case
Use cases

How to move data from on-premises Hadoop Distributed File System (HDFS) to Google Cloud.

Use case
Use cases

Recommended approaches to including dependencies when you submit a Spark job to a Managed Service for Apache Spark cluster.

Code sample
Code Samples

Call Dataproc APIs from Python.

Code sample
Code Samples

Call Dataproc APIs from Java.

Code sample
Code Samples

Call Dataproc APIs from Node.js.

Code sample
Code Samples

Call Dataproc APIs from Go.

Related videos