spark-on-k8s-operator (homepage)

Kubernetes operator for specifying and running Apache Spark applications idiomatically on Kubernetes.

The Spark Operator is a project that makes specifying, running, and monitoring Spark applications idiomatically on Kubernetes, leveraging the new Kubernetes scheduler backend in Spark 2.3+. It follows the recent trend of using custom resources to extend the Kubernetes API and the operator pattern to extend Kubernetes with application-specific domain knowledge. The Spark Operator allows users to use declarative Spark application specifications to describe their applications, and automatically submits applications on behalf of users. It also features native cron support for running time-based Spark applications.


Tags

  • 1|application
  • 1|Kubernetes

How to

This package doesn't have any releases published in the Spark Packages repo, or with maven coordinates supplied. You may have to build this package from source, or it may simply be a script. To use this Spark Package, please follow the instructions in the README.

Releases

No releases yet.