spark-metrics (homepage)

A library to expose Apache Spark's metrics system

@groupon / (0)

The Spark-Metrics library exposes Spark's internal metrics system allowing you to have user-defined metrics in your Spark application. This library is integrated with Spark's built-in metrics servlet thereby allowing the metrics collected, using this library, to be visible at the /metrics/json/ endpoint.


  • 1|application
  • 1|core
  • 1|metrics

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages com.groupon.dse:spark-metrics:1.0


In your sbt build file, add:

libraryDependencies += "com.groupon.dse" % "spark-metrics" % "1.0"


In your pom.xml, add:
  <!-- list of dependencies -->


Version: 1.0 ( a87a33 | zip | jar ) / Date: 2016-05-21 / License: BSD 3-Clause / Scala version: 2.10