spark-metrics (homepage)

A library to expose Apache Spark's metrics system

@groupon / (0)

The Spark-Metrics library exposes Spark's internal metrics system allowing you to have user-defined metrics in your Spark application. This library is integrated with Spark's built-in metrics servlet thereby allowing the metrics collected, using this library, to be visible at the /metrics/json/ endpoint.

Tags

  • 1|application
  • 1|core
  • 1|metrics

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages com.groupon.dse:spark-metrics:1.0

sbt

In your sbt build file, add:

libraryDependencies += "com.groupon.dse" % "spark-metrics" % "1.0"

Maven

In your pom.xml, add: 
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>com.groupon.dse</groupId>
    <artifactId>spark-metrics</artifactId>
    <version>1.0</version>
  </dependency>
</dependencies>

Releases

Version: 1.0 ( a87a33 | zip | jar ) / Date: 2016-05-21 / License: BSD 3-Clause / Scala version: 2.10