spark-es (homepage)

ElasticSearch integration for Apache Spark

@SHSE / (1)

ElasticSearch integration for Apache Spark using transport client.

Tags

  • 1|elasticsearch
  • 1|search
  • 1|analytics

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages com.github.shse:spark-es_2.10:1.0.7

sbt

In your sbt build file, add:

libraryDependencies += "com.github.shse" % "spark-es_2.10" % "1.0.7"

Maven

In your pom.xml, add: 
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>com.github.shse</groupId>
    <artifactId>spark-es_2.10</artifactId>
    <version>1.0.7</version>
  </dependency>
</dependencies>

Releases

Version: 1.0.7 ( 486a5b | zip | jar ) / Date: 2016-02-04 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 33% , - 91% , - 33% , - 82% , - 34% , - 86%

Version: 1.0.4 ( d83dc8 | zip | jar ) / Date: 2015-08-18 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 35% , - 35% , - 90% , - 36% , - 100%

Version: 1.0.3 ( 75f29b | zip | jar ) / Date: 2015-08-14 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 35% , - 35% , - 90% , - 36%

Version: 1.0.2 ( 1d7a5e | zip | jar ) / Date: 2015-05-29 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 37% , - 100% , - 38% , - 37%