spark-cloudant (homepage)

Cloudant integration with Spark as Spark SQL external datasource

Connector library for Spark integration with the Cloudant noSQL database (http://cloudant.com/).
The connector implements a RelationProvider for loading data from Cloudant to Spark, and saving it back from Cloudant to Spark. For details see https://github.com/cloudant-labs/spark-cloudant


Tags

  • 1|Cloudant
  • 1|IBM

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages cloudant-labs:spark-cloudant:2.0.0-s_2.11

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "cloudant-labs/spark-cloudant:2.0.0-s_2.11"

Otherwise,

resolvers += "Spark Packages Repo" at "http://dl.bintray.com/spark-packages/maven"

libraryDependencies += "cloudant-labs" % "spark-cloudant" % "2.0.0-s_2.11"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>cloudant-labs</groupId>
    <artifactId>spark-cloudant</artifactId>
    <version>2.0.0-s_2.11</version>
  </dependency>
</dependencies>
<repositories>
  <!-- list of other repositories -->
  <repository>
    <id>SparkPackagesRepo</id>
    <url>http://dl.bintray.com/spark-packages/maven</url>
  </repository>
</repositories>

Releases

Version: 2.0.0-s_2.11 ( 39d727 | zip | jar ) / Date: 2016-09-23 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.4-s_2.10 ( 4ca11e | zip | jar ) / Date: 2016-09-07 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.3-s_2.10 ( 3d6c54 | zip | jar ) / Date: 2016-03-23 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.2-s_2.10 ( 12f45c | zip | jar ) / Date: 2016-03-07 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.1-s_2.10 ( e2256d | zip | jar ) / Date: 2016-03-07 / License: Apache-2.0 / Scala version: 2.10