spark-cloudant (homepage)

Deprecated, please see bahir/sql-cloudant

As of July 2017, spark-cloudant project is deprecated in favor of the new project sql-cloudant as part of Apache Bahir.
v2.0.0 is the final version of this project.
Please use the new library for your new projects and begin to migrate your old projects that have used versions v2.0.0 and prior.
Connector library for Spark integration with the Cloudant noSQL database (http://cloudant.com/).
The connector implements a RelationProvider for loading data from Cloudant to Spark, and saving it back from Cloudant to Spark. For details see https://github.com/cloudant-labs/spark-cloudant


Tags

  • 1|Cloudant
  • 1|IBM

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages cloudant-labs:spark-cloudant:2.0.0-s_2.11

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "cloudant-labs/spark-cloudant:2.0.0-s_2.11"

Otherwise,

resolvers += "Spark Packages Repo" at "http://dl.bintray.com/spark-packages/maven"

libraryDependencies += "cloudant-labs" % "spark-cloudant" % "2.0.0-s_2.11"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>cloudant-labs</groupId>
    <artifactId>spark-cloudant</artifactId>
    <version>2.0.0-s_2.11</version>
  </dependency>
</dependencies>
<repositories>
  <!-- list of other repositories -->
  <repository>
    <id>SparkPackagesRepo</id>
    <url>http://dl.bintray.com/spark-packages/maven</url>
  </repository>
</repositories>

Releases

Version: 2.0.0-s_2.11 ( 39d727 | zip | jar ) / Date: 2016-09-23 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.4-s_2.10 ( 4ca11e | zip | jar ) / Date: 2016-09-07 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.3-s_2.10 ( 3d6c54 | zip | jar ) / Date: 2016-03-23 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.2-s_2.10 ( 12f45c | zip | jar ) / Date: 2016-03-07 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.1-s_2.10 ( e2256d | zip | jar ) / Date: 2016-03-07 / License: Apache-2.0 / Scala version: 2.10