pyspark-cassandra (homepage)

PySpark Cassandra brings back the fun in working with Cassandra data in PySpark.

This module provides python support for Apache Spark's Resillient Distributed Datasets from Apache Cassandra CQL rows using https://github.com/datastax/spark-cassandra-connector within PySpark, both in the interactive shell and in python programs submitted with spark-submit.


Tags

  • 1|sql
  • 1|python
  • 1|spark
  • 1|database
  • 1|cassandra
  • 1|nosql
  • 1|pyspark
  • 1|data source

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages TargetHolding:pyspark-cassandra:0.3.5

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "TargetHolding/pyspark-cassandra:0.3.5"

Otherwise,

resolvers += "Spark Packages Repo" at "http://dl.bintray.com/spark-packages/maven"

libraryDependencies += "TargetHolding" % "pyspark-cassandra" % "0.3.5"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>TargetHolding</groupId>
    <artifactId>pyspark-cassandra</artifactId>
    <version>0.3.5</version>
  </dependency>
</dependencies>
<repositories>
  <!-- list of other repositories -->
  <repository>
    <id>SparkPackagesRepo</id>
    <url>http://dl.bintray.com/spark-packages/maven</url>
  </repository>
</repositories>

Releases

Version: 0.3.5 ( 02ad8e | zip | jar ) / Date: 2016-03-30 / License: Apache-2.0 / Scala version: 2.10

Version: 0.3.4 ( eff90a | zip | jar ) / Date: 2016-03-18 / License: Apache-2.0 / Scala version: 2.10

Version: 0.3.3 ( a3e976 | zip | jar ) / Date: 2016-03-15 / License: Apache-2.0 / Scala version: 2.10

Version: 0.3.2 ( 4ba755 | zip | jar ) / Date: 2016-03-14 / License: Apache-2.0 / Scala version: 2.10

Version: 0.3.1 ( a8a278 | zip | jar ) / Date: 2016-03-08 / License: Apache-2.0 / Scala version: 2.10

Version: 0.2.7 ( d847eb | zip | jar ) / Date: 2016-01-31 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.6 ( 07102b | zip | jar ) / Date: 2016-01-31 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.6-test ( 81eaf1 | zip | jar ) / Date: 2016-01-31 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.6-py3 ( 845367 | zip | jar ) / Date: 2016-01-31 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.6-py2 ( ec4540 | zip | jar ) / Date: 2016-01-31 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.5 ( c590b2 | zip | jar ) / Date: 2016-01-26 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.4 ( 0dc9cd | zip | jar ) / Date: 2016-01-18 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.3 ( cdb809 | zip | jar ) / Date: 2016-01-10 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.2 ( 13b1c0 | zip | jar ) / Date: 2015-12-15 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.1 ( 2a7d91 | zip | jar ) / Date: 2015-12-05 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.2.0 ( 367e83 | zip | jar ) / Date: 2015-11-26 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100% , 1.4.0 - 100% , 1.5.0 - 100%

Version: 0.1.5 ( 613341 | zip | jar ) / Date: 2015-06-06 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100%

Version: 0.1.4 ( b75a8e | zip | jar ) / Date: 2015-05-02 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100%

Version: 0.1.3 ( 66217c | zip ) / Date: 2015-04-28 / License: Apache-2.0

Version: 0.1.2 ( c161ab | zip | jar ) / Date: 2015-04-27 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 100% , 1.1.0 - 100% , 1.2.0 - 100% , 1.3.0 - 100%

Version: 0.1.1 ( 6141d9 | zip ) / Date: 2015-03-17 / License: Apache-2.0

Version: 0.1.0 ( 645a3c | zip ) / Date: 2015-02-20 / License: Apache-2.0