spark-cassandra-connector (homepage)

Connects Spark to Cassandra

@datastax / (14)

Spark-Cassandra Connector:
Exposes Cassandra tables as Spark RDDs
Maps table rows to CassandraRow objects or tuples
Offers customizable object mapper for mapping rows to objects of user-defined classes
Saves RDDs back to Cassandra by implicit saveToCassandra call
Join with a subset of Cassandra data using joinWithCassandraTable call
Partition RDDs according to Cassandra replication using repartitionByCassandraReplica call
Converts data types between Cassandra and Scala
Supports all Cassandra data types including collections
Filters rows on the server side via the CQL WHERE clause
Allows for execution of arbitrary CQL statements
Plays nice with Cassandra Virtual Nodes
Works with PySpark DataFrames


Tags

  • 3|spark
  • 3|cassandra
  • 2|nosql
  • 1|streaming
  • 1|sql
  • 1|scala
  • 1|big data
  • 1|cluster
  • 1|fault tolerance
  • 1|always on
  • 1|data source

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages datastax:spark-cassandra-connector:2.4.0-s_2.11

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "datastax/spark-cassandra-connector:2.4.0-s_2.11"

Otherwise,

resolvers += "Spark Packages Repo" at "https://repos.spark-packages.org/"

libraryDependencies += "datastax" % "spark-cassandra-connector" % "2.4.0-s_2.11"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>datastax</groupId>
    <artifactId>spark-cassandra-connector</artifactId>
    <version>2.4.0-s_2.11</version>
  </dependency>
</dependencies>
<repositories>
  <!-- list of other repositories -->
  <repository>
    <id>SparkPackagesRepo</id>
    <url>https://repos.spark-packages.org/</url>
  </repository>
</repositories>

Releases

Version: 2.4.0-s_2.11 ( f52c09 | zip | jar ) / Date: 2018-11-29 / License: Apache-2.0 / Scala version: 2.11

Version: 2.3.1-s_2.11 ( 0721d8 | zip | jar ) / Date: 2018-07-09 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.9-s_2.11 ( 3a8c19 | zip | jar ) / Date: 2018-07-09 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.9-s_2.10 ( 3a8c19 | zip | jar ) / Date: 2018-07-09 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.12-s_2.11 ( b7f2eb | zip | jar ) / Date: 2018-07-09 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.12-s_2.10 ( b7f2eb | zip | jar ) / Date: 2018-07-09 / License: Apache-2.0 / Scala version: 2.10

Version: 2.3.0-s_2.11 ( d8a3eb | zip | jar ) / Date: 2018-05-17 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.8-s_2.11 ( 49659b | zip | jar ) / Date: 2018-05-17 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.8-s_2.10 ( 49659b | zip | jar ) / Date: 2018-05-17 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.7-s_2.10 ( 933c14 | zip | jar ) / Date: 2018-02-08 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.7-s_2.11 ( 933c14 | zip | jar ) / Date: 2018-02-08 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.11-s_2.11 ( b04a22 | zip | jar ) / Date: 2018-01-24 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.11-s_2.10 ( b04a22 | zip | jar ) / Date: 2018-01-24 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.10-s_2.11 ( 5efd0c | zip | jar ) / Date: 2017-11-29 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.10-s_2.10 ( 5efd0c | zip | jar ) / Date: 2017-11-29 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.6-s_2.11 ( d05c63 | zip | jar ) / Date: 2017-11-29 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.6-s_2.10 ( d05c63 | zip | jar ) / Date: 2017-11-29 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.5-s_2.11 ( 13417e | zip | jar ) / Date: 2017-08-25 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.5-s_2.10 ( 13417e | zip | jar ) / Date: 2017-08-25 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.9-s_2.10 ( b042a6 | zip | jar ) / Date: 2017-08-24 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.9-s_2.11 ( b042a6 | zip | jar ) / Date: 2017-08-24 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.3-s_2.11 ( a145ff | zip | jar ) / Date: 2017-07-08 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.3-s_2.10 ( a145ff | zip | jar ) / Date: 2017-07-08 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.8-s_2.10 ( 844969 | zip | jar ) / Date: 2017-07-08 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.8-s_2.11 ( 844969 | zip | jar ) / Date: 2017-07-08 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.7-s_2.11 ( ad7284 | zip | jar ) / Date: 2017-06-12 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.7-s_2.10 ( ad7284 | zip | jar ) / Date: 2017-06-12 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.6-s_2.10 ( 337d0d | zip | jar ) / Date: 2017-04-04 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.6-s_2.11 ( 337d0d | zip | jar ) / Date: 2017-04-04 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.1-s_2.11 ( 98b55f | zip | jar ) / Date: 2017-03-30 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.1-s_2.10 ( 98b55f | zip | jar ) / Date: 2017-03-30 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.0-s_2.11 ( 82ea4c | zip | jar ) / Date: 2017-03-06 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.0-s_2.10 ( 82ea4c | zip | jar ) / Date: 2017-03-06 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.0-RC1-s_2.10 ( 5ba099 | zip | jar ) / Date: 2017-02-16 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.0-RC1-s_2.11 ( f46b40 | zip | jar ) / Date: 2017-02-16 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.5-s_2.11 ( f46b40 | zip | jar ) / Date: 2017-02-16 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.5-s_2.10 ( f46b40 | zip | jar ) / Date: 2017-02-16 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.4-s_2.10 ( b2db10 | zip | jar ) / Date: 2017-01-13 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.4-s_2.11 ( b2db10 | zip | jar ) / Date: 2017-01-13 / License: Apache-2.0 / Scala version: 2.11

Version: 1.5.2-s_2.11 ( 193b93 | zip | jar ) / Date: 2017-01-12 / License: Apache-2.0 / Scala version: 2.11

Version: 1.5.2-s_2.10 ( 193b93 | zip | jar ) / Date: 2017-01-12 / License: Apache-2.0 / Scala version: 2.10

Version: 1.4.5-s_2.11 ( dc9b35 | zip | jar ) / Date: 2017-01-12 / License: Apache-2.0 / Scala version: 2.11

Version: 1.4.5-s_2.10 ( dc9b35 | zip | jar ) / Date: 2017-01-12 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.3-s_2.11 ( 2b9d2a | zip | jar ) / Date: 2016-11-18 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.3-s_2.10 ( 2b9d2a | zip | jar ) / Date: 2016-11-18 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.0-M2-s_2.10 ( 1a8a21 | zip | jar ) / Date: 2016-08-26 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.0-M2-s_2.11 ( 1a8a21 | zip | jar ) / Date: 2016-08-26 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.1-s_2.11 ( 8e3c32 | zip | jar ) / Date: 2016-08-26 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.1-s_2.10 ( 8e3c32 | zip | jar ) / Date: 2016-08-26 / License: Apache-2.0 / Scala version: 2.10

Version: 1.5.1-s_2.11 ( 50614c | zip | jar ) / Date: 2016-06-09 / License: Apache-2.0 / Scala version: 2.11

Version: 1.5.1-s_2.10 ( 50614c | zip | jar ) / Date: 2016-06-09 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.0-s_2.11 ( 75380d | zip | jar ) / Date: 2016-06-09 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.0-s_2.10 ( 75380d | zip | jar ) / Date: 2016-06-09 / License: Apache-2.0 / Scala version: 2.10

Version: 1.4.4-s_2.11 ( b6d9d2 | zip | jar ) / Date: 2016-05-25 / License: Apache-2.0 / Scala version: 2.11

Version: 1.4.4-s_2.10 ( b6d9d2 | zip | jar ) / Date: 2016-05-25 / License: Apache-2.0 / Scala version: 2.10

Version: 1.4.3-s_2.11 ( 1321ef | zip | jar ) / Date: 2016-05-06 / License: Apache-2.0 / Scala version: 2.11

Version: 1.4.3-s_2.10 ( 1321ef | zip | jar ) / Date: 2016-05-06 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.0-M2-s_2.11 ( bebcf0 | zip | jar ) / Date: 2016-04-14 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.0-M2-s_2.10 ( bebcf0 | zip | jar ) / Date: 2016-04-14 / License: Apache-2.0 / Scala version: 2.10

Version: 1.6.0-M1-s_2.11 ( df0bc0 | zip | jar ) / Date: 2016-02-22 / License: Apache-2.0 / Scala version: 2.11

Version: 1.6.0-M1-s_2.10 ( df0bc0 | zip | jar ) / Date: 2016-02-22 / License: Apache-2.0 / Scala version: 2.10

Version: 1.5.0-s_2.11 ( 9ad250 | zip | jar ) / Date: 2016-02-22 / License: Apache-2.0 / Scala version: 2.11

Version: 1.5.0-s_2.10 ( 9ad250 | zip | jar ) / Date: 2016-02-22 / License: Apache-2.0 / Scala version: 2.10

Version: 1.4.2-s_2.11 ( 70bfbf | zip | jar ) / Date: 2016-02-17 / License: Apache-2.0 / Scala version: 2.11

Version: 1.4.2-s_2.10 ( 70bfbf | zip | jar ) / Date: 2016-02-17 / License: Apache-2.0 / Scala version: 2.10

Version: 1.5.0-RC1-s_2.11 ( 526e7b | zip | jar ) / Date: 2016-01-07 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 79% , - 86% , - 44% , - 100%

Version: 1.5.0-RC1-s_2.10 ( 526e7b | zip | jar ) / Date: 2016-01-07 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 87%

Version: 1.5.0-M3-s_2.10 ( 39dcad | zip | jar ) / Date: 2015-12-09 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 87%

Version: 1.5.0-M3-s_2.11 ( 39dcad | zip | jar ) / Date: 2015-12-09 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 87% , - 44% , - 100% , - 80%

Version: 1.4.1-s_2.11 ( edb597 | zip | jar ) / Date: 2015-12-09 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 86% , - 100% , - 46% , - 85%

Version: 1.4.1-s_2.10 ( edb597 | zip | jar ) / Date: 2015-12-09 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 44% , - 85% , - 31% , - 86% , - 39% , - 100%

Version: 1.5.0-M2-s_2.11 ( 61e568 | zip | jar ) / Date: 2015-10-05 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 44% , - 100% , - 80% , - 87%

Version: 1.3.1-s_2.11 ( d97776 | zip | jar ) / Date: 2015-10-05 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 97% , - 48% , - 84% , - 100%

Version: 1.3.1-s_2.10 ( d97776 | zip | jar ) / Date: 2015-10-05 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 33% , - 100% , - 41% , - 97% , - 46% , - 84%

Version: 1.4.0-s_2.10 ( 361450 | zip | jar ) / Date: 2015-09-24 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 39% , - 100% , - 44% , - 85% , - 31% , - 86%

Version: 1.4.0-s_2.11 ( 361450 | zip | jar ) / Date: 2015-09-24 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 85% , - 86% , - 100% , - 46%

Version: 1.4.0-M3-s_2.10 ( 44288c | zip | jar ) / Date: 2015-09-03 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 39% , - 100% , - 44% , - 31% , - 86%