Datasource-Receiver (homepage)

Spark Receiver for SQL or NoSQL Databases like Cassandra, MongoDB, Elasticsearch or JDBC

@Stratio / (1)

Streaming receiver library that allows the user to read data from Datasources and then insert all of this in Spark Streaming.
The library use Spark SQL for read data and is polyglot because can connect with multiple relational SQL Databases and NoSql Databases.

Tags

  • 1|library
  • 1|streaming
  • 1|sql
  • 1|input
  • 1|SparkSQL
  • 1|cassandra
  • 1|elasticsearch
  • 1|MongoDB
  • 1|scala
  • 1|realtime
  • 1|data source
  • 1|java
  • 1|jdbc

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages com.stratio.receiver:spark-datasource_1.6:0.1.0

sbt

In your sbt build file, add:

libraryDependencies += "com.stratio.receiver" % "spark-datasource_1.6" % "0.1.0"

Maven

In your pom.xml, add: 
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>com.stratio.receiver</groupId>
    <artifactId>spark-datasource_1.6</artifactId>
    <version>0.1.0</version>
  </dependency>
</dependencies>

Releases

Version: 0.1.0 ( 42c357 | zip | jar ) / Date: 2016-06-30 / License: Apache-2.0