stocator (homepage)

High performing connector to object storage for Apache Spark.  Comes with a complete driver for OpenStack Swift

@SparkTC / (1)

Stocator is high performing connector to object storage for Spark, achieving performance by leveraging object store semantics.  Stocator comes with a complete driver for OpenStack Swift and can easily be extended to support other object storage interfaces. 


Tags

  • 1|data source
  • 1|Swift
  • 1|data s
  • 1|object store
  • 1|softlayer

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages com.ibm.stocator:stocator:1.0.8

sbt

In your sbt build file, add:

libraryDependencies += "com.ibm.stocator" % "stocator" % "1.0.8"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>com.ibm.stocator</groupId>
    <artifactId>stocator</artifactId>
    <version>1.0.8</version>
  </dependency>
</dependencies>

Releases

Version: 1.0.8 ( b458f2 | zip | jar ) / Date: 2017-01-19 / License: Apache-2.0

Version: 1.0.7 ( 0e558b | zip | jar ) / Date: 2016-10-28 / License: Apache-2.0

Version: 1.0.6 ( 23f91a | zip | jar ) / Date: 2016-09-30 / License: Apache-2.0

Version: 1.0.5 ( d7dab2 | zip | jar ) / Date: 2016-09-08 / License: Apache-2.0

Version: 1.0.4 ( e74c98 | zip | jar ) / Date: 2016-07-10 / License: Apache-2.0

Version: 1.0.3 ( 6d574d | zip | jar ) / Date: 2016-05-21 / License: Apache-2.0

Version: 1.0.2 ( 8ac569 | zip | jar ) / Date: 2016-04-26 / License: Apache-2.0

Version: 1.0.0 ( df77d8 | zip | jar ) / Date: 2016-04-09 / License: Apache-2.0