scalable-deeplearning (homepage)

Scalable implementation of artificial neural networks for Spark deep learning

@avulanov / (1)

This library is based on the implementation of artificial neural networks in Spark ML. In addition to the multilayer perceptron, it contains new Spark deep learning features that were not yet merged to Spark ML. Currently, they are Stacked Autoencoder and tensor data flow.

Tags

  • 1|machine learning
  • 1|deep learning

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages avulanov:scalable-deeplearning:1.0.0

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "avulanov/scalable-deeplearning:1.0.0"

Otherwise,

resolvers += "Spark Packages Repo" at "https://repos.spark-packages.org/"

libraryDependencies += "avulanov" % "scalable-deeplearning" % "1.0.0"

Maven

In your pom.xml, add: 
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>avulanov</groupId>
    <artifactId>scalable-deeplearning</artifactId>
    <version>1.0.0</version>
  </dependency>
</dependencies>
<repositories>
  <!-- list of other repositories -->
  <repository>
    <id>SparkPackagesRepo</id>
    <url>https://repos.spark-packages.org/</url>
  </repository>
</repositories>

Releases

Version: 1.0.0 ( e122c5 | zip | jar ) / Date: 2016-09-09 / License: Apache-2.0 / Scala version: 2.11