dl4j-spark-ml (homepage)

Deep Learning for Spark ML

Based on the deeplearning4j library, dl4j-spark-ml provides distributed deep-learning algorithms for
classification and reconstruction with Spark ML. Also provides DataFrame readers for MNIST,
Labeled Faces in the Wild (LFW) and IRIS.


Tags

  • 1|machine learning
  • 1|Spark ML

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages deeplearning4j:dl4j-spark-ml:0.4-rc3.4

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "deeplearning4j/dl4j-spark-ml:0.4-rc3.4"

Otherwise,

resolvers += "Spark Packages Repo" at "http://dl.bintray.com/spark-packages/maven"

libraryDependencies += "deeplearning4j" % "dl4j-spark-ml" % "0.4-rc3.4"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>deeplearning4j</groupId>
    <artifactId>dl4j-spark-ml</artifactId>
    <version>0.4-rc3.4</version>
  </dependency>
</dependencies>
<repositories>
  <!-- list of other repositories -->
  <repository>
    <id>SparkPackagesRepo</id>
    <url>http://dl.bintray.com/spark-packages/maven</url>
  </repository>
</repositories>

Releases

Version: 0.4-rc3.4 ( 5c8d28 | zip | jar ) / Date: 2015-10-02 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 100% , - 100% , - 100% , - 100% , - 100%

Version: 0.4-rc3.3 ( c2c7d5 | zip | jar ) / Date: 2015-09-23 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 100% , - 100% , - 100% , - 100% , - 100%

Version: 0.4-rc3.2 ( d372df | zip | jar ) / Date: 2015-09-22 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 100% , - 100% , - 100% , - 100% , - 100%

Version: 0.4-rc3.1 ( 0cc167 | zip | jar ) / Date: 2015-09-18 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 100% , - 100% , - 100% , - 100% , - 100%

Version: 0.4-rc2.2 ( d6c51b | zip | jar ) / Date: 2015-09-18 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 100% , - 100% , - 100% , - 100% , - 100%

Version: 0.4-rc1.2 ( 2e8190 | zip | jar ) / Date: 2015-09-05 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 100% , - 100% , - 100% , - 100%

Version: 0.4-rc0 ( 6b690d | zip | jar ) / Date: 2015-08-31 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 100% , - 100% , - 100% , - 100%