mmlspark (homepage)

Microsoft Machine Learning for Apache Spark

@Azure / (4)

MMLSpark provides a number of deep learning and data science tools for Apache Spark, including seamless integration of Spark Machine Learning pipelines with Microsoft Cognitive Toolkit (CNTK) and OpenCV, enabling you to quickly create powerful, highly-scalable predictive and analytical models for large image and text datasets.


Tags

  • 3|ml
  • 3|machine learning
  • 3|Microsoft
  • 3|Azure
  • 3|pyspark
  • 3|cntk
  • 3|Microsoft Machine Learning
  • 2|tools

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages Azure:mmlspark:0.17

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "Azure/mmlspark:0.17"

Otherwise,

resolvers += "Spark Packages Repo" at "https://repos.spark-packages.org/"

libraryDependencies += "Azure" % "mmlspark" % "0.17"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>Azure</groupId>
    <artifactId>mmlspark</artifactId>
    <version>0.17</version>
  </dependency>
</dependencies>
<repositories>
  <!-- list of other repositories -->
  <repository>
    <id>SparkPackagesRepo</id>
    <url>https://repos.spark-packages.org/</url>
  </repository>
</repositories>

Releases

Version: 0.17 ( bba5c1 | zip | jar ) / Date: 2019-04-23 / License: MIT

Version: 0.16 ( 1d2939 | zip | jar ) / Date: 2019-03-06 / License: MIT

Version: 0.15 ( fd1f66 | zip | jar ) / Date: 2018-11-29 / License: MIT

Version: 0.14 ( 7eed83 | zip | jar ) / Date: 2018-09-23 / License: MIT

Version: 0.13 ( ad2055 | zip | jar ) / Date: 2018-06-29 / License: MIT

Version: 0.12 ( 0a2807 | zip | jar ) / Date: 2018-04-17 / License: MIT

Version: 0.11 ( 43d2a8 | zip | jar ) / Date: 2018-02-09 / License: MIT

Version: 0.10 ( 36740e | zip | jar ) / Date: 2017-11-15 / License: MIT

Version: 0.9 ( c1a08f | zip | jar ) / Date: 2017-10-14 / License: MIT

Version: 0.8 ( b61bf5 | zip | jar ) / Date: 2017-09-15 / License: MIT

Version: 0.7 ( 5ea648 | zip | jar ) / Date: 2017-08-24 / License: MIT

Version: 0.5 ( 70be8d | zip | jar ) / Date: 2017-06-16 / License: MIT