magellan (homepage)

Geo Spatial Data Analytics on Spark

@harsha2010 / (1)

Magellan is an open source library for Geospatial Analytics on top of Spark.
The library currently supports the ESRI Shapefile and GeoJSON formats.
We aim to support the full suite of OpenGIS Simple Features for SQL spatial predicate functions and operators together with additional topological functions.
capabilities include:
Geometries: Point, LineString, Polygon, MultiPoint, MultiLineString, MultiPolygon, GeometryCollection
Predicates: Intersects, Touches, Disjoint, Crosses, Within, Contains, Overlaps, Equals, Covers
Operations: Union, Distance, Intersection, Symmetric Difference, Convex Hull, Envelope, Buffer, Simplify, Valid, Area, Length
Scala and Python API

Tags

  • 2|sql
  • 2|data source
  • 2|geospatial
  • 2|GeoJSON
  • 2|spatial analytics

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages harsha2010:magellan:1.0.5-s_2.11

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "harsha2010/magellan:1.0.5-s_2.11"

Otherwise,

resolvers += "Spark Packages Repo" at "https://repos.spark-packages.org/"

libraryDependencies += "harsha2010" % "magellan" % "1.0.5-s_2.11"

Maven

In your pom.xml, add: 
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>harsha2010</groupId>
    <artifactId>magellan</artifactId>
    <version>1.0.5-s_2.11</version>
  </dependency>
</dependencies>
<repositories>
  <!-- list of other repositories -->
  <repository>
    <id>SparkPackagesRepo</id>
    <url>https://repos.spark-packages.org/</url>
  </repository>
</repositories>

Releases

Version: 1.0.5-s_2.11 ( 24e70b | zip | jar ) / Date: 2017-08-14 / License: Apache-2.0 / Scala version: 2.11

Version: 1.0.4-s_2.11 ( d52617 | zip | jar ) / Date: 2017-02-03 / License: Apache-2.0 / Scala version: 2.11

Version: 1.0.3-s_2.10 ( 9ec7a1 | zip | jar ) / Date: 2015-08-20 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 40% , - 100% , - 46% , - 13% , - 39%

Version: 1.0.1-s_2.10 ( c48ce3 | zip | jar ) / Date: 2015-07-20 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 47% , - 45% , - 100% , - 52% , - 14%

Version: 1.0.0-s_2.10 ( 435236 | zip | jar ) / Date: 2015-07-20 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 14% , - 47% , - 46% , - 100% , - 52%