spark-lucenerdd (homepage)

Spark RDD with Lucene's query capabilities

@zouzias / (0)

Spark RDD with Apache Lucene's query capabilities.
The main abstractions are special types of RDD called LuceneRDD, FacetedLuceneRDD and ShapeLuceneRDD that instantiate a Lucene index on each Spark executor. These RDDs distribute search queries and aggregate search results between the Spark driver and its executors.
* Version 0.3.1 for Spark version >= 2.2.0
* 0.2.9 2017  for Spark versions 2.1.x
* 0.1.0 for Spark versions >= 1.4.x, 1.5.x, 1.6.x  (Cross-released with 2.10/2.11)


Tags

  • 1|search
  • 1|geospatial
  • 1|GeoJSON
  • 1|spatial
  • 1|WKT
  • 1|lucene
  • 1|full text search
  • 1|fuzzy search
  • 1|faceted search
  • 1|inverted index

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages org.zouzias:spark-lucenerdd_2.11:0.3.3

sbt

In your sbt build file, add:

libraryDependencies += "org.zouzias" % "spark-lucenerdd_2.11" % "0.3.3"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>org.zouzias</groupId>
    <artifactId>spark-lucenerdd_2.11</artifactId>
    <version>0.3.3</version>
  </dependency>
</dependencies>

Releases

Version: 0.3.3 ( 148383 | zip | jar ) / Date: 2018-07-24 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.9 ( 69d029 | zip | jar ) / Date: 2017-10-25 / License: Apache-2.0 / Scala version: 2.11

Version: 0.3.1 ( 487f4b | zip | jar ) / Date: 2017-10-25 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.8 ( 65f619 | zip | jar ) / Date: 2017-06-03 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.7 ( f1eb8c | zip | jar ) / Date: 2017-03-03 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.6 ( f905b7 | zip | jar ) / Date: 2017-02-15 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.5 ( 5b760d | zip | jar ) / Date: 2017-01-07 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.4 ( 319584 | zip | jar ) / Date: 2016-12-02 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.3 ( a96449 | zip | jar ) / Date: 2016-11-11 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.0-s_2.11 ( c7612b | zip | jar ) / Date: 2016-10-09 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.23-s_2.10 ( a1c52a | zip | jar ) / Date: 2016-09-16 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.23-s_2.11 ( a1c52a | zip | jar ) / Date: 2016-09-16 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.21-s_2.10 ( 71ea80 | zip | jar ) / Date: 2016-08-25 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.21-s_2.11 ( 71ea80 | zip | jar ) / Date: 2016-08-25 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.20-s_2.10 ( f9f333 | zip | jar ) / Date: 2016-08-21 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.20-s_2.11 ( f9f333 | zip | jar ) / Date: 2016-08-21 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.19-s_2.10 ( 3da28a | zip | jar ) / Date: 2016-08-19 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.19-s_2.11 ( 3da28a | zip | jar ) / Date: 2016-08-19 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.18-s_2.10 ( 054f83 | zip | jar ) / Date: 2016-08-08 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.18-s_2.11 ( 054f83 | zip | jar ) / Date: 2016-08-08 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.17-s_2.11 ( bb8586 | zip | jar ) / Date: 2016-07-29 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.17-s_2.10 ( bb8586 | zip | jar ) / Date: 2016-07-29 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.16-s_2.11 ( 565d86 | zip | jar ) / Date: 2016-07-29 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.16-s_2.10 ( 565d86 | zip | jar ) / Date: 2016-07-29 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.14-s_2.11 ( 46a742 | zip | jar ) / Date: 2016-07-29 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.15-s_2.10 ( 9f1f6a | zip | jar ) / Date: 2016-07-29 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.14-s_2.10 ( 46a742 | zip | jar ) / Date: 2016-07-29 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.14 ( 46a742 | zip | jar ) / Date: 2016-07-29 / License: Apache-2.0 / Scala version: 2.11

Version: 0.0.13 ( a27b71 | zip | jar ) / Date: 2016-06-14 / License: Apache-2.0 / Scala version: 2.11