parquet-index (homepage)
Spark SQL index for Parquet tables
@lightcopy / (1)
Index for Parquet tables to reduce query latency when used for almost interactive analysis or point queries in Spark SQL
Tags
How to
Include this package in your Spark Applications using:
spark-shell, pyspark, or spark-submit
> $SPARK_HOME/bin/spark-shell --packages lightcopy:parquet-index:0.5.0-s_2.12
sbt
If you use the sbt-spark-package plugin, in your sbt build file, add:
spDependencies += "lightcopy/parquet-index:0.5.0-s_2.12"
Otherwise,
resolvers += "Spark Packages Repo" at "https://repos.spark-packages.org/" libraryDependencies += "lightcopy" % "parquet-index" % "0.5.0-s_2.12"
Maven
In your pom.xml, add:<dependencies> <!-- list of dependencies --> <dependency> <groupId>lightcopy</groupId> <artifactId>parquet-index</artifactId> <version>0.5.0-s_2.12</version> </dependency> </dependencies> <repositories> <!-- list of other repositories --> <repository> <id>SparkPackagesRepo</id> <url>https://repos.spark-packages.org/</url> </repository> </repositories>
Releases
Version: 0.5.0-s_2.12 ( fd410e | zip | jar ) / Date: 2020-08-01 / License: Apache-2.0 / Scala version: 2.12
Version: 0.4.0-s_2.11 ( 18ac0a | zip | jar ) / Date: 2018-01-02 / License: Apache-2.0 / Scala version: 2.11
Version: 0.3.0-s_2.11 ( 692030 | zip | jar ) / Date: 2018-01-02 / License: Apache-2.0 / Scala version: 2.11
Version: 0.2.3-s_2.11 ( 111047 | zip | jar ) / Date: 2017-03-23 / License: Apache-2.0 / Scala version: 2.11
Version: 0.2.3-s_2.10 ( 111047 | zip | jar ) / Date: 2017-03-23 / License: Apache-2.0 / Scala version: 2.10
Version: 0.2.2-s_2.11 ( f2bb1b | zip | jar ) / Date: 2017-02-25 / License: Apache-2.0 / Scala version: 2.11
Version: 0.2.2-s_2.10 ( f2bb1b | zip | jar ) / Date: 2017-02-25 / License: Apache-2.0 / Scala version: 2.10
Version: 0.2.1-s_2.11 ( 4d1cfe | zip | jar ) / Date: 2017-02-06 / License: Apache-2.0 / Scala version: 2.11
Version: 0.2.1-s_2.10 ( 4d1cfe | zip | jar ) / Date: 2017-02-06 / License: Apache-2.0 / Scala version: 2.10
Version: 0.2.0-s_2.11 ( f857dc | zip | jar ) / Date: 2017-01-06 / License: Apache-2.0 / Scala version: 2.11
Version: 0.2.0-s_2.10 ( f857dc | zip | jar ) / Date: 2017-01-06 / License: Apache-2.0 / Scala version: 2.10
Version: 0.1.0-s_2.10 ( cc5030 | zip | jar ) / Date: 2016-12-26 / License: Apache-2.0 / Scala version: 2.10
Version: 0.1.0-s_2.11 ( cc5030 | zip | jar ) / Date: 2016-12-26 / License: Apache-2.0 / Scala version: 2.11