spark-snowflake (homepage)
Snowflake Data Source for Apache Spark.
@snowflakedb / (2)
A package to load data into Spark SQL DataFrames from Snowflake and write them back to Snowflake.
Amazon S3 is used to transfer data in and out of Snowflake, and JDBC is used to automatically trigger the appropriate COPY and UNLOAD commands in Snowflake."
Tags
How to
Include this package in your Spark Applications using:
spark-shell, pyspark, or spark-submit
> $SPARK_HOME/bin/spark-shell --packages net.snowflake:spark-snowflake_2.12:2.5.1-spark_2.4
sbt
In your sbt build file, add:
libraryDependencies += "net.snowflake" % "spark-snowflake_2.12" % "2.5.1-spark_2.4"
Maven
In your pom.xml, add:<dependencies>
<!-- list of dependencies -->
<dependency>
<groupId>net.snowflake</groupId>
<artifactId>spark-snowflake_2.12</artifactId>
<version>2.5.1-spark_2.4</version>
</dependency>
</dependencies>
Releases
Version: 2.5.1-spark_2.4 ( 22eba8 | zip | jar ) / Date: 2019-08-01 / License: Apache-2.0 / Scala version: 2.12
Version: 2.4.14-spark_2.3 ( 6079a9 | zip | jar ) / Date: 2019-06-12 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.14-spark_2.4 ( af3801 | zip | jar ) / Date: 2019-06-12 / License: Apache-2.0 / Scala version: 2.12
Version: 2.4.5-s_2.11-spark_2.1 ( 92fbde | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.5-s_2.11-spark_2.2 ( b90261 | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.5-s_2.11 ( 0c9d4f | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.4-s_2.11-spark_2.1 ( 70ac09 | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.4-s_2.11-spark_2.2 ( 7c8d0f | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.3-s_2.11-spark_2.1 ( 2bc185 | zip | jar ) / Date: 2018-07-23 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.3-s_2.11-spark_2.2 ( 7c1594 | zip | jar ) / Date: 2018-07-23 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.3-s_2.11 ( bac08f | zip | jar ) / Date: 2018-07-23 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.2-s_2.11-spark_2.1 ( 8b1726 | zip | jar ) / Date: 2018-07-12 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.2-s_2.11-spark_2.2 ( 46e9be | zip | jar ) / Date: 2018-07-12 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.2-s_2.11 ( ecea26 | zip | jar ) / Date: 2018-07-12 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.1-s_2.11-spark_2.1 ( 486af9 | zip | jar ) / Date: 2018-06-29 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.1-s_2.11-spark_2.2 ( 1770c9 | zip | jar ) / Date: 2018-06-29 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.1-s_2.11 ( 412486 | zip | jar ) / Date: 2018-06-29 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.0-s_2.11-spark_2.1 ( 288c74 | zip | jar ) / Date: 2018-06-21 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.0-s_2.11-spark_2.2 ( 8ca70d | zip | jar ) / Date: 2018-06-21 / License: Apache-2.0 / Scala version: 2.11
Version: 2.4.0-s_2.11 ( c3463a | zip | jar ) / Date: 2018-06-21 / License: Apache-2.0 / Scala version: 2.11
Version: 2.3.3-s_2.11-spark_2.1 ( cae2e9 | zip | jar ) / Date: 2018-06-15 / License: Apache-2.0 / Scala version: 2.11
Version: 2.3.3-s_2.11-spark_2.2 ( f6b401 | zip | jar ) / Date: 2018-06-15 / License: Apache-2.0 / Scala version: 2.11
Version: 2.3.3-s_2.11 ( 4da8f6 | zip | jar ) / Date: 2018-06-15 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.8-s_2.11 ( 46f4d2 | zip | jar ) / Date: 2017-11-30 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.8-s_2.10 ( 46f4d2 | zip | jar ) / Date: 2017-11-30 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.8-s_2.11-spark_2.0 ( 555f36 | zip | jar ) / Date: 2017-11-30 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.8-s_2.10-spark_2.0 ( 555f36 | zip | jar ) / Date: 2017-11-30 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.7-s_2.11 ( 886a85 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.7-s_2.11-spark_2.0 ( af1c88 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.7-s_2.10 ( 886a85 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.7-s_2.10-spark_2.0 ( af1c88 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.6-s_2.10 ( 675507 | zip | jar ) / Date: 2017-09-14 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.6-s_2.10-spark_2.0 ( be4340 | zip | jar ) / Date: 2017-09-14 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.6-s_2.11-spark_2.0 ( be4340 | zip | jar ) / Date: 2017-09-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.6-s_2.11 ( 675507 | zip | jar ) / Date: 2017-09-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.4-s_2.10-spark_2.0 ( 15c300 | zip | jar ) / Date: 2017-08-04 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.4-s_2.11-spark_2.0 ( 15c300 | zip | jar ) / Date: 2017-08-04 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.4-s_2.10 ( 5896e4 | zip | jar ) / Date: 2017-08-04 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.4-s_2.11 ( 5896e4 | zip | jar ) / Date: 2017-08-04 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.3-s_2.11 ( 7feed6 | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.3-s_2.10 ( 7feed6 | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.3-s_2.11-spark_2.0 ( 8738dc | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.3-s_2.10-spark_2.0 ( 8738dc | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.1-s_2.11 ( f59160 | zip | jar ) / Date: 2017-05-12 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.1-s_2.10 ( f59160 | zip | jar ) / Date: 2017-05-12 / License: Apache-2.0 / Scala version: 2.10
Version: 2.2.1-s_2.11-spark_2.0 ( 70a099 | zip | jar ) / Date: 2017-05-12 / License: Apache-2.0 / Scala version: 2.11
Version: 2.2.1-s_2.10-spark_2.0 ( 70a099 | zip | jar ) / Date: 2017-05-12 / License: Apache-2.0 / Scala version: 2.10
Version: 2.1.3-s_2.10-spark_2.0 ( 691f90 | zip | jar ) / Date: 2017-04-14 / License: Apache-2.0 / Scala version: 2.10
Version: 2.1.3-s_2.11-spark_2.0 ( 691f90 | zip | jar ) / Date: 2017-04-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.1.3-s_2.11 ( 2194f7 | zip | jar ) / Date: 2017-04-14 / License: Apache-2.0 / Scala version: 2.11
Version: 2.1.3-s_2.10 ( 2194f7 | zip | jar ) / Date: 2017-04-14 / License: Apache-2.0 / Scala version: 2.10
Version: 2.1.2-s_2.11 ( 6c750f | zip | jar ) / Date: 2017-03-17 / License: Apache-2.0 / Scala version: 2.11
Version: 2.1.2-s_2.10 ( 6c750f | zip | jar ) / Date: 2017-03-17 / License: Apache-2.0 / Scala version: 2.10
Version: 2.1.2-s_2.11-spark_2.0 ( d7f20e | zip | jar ) / Date: 2017-03-17 / License: Apache-2.0 / Scala version: 2.11
Version: 2.1.2-s_2.10-spark_2.0 ( d7f20e | zip | jar ) / Date: 2017-03-17 / License: Apache-2.0 / Scala version: 2.10
Version: 2.1.1-s_2.11 ( e3bcbe | zip | jar ) / Date: 2017-01-27 / License: Apache-2.0 / Scala version: 2.11
Version: 2.1.1-s_2.10 ( e3bcbe | zip | jar ) / Date: 2017-01-27 / License: Apache-2.0 / Scala version: 2.10
Version: 2.1.0-s_2.11 ( a22449 | zip | jar ) / Date: 2017-01-20 / License: Apache-2.0 / Scala version: 2.11
Version: 2.1.0-s_2.10 ( a22449 | zip | jar ) / Date: 2017-01-20 / License: Apache-2.0 / Scala version: 2.10
Version: 2.0.0-s_2.11 ( 95ce6a | zip | jar ) / Date: 2016-10-04 / License: Apache-2.0 / Scala version: 2.11
Version: 2.0.0 ( 95ce6a | zip | jar ) / Date: 2016-10-03 / License: Apache-2.0 / Scala version: 2.10