spark-snowflake (homepage)

Snowflake Data Source for Apache Spark.

@snowflakedb / (2)

A package to load data into Spark SQL DataFrames from Snowflake and write them back to Snowflake.
Amazon S3 is used to transfer data in and out of Snowflake, and JDBC is used to automatically trigger the appropriate COPY and UNLOAD commands in Snowflake."


Tags

  • 1|sql
  • 1|da
  • 1|snowflake

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages net.snowflake:spark-snowflake_2.11:2.4.14-spark_2.3

sbt

In your sbt build file, add:

libraryDependencies += "net.snowflake" % "spark-snowflake_2.11" % "2.4.14-spark_2.3"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>net.snowflake</groupId>
    <artifactId>spark-snowflake_2.11</artifactId>
    <version>2.4.14-spark_2.3</version>
  </dependency>
</dependencies>

Releases

Version: 2.4.14-spark_2.3 ( 6079a9 | zip | jar ) / Date: 2019-06-12 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.14-spark_2.4 ( af3801 | zip | jar ) / Date: 2019-06-12 / License: Apache-2.0 / Scala version: 2.12

Version: 2.4.5-s_2.11-spark_2.1 ( 92fbde | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.5-s_2.11-spark_2.2 ( b90261 | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.5-s_2.11 ( 0c9d4f | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.4-s_2.11-spark_2.1 ( 70ac09 | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.4-s_2.11-spark_2.2 ( 7c8d0f | zip | jar ) / Date: 2018-09-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.3-s_2.11-spark_2.1 ( 2bc185 | zip | jar ) / Date: 2018-07-23 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.3-s_2.11-spark_2.2 ( 7c1594 | zip | jar ) / Date: 2018-07-23 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.3-s_2.11 ( bac08f | zip | jar ) / Date: 2018-07-23 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.2-s_2.11-spark_2.1 ( 8b1726 | zip | jar ) / Date: 2018-07-12 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.2-s_2.11-spark_2.2 ( 46e9be | zip | jar ) / Date: 2018-07-12 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.2-s_2.11 ( ecea26 | zip | jar ) / Date: 2018-07-12 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.1-s_2.11-spark_2.1 ( 486af9 | zip | jar ) / Date: 2018-06-29 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.1-s_2.11-spark_2.2 ( 1770c9 | zip | jar ) / Date: 2018-06-29 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.1-s_2.11 ( 412486 | zip | jar ) / Date: 2018-06-29 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.0-s_2.11-spark_2.1 ( 288c74 | zip | jar ) / Date: 2018-06-21 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.0-s_2.11-spark_2.2 ( 8ca70d | zip | jar ) / Date: 2018-06-21 / License: Apache-2.0 / Scala version: 2.11

Version: 2.4.0-s_2.11 ( c3463a | zip | jar ) / Date: 2018-06-21 / License: Apache-2.0 / Scala version: 2.11

Version: 2.3.3-s_2.11-spark_2.1 ( cae2e9 | zip | jar ) / Date: 2018-06-15 / License: Apache-2.0 / Scala version: 2.11

Version: 2.3.3-s_2.11-spark_2.2 ( f6b401 | zip | jar ) / Date: 2018-06-15 / License: Apache-2.0 / Scala version: 2.11

Version: 2.3.3-s_2.11 ( 4da8f6 | zip | jar ) / Date: 2018-06-15 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.8-s_2.11 ( 46f4d2 | zip | jar ) / Date: 2017-11-30 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.8-s_2.10 ( 46f4d2 | zip | jar ) / Date: 2017-11-30 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.8-s_2.11-spark_2.0 ( 555f36 | zip | jar ) / Date: 2017-11-30 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.8-s_2.10-spark_2.0 ( 555f36 | zip | jar ) / Date: 2017-11-30 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.7-s_2.11 ( 886a85 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.7-s_2.11-spark_2.0 ( af1c88 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.7-s_2.10 ( 886a85 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.7-s_2.10-spark_2.0 ( af1c88 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.6-s_2.10 ( 675507 | zip | jar ) / Date: 2017-09-14 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.6-s_2.10-spark_2.0 ( be4340 | zip | jar ) / Date: 2017-09-14 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.6-s_2.11-spark_2.0 ( be4340 | zip | jar ) / Date: 2017-09-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.6-s_2.11 ( 675507 | zip | jar ) / Date: 2017-09-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.4-s_2.10-spark_2.0 ( 15c300 | zip | jar ) / Date: 2017-08-04 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.4-s_2.11-spark_2.0 ( 15c300 | zip | jar ) / Date: 2017-08-04 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.4-s_2.10 ( 5896e4 | zip | jar ) / Date: 2017-08-04 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.4-s_2.11 ( 5896e4 | zip | jar ) / Date: 2017-08-04 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.3-s_2.11 ( 7feed6 | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.3-s_2.10 ( 7feed6 | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.3-s_2.11-spark_2.0 ( 8738dc | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.3-s_2.10-spark_2.0 ( 8738dc | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.1-s_2.11 ( f59160 | zip | jar ) / Date: 2017-05-12 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.1-s_2.10 ( f59160 | zip | jar ) / Date: 2017-05-12 / License: Apache-2.0 / Scala version: 2.10

Version: 2.2.1-s_2.11-spark_2.0 ( 70a099 | zip | jar ) / Date: 2017-05-12 / License: Apache-2.0 / Scala version: 2.11

Version: 2.2.1-s_2.10-spark_2.0 ( 70a099 | zip | jar ) / Date: 2017-05-12 / License: Apache-2.0 / Scala version: 2.10

Version: 2.1.3-s_2.10-spark_2.0 ( 691f90 | zip | jar ) / Date: 2017-04-14 / License: Apache-2.0 / Scala version: 2.10

Version: 2.1.3-s_2.11-spark_2.0 ( 691f90 | zip | jar ) / Date: 2017-04-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.1.3-s_2.11 ( 2194f7 | zip | jar ) / Date: 2017-04-14 / License: Apache-2.0 / Scala version: 2.11

Version: 2.1.3-s_2.10 ( 2194f7 | zip | jar ) / Date: 2017-04-14 / License: Apache-2.0 / Scala version: 2.10

Version: 2.1.2-s_2.11 ( 6c750f | zip | jar ) / Date: 2017-03-17 / License: Apache-2.0 / Scala version: 2.11

Version: 2.1.2-s_2.10 ( 6c750f | zip | jar ) / Date: 2017-03-17 / License: Apache-2.0 / Scala version: 2.10

Version: 2.1.2-s_2.11-spark_2.0 ( d7f20e | zip | jar ) / Date: 2017-03-17 / License: Apache-2.0 / Scala version: 2.11

Version: 2.1.2-s_2.10-spark_2.0 ( d7f20e | zip | jar ) / Date: 2017-03-17 / License: Apache-2.0 / Scala version: 2.10

Version: 2.1.1-s_2.11 ( e3bcbe | zip | jar ) / Date: 2017-01-27 / License: Apache-2.0 / Scala version: 2.11

Version: 2.1.1-s_2.10 ( e3bcbe | zip | jar ) / Date: 2017-01-27 / License: Apache-2.0 / Scala version: 2.10

Version: 2.1.0-s_2.11 ( a22449 | zip | jar ) / Date: 2017-01-20 / License: Apache-2.0 / Scala version: 2.11

Version: 2.1.0-s_2.10 ( a22449 | zip | jar ) / Date: 2017-01-20 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.0-s_2.11 ( 95ce6a | zip | jar ) / Date: 2016-10-04 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.0 ( 95ce6a | zip | jar ) / Date: 2016-10-03 / License: Apache-2.0 / Scala version: 2.10