memsql-spark-connector (homepage)

A connector for MemSQL and Spark

@memsql / (6)

The MemSQL 3.0 Spark connector enables users to load data from MemSQL tables into Spark Dataframes, and write Spark Dataframes to MemSQL tables. The connector has robust  SQL pushdown capabilities, is a true Spark Data Source,  supports load data compression, and is compatible with the latest versions of Spark and MemSQL.


Tags

  • 2|memsql
  • 1|spark
  • 1|jdbc
  • 1|pushdown
  • 1|connector

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages com.memsql:memsql-spark-connector_2.11:3.0.2-spark-2.4.4

sbt

In your sbt build file, add:

libraryDependencies += "com.memsql" % "memsql-spark-connector_2.11" % "3.0.2-spark-2.4.4"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>com.memsql</groupId>
    <artifactId>memsql-spark-connector_2.11</artifactId>
    <version>3.0.2-spark-2.4.4</version>
  </dependency>
</dependencies>

Releases

Version: 3.0.2-spark-2.4.4 ( 42bc60 | zip | jar ) / Date: 2020-08-04 / License: Apache-2.0 / Scala version: 2.11

Version: 3.0.2-spark-2.3.4 ( 42bc60 | zip | jar ) / Date: 2020-08-04 / License: Apache-2.0 / Scala version: 2.11

Version: 3.0.1-spark-2.4.4 ( 8cf9c7 | zip | jar ) / Date: 2020-06-12 / License: Apache-2.0 / Scala version: 2.11

Version: 3.0.1-spark-2.3.4 ( 8cf9c7 | zip | jar ) / Date: 2020-06-12 / License: Apache-2.0 / Scala version: 2.11

Version: 3.0.0-spark-2.3.4 ( 9aebc5 | zip | jar ) / Date: 2020-05-28 / License: Apache-2.0 / Scala version: 2.11

Version: 3.0.0-spark-2.4.4 ( 9aebc5 | zip | jar ) / Date: 2020-05-28 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.5 ( 56abf8 | zip | jar ) / Date: 2018-02-22 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.4 ( d29fc2 | zip | jar ) / Date: 2017-10-02 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.3 ( b8fd0c | zip | jar ) / Date: 2017-07-25 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.2 ( 9200c5 | zip | jar ) / Date: 2017-05-11 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.1 ( 033740 | zip | jar ) / Date: 2017-02-07 / License: Apache-2.0 / Scala version: 2.11