spark-csv (homepage)

Spark SQL CSV data source

@databricks / (10)

This packages implements a CSV data source for Apache Spark. CSV files can be read as DataFrame.

Tags

  • 4|csv
  • 3|sql
  • 2|DataSource
  • 1|SparkSQL

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages com.databricks:spark-csv_2.11:1.5.0

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "databricks/spark-csv:1.5.0"

Otherwise,

libraryDependencies += "com.databricks" % "spark-csv_2.11" % "1.5.0"

Maven

In your pom.xml, add: 
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>com.databricks</groupId>
    <artifactId>spark-csv_2.11</artifactId>
    <version>1.5.0</version>
  </dependency>
</dependencies>

Releases

Version: 1.5.0-s_2.11 ( 1ae649 | zip | jar ) / Date: 2016-09-07 / License: Apache-2.0 / Scala version: 2.11

Version: 1.5.0-s_2.10 ( 1ae649 | zip | jar ) / Date: 2016-09-07 / License: Apache-2.0 / Scala version: 2.10

Version: 1.4.0-s_2.11 ( cbc72f | zip | jar ) / Date: 2016-03-05 / License: Apache-2.0 / Scala version: 2.11

Version: 1.4.0-s_2.10 ( cbc72f | zip | jar ) / Date: 2016-03-05 / License: Apache-2.0 / Scala version: 2.10

Version: 1.3.0-s_2.10 ( 84858c | zip | jar ) / Date: 2015-11-20 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 92% , - 26% , - 100% , - 6% , - 79% , - 22%

Version: 1.3.0-s_2.11 ( 84858c | zip | jar ) / Date: 2015-11-20 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 79% , - 92% , - 26% , - 100%

Version: 1.2.0-s_2.11 ( 82344b | zip | jar ) / Date: 2015-08-07 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 100% , - 43% , - 77%

Version: 1.2.0-s_2.10 ( 82344b | zip | jar ) / Date: 2015-08-07 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 100% , - 43% , - 11% , - 77% , - 38%

Version: 1.0.3 ( 464a3e | zip | jar ) / Date: 2015-04-04 / License: Apache-2.0 / Scala version: 2.11

Spark Scala/Java API compatibility: - 100% , - 43%

Version: 1.0.2 ( 8a2503 | zip | jar ) / Date: 2015-04-04 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 43% , - 11% , - 100% , - 37%

Version: 1.0.0 ( 074388 | zip | jar ) / Date: 2015-03-17 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: - 37% , - 43% , - 11% , - 100%

Version: 0.1.1 ( a0b932 | zip | jar ) / Date: 2015-01-12 / License: Apache-2.0

Version: 0.1 ( 09ebf6 | zip | jar ) / Date: 2014-12-31 / License: BSD 3-Clause