spark-netflow (homepage)

NetFlow data source for Spark SQL and DataFrames

@sadikovi / (2)

Reading NetFlow files using Spark SQL


Tags

  • 1|library
  • 1|sql
  • 1|input
  • 1|data source
  • 1|netflow

How to

Include this package in your Spark Applications using:

spark-shell, pyspark, or spark-submit

> $SPARK_HOME/bin/spark-shell --packages com.github.sadikovi:spark-netflow_2.11:2.0.4

sbt

If you use the sbt-spark-package plugin, in your sbt build file, add:

spDependencies += "sadikovi/spark-netflow:2.0.4"

Otherwise,

libraryDependencies += "com.github.sadikovi" % "spark-netflow_2.11" % "2.0.4"

Maven

In your pom.xml, add:
<dependencies>
  <!-- list of dependencies -->
  <dependency>
    <groupId>com.github.sadikovi</groupId>
    <artifactId>spark-netflow_2.11</artifactId>
    <version>2.0.4</version>
  </dependency>
</dependencies>

Releases

Version: 2.0.4-s_2.11 ( ab4b67 | zip | jar ) / Date: 2017-09-08 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.4-s_2.10 ( ab4b67 | zip | jar ) / Date: 2017-09-08 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.3-s_2.10 ( bd5979 | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.3-s_2.11 ( bd5979 | zip | jar ) / Date: 2017-06-29 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.2-s_2.10 ( f9fc2a | zip | jar ) / Date: 2017-06-02 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.2-s_2.11 ( f9fc2a | zip | jar ) / Date: 2017-06-02 / License: Apache-2.0 / Scala version: 2.11

Version: 1.3.1-s_2.10 ( c0f65e | zip | jar ) / Date: 2017-06-02 / License: Apache-2.0 / Scala version: 2.10

Version: 1.3.1-s_2.11 ( c0f65e | zip | jar ) / Date: 2017-06-02 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.1-s_2.10 ( b7e839 | zip | jar ) / Date: 2017-04-21 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.1-s_2.11 ( b7e839 | zip | jar ) / Date: 2017-04-21 / License: Apache-2.0 / Scala version: 2.11

Version: 2.0.0-s_2.10 ( 6974bc | zip | jar ) / Date: 2017-02-18 / License: Apache-2.0 / Scala version: 2.10

Version: 2.0.0-s_2.11 ( 6974bc | zip | jar ) / Date: 2017-02-18 / License: Apache-2.0 / Scala version: 2.11

Version: 1.3.0-s_2.10 ( 675f07 | zip | jar ) / Date: 2016-12-25 / License: Apache-2.0 / Scala version: 2.10

Version: 1.3.0-s_2.11 ( 675f07 | zip | jar ) / Date: 2016-12-25 / License: Apache-2.0 / Scala version: 2.11

Version: 1.2.0-s_2.11 ( f1350f | zip | jar ) / Date: 2016-11-14 / License: Apache-2.0 / Scala version: 2.11

Version: 1.2.0-s_2.10 ( f1350f | zip | jar ) / Date: 2016-11-14 / License: Apache-2.0 / Scala version: 2.10

Version: 1.1.0-s_2.10 ( a8ec2b | zip | jar ) / Date: 2016-06-26 / License: Apache-2.0 / Scala version: 2.10

Version: 1.1.0-s_2.11 ( adac01 | zip | jar ) / Date: 2016-06-26 / License: Apache-2.0 / Scala version: 2.11

Version: 1.0.0-s_2.11 ( 866238 | zip | jar ) / Date: 2016-05-04 / License: Apache-2.0 / Scala version: 2.11

Version: 1.0.0-s_2.10 ( 866238 | zip | jar ) / Date: 2016-05-04 / License: Apache-2.0 / Scala version: 2.10

Version: 0.2.2-s_2.10 ( d75653 | zip | jar ) / Date: 2016-04-10 / License: Apache-2.0 / Scala version: 2.10

Version: 0.2.2-s_2.11 ( d75653 | zip | jar ) / Date: 2016-04-10 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.1-s_2.11 ( d2f67f | zip | jar ) / Date: 2016-03-15 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.1-s_2.10 ( d2f67f | zip | jar ) / Date: 2016-03-15 / License: Apache-2.0 / Scala version: 2.10

Version: 0.2.0-s_2.11 ( a22c5b | zip | jar ) / Date: 2016-03-06 / License: Apache-2.0 / Scala version: 2.11

Version: 0.2.0-s_2.10 ( a22c5b | zip | jar ) / Date: 2016-03-06 / License: Apache-2.0 / Scala version: 2.10

Version: 0.1.0-s_2.10 ( 900b48 | zip | jar ) / Date: 2016-02-15 / License: Apache-2.0 / Scala version: 2.10

Version: 0.0.2-s_2.10 ( 1a22ac | zip | jar ) / Date: 2016-01-30 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 29% , 1.1.0 - 44% , 1.2.0 - 47% , 1.3.0 - 81% , 1.4.0 - 100% , 1.5.0 - 90%

Version: 0.0.1 ( 7fbcf6 | zip ) / Date: 2016-01-24 / License: Apache-2.0

Version: 0.0.1-s_2.10 ( 39a333 | zip | jar ) / Date: 2016-01-20 / License: Apache-2.0 / Scala version: 2.10

Spark Scala/Java API compatibility: 1.0.0 - 30% , 1.1.0 - 46% , 1.2.0 - 48% , 1.3.0 - 84% , 1.4.0 - 100% , 1.5.0 - 92%