A community index of third-party packages for Apache Spark.

Showing packages 251 - 300 out of 516

< Previous Next >

spark-sample-scripts

(WIP) This is a set of Spark application examples, which run on spark-shell for beginners

@dobachi / Latest release: 0.1.0 (2016-08-04) / Apache-2.0 / (0)

  • 1|example

spark-hdf5

A plugin to enable Apache Spark to read HDF5 files

@LLNL / Latest release: 0.0.4 (2016-09-10) / Apache-2.0 / (0)

  • 1|input
  • 1|sql
  • 1|hdf5

spark-kafka-writer

Write your RDDs and DStreams to Kafka seamlessly

@BenFradet / Latest release: 0.4.0 (2017-07-22) / Apache-2.0 / (0)

  • 1|streaming
  • 1|data source

rich-spark

Rich Spark adds more to Apache Spark

@mashin-io / No release yet / (0)

  • 1|ml
  • 1|library
  • 1|streaming

MCL_spark

An implementation of Markov Clustering algorithm for Spark in Scala

@joandre / Latest release: 1.0.0-s_2.11 (2016-08-15) / MIT / (0)

  • 1|graph

spark-ranking-algorithms

Ranking algorithms for Spark DataFrame

@yu-iskw / Latest release: 0.0.4 (2016-08-26) / Apache-2.0 / (0)

  • 1|ml
  • 1|machine learning
  • 1|scala

spark-graphx-cassandra

An example of Spark GraphX as an analytics engine and Cassandra as persistence layer.

@knoldus / No release yet / (1)

  • 1|graph
  • 1|ex

maelstrom

Maelstrom is an open source Kafka integration with Spark that is designed to be developer friendly, high performance (millisecond stream processing), scalable (consumes messges at Spark worker nodes), and is extremely reliable.

@jeoffreylim / No release yet / (0)

  • 1|streaming
  • 1|kafka

magellan

Geo Spatial Data Analytics on Spark

@yuanzhaoYZ / No release yet / (0)

shc

Apache HBase Connector for Apache Spark

@hortonworks-spark / No release yet / (0)

real-time-stream-processing-engine

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

@knoldus / No release yet / (0)

proxy4sparkui

Configure nginx on the master node for a reverse proxy to Apache Spark web UI and history server. No more ssh socks/tunnel.

@ekasitk / No release yet / (0)

  • 1|tool
  • 1|deployment

scalable-deeplearning

Scalable implementation of artificial neural networks for Spark deep learning

@avulanov / Latest release: 1.0.0 (2016-09-09) / Apache-2.0 / (1)

  • 1|deep learning
  • 1|machine learning

annoy4s

A Scala Implementation of Annoy which searches nearest neighbors given query point. Ann4s also provides DataFrame-based API for Apache Spark.

@mskimm / No release yet / (0)

  • 1|kNN
  • 1|machine learning

spark-timeseries

A library for time series analysis on Apache Spark

@sryza / Latest release: 0.4.1 (2016-11-15) / Apache-2.0 / (0)

spark-llap

A library to load data into Spark SQL DataFrames from Hive using LLAP

@hortonworks-spark / No release yet / (0)

carbondata

An indexed columnar file format for interactive query

@jackylk / No release yet / (0)

spark-snowflake

Snowflake Data Source for Apache Spark.

@snowflakedb / Latest release: 2.5.1-spark_2.4 (2019-08-01) / Apache-2.0 / (2)

  • 1|sql
  • 1|snowflake
  • 1|da

Sparkathon

A library having Java and Scala examples for Spark 2.0.0

@knoldus / No release yet / (1)

  • 1|java
  • 1|example
  • 1|scala

test

test

@kanterov / Latest release: 0.3.1 (2016-10-03) / Apache-2.0 / (0)

spark-orientdb

Apache Spark datasource for OrientDB

@sbcd90 / No release yet / (1)

  • 1|orientdb
  • 1|spark datasource

raspi-spark-streaming-mqtt

Stream Data analysis on IoT generated data via Apache spark

@shiv4nsh / No release yet / (0)

  • 1|streaming
  • 1|spark
  • 1|example

spark-workday

Spark Connector for Workday

@springml / Latest release: 1.1.0 (2017-03-10) / Apache-2.0 / (1)

spark-LDA-example

A example for Spark ML and StanfordNLP for topic discovery using LDA clustering

@shiv4nsh / No release yet / (0)

  • 1|clustering
  • 1|spark
  • 1|scala

spark-bigquery

Spark connector for BigQuery

@appsflyer-dev / Latest release: 0.1.1 (2017-01-29) / Apache-2.0 / (0)

  • 1|BigQuery

spark-transformer

Standard Spark transformations

@mrpowers / No release yet / (0)

cassandra-spark-akka-http-starter-kit

A REST Api for CRUD operations on Cassandra using Apache Spark

@shiv4nsh / No release yet / (0)

  • 1|application
  • 1|spark
  • 1|example

dist-keras

Distributed deep learning with Keras and Apache Spark.

@JoeriHermans / No release yet / (0)

  • 1|machine learning
  • 1|pyspark

GeoSpark

A Cluster Computing System for Processing Large-Scale Spatial Data

@DataSystemsLab / No release yet / (1)

  • 1|geometry operations
  • 1|geospatial
  • 1|spatial queries

spark-utils

Practical utilities for spark applications

@CeON / Latest release: 1.0.0 (2016-10-19) / Apache-2.0 / (0)

spark_jupyter

This library customizes some DataFrame outputs.

@jeanbaptistepriez / No release yet / (1)

  • 1|pyth
  • 1|jupyter
  • 1|pyspark

Greedy-K-means

Greedy K-means Spark Package in Python

@Hongfu-Liu / No release yet / (0)

spark-github-pr

Spark SQL datasource for GitHub PR API

@lightcopy / Latest release: 1.3.0-s_2.10 (2016-12-25) / Apache-2.0 / (0)

  • 1|input
  • 1|library
  • 1|sql

pu4spark

Positive-Unlabeled Learning for Apache Spark

@ispras / No release yet / (0)

  • 1|machine learning

spark-kafka-0-8-sql

Spark Structured Streaming Kafka 0.8 Source Implementation

@jerryshao / No release yet / (0)

spark-netsuite

Spark NetSuite Connector

@springml / Latest release: 1.1.0 (2017-03-10) / Apache-2.0 / (2)

sparklyr

R interface for Apache Spark

@rstudio / No release yet / (0)

spark-word2vec

A parallel implementation of word2vec based on Spark

@chen-lin / No release yet / (1)

  • 1|machine learning

spark-openstack

Openstack Spark cluster deployment

@ispras / Latest release: 0.9.5 (2016-11-10) / Apache-2.0 / (0)

  • 1|tools
  • 1|deployment

spark-fim

A library of scalable frequent itemset mining algorithms based on Spark

@chen-lin / No release yet / (1)

  • 1|frequent itemset mining
  • 1|association rule mining
  • 1|data mining

spark-hadoopcryptoledger-ds

A Spark datasource for the HadoopCryptoLedger library

@ZuInnoTe / Latest release: 1.3.2-s_2.12 (2021-12-24) / Apache-2.0 / (1)

  • 1|hadoocryptoledger
  • 1|data source
  • 1|bitcoin

sparkhpc

launching and controlling spark on hpc clusters made easy

@rokroskar / No release yet / (0)

  • 1|hpc
  • 1|high-performance computing
  • 1|pyspark

Spark-AdaOptimizer

implement Adam for stochastic optimization.

@VinceShieh / Latest release: 0.1 (2016-12-13) / Apache-2.0 / (1)

  • 1|ml
  • 1|ma
  • 1|mllib

spark-fm

A parallel implementation of factorization machines based on Spark

@chen-lin / No release yet / (1)

  • 1|factorization machines
  • 1|machine learning

spark-mergejoin

Robust and scalable join operators using sort-merge algorithm (high data skew, low cardinality, etc)

@hindog / Latest release: 2.0.1 (2017-04-04) / Apache-2.0 / (0)

  • 1|core

SpectralLDA-TensorSpark

Quick summary: This code implements a spectral (third order tensor decomposition) learning method for learning LDA topic model on Spark.

@FurongHuang / Latest release: 1.0 (2016-12-04) / Apache-2.0 / (1)

  • 1|machine learning

kraps-server

Kraps: safe, robust and reliable data pipelines over Apache Spark.

@krapsh / Latest release: 0.1.9-s_2.11 (2017-01-16) / Apache-2.0 / (0)

  • 1|API
  • 1|haskell
  • 1|REST

Spark_Knapsack

A PySpark simple greedy parallel implementation of 0-1 Knapsack algorithm.

@drulm / No release yet / (0)

spark-zuora

Spark Zuora Connector

@springml / Latest release: 1.1.0 (2017-03-10) / Apache-2.0 / (1)

spark-lp

Distributed Linear Programming Solver with Apache Spark

@ehsanmok / No release yet / (1)

  • 1|machine learning
  • 1|optimization
  • 1|convex

< Previous Next >