smartframes (homepage)

Enhanced Python Dataframes for Spark

@dondrake / (0)

Smartframes allow you to define a class by just creating the schema that represents the fields and datatypes. You can then create an object and set the values like any other Python class. When you are ready to store that in a DataFrame, just call the createRow() method.
Install:
pip install smartframes

Tags

  • 1|sql
  • 1|python
  • 1|pyspark

How to

This package doesn't have any releases published in the Spark Packages repo, or with maven coordinates supplied. You may have to build this package from source, or it may simply be a script. To use this Spark Package, please follow the instructions in the README.

Releases

No releases yet.