Binary compatibility report for the spark-redshift-0.5.0 library between 1.4.0 and 1.2.0 versions (relating to the portability of client application spark-redshift-0.5.0.jar)

Test Info

Library Name	spark-redshift-0.5.0
Version #1	1.4.0
Version #2	1.2.0
Java Version	1.7.0_75

Test Results

Total Java ARchives	3
Total Methods / Classes	337 / 2616
Verdict	Incompatible (55.8%)

Problem Summary

	Severity	Count
Added Methods	-	105
Removed Methods	High	175
Problems with Data Types	High	11
	Medium	2
	Low	0
Problems with Methods	High	0
	Medium	0
	Low	0

Added Methods (105)

spark-sql_2.10-1.2.0.jar, BaseRelation.class
package org.apache.spark.sql.sources
BaseRelation.schema ( ) [abstract] :  org.apache.spark.sql.catalyst.types.StructType

spark-sql_2.10-1.2.0.jar, PrunedFilteredScan.class
package org.apache.spark.sql.sources
PrunedFilteredScan.PrunedFilteredScan ( )

spark-sql_2.10-1.2.0.jar, SQLContext.class
package org.apache.spark.sql
SQLContext.abs ( catalyst.expressions.Expression e ) :  catalyst.expressions.Abs
SQLContext.applySchema ( org.apache.spark.rdd.RDD<catalyst.expressions.Row> rowRDD, catalyst.types.StructType schema ) :  SchemaRDD
SQLContext.applySchemaToPythonRDD ( org.apache.spark.rdd.RDD<Object[ ]> rdd, catalyst.types.StructType schema ) :  SchemaRDD
SQLContext.applySchemaToPythonRDD ( org.apache.spark.rdd.RDD<Object[ ]> rdd, String schemaString ) :  SchemaRDD
SQLContext.approxCountDistinct ( catalyst.expressions.Expression e, double rsd ) :  catalyst.expressions.ApproxCountDistinct
SQLContext.autoBroadcastJoinThreshold ( ) :  int
SQLContext.avg ( catalyst.expressions.Expression e ) :  catalyst.expressions.Average
SQLContext.baseRelationToSchemaRDD ( sources.BaseRelation baseRelation ) :  SchemaRDD
SQLContext.bigDecimalToLiteral ( scala.math.BigDecimal d ) :  catalyst.expressions.Literal
SQLContext.binaryToLiteral ( byte[ ] a ) :  catalyst.expressions.Literal
SQLContext.booleanToLiteral ( boolean b ) :  catalyst.expressions.Literal
SQLContext.byteToLiteral ( byte b ) :  catalyst.expressions.Literal
SQLContext.cacheQuery ( SchemaRDD query, scala.Option<String> tableName, org.apache.spark.storage.StorageLevel storageLevel ) :  void
SQLContext.clear ( ) :  void
SQLContext.codegenEnabled ( ) :  boolean
SQLContext.columnBatchSize ( ) :  int
SQLContext.columnNameOfCorruptRecord ( ) :  String
SQLContext.count ( catalyst.expressions.Expression e ) :  catalyst.expressions.Count
SQLContext.countDistinct ( scala.collection.Seq<catalyst.expressions.Expression> e ) :  catalyst.expressions.CountDistinct
SQLContext.createParquetFile ( String path, boolean allowExisting, org.apache.hadoop.conf.Configuration conf, scala.reflect.api.TypeTags.TypeTag<A> p4 ) :  SchemaRDD
SQLContext.createSchemaRDD ( org.apache.spark.rdd.RDD<A> rdd, scala.reflect.api.TypeTags.TypeTag<A> p2 ) :  SchemaRDD
SQLContext.dateToLiteral ( java.sql.Date d ) :  catalyst.expressions.Literal
SQLContext.decimalToLiteral ( catalyst.types.decimal.Decimal d ) :  catalyst.expressions.Literal
SQLContext.defaultSizeInBytes ( ) :  long
SQLContext.dialect ( ) :  String
SQLContext.doubleToLiteral ( double d ) :  catalyst.expressions.Literal
SQLContext.DslAttribute ( catalyst.expressions.AttributeReference a ) :  catalyst.dsl.package.ExpressionConversions.DslAttribute
SQLContext.DslExpression ( catalyst.expressions.Expression e ) :  catalyst.dsl.package.ExpressionConversions.DslExpression
SQLContext.DslString ( String s ) :  catalyst.dsl.package.ExpressionConversions.DslString
SQLContext.DslSymbol ( scala.Symbol sym ) :  catalyst.dsl.package.ExpressionConversions.DslSymbol
SQLContext.externalSortEnabled ( ) :  boolean
SQLContext.extraStrategies ( ) :  scala.collection.Seq<catalyst.planning.GenericStrategy<execution.SparkPlan>>
SQLContext.extraStrategies_.eq ( scala.collection.Seq<catalyst.planning.GenericStrategy<execution.SparkPlan>> p1 ) :  void
SQLContext.first ( catalyst.expressions.Expression e ) :  catalyst.expressions.First
SQLContext.floatToLiteral ( float f ) :  catalyst.expressions.Literal
SQLContext.inMemoryPartitionPruning ( ) :  boolean
SQLContext.intToLiteral ( int i ) :  catalyst.expressions.Literal
SQLContext.invalidateCache ( catalyst.plans.logical.LogicalPlan plan ) :  void
SQLContext.isParquetBinaryAsString ( ) :  boolean
SQLContext.jsonFile ( String path ) :  SchemaRDD
SQLContext.jsonFile ( String path, double samplingRatio ) :  SchemaRDD
SQLContext.jsonFile ( String path, catalyst.types.StructType schema ) :  SchemaRDD
SQLContext.jsonRDD ( org.apache.spark.rdd.RDD<String> json ) :  SchemaRDD
SQLContext.jsonRDD ( org.apache.spark.rdd.RDD<String> json, double samplingRatio ) :  SchemaRDD
SQLContext.jsonRDD ( org.apache.spark.rdd.RDD<String> json, catalyst.types.StructType schema ) :  SchemaRDD
SQLContext.last ( catalyst.expressions.Expression e ) :  catalyst.expressions.Last
SQLContext.logicalPlanToSparkQuery ( catalyst.plans.logical.LogicalPlan plan ) :  SchemaRDD
SQLContext.longToLiteral ( long l ) :  catalyst.expressions.Literal
SQLContext.lookupCachedData ( catalyst.plans.logical.LogicalPlan plan ) :  scala.Option<CachedData>
SQLContext.lookupCachedData ( SchemaRDD query ) :  scala.Option<CachedData>
SQLContext.lower ( catalyst.expressions.Expression e ) :  catalyst.expressions.Lower
SQLContext.max ( catalyst.expressions.Expression e ) :  catalyst.expressions.Max
SQLContext.min ( catalyst.expressions.Expression e ) :  catalyst.expressions.Min
SQLContext.numShufflePartitions ( ) :  int
SQLContext.CacheManager..cachedData ( ) :  scala.collection.mutable.ArrayBuffer<CachedData>
SQLContext.CacheManager..cacheLock ( ) :  java.util.concurrent.locks.ReentrantReadWriteLock
SQLContext.CacheManager._setter_.CacheManager..cachedData_.eq ( scala.collection.mutable.ArrayBuffer p1 ) :  void
SQLContext.CacheManager._setter_.CacheManager..cacheLock_.eq ( java.util.concurrent.locks.ReentrantReadWriteLock p1 ) :  void
SQLContext.SQLConf._setter_.settings_.eq ( java.util.Map p1 ) :  void
SQLContext.parquetCompressionCodec ( ) :  String
SQLContext.parquetFile ( String path ) :  SchemaRDD
SQLContext.parquetFilterPushDown ( ) :  boolean
SQLContext.parseDataType ( String dataTypeString ) :  catalyst.types.DataType
SQLContext.registerFunction ( String name, scala.Function10<?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function11<?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function12<?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function13<?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function14<?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function15<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function16<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function17<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function18<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function19<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function1<?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function20<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function21<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function22<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function2<?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function3<?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function4<?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function5<?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function6<?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function7<?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function8<?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function9<?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerPython ( String name, byte[ ] command, java.util.Map<String,String> envVars, java.util.List<String> pythonIncludes, String pythonExec, java.util.List<org.apache.spark.broadcast.Broadcast<org.apache.spark.api.python.PythonBroadcast>> broadcastVars, org.apache.spark.Accumulator<java.util.List<byte[ ]>> accumulator, String stringDataType ) :  void
SQLContext.registerRDDAsTable ( SchemaRDD rdd, String tableName ) :  void
SQLContext.settings ( ) :  java.util.Map<String,String>
SQLContext.shortToLiteral ( short s ) :  catalyst.expressions.Literal
SQLContext.sql ( String sqlText ) :  SchemaRDD
SQLContext.sqlParser ( ) :  catalyst.SparkSQLParser
SQLContext.sqrt ( catalyst.expressions.Expression e ) :  catalyst.expressions.Sqrt
SQLContext.stringToLiteral ( String s ) :  catalyst.expressions.Literal
SQLContext.sum ( catalyst.expressions.Expression e ) :  catalyst.expressions.Sum
SQLContext.sumDistinct ( catalyst.expressions.Expression e ) :  catalyst.expressions.SumDistinct
SQLContext.symbolToUnresolvedAttribute ( scala.Symbol s ) :  catalyst.analysis.UnresolvedAttribute
SQLContext.table ( String tableName ) :  SchemaRDD
SQLContext.timestampToLiteral ( java.sql.Timestamp t ) :  catalyst.expressions.Literal
SQLContext.tryUncacheQuery ( SchemaRDD query, boolean blocking ) :  boolean
SQLContext.uncacheQuery ( SchemaRDD query, boolean blocking ) :  void
SQLContext.upper ( catalyst.expressions.Expression e ) :  catalyst.expressions.Upper
SQLContext.useCachedData ( catalyst.plans.logical.LogicalPlan plan ) :  catalyst.plans.logical.LogicalPlan
SQLContext.useCompression ( ) :  boolean

to the top

Removed Methods (175)

spark-sql_2.10-1.4.0.jar, BaseRelation.class
package org.apache.spark.sql.sources
BaseRelation.needConversion ( ) :  boolean
BaseRelation.schema ( ) [abstract] :  org.apache.spark.sql.types.StructType

spark-sql_2.10-1.4.0.jar, CreatableRelationProvider.class
package org.apache.spark.sql.sources
CreatableRelationProvider.createRelation ( org.apache.spark.sql.SQLContext p1, org.apache.spark.sql.SaveMode p2, scala.collection.immutable.Map<String,String> p3, org.apache.spark.sql.DataFrame p4 ) [abstract] :  BaseRelation

spark-sql_2.10-1.4.0.jar, DataFrame.class
package org.apache.spark.sql
DataFrame.agg ( java.util.Map<String,String> exprs ) :  DataFrame
DataFrame.agg ( Column expr, Column... exprs ) :  DataFrame
DataFrame.agg ( Column expr, scala.collection.Seq<Column> exprs ) :  DataFrame
DataFrame.agg ( scala.collection.immutable.Map<String,String> exprs ) :  DataFrame
DataFrame.agg ( scala.Tuple2<String,String> aggExpr, scala.collection.Seq<scala.Tuple2<String,String>> aggExprs ) :  DataFrame
DataFrame.apply ( String colName ) :  Column
DataFrame.as ( scala.Symbol alias ) :  DataFrame
DataFrame.as ( String alias ) :  DataFrame
DataFrame.cache ( ) :  DataFrame
DataFrame.cache ( ) :  RDDApi
DataFrame.coalesce ( int numPartitions ) :  DataFrame
DataFrame.col ( String colName ) :  Column
DataFrame.collect ( ) :  Object
DataFrame.collect ( ) :  Row[ ]
DataFrame.collectAsList ( ) :  java.util.List<Row>
DataFrame.columns ( ) :  String[ ]
DataFrame.count ( ) :  long
DataFrame.cube ( Column... cols ) :  GroupedData
DataFrame.cube ( scala.collection.Seq<Column> cols ) :  GroupedData
DataFrame.cube ( String col1, scala.collection.Seq<String> cols ) :  GroupedData
DataFrame.cube ( String col1, String... cols ) :  GroupedData
DataFrame.DataFrame ( SQLContext sqlContext, catalyst.plans.logical.LogicalPlan logicalPlan )
DataFrame.DataFrame ( SQLContext sqlContext, SQLContext.QueryExecution queryExecution )
DataFrame.describe ( scala.collection.Seq<String> cols ) :  DataFrame
DataFrame.describe ( String... cols ) :  DataFrame
DataFrame.distinct ( ) :  DataFrame
DataFrame.drop ( String colName ) :  DataFrame
DataFrame.dropDuplicates ( ) :  DataFrame
DataFrame.dropDuplicates ( scala.collection.Seq<String> colNames ) :  DataFrame
DataFrame.dropDuplicates ( String[ ] colNames ) :  DataFrame
DataFrame.dtypes ( ) :  scala.Tuple2<String,String>[ ]
DataFrame.except ( DataFrame other ) :  DataFrame
DataFrame.explain ( ) :  void
DataFrame.explain ( boolean extended ) :  void
DataFrame.explode ( scala.collection.Seq<Column> input, scala.Function1<Row,scala.collection.TraversableOnce<A>> f, scala.reflect.api.TypeTags.TypeTag<A> p3 ) :  DataFrame
DataFrame.explode ( String inputColumn, String outputColumn, scala.Function1<A,scala.collection.TraversableOnce<B>> f, scala.reflect.api.TypeTags.TypeTag<B> p4 ) :  DataFrame
DataFrame.filter ( Column condition ) :  DataFrame
DataFrame.filter ( String conditionExpr ) :  DataFrame
DataFrame.first ( ) :  Object
DataFrame.first ( ) :  Row
DataFrame.flatMap ( scala.Function1<Row,scala.collection.TraversableOnce<R>> f, scala.reflect.ClassTag<R> p2 ) :  org.apache.spark.rdd.RDD<R>
DataFrame.foreach ( scala.Function1<Row,scala.runtime.BoxedUnit> f ) :  void
DataFrame.foreachPartition ( scala.Function1<scala.collection.Iterator<Row>,scala.runtime.BoxedUnit> f ) :  void
DataFrame.groupBy ( Column... cols ) :  GroupedData
DataFrame.groupBy ( scala.collection.Seq<Column> cols ) :  GroupedData
DataFrame.groupBy ( String col1, scala.collection.Seq<String> cols ) :  GroupedData
DataFrame.groupBy ( String col1, String... cols ) :  GroupedData
DataFrame.head ( ) :  Row
DataFrame.head ( int n ) :  Row[ ]
DataFrame.intersect ( DataFrame other ) :  DataFrame
DataFrame.isLocal ( ) :  boolean
DataFrame.javaRDD ( ) :  org.apache.spark.api.java.JavaRDD<Row>
DataFrame.javaToPython ( ) :  org.apache.spark.api.java.JavaRDD<byte[ ]>
DataFrame.join ( DataFrame right ) :  DataFrame
DataFrame.join ( DataFrame right, Column joinExprs ) :  DataFrame
DataFrame.join ( DataFrame right, Column joinExprs, String joinType ) :  DataFrame
DataFrame.join ( DataFrame right, String usingColumn ) :  DataFrame
DataFrame.limit ( int n ) :  DataFrame
DataFrame.logicalPlan ( ) :  catalyst.plans.logical.LogicalPlan
DataFrame.map ( scala.Function1<Row,R> f, scala.reflect.ClassTag<R> p2 ) :  org.apache.spark.rdd.RDD<R>
DataFrame.mapPartitions ( scala.Function1<scala.collection.Iterator<Row>,scala.collection.Iterator<R>> f, scala.reflect.ClassTag<R> p2 ) :  org.apache.spark.rdd.RDD<R>
DataFrame.na ( ) :  DataFrameNaFunctions
DataFrame.numericColumns ( ) :  scala.collection.Seq<catalyst.expressions.Expression>
DataFrame.orderBy ( Column... sortExprs ) :  DataFrame
DataFrame.orderBy ( scala.collection.Seq<Column> sortExprs ) :  DataFrame
DataFrame.orderBy ( String sortCol, scala.collection.Seq<String> sortCols ) :  DataFrame
DataFrame.orderBy ( String sortCol, String... sortCols ) :  DataFrame
DataFrame.DataFrame..logicalPlanToDataFrame ( catalyst.plans.logical.LogicalPlan logicalPlan ) :  DataFrame
DataFrame.persist ( ) :  DataFrame
DataFrame.persist ( ) :  RDDApi
DataFrame.persist ( org.apache.spark.storage.StorageLevel newLevel ) :  DataFrame
DataFrame.persist ( org.apache.spark.storage.StorageLevel newLevel ) :  RDDApi
DataFrame.printSchema ( ) :  void
DataFrame.queryExecution ( ) :  SQLContext.QueryExecution
DataFrame.randomSplit ( double[ ] weights ) :  DataFrame[ ]
DataFrame.randomSplit ( double[ ] weights, long seed ) :  DataFrame[ ]
DataFrame.randomSplit ( scala.collection.immutable.List<Object> weights, long seed ) :  DataFrame[ ]
DataFrame.rdd ( ) :  org.apache.spark.rdd.RDD<Row>
DataFrame.registerTempTable ( String tableName ) :  void
DataFrame.repartition ( int numPartitions ) :  DataFrame
DataFrame.resolve ( String colName ) :  catalyst.expressions.NamedExpression
DataFrame.rollup ( Column... cols ) :  GroupedData
DataFrame.rollup ( scala.collection.Seq<Column> cols ) :  GroupedData
DataFrame.rollup ( String col1, scala.collection.Seq<String> cols ) :  GroupedData
DataFrame.rollup ( String col1, String... cols ) :  GroupedData
DataFrame.sample ( boolean withReplacement, double fraction ) :  DataFrame
DataFrame.sample ( boolean withReplacement, double fraction, long seed ) :  DataFrame
DataFrame.schema ( ) :  types.StructType
DataFrame.select ( Column... cols ) :  DataFrame
DataFrame.select ( scala.collection.Seq<Column> cols ) :  DataFrame
DataFrame.select ( String col, scala.collection.Seq<String> cols ) :  DataFrame
DataFrame.select ( String col, String... cols ) :  DataFrame
DataFrame.selectExpr ( scala.collection.Seq<String> exprs ) :  DataFrame
DataFrame.selectExpr ( String... exprs ) :  DataFrame
DataFrame.show ( ) :  void
DataFrame.show ( int numRows ) :  void
DataFrame.showString ( int numRows ) :  String
DataFrame.sort ( Column... sortExprs ) :  DataFrame
DataFrame.sort ( scala.collection.Seq<Column> sortExprs ) :  DataFrame
DataFrame.sort ( String sortCol, scala.collection.Seq<String> sortCols ) :  DataFrame
DataFrame.sort ( String sortCol, String... sortCols ) :  DataFrame
DataFrame.sqlContext ( ) :  SQLContext
DataFrame.stat ( ) :  DataFrameStatFunctions
DataFrame.take ( int n ) :  Object
DataFrame.take ( int n ) :  Row[ ]
DataFrame.toDF ( ) :  DataFrame
DataFrame.toDF ( scala.collection.Seq<String> colNames ) :  DataFrame
DataFrame.toDF ( String... colNames ) :  DataFrame
DataFrame.toJavaRDD ( ) :  org.apache.spark.api.java.JavaRDD<Row>
DataFrame.toJSON ( ) :  org.apache.spark.rdd.RDD<String>
DataFrame.toString ( ) :  String
DataFrame.unionAll ( DataFrame other ) :  DataFrame
DataFrame.unpersist ( ) :  DataFrame
DataFrame.unpersist ( ) :  RDDApi
DataFrame.unpersist ( boolean blocking ) :  DataFrame
DataFrame.unpersist ( boolean blocking ) :  RDDApi
DataFrame.where ( Column condition ) :  DataFrame
DataFrame.withColumn ( String colName, Column col ) :  DataFrame
DataFrame.withColumnRenamed ( String existingName, String newName ) :  DataFrame
DataFrame.write ( ) :  DataFrameWriter

spark-sql_2.10-1.4.0.jar, DataFrameWriter.class
package org.apache.spark.sql
DataFrameWriter.format ( String source ) :  DataFrameWriter
DataFrameWriter.save ( String path ) :  void

spark-sql_2.10-1.4.0.jar, InsertableRelation.class
package org.apache.spark.sql.sources
InsertableRelation.insert ( org.apache.spark.sql.DataFrame p1, boolean p2 ) [abstract] :  void

spark-sql_2.10-1.4.0.jar, SaveMode.class
package org.apache.spark.sql
SaveMode.valueOf ( String name ) [static] :  SaveMode
SaveMode.values ( ) [static] :  SaveMode[ ]

spark-sql_2.10-1.4.0.jar, SchemaRelationProvider.class
package org.apache.spark.sql.sources
SchemaRelationProvider.createRelation ( org.apache.spark.sql.SQLContext p1, scala.collection.immutable.Map<String,String> p2, org.apache.spark.sql.types.StructType p3 ) [abstract] :  BaseRelation

spark-sql_2.10-1.4.0.jar, SQLContext.class
package org.apache.spark.sql
SQLContext.applySchemaToPythonRDD ( org.apache.spark.rdd.RDD<Object[ ]> rdd, types.StructType schema ) :  DataFrame
SQLContext.applySchemaToPythonRDD ( org.apache.spark.rdd.RDD<Object[ ]> rdd, String schemaString ) :  DataFrame
SQLContext.baseRelationToDataFrame ( sources.BaseRelation baseRelation ) :  DataFrame
SQLContext.cacheManager ( ) :  execution.CacheManager
SQLContext.conf ( ) :  SQLConf
SQLContext.createDataFrame ( org.apache.spark.api.java.JavaRDD<?> rdd, Class<?> beanClass ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.api.java.JavaRDD<Row> rowRDD, types.StructType schema ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<?> rdd, Class<?> beanClass ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<A> rdd, scala.reflect.api.TypeTags.TypeTag<A> p2 ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<Row> rowRDD, types.StructType schema ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<Row> rowRDD, types.StructType schema, boolean needsConversion ) :  DataFrame
SQLContext.createDataFrame ( scala.collection.Seq<A> data, scala.reflect.api.TypeTags.TypeTag<A> p2 ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String path ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String path, String source ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String source, java.util.Map<String,String> options ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String source, types.StructType schema, java.util.Map<String,String> options ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String source, types.StructType schema, scala.collection.immutable.Map<String,String> options ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String source, scala.collection.immutable.Map<String,String> options ) :  DataFrame
SQLContext.createSession ( ) :  SQLContext.SQLSession
SQLContext.currentSession ( ) :  SQLContext.SQLSession
SQLContext.defaultSession ( ) :  SQLContext.SQLSession
SQLContext.detachSession ( ) :  void
SQLContext.dialectClassName ( ) :  String
SQLContext.emptyDataFrame ( ) :  DataFrame
SQLContext.experimental ( ) :  ExperimentalMethods
SQLContext.getOrCreate ( org.apache.spark.SparkContext p1 ) [static] :  SQLContext
SQLContext.getSchema ( Class<?> beanClass ) :  scala.collection.Seq<catalyst.expressions.AttributeReference>
SQLContext.getSQLDialect ( ) :  catalyst.ParserDialect
SQLContext.implicits ( ) :  SQLContext.implicits.
SQLContext.openSession ( ) :  SQLContext.SQLSession
SQLContext.parquetFile ( String... paths ) :  DataFrame
SQLContext.parseDataType ( String dataTypeString ) :  types.DataType
SQLContext.range ( long start, long end ) :  DataFrame
SQLContext.range ( long start, long end, long step, int numPartitions ) :  DataFrame
SQLContext.read ( ) :  DataFrameReader
SQLContext.registerDataFrameAsTable ( DataFrame df, String tableName ) :  void
SQLContext.sql ( String sqlText ) :  DataFrame
SQLContext.SQLContext ( org.apache.spark.api.java.JavaSparkContext sparkContext )
SQLContext.sqlParser ( ) :  SparkSQLParser
SQLContext.table ( String tableName ) :  DataFrame
SQLContext.tableNames ( ) :  String[ ]
SQLContext.tableNames ( String databaseName ) :  String[ ]
SQLContext.tables ( ) :  DataFrame
SQLContext.tables ( String databaseName ) :  DataFrame
SQLContext.tlSession ( ) :  ThreadLocal<SQLContext.SQLSession>
SQLContext.udf ( ) :  UDFRegistration

to the top

Problems with Data Types, High Severity (11)

	Change	Effect
1	Removed super-interface ExecutorAllocationClient.	A client program may be interrupted by NoSuchMethodError exception.

	Change	Effect
1	This class has been removed.	A client program may be interrupted by NoClassDefFoundError exception.

	Change	Effect
1	This class has been removed.	A client program may be interrupted by NoClassDefFoundError exception.

	Change	Effect
1	This class has been removed.	A client program may be interrupted by NoClassDefFoundError exception.

	Change	Effect
1	This class became abstract.	A client program may be interrupted by InstantiationError exception.

	Change	Effect
1	Abstract method schema ( ) has been removed from this class.	A client program may be interrupted by NoSuchMethodError exception.

	Change	Effect
1	This interface has been removed.	A client program may be interrupted by NoClassDefFoundError exception.

	Change	Effect
1	Removed super-interface org.apache.spark.sql.types.DataTypeParser.	A client program may be interrupted by NoSuchMethodError exception.

	Change	Effect
1	This interface has been removed.	A client program may be interrupted by NoClassDefFoundError exception.

	Change	Effect
1	This interface became class.	A client program may be interrupted by IncompatibleClassChangeError exception.

	Change	Effect
1	This interface has been removed.	A client program may be interrupted by NoClassDefFoundError exception.

spark-core_2.10-1.4.0.jar
package org.apache.spark
[+] SparkContext (1)

spark-sql_2.10-1.4.0.jar
package org.apache.spark.sql
[+] DataFrame (1)
[+] DataFrameWriter (1)
[+] SaveMode (1)
[+] SQLContext.QueryExecution (1)

package org.apache.spark.sql.sources
[+] BaseRelation (1)
[+] CreatableRelationProvider (1)
[+] DDLParser (1)
[+] InsertableRelation (1)
[+] PrunedFilteredScan (1)
[+] SchemaRelationProvider (1)

to the top

Problems with Data Types, Medium Severity (2)

	Change	Effect
1	Abstract method schema ( ) has been added to this class.	A client program may be interrupted by AbstractMethodError exception. Added abstract method is called in 2nd library version by the method LogicalRelation ( BaseRelation ) and may not be implemented by old clients.

	Change	Effect
1	Superclass has been changed from org.apache.spark.sql.catalyst.AbstractSparkSQLParser to scala.util.parsing.combinator.syntactical.StandardTokenParsers.	1) Access of a client program to the fields or methods of the old super-class may be interrupted by NoSuchFieldError or NoSuchMethodError exceptions. 2) A static field from a super-interface of a client class may hide a field (with the same name) inherited from new super-class and cause IncompatibleClassChangeError exception.

spark-sql_2.10-1.4.0.jar
package org.apache.spark.sql.sources
[+] BaseRelation (1)
[+] DDLParser (1)

to the top

Java ARchives (3)

spark-core_2.10-1.4.0.jar
spark-hive_2.10-1.4.0.jar
spark-sql_2.10-1.4.0.jar

to the top

Generated on Fri Sep 11 18:58:40 2015 for spark-redshift-0.5.0 by Java API Compliance Checker 1.4.1
A tool for checking backward compatibility of a Java library API