Binary compatibility report for the magellan-1.0.1-s_2.10 library between 1.4.0 and 1.2.0 versions (relating to the portability of client application magellan-1.0.1-s_2.10.jar)

Test Info

Library Name	magellan-1.0.1-s_2.10
Version #1	1.4.0
Version #2	1.2.0
Java Version	1.7.0_75

Test Results

Total Java ARchives	1
Total Methods / Classes	269 / 550
Verdict	Incompatible (48%)

Problem Summary

	Severity	Count
Added Methods	-	104
Removed Methods	High	122
Problems with Data Types	High	5
	Medium	2
	Low	0
Problems with Methods	High	0
	Medium	0
	Low	0

Added Methods (104)

spark-sql_2.10-1.2.0.jar, BaseRelation.class
package org.apache.spark.sql.sources
BaseRelation.schema ( ) [abstract] :  org.apache.spark.sql.catalyst.types.StructType

spark-sql_2.10-1.2.0.jar, SQLContext.class
package org.apache.spark.sql
SQLContext.abs ( catalyst.expressions.Expression e ) :  catalyst.expressions.Abs
SQLContext.applySchema ( org.apache.spark.rdd.RDD<catalyst.expressions.Row> rowRDD, catalyst.types.StructType schema ) :  SchemaRDD
SQLContext.applySchemaToPythonRDD ( org.apache.spark.rdd.RDD<Object[ ]> rdd, catalyst.types.StructType schema ) :  SchemaRDD
SQLContext.applySchemaToPythonRDD ( org.apache.spark.rdd.RDD<Object[ ]> rdd, String schemaString ) :  SchemaRDD
SQLContext.approxCountDistinct ( catalyst.expressions.Expression e, double rsd ) :  catalyst.expressions.ApproxCountDistinct
SQLContext.autoBroadcastJoinThreshold ( ) :  int
SQLContext.avg ( catalyst.expressions.Expression e ) :  catalyst.expressions.Average
SQLContext.baseRelationToSchemaRDD ( sources.BaseRelation baseRelation ) :  SchemaRDD
SQLContext.bigDecimalToLiteral ( scala.math.BigDecimal d ) :  catalyst.expressions.Literal
SQLContext.binaryToLiteral ( byte[ ] a ) :  catalyst.expressions.Literal
SQLContext.booleanToLiteral ( boolean b ) :  catalyst.expressions.Literal
SQLContext.byteToLiteral ( byte b ) :  catalyst.expressions.Literal
SQLContext.cacheQuery ( SchemaRDD query, scala.Option<String> tableName, org.apache.spark.storage.StorageLevel storageLevel ) :  void
SQLContext.clear ( ) :  void
SQLContext.codegenEnabled ( ) :  boolean
SQLContext.columnBatchSize ( ) :  int
SQLContext.columnNameOfCorruptRecord ( ) :  String
SQLContext.count ( catalyst.expressions.Expression e ) :  catalyst.expressions.Count
SQLContext.countDistinct ( scala.collection.Seq<catalyst.expressions.Expression> e ) :  catalyst.expressions.CountDistinct
SQLContext.createParquetFile ( String path, boolean allowExisting, org.apache.hadoop.conf.Configuration conf, scala.reflect.api.TypeTags.TypeTag<A> p4 ) :  SchemaRDD
SQLContext.createSchemaRDD ( org.apache.spark.rdd.RDD<A> rdd, scala.reflect.api.TypeTags.TypeTag<A> p2 ) :  SchemaRDD
SQLContext.dateToLiteral ( java.sql.Date d ) :  catalyst.expressions.Literal
SQLContext.decimalToLiteral ( catalyst.types.decimal.Decimal d ) :  catalyst.expressions.Literal
SQLContext.defaultSizeInBytes ( ) :  long
SQLContext.dialect ( ) :  String
SQLContext.doubleToLiteral ( double d ) :  catalyst.expressions.Literal
SQLContext.DslAttribute ( catalyst.expressions.AttributeReference a ) :  catalyst.dsl.package.ExpressionConversions.DslAttribute
SQLContext.DslExpression ( catalyst.expressions.Expression e ) :  catalyst.dsl.package.ExpressionConversions.DslExpression
SQLContext.DslString ( String s ) :  catalyst.dsl.package.ExpressionConversions.DslString
SQLContext.DslSymbol ( scala.Symbol sym ) :  catalyst.dsl.package.ExpressionConversions.DslSymbol
SQLContext.externalSortEnabled ( ) :  boolean
SQLContext.extraStrategies ( ) :  scala.collection.Seq<catalyst.planning.GenericStrategy<execution.SparkPlan>>
SQLContext.extraStrategies_.eq ( scala.collection.Seq<catalyst.planning.GenericStrategy<execution.SparkPlan>> p1 ) :  void
SQLContext.first ( catalyst.expressions.Expression e ) :  catalyst.expressions.First
SQLContext.floatToLiteral ( float f ) :  catalyst.expressions.Literal
SQLContext.inMemoryPartitionPruning ( ) :  boolean
SQLContext.intToLiteral ( int i ) :  catalyst.expressions.Literal
SQLContext.invalidateCache ( catalyst.plans.logical.LogicalPlan plan ) :  void
SQLContext.isParquetBinaryAsString ( ) :  boolean
SQLContext.jsonFile ( String path ) :  SchemaRDD
SQLContext.jsonFile ( String path, double samplingRatio ) :  SchemaRDD
SQLContext.jsonFile ( String path, catalyst.types.StructType schema ) :  SchemaRDD
SQLContext.jsonRDD ( org.apache.spark.rdd.RDD<String> json ) :  SchemaRDD
SQLContext.jsonRDD ( org.apache.spark.rdd.RDD<String> json, double samplingRatio ) :  SchemaRDD
SQLContext.jsonRDD ( org.apache.spark.rdd.RDD<String> json, catalyst.types.StructType schema ) :  SchemaRDD
SQLContext.last ( catalyst.expressions.Expression e ) :  catalyst.expressions.Last
SQLContext.logicalPlanToSparkQuery ( catalyst.plans.logical.LogicalPlan plan ) :  SchemaRDD
SQLContext.longToLiteral ( long l ) :  catalyst.expressions.Literal
SQLContext.lookupCachedData ( catalyst.plans.logical.LogicalPlan plan ) :  scala.Option<CachedData>
SQLContext.lookupCachedData ( SchemaRDD query ) :  scala.Option<CachedData>
SQLContext.lower ( catalyst.expressions.Expression e ) :  catalyst.expressions.Lower
SQLContext.max ( catalyst.expressions.Expression e ) :  catalyst.expressions.Max
SQLContext.min ( catalyst.expressions.Expression e ) :  catalyst.expressions.Min
SQLContext.numShufflePartitions ( ) :  int
SQLContext.CacheManager..cachedData ( ) :  scala.collection.mutable.ArrayBuffer<CachedData>
SQLContext.CacheManager..cacheLock ( ) :  java.util.concurrent.locks.ReentrantReadWriteLock
SQLContext.CacheManager._setter_.CacheManager..cachedData_.eq ( scala.collection.mutable.ArrayBuffer p1 ) :  void
SQLContext.CacheManager._setter_.CacheManager..cacheLock_.eq ( java.util.concurrent.locks.ReentrantReadWriteLock p1 ) :  void
SQLContext.SQLConf._setter_.settings_.eq ( java.util.Map p1 ) :  void
SQLContext.parquetCompressionCodec ( ) :  String
SQLContext.parquetFile ( String path ) :  SchemaRDD
SQLContext.parquetFilterPushDown ( ) :  boolean
SQLContext.parseDataType ( String dataTypeString ) :  catalyst.types.DataType
SQLContext.registerFunction ( String name, scala.Function10<?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function11<?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function12<?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function13<?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function14<?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function15<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function16<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function17<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function18<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function19<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function1<?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function20<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function21<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function22<?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function2<?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function3<?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function4<?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function5<?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function6<?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function7<?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function8<?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerFunction ( String name, scala.Function9<?,?,?,?,?,?,?,?,?,T> func, scala.reflect.api.TypeTags.TypeTag<T> p3 ) :  void
SQLContext.registerPython ( String name, byte[ ] command, java.util.Map<String,String> envVars, java.util.List<String> pythonIncludes, String pythonExec, java.util.List<org.apache.spark.broadcast.Broadcast<org.apache.spark.api.python.PythonBroadcast>> broadcastVars, org.apache.spark.Accumulator<java.util.List<byte[ ]>> accumulator, String stringDataType ) :  void
SQLContext.registerRDDAsTable ( SchemaRDD rdd, String tableName ) :  void
SQLContext.settings ( ) :  java.util.Map<String,String>
SQLContext.shortToLiteral ( short s ) :  catalyst.expressions.Literal
SQLContext.sql ( String sqlText ) :  SchemaRDD
SQLContext.sqlParser ( ) :  catalyst.SparkSQLParser
SQLContext.sqrt ( catalyst.expressions.Expression e ) :  catalyst.expressions.Sqrt
SQLContext.stringToLiteral ( String s ) :  catalyst.expressions.Literal
SQLContext.sum ( catalyst.expressions.Expression e ) :  catalyst.expressions.Sum
SQLContext.sumDistinct ( catalyst.expressions.Expression e ) :  catalyst.expressions.SumDistinct
SQLContext.symbolToUnresolvedAttribute ( scala.Symbol s ) :  catalyst.analysis.UnresolvedAttribute
SQLContext.table ( String tableName ) :  SchemaRDD
SQLContext.timestampToLiteral ( java.sql.Timestamp t ) :  catalyst.expressions.Literal
SQLContext.tryUncacheQuery ( SchemaRDD query, boolean blocking ) :  boolean
SQLContext.uncacheQuery ( SchemaRDD query, boolean blocking ) :  void
SQLContext.upper ( catalyst.expressions.Expression e ) :  catalyst.expressions.Upper
SQLContext.useCachedData ( catalyst.plans.logical.LogicalPlan plan ) :  catalyst.plans.logical.LogicalPlan
SQLContext.useCompression ( ) :  boolean

to the top

Removed Methods (122)

spark-sql_2.10-1.4.0.jar, BaseRelation.class
package org.apache.spark.sql.sources
BaseRelation.needConversion ( ) :  boolean
BaseRelation.schema ( ) [abstract] :  org.apache.spark.sql.types.StructType

spark-sql_2.10-1.4.0.jar, Column.class
package org.apache.spark.sql
Column.alias ( String alias ) :  Column
Column.and ( Column other ) :  Column
Column.apply ( Object extraction ) :  Column
Column.as ( scala.collection.Seq<String> aliases ) :  Column
Column.as ( scala.Symbol alias ) :  Column
Column.as ( String alias ) :  Column
Column.as ( String alias, types.Metadata metadata ) :  Column
Column.as ( String[ ] aliases ) :  Column
Column.asc ( ) :  Column
Column.between ( Object lowerBound, Object upperBound ) :  Column
Column.bitwiseAND ( Object other ) :  Column
Column.bitwiseOR ( Object other ) :  Column
Column.bitwiseXOR ( Object other ) :  Column
Column.cast ( types.DataType to ) :  Column
Column.cast ( String to ) :  Column
Column.Column ( catalyst.expressions.Expression expr )
Column.Column ( String name )
Column.contains ( Object other ) :  Column
Column.desc ( ) :  Column
Column.divide ( Object other ) :  Column
Column.endsWith ( Column other ) :  Column
Column.endsWith ( String literal ) :  Column
Column.eqNullSafe ( Object other ) :  Column
Column.equals ( Object that ) :  boolean
Column.equalTo ( Object other ) :  Column
Column.explain ( boolean extended ) :  void
Column.expr ( ) :  catalyst.expressions.Expression
Column.geq ( Object other ) :  Column
Column.getField ( String fieldName ) :  Column
Column.getItem ( Object key ) :  Column
Column.gt ( Object other ) :  Column
Column.hashCode ( ) :  int
Column.in ( Column... list ) :  Column
Column.in ( scala.collection.Seq<Column> list ) :  Column
Column.isNotNull ( ) :  Column
Column.isNull ( ) :  Column
Column.isTraceEnabled ( ) :  boolean
Column.leq ( Object other ) :  Column
Column.like ( String literal ) :  Column
Column.log ( ) :  org.slf4j.Logger
Column.logDebug ( scala.Function0<String> msg ) :  void
Column.logDebug ( scala.Function0<String> msg, Throwable throwable ) :  void
Column.logError ( scala.Function0<String> msg ) :  void
Column.logError ( scala.Function0<String> msg, Throwable throwable ) :  void
Column.logInfo ( scala.Function0<String> msg ) :  void
Column.logInfo ( scala.Function0<String> msg, Throwable throwable ) :  void
Column.logName ( ) :  String
Column.logTrace ( scala.Function0<String> msg ) :  void
Column.logTrace ( scala.Function0<String> msg, Throwable throwable ) :  void
Column.logWarning ( scala.Function0<String> msg ) :  void
Column.logWarning ( scala.Function0<String> msg, Throwable throwable ) :  void
Column.lt ( Object other ) :  Column
Column.minus ( Object other ) :  Column
Column.mod ( Object other ) :  Column
Column.multiply ( Object other ) :  Column
Column.notEqual ( Object other ) :  Column
Column.or ( Column other ) :  Column
Column.org.apache.spark.Logging..log_ ( ) :  org.slf4j.Logger
Column.org.apache.spark.Logging..log__.eq ( org.slf4j.Logger p1 ) :  void
Column.otherwise ( Object value ) :  Column
Column.over ( expressions.WindowSpec window ) :  Column
Column.plus ( Object other ) :  Column
Column.rlike ( String literal ) :  Column
Column.startsWith ( Column other ) :  Column
Column.startsWith ( String literal ) :  Column
Column.substr ( int startPos, int len ) :  Column
Column.substr ( Column startPos, Column len ) :  Column
Column.toString ( ) :  String
Column.unapply ( Column p1 ) [static] :  scala.Option<catalyst.expressions.Expression>
Column.unary_.bang ( ) :  Column
Column.unary_.minus ( ) :  Column
Column.when ( Column condition, Object value ) :  Column

spark-sql_2.10-1.4.0.jar, SchemaRelationProvider.class
package org.apache.spark.sql.sources
SchemaRelationProvider.createRelation ( org.apache.spark.sql.SQLContext p1, scala.collection.immutable.Map<String,String> p2, org.apache.spark.sql.types.StructType p3 ) [abstract] :  BaseRelation

spark-sql_2.10-1.4.0.jar, SQLConf.class
package org.apache.spark.sql
SQLConf.SQLConf ( )

spark-sql_2.10-1.4.0.jar, SQLContext.class
package org.apache.spark.sql
SQLContext.applySchemaToPythonRDD ( org.apache.spark.rdd.RDD<Object[ ]> rdd, types.StructType schema ) :  DataFrame
SQLContext.applySchemaToPythonRDD ( org.apache.spark.rdd.RDD<Object[ ]> rdd, String schemaString ) :  DataFrame
SQLContext.baseRelationToDataFrame ( sources.BaseRelation baseRelation ) :  DataFrame
SQLContext.cacheManager ( ) :  execution.CacheManager
SQLContext.conf ( ) :  SQLConf
SQLContext.createDataFrame ( org.apache.spark.api.java.JavaRDD<?> rdd, Class<?> beanClass ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.api.java.JavaRDD<Row> rowRDD, types.StructType schema ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<?> rdd, Class<?> beanClass ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<A> rdd, scala.reflect.api.TypeTags.TypeTag<A> p2 ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<Row> rowRDD, types.StructType schema ) :  DataFrame
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<Row> rowRDD, types.StructType schema, boolean needsConversion ) :  DataFrame
SQLContext.createDataFrame ( scala.collection.Seq<A> data, scala.reflect.api.TypeTags.TypeTag<A> p2 ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String path ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String path, String source ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String source, java.util.Map<String,String> options ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String source, types.StructType schema, java.util.Map<String,String> options ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String source, types.StructType schema, scala.collection.immutable.Map<String,String> options ) :  DataFrame
SQLContext.createExternalTable ( String tableName, String source, scala.collection.immutable.Map<String,String> options ) :  DataFrame
SQLContext.createSession ( ) :  SQLContext.SQLSession
SQLContext.currentSession ( ) :  SQLContext.SQLSession
SQLContext.defaultSession ( ) :  SQLContext.SQLSession
SQLContext.detachSession ( ) :  void
SQLContext.dialectClassName ( ) :  String
SQLContext.emptyDataFrame ( ) :  DataFrame
SQLContext.experimental ( ) :  ExperimentalMethods
SQLContext.getOrCreate ( org.apache.spark.SparkContext p1 ) [static] :  SQLContext
SQLContext.getSchema ( Class<?> beanClass ) :  scala.collection.Seq<catalyst.expressions.AttributeReference>
SQLContext.getSQLDialect ( ) :  catalyst.ParserDialect
SQLContext.implicits ( ) :  SQLContext.implicits.
SQLContext.openSession ( ) :  SQLContext.SQLSession
SQLContext.parquetFile ( String... paths ) :  DataFrame
SQLContext.parseDataType ( String dataTypeString ) :  types.DataType
SQLContext.range ( long start, long end ) :  DataFrame
SQLContext.range ( long start, long end, long step, int numPartitions ) :  DataFrame
SQLContext.read ( ) :  DataFrameReader
SQLContext.registerDataFrameAsTable ( DataFrame df, String tableName ) :  void
SQLContext.sql ( String sqlText ) :  DataFrame
SQLContext.SQLContext ( org.apache.spark.api.java.JavaSparkContext sparkContext )
SQLContext.sqlParser ( ) :  SparkSQLParser
SQLContext.table ( String tableName ) :  DataFrame
SQLContext.tableNames ( ) :  String[ ]
SQLContext.tableNames ( String databaseName ) :  String[ ]
SQLContext.tables ( ) :  DataFrame
SQLContext.tables ( String databaseName ) :  DataFrame
SQLContext.tlSession ( ) :  ThreadLocal<SQLContext.SQLSession>
SQLContext.udf ( ) :  UDFRegistration

to the top

Problems with Data Types, High Severity (5)

	Change	Effect
1	This class has been removed.	A client program may be interrupted by NoClassDefFoundError exception.

	Change	Effect
1	This class became abstract.	A client program may be interrupted by InstantiationError exception.

	Change	Effect
1	Abstract method schema ( ) has been removed from this class.	A client program may be interrupted by NoSuchMethodError exception.

	Change	Effect
1	Removed super-interface org.apache.spark.sql.types.DataTypeParser.	A client program may be interrupted by NoSuchMethodError exception.

	Change	Effect
1	This interface has been removed.	A client program may be interrupted by NoClassDefFoundError exception.

spark-sql_2.10-1.4.0.jar
package org.apache.spark.sql
[+] Column (1)
[+] SQLContext.QueryExecution (1)

package org.apache.spark.sql.sources
[+] BaseRelation (1)
[+] DDLParser (1)
[+] SchemaRelationProvider (1)

to the top

Problems with Data Types, Medium Severity (2)

	Change	Effect
1	Abstract method schema ( ) has been added to this class.	A client program may be interrupted by AbstractMethodError exception. Added abstract method is called in 2nd library version by the method LogicalRelation ( BaseRelation ) and may not be implemented by old clients.

	Change	Effect
1	Superclass has been changed from org.apache.spark.sql.catalyst.AbstractSparkSQLParser to scala.util.parsing.combinator.syntactical.StandardTokenParsers.	1) Access of a client program to the fields or methods of the old super-class may be interrupted by NoSuchFieldError or NoSuchMethodError exceptions. 2) A static field from a super-interface of a client class may hide a field (with the same name) inherited from new super-class and cause IncompatibleClassChangeError exception.

spark-sql_2.10-1.4.0.jar
package org.apache.spark.sql.sources
[+] BaseRelation (1)
[+] DDLParser (1)

to the top

Java ARchives (1)

spark-sql_2.10-1.4.0.jar

to the top

Generated on Mon Jul 20 21:02:55 2015 for magellan-1.0.1-s_2.10 by Java API Compliance Checker 1.4.1
A tool for checking backward compatibility of a Java library API