Binary compatibility report for the spark-testing-base_2.10-0.3.1 library  between 1.6.0 and 1.5.0 versions   (relating to the portability of client application spark-testing-base_2.10-0.3.1.jar)

Test Info


Library Namespark-testing-base_2.10-0.3.1
Version #11.6.0
Version #21.5.0
Java Version1.7.0_85

Test Results


Total Java ARchives8
Total Methods / Classes1372 / 5294
VerdictIncompatible
(14%)

Problem Summary


SeverityCount
Added Methods-11
Removed MethodsHigh66
Problems with
Data Types
High5
Medium2
Low5
Problems with
Methods
High2
Medium0
Low1

Added Methods (11)


spark-core_2.10-1.5.0.jar, SparkContext.class
package org.apache.spark
SparkContext.preferredNodeLocationData ( )  :  scala.collection.Map<String,scala.collection.Set<scheduler.SplitInfo>>
SparkContext.preferredNodeLocationData_.eq ( scala.collection.Map<String,scala.collection.Set<scheduler.SplitInfo>> p1 )  :  void

spark-hive_2.10-1.5.0.jar, HiveContext.class
package org.apache.spark.sql.hive
HiveContext.createSession ( )  :  HiveContext.SQLSession
HiveContext.createSession ( )  :  org.apache.spark.sql.SQLContext.SQLSession
HiveContext.dialectClassName ( )  :  String
HiveContext.executePlan ( org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan )  :  org.apache.spark.sql.SQLContext.QueryExecution
HiveContext.HIVE_METASTORE_VERSION ( ) [static]  :  String

spark-sql_2.10-1.5.0.jar, DataFrame.class
package org.apache.spark.sql
DataFrame.DataFrame ( SQLContext sqlContext, SQLContext.QueryExecution queryExecution )
DataFrame.DataFrame..logicalPlanToDataFrame ( catalyst.plans.logical.LogicalPlan logicalPlan )  :  DataFrame
DataFrame.queryExecution ( )  :  SQLContext.QueryExecution

spark-streaming_2.10-1.5.0.jar, DStream<T>.class
package org.apache.spark.streaming.dstream
DStream<T>.createRDDWithLocalProperties ( org.apache.spark.streaming.Time time, scala.Function0<U> body )  :  U

to the top

Removed Methods (66)


spark-core_2.10-1.6.0.jar, RDD<T>.class
package org.apache.spark.rdd
RDD<T>.getNumPartitions ( )  :  int
RDD<T>.isCheckpointedAndMaterialized ( )  :  boolean
RDD<T>.mapPartitionsInternal ( scala.Function1<scala.collection.Iterator<T>,scala.collection.Iterator<U>> f, boolean preservesPartitioning, scala.reflect.ClassTag<U> p3 )  :  RDD<U>

spark-core_2.10-1.6.0.jar, SparkContext.class
package org.apache.spark
SparkContext.getRDDStorageInfo ( scala.Function1<rdd.RDD<?>,Object> filter )  :  storage.RDDInfo[ ]
SparkContext.isStopped ( )  :  boolean
SparkContext.SparkContext.._applicationId ( )  :  String
SparkContext.submitMapStage ( ShuffleDependency<K,V,C> dependency )  :  SimpleFutureAction<MapOutputStatistics>

spark-hive_2.10-1.6.0.jar, HiveContext.class
package org.apache.spark.sql.hive
HiveContext.addJar ( String path )  :  void
HiveContext.HIVE_EXECUTION_VERSION ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<String>
HiveContext.HIVE_METASTORE_VERSION ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<String>
HiveContext.HiveContext ( org.apache.spark.api.java.JavaSparkContext sc )
HiveContext.HiveContext ( org.apache.spark.SparkContext sc, org.apache.spark.sql.execution.CacheManager cacheManager, org.apache.spark.sql.execution.ui.SQLListener listener, client.ClientWrapper execHive, client.ClientInterface metaHive, boolean isRootContext )
HiveContext.hiveThriftServerSingleSession ( )  :  boolean
HiveContext.newSession ( )  :  HiveContext
HiveContext.newSession ( )  :  org.apache.spark.sql.SQLContext

spark-sql_2.10-1.6.0.jar, DataFrame.class
package org.apache.spark.sql
DataFrame.alias ( scala.Symbol alias )  :  DataFrame
DataFrame.alias ( String alias )  :  DataFrame
DataFrame.as ( Encoder<U> p1 )  :  Dataset<U>
DataFrame.collectToPython ( )  :  int
DataFrame.DataFrame ( SQLContext sqlContext, execution.QueryExecution queryExecution )
DataFrame.join ( DataFrame right, scala.collection.Seq<String> usingColumns, String joinType )  :  DataFrame
DataFrame.DataFrame..collect ( boolean needCallback )  :  Row[ ]
DataFrame.DataFrame..withPlan ( scala.Function0<catalyst.plans.logical.LogicalPlan> logicalPlan )  :  DataFrame
DataFrame.queryExecution ( )  :  execution.QueryExecution
DataFrame.repartition ( int numPartitions, Column... partitionExprs )  :  DataFrame
DataFrame.repartition ( int numPartitions, scala.collection.Seq<Column> partitionExprs )  :  DataFrame
DataFrame.repartition ( Column... partitionExprs )  :  DataFrame
DataFrame.repartition ( scala.collection.Seq<Column> partitionExprs )  :  DataFrame
DataFrame.sortWithinPartitions ( Column... sortExprs )  :  DataFrame
DataFrame.sortWithinPartitions ( scala.collection.Seq<Column> sortExprs )  :  DataFrame
DataFrame.sortWithinPartitions ( String sortCol, scala.collection.Seq<String> sortCols )  :  DataFrame
DataFrame.sortWithinPartitions ( String sortCol, String... sortCols )  :  DataFrame
DataFrame.takeAsList ( int n )  :  java.util.List<Row>
DataFrame.transform ( scala.Function1<DataFrame,DataFrame> t )  :  DataFrame
DataFrame.withColumn ( String colName, Column col, types.Metadata metadata )  :  DataFrame

spark-streaming_2.10-1.6.0.jar, DStream<T>.class
package org.apache.spark.streaming.dstream
DStream<T>.createRDDWithLocalProperties ( org.apache.spark.streaming.Time time, boolean displayInnerRDDOps, scala.Function0<U> body )  :  U
DStream<T>.DStream..foreachRDD ( scala.Function2<org.apache.spark.rdd.RDD<T>,org.apache.spark.streaming.Time,scala.runtime.BoxedUnit> foreachFunc, boolean displayInnerRDDOps )  :  void

spark-streaming_2.10-1.6.0.jar, StreamingContext.class
package org.apache.spark.streaming
StreamingContext.getStartSite ( )  :  org.apache.spark.util.CallSite

spark-streaming_2.10-1.6.0.jar, StreamingListener.class
package org.apache.spark.streaming.scheduler
StreamingListener.onOutputOperationCompleted ( StreamingListenerOutputOperationCompleted p1 ) [abstract]  :  void
StreamingListener.onOutputOperationStarted ( StreamingListenerOutputOperationStarted p1 ) [abstract]  :  void

spark-streaming_2.10-1.6.0.jar, StreamingListenerOutputOperationCompleted.class
package org.apache.spark.streaming.scheduler
StreamingListenerOutputOperationCompleted.andThen ( scala.Function1<StreamingListenerOutputOperationCompleted,A> p1 ) [static]  :  scala.Function1<OutputOperationInfo,A>
StreamingListenerOutputOperationCompleted.canEqual ( Object p1 )  :  boolean
StreamingListenerOutputOperationCompleted.compose ( scala.Function1<A,OutputOperationInfo> p1 ) [static]  :  scala.Function1<A,StreamingListenerOutputOperationCompleted>
StreamingListenerOutputOperationCompleted.copy ( OutputOperationInfo outputOperationInfo )  :  StreamingListenerOutputOperationCompleted
StreamingListenerOutputOperationCompleted.equals ( Object p1 )  :  boolean
StreamingListenerOutputOperationCompleted.hashCode ( )  :  int
StreamingListenerOutputOperationCompleted.outputOperationInfo ( )  :  OutputOperationInfo
StreamingListenerOutputOperationCompleted.productArity ( )  :  int
StreamingListenerOutputOperationCompleted.productElement ( int p1 )  :  Object
StreamingListenerOutputOperationCompleted.productIterator ( )  :  scala.collection.Iterator<Object>
StreamingListenerOutputOperationCompleted.productPrefix ( )  :  String
StreamingListenerOutputOperationCompleted.StreamingListenerOutputOperationCompleted ( OutputOperationInfo outputOperationInfo )
StreamingListenerOutputOperationCompleted.toString ( )  :  String

spark-streaming_2.10-1.6.0.jar, StreamingListenerOutputOperationStarted.class
package org.apache.spark.streaming.scheduler
StreamingListenerOutputOperationStarted.andThen ( scala.Function1<StreamingListenerOutputOperationStarted,A> p1 ) [static]  :  scala.Function1<OutputOperationInfo,A>
StreamingListenerOutputOperationStarted.canEqual ( Object p1 )  :  boolean
StreamingListenerOutputOperationStarted.compose ( scala.Function1<A,OutputOperationInfo> p1 ) [static]  :  scala.Function1<A,StreamingListenerOutputOperationStarted>
StreamingListenerOutputOperationStarted.copy ( OutputOperationInfo outputOperationInfo )  :  StreamingListenerOutputOperationStarted
StreamingListenerOutputOperationStarted.equals ( Object p1 )  :  boolean
StreamingListenerOutputOperationStarted.hashCode ( )  :  int
StreamingListenerOutputOperationStarted.outputOperationInfo ( )  :  OutputOperationInfo
StreamingListenerOutputOperationStarted.productArity ( )  :  int
StreamingListenerOutputOperationStarted.productElement ( int p1 )  :  Object
StreamingListenerOutputOperationStarted.productIterator ( )  :  scala.collection.Iterator<Object>
StreamingListenerOutputOperationStarted.productPrefix ( )  :  String
StreamingListenerOutputOperationStarted.StreamingListenerOutputOperationStarted ( OutputOperationInfo outputOperationInfo )
StreamingListenerOutputOperationStarted.toString ( )  :  String

to the top

Problems with Data Types, High Severity (5)


spark-sql_2.10-1.6.0.jar
package org.apache.spark.sql
[+] DataFrame (1)

spark-streaming_2.10-1.6.0.jar
package org.apache.spark.streaming.scheduler
[+] StreamingListener (2)
[+] StreamingListenerOutputOperationCompleted (1)
[+] StreamingListenerOutputOperationStarted (1)

to the top

Problems with Methods, High Severity (2)


spark-core_2.10-1.6.0.jar, SparkContext
package org.apache.spark
[+] SparkContext.localProperties ( )  :  InheritableThreadLocal<java.util.Properties> (1)
[+] SparkContext.stopped ( )  :  java.util.concurrent.atomic.AtomicBoolean (1)

to the top

Problems with Data Types, Medium Severity (2)


spark-hive_2.10-1.6.0.jar
package org.apache.spark.sql.hive
[+] HiveContext.QueryExecution (1)

spark-sql_2.10-1.6.0.jar
package org.apache.spark.sql
[+] SQLContext.SparkPlanner (1)

to the top

Problems with Data Types, Low Severity (5)


spark-hive_2.10-1.6.0.jar
package org.apache.spark.sql.hive
[+] HiveContext (5)

to the top

Problems with Methods, Low Severity (1)


spark-streaming_2.10-1.6.0.jar, StreamingContext
package org.apache.spark.streaming
[+] StreamingContext.stop ( boolean stopSparkContext, boolean stopGracefully )  :  void (1)

to the top

Java ARchives (8)


spark-catalyst_2.10-1.6.0.jar
spark-core_2.10-1.6.0.jar
spark-hive_2.10-1.6.0.jar
spark-mllib_2.10-1.6.0.jar
spark-sql_2.10-1.6.0.jar
spark-streaming-kafka_2.10-1.6.0.jar
spark-streaming_2.10-1.6.0.jar
spark-yarn_2.10-1.6.0.jar

to the top




Generated on Tue Feb 2 01:53:33 2016 for spark-testing-base_2.10-0.3.1 by Java API Compliance Checker 1.4.1  
A tool for checking backward compatibility of a Java library API