Binary compatibility report for the spark-testing-base_2.10-1.6.0_0.3.0 library  between 1.6.0 and 1.4.0 versions   (relating to the portability of client application spark-testing-base_2.10-1.6.0_0.3.0.jar)

Test Info


Library Namespark-testing-base_2.10-1.6.0_0.3.0
Version #11.6.0
Version #21.4.0
Java Version1.7.0_85

Test Results


Total Java ARchives8
Total Methods / Classes1668 / 5294
VerdictIncompatible
(18.4%)

Problem Summary


SeverityCount
Added Methods-28
Removed MethodsHigh138
Problems with
Data Types
High9
Medium3
Low7
Problems with
Methods
High2
Medium0
Low1

Added Methods (28)


spark-core_2.10-1.4.0.jar, RDD<T>.class
package org.apache.spark.rdd
RDD<T>.markCheckpointed ( RDD<?> checkpointRDD )  :  void

spark-core_2.10-1.4.0.jar, SparkContext.class
package org.apache.spark
SparkContext.preferredNodeLocationData ( )  :  scala.collection.Map<String,scala.collection.Set<scheduler.SplitInfo>>
SparkContext.preferredNodeLocationData_.eq ( scala.collection.Map<String,scala.collection.Set<scheduler.SplitInfo>> p1 )  :  void
SparkContext.requestTotalExecutors ( int numExecutors )  :  boolean
SparkContext.supportDynamicAllocation ( )  :  boolean

spark-core_2.10-1.4.0.jar, SparkListenerApplicationStart.class
package org.apache.spark.scheduler
SparkListenerApplicationStart.copy ( String appName, scala.Option<String> appId, long time, String sparkUser, scala.Option<String> appAttemptId )  :  SparkListenerApplicationStart
SparkListenerApplicationStart.SparkListenerApplicationStart ( String appName, scala.Option<String> appId, long time, String sparkUser, scala.Option<String> appAttemptId )

spark-hive_2.10-1.4.0.jar, HiveContext.class
package org.apache.spark.sql.hive
HiveContext.createSession ( )  :  HiveContext.SQLSession
HiveContext.createSession ( )  :  org.apache.spark.sql.SQLContext.SQLSession
HiveContext.dialectClassName ( )  :  String
HiveContext.executePlan ( org.apache.spark.sql.catalyst.plans.logical.LogicalPlan plan )  :  org.apache.spark.sql.SQLContext.QueryExecution
HiveContext.functionRegistry ( )  :  HiveFunctionRegistry
HiveContext.HIVE_METASTORE_JARS ( ) [static]  :  String
HiveContext.HIVE_METASTORE_VERSION ( ) [static]  :  String

spark-sql_2.10-1.4.0.jar, DataFrame.class
package org.apache.spark.sql
DataFrame.cache ( )  :  RDDApi
DataFrame.collect ( )  :  Object
DataFrame.DataFrame ( SQLContext sqlContext, SQLContext.QueryExecution queryExecution )
DataFrame.first ( )  :  Object
DataFrame.DataFrame..logicalPlanToDataFrame ( catalyst.plans.logical.LogicalPlan logicalPlan )  :  DataFrame
DataFrame.persist ( )  :  RDDApi
DataFrame.persist ( org.apache.spark.storage.StorageLevel newLevel )  :  RDDApi
DataFrame.queryExecution ( )  :  SQLContext.QueryExecution
DataFrame.showString ( int numRows )  :  String
DataFrame.take ( int n )  :  Object
DataFrame.unpersist ( )  :  RDDApi
DataFrame.unpersist ( boolean blocking )  :  RDDApi

spark-streaming-kafka_2.10-1.4.0.jar, KafkaTestUtils.class
package org.apache.spark.streaming.kafka
KafkaTestUtils.waitUntilLeaderOffset ( String topic, int partition, long offset )  :  void

spark-streaming_2.10-1.4.0.jar, DStream<T>.class
package org.apache.spark.streaming.dstream
DStream<T>.createRDDWithLocalProperties ( org.apache.spark.streaming.Time time, scala.Function0<U> body )  :  U

to the top

Removed Methods (138)


spark-catalyst_2.10-1.6.0.jar, Row.class
package org.apache.spark.sql
Row.getTimestamp ( int p1 ) [abstract]  :  java.sql.Timestamp

spark-catalyst_2.10-1.6.0.jar, StructType.class
package org.apache.spark.sql.types
StructType.add ( StructField field )  :  StructType
StructType.add ( String name, DataType dataType )  :  StructType
StructType.add ( String name, DataType dataType, boolean nullable )  :  StructType
StructType.add ( String name, DataType dataType, boolean nullable, Metadata metadata )  :  StructType
StructType.add ( String name, String dataType )  :  StructType
StructType.add ( String name, String dataType, boolean nullable )  :  StructType
StructType.add ( String name, String dataType, boolean nullable, Metadata metadata )  :  StructType
StructType.existsRecursively ( scala.Function1<DataType,Object> f )  :  boolean
StructType.interpretedOrdering ( )  :  org.apache.spark.sql.catalyst.expressions.InterpretedOrdering

spark-core_2.10-1.6.0.jar, RDD<T>.class
package org.apache.spark.rdd
RDD<T>.getNumPartitions ( )  :  int
RDD<T>.isCheckpointedAndMaterialized ( )  :  boolean
RDD<T>.isLocallyCheckpointed ( )  :  boolean
RDD<T>.localCheckpoint ( )  :  RDD<T>
RDD<T>.mapPartitionsInternal ( scala.Function1<scala.collection.Iterator<T>,scala.collection.Iterator<U>> f, boolean preservesPartitioning, scala.reflect.ClassTag<U> p3 )  :  RDD<U>
RDD<T>.markCheckpointed ( )  :  void

spark-core_2.10-1.6.0.jar, SparkConf.class
package org.apache.spark
SparkConf.getAvroSchema ( )  :  scala.collection.immutable.Map<Object,String>
SparkConf.getSizeAsBytes ( String key, long defaultValue )  :  long
SparkConf.registerAvroSchemas ( scala.collection.Seq<org.apache.avro.Schema> schemas )  :  SparkConf

spark-core_2.10-1.6.0.jar, SparkContext.class
package org.apache.spark
SparkContext.getRDDStorageInfo ( scala.Function1<rdd.RDD<?>,Object> filter )  :  storage.RDDInfo[ ]
SparkContext.isStopped ( )  :  boolean
SparkContext.killAndReplaceExecutor ( String executorId )  :  boolean
SparkContext.SparkContext.._applicationId ( )  :  String
SparkContext.SparkContext.._cleaner ( )  :  scala.Option<ContextCleaner>
SparkContext.SparkContext.._dagScheduler ( )  :  scheduler.DAGScheduler
SparkContext.SparkContext.._eventLogger ( )  :  scala.Option<scheduler.EventLoggingListener>
SparkContext.SparkContext.._executorAllocationManager ( )  :  scala.Option<ExecutorAllocationManager>
SparkContext.SparkContext.._heartbeatReceiver ( )  :  rpc.RpcEndpointRef
SparkContext.SparkContext.._listenerBusStarted_.eq ( boolean p1 )  :  void
SparkContext.SparkContext.._progressBar ( )  :  scala.Option<ui.ConsoleProgressBar>
SparkContext.SparkContext.._ui ( )  :  scala.Option<ui.SparkUI>
SparkContext.SparkContext..postApplicationEnd ( )  :  void
SparkContext.requestTotalExecutors ( int numExecutors, int localityAwareTasks, scala.collection.immutable.Map<String,Object> hostToLocalTaskCount )  :  boolean
SparkContext.runJob ( rdd.RDD<T> rdd, scala.Function1<scala.collection.Iterator<T>,U> func, scala.collection.Seq<Object> partitions, scala.reflect.ClassTag<U> p4 )  :  Object
SparkContext.runJob ( rdd.RDD<T> rdd, scala.Function2<TaskContext,scala.collection.Iterator<T>,U> func, scala.collection.Seq<Object> partitions, scala.Function2<Object,U,scala.runtime.BoxedUnit> resultHandler, scala.reflect.ClassTag<U> p5 )  :  void
SparkContext.runJob ( rdd.RDD<T> rdd, scala.Function2<TaskContext,scala.collection.Iterator<T>,U> func, scala.collection.Seq<Object> partitions, scala.reflect.ClassTag<U> p4 )  :  Object
SparkContext.submitMapStage ( ShuffleDependency<K,V,C> dependency )  :  SimpleFutureAction<MapOutputStatistics>

spark-core_2.10-1.6.0.jar, SparkListener.class
package org.apache.spark.scheduler
SparkListener.onBlockUpdated ( SparkListenerBlockUpdated p1 ) [abstract]  :  void

spark-core_2.10-1.6.0.jar, SparkListenerApplicationStart.class
package org.apache.spark.scheduler
SparkListenerApplicationStart.copy ( String appName, scala.Option<String> appId, long time, String sparkUser, scala.Option<String> appAttemptId, scala.Option<scala.collection.Map<String,String>> driverLogs )  :  SparkListenerApplicationStart
SparkListenerApplicationStart.driverLogs ( )  :  scala.Option<scala.collection.Map<String,String>>
SparkListenerApplicationStart.SparkListenerApplicationStart ( String appName, scala.Option<String> appId, long time, String sparkUser, scala.Option<String> appAttemptId, scala.Option<scala.collection.Map<String,String>> driverLogs )

spark-core_2.10-1.6.0.jar, SparkListenerBlockUpdated.class
package org.apache.spark.scheduler
SparkListenerBlockUpdated.andThen ( scala.Function1<SparkListenerBlockUpdated,A> p1 ) [static]  :  scala.Function1<org.apache.spark.storage.BlockUpdatedInfo,A>
SparkListenerBlockUpdated.blockUpdatedInfo ( )  :  org.apache.spark.storage.BlockUpdatedInfo
SparkListenerBlockUpdated.canEqual ( Object p1 )  :  boolean
SparkListenerBlockUpdated.compose ( scala.Function1<A,org.apache.spark.storage.BlockUpdatedInfo> p1 ) [static]  :  scala.Function1<A,SparkListenerBlockUpdated>
SparkListenerBlockUpdated.copy ( org.apache.spark.storage.BlockUpdatedInfo blockUpdatedInfo )  :  SparkListenerBlockUpdated
SparkListenerBlockUpdated.equals ( Object p1 )  :  boolean
SparkListenerBlockUpdated.hashCode ( )  :  int
SparkListenerBlockUpdated.productArity ( )  :  int
SparkListenerBlockUpdated.productElement ( int p1 )  :  Object
SparkListenerBlockUpdated.productIterator ( )  :  scala.collection.Iterator<Object>
SparkListenerBlockUpdated.productPrefix ( )  :  String
SparkListenerBlockUpdated.SparkListenerBlockUpdated ( org.apache.spark.storage.BlockUpdatedInfo blockUpdatedInfo )
SparkListenerBlockUpdated.toString ( )  :  String

spark-core_2.10-1.6.0.jar, TaskMetrics.class
package org.apache.spark.executor
TaskMetrics.accumulatorUpdates ( )  :  scala.collection.immutable.Map<Object,Object>
TaskMetrics.getCachedHostName ( String p1 ) [static]  :  String
TaskMetrics.TaskMetrics.._hostname ( )  :  String
TaskMetrics.TaskMetrics.._hostname_.eq ( String p1 )  :  void
TaskMetrics.setAccumulatorsUpdater ( scala.Function0<scala.collection.immutable.Map<Object,Object>> accumulatorsUpdater )  :  void
TaskMetrics.updateAccumulators ( )  :  void

spark-hive_2.10-1.6.0.jar, HiveContext.class
package org.apache.spark.sql.hive
HiveContext.addJar ( String path )  :  void
HiveContext.CONVERT_CTAS ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<Object>
HiveContext.CONVERT_METASTORE_PARQUET ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<Object>
HiveContext.CONVERT_METASTORE_PARQUET_WITH_SCHEMA_MERGING ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<Object>
HiveContext.defaultOverrides ( )  :  void
HiveContext.HIVE_EXECUTION_VERSION ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<String>
HiveContext.HIVE_METASTORE_BARRIER_PREFIXES ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<scala.collection.Seq<String>>
HiveContext.HIVE_METASTORE_JARS ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<String>
HiveContext.HIVE_METASTORE_SHARED_PREFIXES ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<scala.collection.Seq<String>>
HiveContext.HIVE_METASTORE_VERSION ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<String>
HiveContext.HIVE_THRIFT_SERVER_ASYNC ( ) [static]  :  org.apache.spark.sql.SQLConf.SQLConfEntry<Object>
HiveContext.HiveContext ( org.apache.spark.api.java.JavaSparkContext sc )
HiveContext.HiveContext ( org.apache.spark.SparkContext sc, org.apache.spark.sql.execution.CacheManager cacheManager, org.apache.spark.sql.execution.ui.SQLListener listener, client.ClientWrapper execHive, client.ClientInterface metaHive, boolean isRootContext )
HiveContext.hiveThriftServerAsync ( )  :  boolean
HiveContext.hiveThriftServerSingleSession ( )  :  boolean
HiveContext.newSession ( )  :  HiveContext
HiveContext.newSession ( )  :  org.apache.spark.sql.SQLContext
HiveContext.setConf ( org.apache.spark.sql.SQLConf.SQLConfEntry<T> entry, T value )  :  void

spark-sql_2.10-1.6.0.jar, DataFrame.class
package org.apache.spark.sql
DataFrame.alias ( scala.Symbol alias )  :  DataFrame
DataFrame.alias ( String alias )  :  DataFrame
DataFrame.as ( Encoder<U> p1 )  :  Dataset<U>
DataFrame.collectToPython ( )  :  int
DataFrame.DataFrame ( SQLContext sqlContext, execution.QueryExecution queryExecution )
DataFrame.drop ( Column col )  :  DataFrame
DataFrame.inputFiles ( )  :  String[ ]
DataFrame.join ( DataFrame right, scala.collection.Seq<String> usingColumns )  :  DataFrame
DataFrame.join ( DataFrame right, scala.collection.Seq<String> usingColumns, String joinType )  :  DataFrame
DataFrame.DataFrame..collect ( boolean needCallback )  :  Row[ ]
DataFrame.DataFrame..withPlan ( scala.Function0<catalyst.plans.logical.LogicalPlan> logicalPlan )  :  DataFrame
DataFrame.queryExecution ( )  :  execution.QueryExecution
DataFrame.repartition ( int numPartitions, Column... partitionExprs )  :  DataFrame
DataFrame.repartition ( int numPartitions, scala.collection.Seq<Column> partitionExprs )  :  DataFrame
DataFrame.repartition ( Column... partitionExprs )  :  DataFrame
DataFrame.repartition ( scala.collection.Seq<Column> partitionExprs )  :  DataFrame
DataFrame.show ( boolean truncate )  :  void
DataFrame.show ( int numRows, boolean truncate )  :  void
DataFrame.showString ( int _numRows, boolean truncate )  :  String
DataFrame.sortWithinPartitions ( Column... sortExprs )  :  DataFrame
DataFrame.sortWithinPartitions ( scala.collection.Seq<Column> sortExprs )  :  DataFrame
DataFrame.sortWithinPartitions ( String sortCol, scala.collection.Seq<String> sortCols )  :  DataFrame
DataFrame.sortWithinPartitions ( String sortCol, String... sortCols )  :  DataFrame
DataFrame.takeAsList ( int n )  :  java.util.List<Row>
DataFrame.transform ( scala.Function1<DataFrame,DataFrame> t )  :  DataFrame
DataFrame.where ( String conditionExpr )  :  DataFrame
DataFrame.withColumn ( String colName, Column col, types.Metadata metadata )  :  DataFrame
DataFrame.withNewExecutionId ( scala.Function0<T> body )  :  T

spark-streaming_2.10-1.6.0.jar, DStream<T>.class
package org.apache.spark.streaming.dstream
DStream<T>.createRDDWithLocalProperties ( org.apache.spark.streaming.Time time, boolean displayInnerRDDOps, scala.Function0<U> body )  :  U
DStream<T>.DStream..foreachRDD ( scala.Function2<org.apache.spark.rdd.RDD<T>,org.apache.spark.streaming.Time,scala.runtime.BoxedUnit> foreachFunc, boolean displayInnerRDDOps )  :  void

spark-streaming_2.10-1.6.0.jar, InputDStream<T>.class
package org.apache.spark.streaming.dstream
InputDStream<T>.rateController ( )  :  scala.Option<org.apache.spark.streaming.scheduler.RateController>

spark-streaming_2.10-1.6.0.jar, StreamingContext.class
package org.apache.spark.streaming
StreamingContext.getStartSite ( )  :  org.apache.spark.util.CallSite

spark-streaming_2.10-1.6.0.jar, StreamingListener.class
package org.apache.spark.streaming.scheduler
StreamingListener.onOutputOperationCompleted ( StreamingListenerOutputOperationCompleted p1 ) [abstract]  :  void
StreamingListener.onOutputOperationStarted ( StreamingListenerOutputOperationStarted p1 ) [abstract]  :  void

spark-streaming_2.10-1.6.0.jar, StreamingListenerOutputOperationCompleted.class
package org.apache.spark.streaming.scheduler
StreamingListenerOutputOperationCompleted.andThen ( scala.Function1<StreamingListenerOutputOperationCompleted,A> p1 ) [static]  :  scala.Function1<OutputOperationInfo,A>
StreamingListenerOutputOperationCompleted.canEqual ( Object p1 )  :  boolean
StreamingListenerOutputOperationCompleted.compose ( scala.Function1<A,OutputOperationInfo> p1 ) [static]  :  scala.Function1<A,StreamingListenerOutputOperationCompleted>
StreamingListenerOutputOperationCompleted.copy ( OutputOperationInfo outputOperationInfo )  :  StreamingListenerOutputOperationCompleted
StreamingListenerOutputOperationCompleted.equals ( Object p1 )  :  boolean
StreamingListenerOutputOperationCompleted.hashCode ( )  :  int
StreamingListenerOutputOperationCompleted.outputOperationInfo ( )  :  OutputOperationInfo
StreamingListenerOutputOperationCompleted.productArity ( )  :  int
StreamingListenerOutputOperationCompleted.productElement ( int p1 )  :  Object
StreamingListenerOutputOperationCompleted.productIterator ( )  :  scala.collection.Iterator<Object>
StreamingListenerOutputOperationCompleted.productPrefix ( )  :  String
StreamingListenerOutputOperationCompleted.StreamingListenerOutputOperationCompleted ( OutputOperationInfo outputOperationInfo )
StreamingListenerOutputOperationCompleted.toString ( )  :  String

spark-streaming_2.10-1.6.0.jar, StreamingListenerOutputOperationStarted.class
package org.apache.spark.streaming.scheduler
StreamingListenerOutputOperationStarted.andThen ( scala.Function1<StreamingListenerOutputOperationStarted,A> p1 ) [static]  :  scala.Function1<OutputOperationInfo,A>
StreamingListenerOutputOperationStarted.canEqual ( Object p1 )  :  boolean
StreamingListenerOutputOperationStarted.compose ( scala.Function1<A,OutputOperationInfo> p1 ) [static]  :  scala.Function1<A,StreamingListenerOutputOperationStarted>
StreamingListenerOutputOperationStarted.copy ( OutputOperationInfo outputOperationInfo )  :  StreamingListenerOutputOperationStarted
StreamingListenerOutputOperationStarted.equals ( Object p1 )  :  boolean
StreamingListenerOutputOperationStarted.hashCode ( )  :  int
StreamingListenerOutputOperationStarted.outputOperationInfo ( )  :  OutputOperationInfo
StreamingListenerOutputOperationStarted.productArity ( )  :  int
StreamingListenerOutputOperationStarted.productElement ( int p1 )  :  Object
StreamingListenerOutputOperationStarted.productIterator ( )  :  scala.collection.Iterator<Object>
StreamingListenerOutputOperationStarted.productPrefix ( )  :  String
StreamingListenerOutputOperationStarted.StreamingListenerOutputOperationStarted ( OutputOperationInfo outputOperationInfo )
StreamingListenerOutputOperationStarted.toString ( )  :  String

to the top

Problems with Data Types, High Severity (9)


spark-catalyst_2.10-1.6.0.jar
package org.apache.spark.sql
[+] Row (1)

package org.apache.spark.sql.catalyst.expressions
[+] NamedExpression (1)

spark-core_2.10-1.6.0.jar
package org.apache.spark.scheduler
[+] SparkListener (1)
[+] SparkListenerBlockUpdated (1)

spark-sql_2.10-1.6.0.jar
package org.apache.spark.sql
[+] DataFrame (1)

spark-streaming_2.10-1.6.0.jar
package org.apache.spark.streaming.scheduler
[+] StreamingListener (2)
[+] StreamingListenerOutputOperationCompleted (1)
[+] StreamingListenerOutputOperationStarted (1)

to the top

Problems with Methods, High Severity (2)


spark-core_2.10-1.6.0.jar, SparkContext
package org.apache.spark
[+] SparkContext.localProperties ( )  :  InheritableThreadLocal<java.util.Properties> (1)
[+] SparkContext.stopped ( )  :  java.util.concurrent.atomic.AtomicBoolean (1)

to the top

Problems with Data Types, Medium Severity (3)


spark-catalyst_2.10-1.6.0.jar
package org.apache.spark.sql.types
[+] DataType (1)

spark-hive_2.10-1.6.0.jar
package org.apache.spark.sql.hive
[+] HiveContext.QueryExecution (1)

spark-sql_2.10-1.6.0.jar
package org.apache.spark.sql
[+] SQLContext.SparkPlanner (1)

to the top

Problems with Data Types, Low Severity (7)


spark-hive_2.10-1.6.0.jar
package org.apache.spark.sql.hive
[+] HiveContext (6)

spark-sql_2.10-1.6.0.jar
package org.apache.spark.sql
[+] DataFrame (1)

to the top

Problems with Methods, Low Severity (1)


spark-streaming_2.10-1.6.0.jar, StreamingContext
package org.apache.spark.streaming
[+] StreamingContext.stop ( boolean stopSparkContext, boolean stopGracefully )  :  void (1)

to the top

Java ARchives (8)


spark-catalyst_2.10-1.6.0.jar
spark-core_2.10-1.6.0.jar
spark-hive_2.10-1.6.0.jar
spark-mllib_2.10-1.6.0.jar
spark-sql_2.10-1.6.0.jar
spark-streaming-kafka_2.10-1.6.0.jar
spark-streaming_2.10-1.6.0.jar
spark-yarn_2.10-1.6.0.jar

to the top




Generated on Sat Jan 23 06:59:41 2016 for spark-testing-base_2.10-1.6.0_0.3.0 by Java API Compliance Checker 1.4.1  
A tool for checking backward compatibility of a Java library API