Binary compatibility report for the spark-scalding_2.11-0.4.0 library between 1.3.0 and 1.5.0 versions (relating to the portability of client application spark-scalding_2.11-0.4.0.jar)
Test Info
| Library Name | spark-scalding_2.11-0.4.0 |
|---|
| Version #1 | 1.3.0 |
|---|
| Version #2 | 1.5.0 |
|---|
| Java Version | 1.7.0_85 |
|---|
Test Results
| Total Java ARchives | 1 |
|---|
| Total Methods / Classes | 363 / 1726 |
|---|
| Verdict | Incompatible
(2.9%) |
|---|
Problem Summary
| Severity | Count |
|---|
| Added Methods | - | 40 |
|---|
| Removed Methods | High | 2 |
|---|
Problems with
Data Types | High | 1 |
|---|
| Medium | 1 |
| Low | 1 |
Problems with
Methods | High | 0 |
|---|
| Medium | 0 |
| Low | 0 |
Other Changes
in Data Types | - | 5 |
|---|
Added Methods (40)
spark-core_2.11-1.5.0.jar, RDD<T>.class
package org.apache.spark.rdd
RDD<T>.isLocallyCheckpointed ( ) : boolean
[mangled: org/apache/spark/rdd/RDD<T>.isLocallyCheckpointed:()Z]
RDD<T>.localCheckpoint ( ) : RDD<T>
[mangled: org/apache/spark/rdd/RDD<T>.localCheckpoint:()Lorg/apache/spark/rdd/RDD;]
RDD<T>.markCheckpointed ( ) : void
[mangled: org/apache/spark/rdd/RDD<T>.markCheckpointed:()V]
RDD<T>.RDD..doCheckpointCalled ( ) : boolean
[mangled: org/apache/spark/rdd/RDD<T>.org.apache.spark.rdd.RDD..doCheckpointCalled:()Z]
RDD<T>.RDD..doCheckpointCalled_.eq ( boolean p1 ) : void
[mangled: org/apache/spark/rdd/RDD<T>.org.apache.spark.rdd.RDD..doCheckpointCalled_.eq:(Z)V]
RDD<T>.RDD..sc ( ) : org.apache.spark.SparkContext
[mangled: org/apache/spark/rdd/RDD<T>.org.apache.spark.rdd.RDD..sc:()Lorg/apache/spark/SparkContext;]
RDD<T>.randomSampleWithRange ( double lb, double ub, long seed ) : RDD<T>
[mangled: org/apache/spark/rdd/RDD<T>.randomSampleWithRange:(DDJ)Lorg/apache/spark/rdd/RDD;]
RDD<T>.scope ( ) : scala.Option<RDDOperationScope>
[mangled: org/apache/spark/rdd/RDD<T>.scope:()Lscala/Option;]
RDD<T>.withScope ( scala.Function0<U> body ) : U
[mangled: org/apache/spark/rdd/RDD<T>.withScope:(Lscala/Function0;)Ljava/lang/Object;]
spark-core_2.11-1.5.0.jar, SparkContext.class
package org.apache.spark
SparkContext.applicationAttemptId ( ) : scala.Option<String>
[mangled: org/apache/spark/SparkContext.applicationAttemptId:()Lscala/Option;]
SparkContext.externalBlockStoreFolderName ( ) : String
[mangled: org/apache/spark/SparkContext.externalBlockStoreFolderName:()Ljava/lang/String;]
SparkContext.getOrCreate ( ) [static] : SparkContext
[mangled: org/apache/spark/SparkContext.getOrCreate:()Lorg/apache/spark/SparkContext;]
SparkContext.getOrCreate ( SparkConf p1 ) [static] : SparkContext
[mangled: org/apache/spark/SparkContext.getOrCreate:(Lorg/apache/spark/SparkConf;)Lorg/apache/spark/SparkContext;]
SparkContext.killAndReplaceExecutor ( String executorId ) : boolean
[mangled: org/apache/spark/SparkContext.killAndReplaceExecutor:(Ljava/lang/String;)Z]
SparkContext.SparkContext.._cleaner ( ) : scala.Option<ContextCleaner>
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._cleaner:()Lscala/Option;]
SparkContext.SparkContext.._conf ( ) : SparkConf
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._conf:()Lorg/apache/spark/SparkConf;]
SparkContext.SparkContext.._dagScheduler ( ) : scheduler.DAGScheduler
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._dagScheduler:()Lorg/apache/spark/scheduler/DAGScheduler;]
SparkContext.SparkContext.._env ( ) : SparkEnv
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._env:()Lorg/apache/spark/SparkEnv;]
SparkContext.SparkContext.._eventLogger ( ) : scala.Option<scheduler.EventLoggingListener>
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._eventLogger:()Lscala/Option;]
SparkContext.SparkContext.._executorAllocationManager ( ) : scala.Option<ExecutorAllocationManager>
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._executorAllocationManager:()Lscala/Option;]
SparkContext.SparkContext.._heartbeatReceiver ( ) : rpc.RpcEndpointRef
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._heartbeatReceiver:()Lorg/apache/spark/rpc/RpcEndpointRef;]
SparkContext.SparkContext.._listenerBusStarted_.eq ( boolean p1 ) : void
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._listenerBusStarted_.eq:(Z)V]
SparkContext.SparkContext.._progressBar ( ) : scala.Option<ui.ConsoleProgressBar>
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._progressBar:()Lscala/Option;]
SparkContext.SparkContext.._ui ( ) : scala.Option<ui.SparkUI>
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._ui:()Lscala/Option;]
SparkContext.SparkContext..assertNotStopped ( ) : void
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext..assertNotStopped:()V]
SparkContext.SparkContext..postApplicationEnd ( ) : void
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext..postApplicationEnd:()V]
SparkContext.range ( long start, long end, long step, int numSlices ) : rdd.RDD<Object>
[mangled: org/apache/spark/SparkContext.range:(JJJI)Lorg/apache/spark/rdd/RDD;]
SparkContext.requestTotalExecutors ( int numExecutors, int localityAwareTasks, scala.collection.immutable.Map<String,Object> hostToLocalTaskCount ) : boolean
[mangled: org/apache/spark/SparkContext.requestTotalExecutors:(IILscala/collection/immutable/Map;)Z]
SparkContext.runJob ( rdd.RDD<T> rdd, scala.Function1<scala.collection.Iterator<T>,U> func, scala.collection.Seq<Object> partitions, scala.reflect.ClassTag<U> p4 ) : Object
[mangled: org/apache/spark/SparkContext.runJob:(Lorg/apache/spark/rdd/RDD;Lscala/Function1;Lscala/collection/Seq;Lscala/reflect/ClassTag;)Ljava/lang/Object;]
SparkContext.runJob ( rdd.RDD<T> rdd, scala.Function2<TaskContext,scala.collection.Iterator<T>,U> func, scala.collection.Seq<Object> partitions, scala.Function2<Object,U,scala.runtime.BoxedUnit> resultHandler, scala.reflect.ClassTag<U> p5 ) : void
[mangled: org/apache/spark/SparkContext.runJob:(Lorg/apache/spark/rdd/RDD;Lscala/Function2;Lscala/collection/Seq;Lscala/Function2;Lscala/reflect/ClassTag;)V]
SparkContext.runJob ( rdd.RDD<T> rdd, scala.Function2<TaskContext,scala.collection.Iterator<T>,U> func, scala.collection.Seq<Object> partitions, scala.reflect.ClassTag<U> p4 ) : Object
[mangled: org/apache/spark/SparkContext.runJob:(Lorg/apache/spark/rdd/RDD;Lscala/Function2;Lscala/collection/Seq;Lscala/reflect/ClassTag;)Ljava/lang/Object;]
SparkContext.setLogLevel ( String logLevel ) : void
[mangled: org/apache/spark/SparkContext.setLogLevel:(Ljava/lang/String;)V]
SparkContext.withScope ( scala.Function0<U> body ) : U
[mangled: org/apache/spark/SparkContext.withScope:(Lscala/Function0;)Ljava/lang/Object;]
spark-core_2.11-1.5.0.jar, TaskContext.class
package org.apache.spark
TaskContext.collectAccumulators ( ) [abstract] : scala.collection.immutable.Map<Object,Object>
[mangled: org/apache/spark/TaskContext.collectAccumulators:()Lscala/collection/immutable/Map;]
TaskContext.collectInternalAccumulators ( ) [abstract] : scala.collection.immutable.Map<Object,Object>
[mangled: org/apache/spark/TaskContext.collectInternalAccumulators:()Lscala/collection/immutable/Map;]
TaskContext.getMetricsSources ( String p1 ) [abstract] : scala.collection.Seq<metrics.source.Source>
[mangled: org/apache/spark/TaskContext.getMetricsSources:(Ljava/lang/String;)Lscala/collection/Seq;]
TaskContext.getPartitionId ( ) [static] : int
[mangled: org/apache/spark/TaskContext.getPartitionId:()I]
TaskContext.internalMetricsToAccumulators ( ) [abstract] : scala.collection.immutable.Map<String,Accumulator<Object>>
[mangled: org/apache/spark/TaskContext.internalMetricsToAccumulators:()Lscala/collection/immutable/Map;]
TaskContext.registerAccumulator ( Accumulable<?,?> p1 ) [abstract] : void
[mangled: org/apache/spark/TaskContext.registerAccumulator:(Lorg/apache/spark/Accumulable;)V]
TaskContext.taskMemoryManager ( ) [abstract] : unsafe.memory.TaskMemoryManager
[mangled: org/apache/spark/TaskContext.taskMemoryManager:()Lorg/apache/spark/unsafe/memory/TaskMemoryManager;]
to the top
Removed Methods (2)
spark-core_2.11-1.3.0.jar, RDD<T>.class
package org.apache.spark.rdd
RDD<T>.markCheckpointed ( RDD<?> checkpointRDD ) : void
[mangled: org/apache/spark/rdd/RDD<T>.markCheckpointed:(Lorg/apache/spark/rdd/RDD;)V]
spark-core_2.11-1.3.0.jar, SparkContext.class
package org.apache.spark
SparkContext.requestTotalExecutors ( int numExecutors ) : boolean
[mangled: org/apache/spark/SparkContext.requestTotalExecutors:(I)Z]
to the top
Problems with Data Types, High Severity (1)
spark-core_2.11-1.3.0.jar
package org.apache.spark.api.java
[+] JavaRDD<T> (1)
| Change | Effect |
|---|
| 1 | Removed super-interface JavaRDDLike<T,JavaRDD<T>>. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (1)
toJavaRDD ( )Return value of this method has type 'JavaRDD<T>'.
to the top
Problems with Data Types, Medium Severity (1)
spark-core_2.11-1.3.0.jar
package org.apache.spark
[+] TaskContext (1)
| Change | Effect |
|---|
| 1 | Abstract method internalMetricsToAccumulators ( ) has been added to this class. | A client program may be interrupted by AbstractMethodError exception. Added abstract method is called in 2nd library version by the method writePartitionedFile ( storage.BlockId, TaskContext, java.io.File ) and may not be implemented by old clients. |
|---|
[+] affected methods (15)
compute ( Partition, TaskContext )2nd parameter 'p2' of this abstract method has type 'TaskContext'.
computeOrReadCheckpoint ( Partition, TaskContext )2nd parameter 'context' of this method has type 'TaskContext'.
iterator ( Partition, TaskContext )2nd parameter 'context' of this method has type 'TaskContext'.
addTaskCompletionListener ( util.TaskCompletionListener )Return value of this abstract method has type 'TaskContext'.
addTaskCompletionListener ( scala.Function1<TaskContext,scala.runtime.BoxedUnit> )Return value of this abstract method has type 'TaskContext'.
attemptNumber ( )This abstract method is from 'TaskContext' abstract class.
get ( )Return value of this method has type 'TaskContext'.
isCompleted ( )This abstract method is from 'TaskContext' abstract class.
isInterrupted ( )This abstract method is from 'TaskContext' abstract class.
isRunningLocally ( )This abstract method is from 'TaskContext' abstract class.
partitionId ( )This abstract method is from 'TaskContext' abstract class.
stageId ( )This abstract method is from 'TaskContext' abstract class.
taskAttemptId ( )This abstract method is from 'TaskContext' abstract class.
TaskContext ( )This constructor is from 'TaskContext' abstract class.
taskMetrics ( )This abstract method is from 'TaskContext' abstract class.
to the top
Problems with Data Types, Low Severity (1)
spark-core_2.11-1.3.0.jar
package org.apache.spark.api.java
[+] JavaRDD<T> (1)
| Change | Effect |
|---|
| 1 | Added super-class AbstractJavaRDDLike<T,JavaRDD<T>>. | A static field from a super-interface of a client class may hide a field (with the same name) inherited from new super-class and cause IncompatibleClassChangeError exception. |
|---|
[+] affected methods (1)
toJavaRDD ( )Return value of this method has type 'JavaRDD<T>'.
to the top
Other Changes in Data Types (5)
spark-core_2.11-1.3.0.jar
package org.apache.spark
[+] TaskContext (5)
| Change | Effect |
|---|
| 1 | Abstract method collectAccumulators ( ) has been added to this class. | No effect. |
|---|
| 2 | Abstract method collectInternalAccumulators ( ) has been added to this class. | No effect. |
|---|
| 3 | Abstract method getMetricsSources ( java.lang.String ) has been added to this class. | No effect. |
|---|
| 4 | Abstract method registerAccumulator ( Accumulable<?,?> ) has been added to this class. | No effect. |
|---|
| 5 | Abstract method taskMemoryManager ( ) has been added to this class. | No effect. |
|---|
[+] affected methods (15)
compute ( Partition, TaskContext )2nd parameter 'p2' of this abstract method has type 'TaskContext'.
computeOrReadCheckpoint ( Partition, TaskContext )2nd parameter 'context' of this method has type 'TaskContext'.
iterator ( Partition, TaskContext )2nd parameter 'context' of this method has type 'TaskContext'.
addTaskCompletionListener ( util.TaskCompletionListener )Return value of this abstract method has type 'TaskContext'.
addTaskCompletionListener ( scala.Function1<TaskContext,scala.runtime.BoxedUnit> )Return value of this abstract method has type 'TaskContext'.
attemptNumber ( )This abstract method is from 'TaskContext' abstract class.
get ( )Return value of this method has type 'TaskContext'.
isCompleted ( )This abstract method is from 'TaskContext' abstract class.
isInterrupted ( )This abstract method is from 'TaskContext' abstract class.
isRunningLocally ( )This abstract method is from 'TaskContext' abstract class.
partitionId ( )This abstract method is from 'TaskContext' abstract class.
stageId ( )This abstract method is from 'TaskContext' abstract class.
taskAttemptId ( )This abstract method is from 'TaskContext' abstract class.
TaskContext ( )This constructor is from 'TaskContext' abstract class.
taskMetrics ( )This abstract method is from 'TaskContext' abstract class.
to the top
Java ARchives (1)
spark-core_2.11-1.3.0.jar
to the top
Generated on Fri Nov 13 00:42:17 2015 for spark-scalding_2.11-0.4.0 by Java API Compliance Checker 1.4.1
A tool for checking backward compatibility of a Java library API