Binary compatibility report for the kafka-spark-consumer-1.0.4 library between 1.4.0 and 1.1.0 versions (relating to the portability of client application kafka-spark-consumer-1.0.4.jar)
Test Info
| Library Name | kafka-spark-consumer-1.0.4 |
|---|
| Version #1 | 1.4.0 |
|---|
| Version #2 | 1.1.0 |
|---|
| Java Version | 1.7.0_75 |
|---|
Test Results
| Total Java ARchives | 2 |
|---|
| Total Methods / Classes | 173 / 2175 |
|---|
| Verdict | Incompatible
(43.9%) |
|---|
Problem Summary
| Severity | Count |
|---|
| Added Methods | - | 6 |
|---|
| Removed Methods | High | 32 |
|---|
Problems with
Data Types | High | 3 |
|---|
| Medium | 3 |
| Low | 0 |
Problems with
Methods | High | 0 |
|---|
| Medium | 0 |
| Low | 0 |
Added Methods (6)
spark-streaming_2.10-1.1.0.jar, JavaStreamingContext.class
package org.apache.spark.streaming.api.java
JavaStreamingContext.fileStream ( String directory ) : JavaPairInputDStream<K,V>
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.fileStream:(Ljava/lang/String;)Lorg/apache/spark/streaming/api/java/JavaPairInputDStream;]
spark-streaming_2.10-1.1.0.jar, StreamingContext.class
package org.apache.spark.streaming
StreamingContext.getNewReceiverStreamId ( ) : int
[mangled: org/apache/spark/streaming/StreamingContext.getNewReceiverStreamId:()I]
StreamingContext.state ( ) : scala.Enumeration.Value
[mangled: org/apache/spark/streaming/StreamingContext.state:()Lscala/Enumeration$Value;]
StreamingContext.state_.eq ( scala.Enumeration.Value p1 ) : void
[mangled: org/apache/spark/streaming/StreamingContext.state_.eq:(Lscala/Enumeration$Value;)V]
StreamingContext.StreamingContextState ( ) : StreamingContext.StreamingContextState.
[mangled: org/apache/spark/streaming/StreamingContext.StreamingContextState:()Lorg/apache/spark/streaming/StreamingContext$StreamingContextState$;]
StreamingContext.uiTab ( ) : ui.StreamingTab
[mangled: org/apache/spark/streaming/StreamingContext.uiTab:()Lorg/apache/spark/streaming/ui/StreamingTab;]
to the top
Removed Methods (32)
spark-core_2.10-1.4.0.jar, StorageLevel.class
package org.apache.spark.storage
StorageLevel.StorageLevel.._deserialized_.eq ( boolean p1 ) : void
[mangled: org/apache/spark/storage/StorageLevel.org.apache.spark.storage.StorageLevel.._deserialized_.eq:(Z)V]
StorageLevel.StorageLevel.._replication ( ) : int
[mangled: org/apache/spark/storage/StorageLevel.org.apache.spark.storage.StorageLevel.._replication:()I]
StorageLevel.StorageLevel.._replication_.eq ( int p1 ) : void
[mangled: org/apache/spark/storage/StorageLevel.org.apache.spark.storage.StorageLevel.._replication_.eq:(I)V]
StorageLevel.StorageLevel.._useDisk_.eq ( boolean p1 ) : void
[mangled: org/apache/spark/storage/StorageLevel.org.apache.spark.storage.StorageLevel.._useDisk_.eq:(Z)V]
StorageLevel.StorageLevel.._useMemory_.eq ( boolean p1 ) : void
[mangled: org/apache/spark/storage/StorageLevel.org.apache.spark.storage.StorageLevel.._useMemory_.eq:(Z)V]
StorageLevel.StorageLevel.._useOffHeap_.eq ( boolean p1 ) : void
[mangled: org/apache/spark/storage/StorageLevel.org.apache.spark.storage.StorageLevel.._useOffHeap_.eq:(Z)V]
spark-streaming_2.10-1.4.0.jar, JavaStreamingContext.class
package org.apache.spark.streaming.api.java
JavaStreamingContext.awaitTerminationOrTimeout ( long timeout ) : boolean
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.awaitTerminationOrTimeout:(J)Z]
JavaStreamingContext.binaryRecordsStream ( String directory, int recordLength ) : JavaDStream<byte[ ]>
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.binaryRecordsStream:(Ljava/lang/String;I)Lorg/apache/spark/streaming/api/java/JavaDStream;]
JavaStreamingContext.close ( ) : void
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.close:()V]
JavaStreamingContext.fileStream ( String directory, Class<K> kClass, Class<V> vClass, Class<F> fClass ) : JavaPairInputDStream<K,V>
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.fileStream:(Ljava/lang/String;Ljava/lang/Class;Ljava/lang/Class;Ljava/lang/Class;)Lorg/apache/spark/streaming/api/java/JavaPairInputDStream;]
JavaStreamingContext.fileStream ( String directory, Class<K> kClass, Class<V> vClass, Class<F> fClass, org.apache.spark.api.java.function.Function<org.apache.hadoop.fs.Path,Boolean> filter, boolean newFilesOnly ) : JavaPairInputDStream<K,V>
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.fileStream:(Ljava/lang/String;Ljava/lang/Class;Ljava/lang/Class;Ljava/lang/Class;Lorg/apache/spark/api/java/function/Function;Z)Lorg/apache/spark/streaming/api/java/JavaPairInputDStream;]
JavaStreamingContext.fileStream ( String directory, Class<K> kClass, Class<V> vClass, Class<F> fClass, org.apache.spark.api.java.function.Function<org.apache.hadoop.fs.Path,Boolean> filter, boolean newFilesOnly, org.apache.hadoop.conf.Configuration conf ) : JavaPairInputDStream<K,V>
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.fileStream:(Ljava/lang/String;Ljava/lang/Class;Ljava/lang/Class;Ljava/lang/Class;Lorg/apache/spark/api/java/function/Function;ZLorg/apache/hadoop/conf/Configuration;)Lorg/apache/spark/streaming/api/java/JavaPairInputDStream;]
JavaStreamingContext.getOrCreate ( String p1, org.apache.spark.api.java.function.Function0<JavaStreamingContext> p2 ) [static] : JavaStreamingContext
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.getOrCreate:(Ljava/lang/String;Lorg/apache/spark/api/java/function/Function0;)Lorg/apache/spark/streaming/api/java/JavaStreamingContext;]
JavaStreamingContext.getOrCreate ( String p1, org.apache.spark.api.java.function.Function0<JavaStreamingContext> p2, org.apache.hadoop.conf.Configuration p3 ) [static] : JavaStreamingContext
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.getOrCreate:(Ljava/lang/String;Lorg/apache/spark/api/java/function/Function0;Lorg/apache/hadoop/conf/Configuration;)Lorg/apache/spark/streaming/api/java/JavaStreamingContext;]
JavaStreamingContext.getOrCreate ( String p1, org.apache.spark.api.java.function.Function0<JavaStreamingContext> p2, org.apache.hadoop.conf.Configuration p3, boolean p4 ) [static] : JavaStreamingContext
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.getOrCreate:(Ljava/lang/String;Lorg/apache/spark/api/java/function/Function0;Lorg/apache/hadoop/conf/Configuration;Z)Lorg/apache/spark/streaming/api/java/JavaStreamingContext;]
JavaStreamingContext.getState ( ) : org.apache.spark.streaming.StreamingContextState
[mangled: org/apache/spark/streaming/api/java/JavaStreamingContext.getState:()Lorg/apache/spark/streaming/StreamingContextState;]
spark-streaming_2.10-1.4.0.jar, StreamingContext.class
package org.apache.spark.streaming
StreamingContext.awaitTerminationOrTimeout ( long timeout ) : boolean
[mangled: org/apache/spark/streaming/StreamingContext.awaitTerminationOrTimeout:(J)Z]
StreamingContext.binaryRecordsStream ( String directory, int recordLength ) : dstream.DStream<byte[ ]>
[mangled: org/apache/spark/streaming/StreamingContext.binaryRecordsStream:(Ljava/lang/String;I)Lorg/apache/spark/streaming/dstream/DStream;]
StreamingContext.fileStream ( String directory, scala.Function1<org.apache.hadoop.fs.Path,Object> filter, boolean newFilesOnly, org.apache.hadoop.conf.Configuration conf, scala.reflect.ClassTag<K> p5, scala.reflect.ClassTag<V> p6, scala.reflect.ClassTag<F> p7 ) : dstream.InputDStream<scala.Tuple2<K,V>>
[mangled: org/apache/spark/streaming/StreamingContext.fileStream:(Ljava/lang/String;Lscala/Function1;ZLorg/apache/hadoop/conf/Configuration;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;Lscala/reflect/ClassTag;)Lorg/apache/spark/streaming/dstream/InputDStream;]
StreamingContext.getActive ( ) [static] : scala.Option<StreamingContext>
[mangled: org/apache/spark/streaming/StreamingContext.getActive:()Lscala/Option;]
StreamingContext.getActiveOrCreate ( scala.Function0<StreamingContext> p1 ) [static] : StreamingContext
[mangled: org/apache/spark/streaming/StreamingContext.getActiveOrCreate:(Lscala/Function0;)Lorg/apache/spark/streaming/StreamingContext;]
StreamingContext.getActiveOrCreate ( String p1, scala.Function0<StreamingContext> p2, org.apache.hadoop.conf.Configuration p3, boolean p4 ) [static] : StreamingContext
[mangled: org/apache/spark/streaming/StreamingContext.getActiveOrCreate:(Ljava/lang/String;Lscala/Function0;Lorg/apache/hadoop/conf/Configuration;Z)Lorg/apache/spark/streaming/StreamingContext;]
StreamingContext.getNewInputStreamId ( ) : int
[mangled: org/apache/spark/streaming/StreamingContext.getNewInputStreamId:()I]
StreamingContext.getState ( ) : StreamingContextState
[mangled: org/apache/spark/streaming/StreamingContext.getState:()Lorg/apache/spark/streaming/StreamingContextState;]
StreamingContext.isCheckpointingEnabled ( ) : boolean
[mangled: org/apache/spark/streaming/StreamingContext.isCheckpointingEnabled:()Z]
StreamingContext.StreamingContext..startSite ( ) : java.util.concurrent.atomic.AtomicReference<org.apache.spark.util.CallSite>
[mangled: org/apache/spark/streaming/StreamingContext.org.apache.spark.streaming.StreamingContext..startSite:()Ljava/util/concurrent/atomic/AtomicReference;]
StreamingContext.StreamingContext..stopOnShutdown ( ) : void
[mangled: org/apache/spark/streaming/StreamingContext.org.apache.spark.streaming.StreamingContext..stopOnShutdown:()V]
StreamingContext.progressListener ( ) : ui.StreamingJobProgressListener
[mangled: org/apache/spark/streaming/StreamingContext.progressListener:()Lorg/apache/spark/streaming/ui/StreamingJobProgressListener;]
StreamingContext.StreamingContext ( String path, org.apache.spark.SparkContext sparkContext )
[mangled: org/apache/spark/streaming/StreamingContext."<init>":(Ljava/lang/String;Lorg/apache/spark/SparkContext;)V]
StreamingContext.uiTab ( ) : scala.Option<ui.StreamingTab>
[mangled: org/apache/spark/streaming/StreamingContext.uiTab:()Lscala/Option;]
StreamingContext.withNamedScope ( String name, scala.Function0<U> body ) : U
[mangled: org/apache/spark/streaming/StreamingContext.withNamedScope:(Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object;]
StreamingContext.withScope ( scala.Function0<U> body ) : U
[mangled: org/apache/spark/streaming/StreamingContext.withScope:(Lscala/Function0;)Ljava/lang/Object;]
to the top
Problems with Data Types, High Severity (3)
spark-core_2.10-1.4.0.jar
package org.apache.spark
[+] SparkContext (1)
| Change | Effect |
|---|
| 1 | Removed super-interface ExecutorAllocationClient. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (4)
sc ( )Return value of this method has type 'SparkContext'.
sparkContext ( )Return value of this method has type 'SparkContext'.
StreamingContext ( SparkContext, streaming.Checkpoint, streaming.Duration )1st parameter 'sc_' of this method has type 'SparkContext'.
StreamingContext ( SparkContext, streaming.Duration )1st parameter 'sparkContext' of this method has type 'SparkContext'.
package org.apache.spark.api.java
[+] JavaSparkContext (1)
| Change | Effect |
|---|
| 1 | Removed super-interface java.io.Closeable. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (2)
JavaStreamingContext ( JavaSparkContext, org.apache.spark.streaming.Duration )1st parameter 'sparkContext' of this method has type 'JavaSparkContext'.
sparkContext ( )Return value of this method has type 'JavaSparkContext'.
spark-streaming_2.10-1.4.0.jar
package org.apache.spark.streaming.api.java
[+] JavaStreamingContext (1)
| Change | Effect |
|---|
| 1 | Removed super-interface java.io.Closeable. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (40)
actorStream ( akka.actor.Props, java.lang.String )This method is from 'JavaStreamingContext' class.
actorStream ( akka.actor.Props, java.lang.String, org.apache.spark.storage.StorageLevel )This method is from 'JavaStreamingContext' class.
actorStream ( akka.actor.Props, java.lang.String, org.apache.spark.storage.StorageLevel, akka.actor.SupervisorStrategy )This method is from 'JavaStreamingContext' class.
addStreamingListener ( org.apache.spark.streaming.scheduler.StreamingListener )This method is from 'JavaStreamingContext' class.
awaitTermination ( )This method is from 'JavaStreamingContext' class.
checkpoint ( java.lang.String )This method is from 'JavaStreamingContext' class.
getOrCreate ( java.lang.String, org.apache.hadoop.conf.Configuration, JavaStreamingContextFactory )Return value of this method has type 'JavaStreamingContext'.
getOrCreate ( java.lang.String, org.apache.hadoop.conf.Configuration, JavaStreamingContextFactory, boolean )Return value of this method has type 'JavaStreamingContext'.
getOrCreate ( java.lang.String, JavaStreamingContextFactory )Return value of this method has type 'JavaStreamingContext'.
jarOfClass ( java.lang.Class<?> )This method is from 'JavaStreamingContext' class.
JavaStreamingContext ( java.lang.String )This constructor is from 'JavaStreamingContext' class.
JavaStreamingContext ( java.lang.String, java.lang.String, org.apache.spark.streaming.Duration )This constructor is from 'JavaStreamingContext' class.
JavaStreamingContext ( java.lang.String, java.lang.String, org.apache.spark.streaming.Duration, java.lang.String, java.lang.String )This constructor is from 'JavaStreamingContext' class.
JavaStreamingContext ( java.lang.String, java.lang.String, org.apache.spark.streaming.Duration, java.lang.String, java.lang.String[ ] )This constructor is from 'JavaStreamingContext' class.
JavaStreamingContext ( java.lang.String, java.lang.String, org.apache.spark.streaming.Duration, java.lang.String, java.lang.String[ ], java.util.Map<java.lang.String,java.lang.String> )This constructor is from 'JavaStreamingContext' class.
JavaStreamingContext ( java.lang.String, org.apache.hadoop.conf.Configuration )This constructor is from 'JavaStreamingContext' class.
JavaStreamingContext ( org.apache.spark.api.java.JavaSparkContext, org.apache.spark.streaming.Duration )This constructor is from 'JavaStreamingContext' class.
JavaStreamingContext ( org.apache.spark.SparkConf, org.apache.spark.streaming.Duration )This constructor is from 'JavaStreamingContext' class.
JavaStreamingContext ( org.apache.spark.streaming.StreamingContext )This constructor is from 'JavaStreamingContext' class.
queueStream ( java.util.Queue<org.apache.spark.api.java.JavaRDD<T>> )This method is from 'JavaStreamingContext' class.
queueStream ( java.util.Queue<org.apache.spark.api.java.JavaRDD<T>>, boolean )This method is from 'JavaStreamingContext' class.
queueStream ( java.util.Queue<org.apache.spark.api.java.JavaRDD<T>>, boolean, org.apache.spark.api.java.JavaRDD<T> )This method is from 'JavaStreamingContext' class.
rawSocketStream ( java.lang.String, int )This method is from 'JavaStreamingContext' class.
rawSocketStream ( java.lang.String, int, org.apache.spark.storage.StorageLevel )This method is from 'JavaStreamingContext' class.
receiverStream ( org.apache.spark.streaming.receiver.Receiver<T> )This method is from 'JavaStreamingContext' class.
remember ( org.apache.spark.streaming.Duration )This method is from 'JavaStreamingContext' class.
socketStream ( java.lang.String, int, org.apache.spark.api.java.function.Function<java.io.InputStream,java.lang.Iterable<T>>, org.apache.spark.storage.StorageLevel )This method is from 'JavaStreamingContext' class.
socketTextStream ( java.lang.String, int )This method is from 'JavaStreamingContext' class.
socketTextStream ( java.lang.String, int, org.apache.spark.storage.StorageLevel )This method is from 'JavaStreamingContext' class.
sparkContext ( )This method is from 'JavaStreamingContext' class.
ssc ( )This method is from 'JavaStreamingContext' class.
start ( )This method is from 'JavaStreamingContext' class.
stop ( )This method is from 'JavaStreamingContext' class.
stop ( boolean )This method is from 'JavaStreamingContext' class.
stop ( boolean, boolean )This method is from 'JavaStreamingContext' class.
textFileStream ( java.lang.String )This method is from 'JavaStreamingContext' class.
transform ( java.util.List<JavaDStream<?>>, org.apache.spark.api.java.function.Function2<java.util.List<org.apache.spark.api.java.JavaRDD<?>>,org.apache.spark.streaming.Time,org.apache.spark.api.java.JavaRDD<T>> )This method is from 'JavaStreamingContext' class.
transformToPair ( java.util.List<JavaDStream<?>>, org.apache.spark.api.java.function.Function2<java.util.List<org.apache.spark.api.java.JavaRDD<?>>,org.apache.spark.streaming.Time,org.apache.spark.api.java.JavaPairRDD<K,V>> )This method is from 'JavaStreamingContext' class.
union ( JavaDStream<T>, java.util.List<JavaDStream<T>> )This method is from 'JavaStreamingContext' class.
union ( JavaPairDStream<K,V>, java.util.List<JavaPairDStream<K,V>> )This method is from 'JavaStreamingContext' class.
to the top
Problems with Data Types, Medium Severity (3)
spark-core_2.10-1.4.0.jar
package org.apache.spark.api.java
[+] JavaRDD<T> (1)
| Change | Effect |
|---|
| 1 | Removed super-class AbstractJavaRDDLike<T,JavaRDD<T>>. | Access of a client program to the fields or methods of the old super-class may be interrupted by NoSuchFieldError or NoSuchMethodError exceptions. |
|---|
[+] affected methods (1)
queueStream ( java.util.Queue<JavaRDD<T>>, boolean, JavaRDD<T> )3rd parameter 'defaultRDD' of this method has type 'JavaRDD<T>'.
spark-streaming_2.10-1.4.0.jar
package org.apache.spark.streaming.api.java
[+] JavaDStream<T> (1)
| Change | Effect |
|---|
| 1 | Removed super-class AbstractJavaDStreamLike<T,JavaDStream<T>,org.apache.spark.api.java.JavaRDD<T>>. | Access of a client program to the fields or methods of the old super-class may be interrupted by NoSuchFieldError or NoSuchMethodError exceptions. |
|---|
[+] affected methods (3)
queueStream ( java.util.Queue<org.apache.spark.api.java.JavaRDD<T>> )Return value of this method has type 'JavaDStream<T>'.
transform ( java.util.List<JavaDStream<?>>, org.apache.spark.api.java.function.Function2<java.util.List<org.apache.spark.api.java.JavaRDD<?>>,org.apache.spark.streaming.Time,org.apache.spark.api.java.JavaRDD<T>> )Return value of this method has type 'JavaDStream<T>'.
union ( JavaDStream<T>, java.util.List<JavaDStream<T>> )1st parameter 'first' of this method has type 'JavaDStream<T>'.
[+] JavaPairDStream<K,V> (1)
| Change | Effect |
|---|
| 1 | Removed super-class AbstractJavaDStreamLike<scala.Tuple2<K,V>,JavaPairDStream<K,V>,org.apache.spark.api.java.JavaPairRDD<K,V>>. | Access of a client program to the fields or methods of the old super-class may be interrupted by NoSuchFieldError or NoSuchMethodError exceptions. |
|---|
[+] affected methods (2)
transformToPair ( java.util.List<JavaDStream<?>>, org.apache.spark.api.java.function.Function2<java.util.List<org.apache.spark.api.java.JavaRDD<?>>,org.apache.spark.streaming.Time,org.apache.spark.api.java.JavaPairRDD<K,V>> )Return value of this method has type 'JavaPairDStream<K,V>'.
union ( JavaPairDStream<K,V>, java.util.List<JavaPairDStream<K,V>> )1st parameter 'first' of this method has type 'JavaPairDStream<K,V>'.
to the top
Java ARchives (2)
spark-core_2.10-1.4.0.jar
spark-streaming_2.10-1.4.0.jar
to the top
Generated on Wed Aug 26 13:39:51 2015 for kafka-spark-consumer-1.0.4 by Java API Compliance Checker 1.4.1
A tool for checking backward compatibility of a Java library API