Binary compatibility report for the spark-connector_2.10-1.0.0 library between 1.4.0 and 1.3.0 versions (relating to the portability of client application spark-connector_2.10-1.0.0.jar)
Test Info
| Library Name | spark-connector_2.10-1.0.0 |
|---|
| Version #1 | 1.4.0 |
|---|
| Version #2 | 1.3.0 |
|---|
| Java Version | 1.7.0_75 |
|---|
Test Results
| Total Java ARchives | 3 |
|---|
| Total Methods / Classes | 983 / 2720 |
|---|
| Verdict | Incompatible
(17%) |
|---|
Problem Summary
| Severity | Count |
|---|
| Added Methods | - | 82 |
|---|
| Removed Methods | High | 115 |
|---|
Problems with
Data Types | High | 7 |
|---|
| Medium | 3 |
| Low | 0 |
Problems with
Methods | High | 0 |
|---|
| Medium | 0 |
| Low | 0 |
Added Methods (82)
spark-core_2.10-1.3.0.jar, JavaRDD<T>.class
package org.apache.spark.api.java
JavaRDD<T>.aggregate ( U zeroValue, function.Function2<U,T,U> seqOp, function.Function2<U,U,U> combOp ) : U
[mangled: org/apache/spark/api/java/JavaRDD<T>.aggregate:(Ljava/lang/Object;Lorg/apache/spark/api/java/function/Function2;Lorg/apache/spark/api/java/function/Function2;)Ljava/lang/Object;]
JavaRDD<T>.cartesian ( JavaRDDLike<U,?> other ) : JavaPairRDD<T,U>
[mangled: org/apache/spark/api/java/JavaRDD<T>.cartesian:(Lorg/apache/spark/api/java/JavaRDDLike;)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.checkpoint ( ) : void
[mangled: org/apache/spark/api/java/JavaRDD<T>.checkpoint:()V]
JavaRDD<T>.collect ( ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.collect:()Ljava/util/List;]
JavaRDD<T>.collectAsync ( ) : JavaFutureAction<java.util.List<T>>
[mangled: org/apache/spark/api/java/JavaRDD<T>.collectAsync:()Lorg/apache/spark/api/java/JavaFutureAction;]
JavaRDD<T>.collectPartitions ( int[ ] partitionIds ) : java.util.List<T>[ ]
[mangled: org/apache/spark/api/java/JavaRDD<T>.collectPartitions:([I)[Ljava/util/List;]
JavaRDD<T>.context ( ) : org.apache.spark.SparkContext
[mangled: org/apache/spark/api/java/JavaRDD<T>.context:()Lorg/apache/spark/SparkContext;]
JavaRDD<T>.count ( ) : long
[mangled: org/apache/spark/api/java/JavaRDD<T>.count:()J]
JavaRDD<T>.countApprox ( long timeout ) : org.apache.spark.partial.PartialResult<org.apache.spark.partial.BoundedDouble>
[mangled: org/apache/spark/api/java/JavaRDD<T>.countApprox:(J)Lorg/apache/spark/partial/PartialResult;]
JavaRDD<T>.countApprox ( long timeout, double confidence ) : org.apache.spark.partial.PartialResult<org.apache.spark.partial.BoundedDouble>
[mangled: org/apache/spark/api/java/JavaRDD<T>.countApprox:(JD)Lorg/apache/spark/partial/PartialResult;]
JavaRDD<T>.countApproxDistinct ( double relativeSD ) : long
[mangled: org/apache/spark/api/java/JavaRDD<T>.countApproxDistinct:(D)J]
JavaRDD<T>.countAsync ( ) : JavaFutureAction<Long>
[mangled: org/apache/spark/api/java/JavaRDD<T>.countAsync:()Lorg/apache/spark/api/java/JavaFutureAction;]
JavaRDD<T>.countByValue ( ) : java.util.Map<T,Long>
[mangled: org/apache/spark/api/java/JavaRDD<T>.countByValue:()Ljava/util/Map;]
JavaRDD<T>.countByValueApprox ( long timeout ) : org.apache.spark.partial.PartialResult<java.util.Map<T,org.apache.spark.partial.BoundedDouble>>
[mangled: org/apache/spark/api/java/JavaRDD<T>.countByValueApprox:(J)Lorg/apache/spark/partial/PartialResult;]
JavaRDD<T>.countByValueApprox ( long timeout, double confidence ) : org.apache.spark.partial.PartialResult<java.util.Map<T,org.apache.spark.partial.BoundedDouble>>
[mangled: org/apache/spark/api/java/JavaRDD<T>.countByValueApprox:(JD)Lorg/apache/spark/partial/PartialResult;]
JavaRDD<T>.first ( ) : T
[mangled: org/apache/spark/api/java/JavaRDD<T>.first:()Ljava/lang/Object;]
JavaRDD<T>.flatMap ( function.FlatMapFunction<T,U> f ) : JavaRDD<U>
[mangled: org/apache/spark/api/java/JavaRDD<T>.flatMap:(Lorg/apache/spark/api/java/function/FlatMapFunction;)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.flatMapToDouble ( function.DoubleFlatMapFunction<T> f ) : JavaDoubleRDD
[mangled: org/apache/spark/api/java/JavaRDD<T>.flatMapToDouble:(Lorg/apache/spark/api/java/function/DoubleFlatMapFunction;)Lorg/apache/spark/api/java/JavaDoubleRDD;]
JavaRDD<T>.flatMapToPair ( function.PairFlatMapFunction<T,K2,V2> f ) : JavaPairRDD<K2,V2>
[mangled: org/apache/spark/api/java/JavaRDD<T>.flatMapToPair:(Lorg/apache/spark/api/java/function/PairFlatMapFunction;)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.fold ( T zeroValue, function.Function2<T,T,T> f ) : T
[mangled: org/apache/spark/api/java/JavaRDD<T>.fold:(Ljava/lang/Object;Lorg/apache/spark/api/java/function/Function2;)Ljava/lang/Object;]
JavaRDD<T>.foreach ( function.VoidFunction<T> f ) : void
[mangled: org/apache/spark/api/java/JavaRDD<T>.foreach:(Lorg/apache/spark/api/java/function/VoidFunction;)V]
JavaRDD<T>.foreachAsync ( function.VoidFunction<T> f ) : JavaFutureAction<Void>
[mangled: org/apache/spark/api/java/JavaRDD<T>.foreachAsync:(Lorg/apache/spark/api/java/function/VoidFunction;)Lorg/apache/spark/api/java/JavaFutureAction;]
JavaRDD<T>.foreachPartition ( function.VoidFunction<java.util.Iterator<T>> f ) : void
[mangled: org/apache/spark/api/java/JavaRDD<T>.foreachPartition:(Lorg/apache/spark/api/java/function/VoidFunction;)V]
JavaRDD<T>.foreachPartitionAsync ( function.VoidFunction<java.util.Iterator<T>> f ) : JavaFutureAction<Void>
[mangled: org/apache/spark/api/java/JavaRDD<T>.foreachPartitionAsync:(Lorg/apache/spark/api/java/function/VoidFunction;)Lorg/apache/spark/api/java/JavaFutureAction;]
JavaRDD<T>.getCheckpointFile ( ) : com.google.common.base.Optional<String>
[mangled: org/apache/spark/api/java/JavaRDD<T>.getCheckpointFile:()Lcom/google/common/base/Optional;]
JavaRDD<T>.getStorageLevel ( ) : org.apache.spark.storage.StorageLevel
[mangled: org/apache/spark/api/java/JavaRDD<T>.getStorageLevel:()Lorg/apache/spark/storage/StorageLevel;]
JavaRDD<T>.glom ( ) : JavaRDD<java.util.List<T>>
[mangled: org/apache/spark/api/java/JavaRDD<T>.glom:()Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.groupBy ( function.Function<T,U> f ) : JavaPairRDD<U,Iterable<T>>
[mangled: org/apache/spark/api/java/JavaRDD<T>.groupBy:(Lorg/apache/spark/api/java/function/Function;)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.groupBy ( function.Function<T,U> f, int numPartitions ) : JavaPairRDD<U,Iterable<T>>
[mangled: org/apache/spark/api/java/JavaRDD<T>.groupBy:(Lorg/apache/spark/api/java/function/Function;I)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.id ( ) : int
[mangled: org/apache/spark/api/java/JavaRDD<T>.id:()I]
JavaRDD<T>.isCheckpointed ( ) : boolean
[mangled: org/apache/spark/api/java/JavaRDD<T>.isCheckpointed:()Z]
JavaRDD<T>.isEmpty ( ) : boolean
[mangled: org/apache/spark/api/java/JavaRDD<T>.isEmpty:()Z]
JavaRDD<T>.iterator ( org.apache.spark.Partition split, org.apache.spark.TaskContext taskContext ) : java.util.Iterator<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.iterator:(Lorg/apache/spark/Partition;Lorg/apache/spark/TaskContext;)Ljava/util/Iterator;]
JavaRDD<T>.keyBy ( function.Function<T,U> f ) : JavaPairRDD<U,T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.keyBy:(Lorg/apache/spark/api/java/function/Function;)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.map ( function.Function<T,R> f ) : JavaRDD<R>
[mangled: org/apache/spark/api/java/JavaRDD<T>.map:(Lorg/apache/spark/api/java/function/Function;)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.mapPartitions ( function.FlatMapFunction<java.util.Iterator<T>,U> f ) : JavaRDD<U>
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapPartitions:(Lorg/apache/spark/api/java/function/FlatMapFunction;)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.mapPartitions ( function.FlatMapFunction<java.util.Iterator<T>,U> f, boolean preservesPartitioning ) : JavaRDD<U>
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapPartitions:(Lorg/apache/spark/api/java/function/FlatMapFunction;Z)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.mapPartitionsToDouble ( function.DoubleFlatMapFunction<java.util.Iterator<T>> f ) : JavaDoubleRDD
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapPartitionsToDouble:(Lorg/apache/spark/api/java/function/DoubleFlatMapFunction;)Lorg/apache/spark/api/java/JavaDoubleRDD;]
JavaRDD<T>.mapPartitionsToDouble ( function.DoubleFlatMapFunction<java.util.Iterator<T>> f, boolean preservesPartitioning ) : JavaDoubleRDD
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapPartitionsToDouble:(Lorg/apache/spark/api/java/function/DoubleFlatMapFunction;Z)Lorg/apache/spark/api/java/JavaDoubleRDD;]
JavaRDD<T>.mapPartitionsToPair ( function.PairFlatMapFunction<java.util.Iterator<T>,K2,V2> f ) : JavaPairRDD<K2,V2>
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapPartitionsToPair:(Lorg/apache/spark/api/java/function/PairFlatMapFunction;)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.mapPartitionsToPair ( function.PairFlatMapFunction<java.util.Iterator<T>,K2,V2> f, boolean preservesPartitioning ) : JavaPairRDD<K2,V2>
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapPartitionsToPair:(Lorg/apache/spark/api/java/function/PairFlatMapFunction;Z)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.mapPartitionsWithIndex ( function.Function2<Integer,java.util.Iterator<T>,java.util.Iterator<R>> f, boolean preservesPartitioning ) : JavaRDD<R>
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapPartitionsWithIndex:(Lorg/apache/spark/api/java/function/Function2;Z)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.mapToDouble ( function.DoubleFunction<T> f ) : JavaDoubleRDD
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapToDouble:(Lorg/apache/spark/api/java/function/DoubleFunction;)Lorg/apache/spark/api/java/JavaDoubleRDD;]
JavaRDD<T>.mapToPair ( function.PairFunction<T,K2,V2> f ) : JavaPairRDD<K2,V2>
[mangled: org/apache/spark/api/java/JavaRDD<T>.mapToPair:(Lorg/apache/spark/api/java/function/PairFunction;)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.max ( java.util.Comparator<T> comp ) : T
[mangled: org/apache/spark/api/java/JavaRDD<T>.max:(Ljava/util/Comparator;)Ljava/lang/Object;]
JavaRDD<T>.min ( java.util.Comparator<T> comp ) : T
[mangled: org/apache/spark/api/java/JavaRDD<T>.min:(Ljava/util/Comparator;)Ljava/lang/Object;]
JavaRDD<T>.name ( ) : String
[mangled: org/apache/spark/api/java/JavaRDD<T>.name:()Ljava/lang/String;]
JavaRDD<T>.partitions ( ) : java.util.List<org.apache.spark.Partition>
[mangled: org/apache/spark/api/java/JavaRDD<T>.partitions:()Ljava/util/List;]
JavaRDD<T>.pipe ( java.util.List<String> command ) : JavaRDD<String>
[mangled: org/apache/spark/api/java/JavaRDD<T>.pipe:(Ljava/util/List;)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.pipe ( java.util.List<String> command, java.util.Map<String,String> env ) : JavaRDD<String>
[mangled: org/apache/spark/api/java/JavaRDD<T>.pipe:(Ljava/util/List;Ljava/util/Map;)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.pipe ( String command ) : JavaRDD<String>
[mangled: org/apache/spark/api/java/JavaRDD<T>.pipe:(Ljava/lang/String;)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.reduce ( function.Function2<T,T,T> f ) : T
[mangled: org/apache/spark/api/java/JavaRDD<T>.reduce:(Lorg/apache/spark/api/java/function/Function2;)Ljava/lang/Object;]
JavaRDD<T>.saveAsObjectFile ( String path ) : void
[mangled: org/apache/spark/api/java/JavaRDD<T>.saveAsObjectFile:(Ljava/lang/String;)V]
JavaRDD<T>.saveAsTextFile ( String path ) : void
[mangled: org/apache/spark/api/java/JavaRDD<T>.saveAsTextFile:(Ljava/lang/String;)V]
JavaRDD<T>.saveAsTextFile ( String path, Class<? extends org.apache.hadoop.io.compress.CompressionCodec> codec ) : void
[mangled: org/apache/spark/api/java/JavaRDD<T>.saveAsTextFile:(Ljava/lang/String;Ljava/lang/Class;)V]
JavaRDD<T>.take ( int num ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.take:(I)Ljava/util/List;]
JavaRDD<T>.takeAsync ( int num ) : JavaFutureAction<java.util.List<T>>
[mangled: org/apache/spark/api/java/JavaRDD<T>.takeAsync:(I)Lorg/apache/spark/api/java/JavaFutureAction;]
JavaRDD<T>.takeOrdered ( int num ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.takeOrdered:(I)Ljava/util/List;]
JavaRDD<T>.takeOrdered ( int num, java.util.Comparator<T> comp ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.takeOrdered:(ILjava/util/Comparator;)Ljava/util/List;]
JavaRDD<T>.takeSample ( boolean withReplacement, int num ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.takeSample:(ZI)Ljava/util/List;]
JavaRDD<T>.takeSample ( boolean withReplacement, int num, long seed ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.takeSample:(ZIJ)Ljava/util/List;]
JavaRDD<T>.toArray ( ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.toArray:()Ljava/util/List;]
JavaRDD<T>.toDebugString ( ) : String
[mangled: org/apache/spark/api/java/JavaRDD<T>.toDebugString:()Ljava/lang/String;]
JavaRDD<T>.toLocalIterator ( ) : java.util.Iterator<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.toLocalIterator:()Ljava/util/Iterator;]
JavaRDD<T>.top ( int num ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.top:(I)Ljava/util/List;]
JavaRDD<T>.top ( int num, java.util.Comparator<T> comp ) : java.util.List<T>
[mangled: org/apache/spark/api/java/JavaRDD<T>.top:(ILjava/util/Comparator;)Ljava/util/List;]
JavaRDD<T>.treeAggregate ( U zeroValue, function.Function2<U,T,U> seqOp, function.Function2<U,U,U> combOp ) : U
[mangled: org/apache/spark/api/java/JavaRDD<T>.treeAggregate:(Ljava/lang/Object;Lorg/apache/spark/api/java/function/Function2;Lorg/apache/spark/api/java/function/Function2;)Ljava/lang/Object;]
JavaRDD<T>.treeAggregate ( U zeroValue, function.Function2<U,T,U> seqOp, function.Function2<U,U,U> combOp, int depth ) : U
[mangled: org/apache/spark/api/java/JavaRDD<T>.treeAggregate:(Ljava/lang/Object;Lorg/apache/spark/api/java/function/Function2;Lorg/apache/spark/api/java/function/Function2;I)Ljava/lang/Object;]
JavaRDD<T>.treeReduce ( function.Function2<T,T,T> f ) : T
[mangled: org/apache/spark/api/java/JavaRDD<T>.treeReduce:(Lorg/apache/spark/api/java/function/Function2;)Ljava/lang/Object;]
JavaRDD<T>.treeReduce ( function.Function2<T,T,T> f, int depth ) : T
[mangled: org/apache/spark/api/java/JavaRDD<T>.treeReduce:(Lorg/apache/spark/api/java/function/Function2;I)Ljava/lang/Object;]
JavaRDD<T>.zip ( JavaRDDLike<U,?> other ) : JavaPairRDD<T,U>
[mangled: org/apache/spark/api/java/JavaRDD<T>.zip:(Lorg/apache/spark/api/java/JavaRDDLike;)Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.zipPartitions ( JavaRDDLike<U,?> other, function.FlatMapFunction2<java.util.Iterator<T>,java.util.Iterator<U>,V> f ) : JavaRDD<V>
[mangled: org/apache/spark/api/java/JavaRDD<T>.zipPartitions:(Lorg/apache/spark/api/java/JavaRDDLike;Lorg/apache/spark/api/java/function/FlatMapFunction2;)Lorg/apache/spark/api/java/JavaRDD;]
JavaRDD<T>.zipWithIndex ( ) : JavaPairRDD<T,Long>
[mangled: org/apache/spark/api/java/JavaRDD<T>.zipWithIndex:()Lorg/apache/spark/api/java/JavaPairRDD;]
JavaRDD<T>.zipWithUniqueId ( ) : JavaPairRDD<T,Long>
[mangled: org/apache/spark/api/java/JavaRDD<T>.zipWithUniqueId:()Lorg/apache/spark/api/java/JavaPairRDD;]
spark-core_2.10-1.3.0.jar, SparkConf.class
package org.apache.spark
SparkConf.translateConfKey ( String p1, boolean p2 ) [static] : String
[mangled: org/apache/spark/SparkConf.translateConfKey:(Ljava/lang/String;Z)Ljava/lang/String;]
spark-sql_2.10-1.3.0.jar, SQLContext.class
package org.apache.spark.sql
SQLContext.cacheManager ( ) : CacheManager
[mangled: org/apache/spark/sql/SQLContext.cacheManager:()Lorg/apache/spark/sql/CacheManager;]
SQLContext.checkAnalysis ( ) : catalyst.analysis.CheckAnalysis
[mangled: org/apache/spark/sql/SQLContext.checkAnalysis:()Lorg/apache/spark/sql/catalyst/analysis/CheckAnalysis;]
SQLContext.createDataFrame ( org.apache.spark.api.java.JavaRDD<Row> rowRDD, java.util.List<String> columns ) : DataFrame
[mangled: org/apache/spark/sql/SQLContext.createDataFrame:(Lorg/apache/spark/api/java/JavaRDD;Ljava/util/List;)Lorg/apache/spark/sql/DataFrame;]
spark-streaming_2.10-1.3.0.jar, StreamingContext.class
package org.apache.spark.streaming
StreamingContext.getNewReceiverStreamId ( ) : int
[mangled: org/apache/spark/streaming/StreamingContext.getNewReceiverStreamId:()I]
StreamingContext.state ( ) : scala.Enumeration.Value
[mangled: org/apache/spark/streaming/StreamingContext.state:()Lscala/Enumeration$Value;]
StreamingContext.state_.eq ( scala.Enumeration.Value p1 ) : void
[mangled: org/apache/spark/streaming/StreamingContext.state_.eq:(Lscala/Enumeration$Value;)V]
StreamingContext.StreamingContextState ( ) : StreamingContext.StreamingContextState.
[mangled: org/apache/spark/streaming/StreamingContext.StreamingContextState:()Lorg/apache/spark/streaming/StreamingContext$StreamingContextState$;]
to the top
Removed Methods (115)
spark-core_2.10-1.4.0.jar, JavaSparkContext.class
package org.apache.spark.api.java
JavaSparkContext.setLogLevel ( String logLevel ) : void
[mangled: org/apache/spark/api/java/JavaSparkContext.setLogLevel:(Ljava/lang/String;)V]
spark-core_2.10-1.4.0.jar, RDD<T>.class
package org.apache.spark.rdd
RDD<T>.RDD..doCheckpointCalled ( ) : boolean
[mangled: org/apache/spark/rdd/RDD<T>.org.apache.spark.rdd.RDD..doCheckpointCalled:()Z]
RDD<T>.RDD..doCheckpointCalled_.eq ( boolean p1 ) : void
[mangled: org/apache/spark/rdd/RDD<T>.org.apache.spark.rdd.RDD..doCheckpointCalled_.eq:(Z)V]
RDD<T>.RDD..sc ( ) : org.apache.spark.SparkContext
[mangled: org/apache/spark/rdd/RDD<T>.org.apache.spark.rdd.RDD..sc:()Lorg/apache/spark/SparkContext;]
RDD<T>.randomSampleWithRange ( double lb, double ub, long seed ) : RDD<T>
[mangled: org/apache/spark/rdd/RDD<T>.randomSampleWithRange:(DDJ)Lorg/apache/spark/rdd/RDD;]
RDD<T>.scope ( ) : scala.Option<RDDOperationScope>
[mangled: org/apache/spark/rdd/RDD<T>.scope:()Lscala/Option;]
RDD<T>.withScope ( scala.Function0<U> body ) : U
[mangled: org/apache/spark/rdd/RDD<T>.withScope:(Lscala/Function0;)Ljava/lang/Object;]
spark-core_2.10-1.4.0.jar, SparkConf.class
package org.apache.spark
SparkConf.getDeprecatedConfig ( String p1, SparkConf p2 ) [static] : scala.Option<String>
[mangled: org/apache/spark/SparkConf.getDeprecatedConfig:(Ljava/lang/String;Lorg/apache/spark/SparkConf;)Lscala/Option;]
SparkConf.getSizeAsBytes ( String key ) : long
[mangled: org/apache/spark/SparkConf.getSizeAsBytes:(Ljava/lang/String;)J]
SparkConf.getSizeAsBytes ( String key, String defaultValue ) : long
[mangled: org/apache/spark/SparkConf.getSizeAsBytes:(Ljava/lang/String;Ljava/lang/String;)J]
SparkConf.getSizeAsGb ( String key ) : long
[mangled: org/apache/spark/SparkConf.getSizeAsGb:(Ljava/lang/String;)J]
SparkConf.getSizeAsGb ( String key, String defaultValue ) : long
[mangled: org/apache/spark/SparkConf.getSizeAsGb:(Ljava/lang/String;Ljava/lang/String;)J]
SparkConf.getSizeAsKb ( String key ) : long
[mangled: org/apache/spark/SparkConf.getSizeAsKb:(Ljava/lang/String;)J]
SparkConf.getSizeAsKb ( String key, String defaultValue ) : long
[mangled: org/apache/spark/SparkConf.getSizeAsKb:(Ljava/lang/String;Ljava/lang/String;)J]
SparkConf.getSizeAsMb ( String key ) : long
[mangled: org/apache/spark/SparkConf.getSizeAsMb:(Ljava/lang/String;)J]
SparkConf.getSizeAsMb ( String key, String defaultValue ) : long
[mangled: org/apache/spark/SparkConf.getSizeAsMb:(Ljava/lang/String;Ljava/lang/String;)J]
SparkConf.getTimeAsMs ( String key ) : long
[mangled: org/apache/spark/SparkConf.getTimeAsMs:(Ljava/lang/String;)J]
SparkConf.getTimeAsMs ( String key, String defaultValue ) : long
[mangled: org/apache/spark/SparkConf.getTimeAsMs:(Ljava/lang/String;Ljava/lang/String;)J]
SparkConf.getTimeAsSeconds ( String key ) : long
[mangled: org/apache/spark/SparkConf.getTimeAsSeconds:(Ljava/lang/String;)J]
SparkConf.getTimeAsSeconds ( String key, String defaultValue ) : long
[mangled: org/apache/spark/SparkConf.getTimeAsSeconds:(Ljava/lang/String;Ljava/lang/String;)J]
SparkConf.logDeprecationWarning ( String p1 ) [static] : void
[mangled: org/apache/spark/SparkConf.logDeprecationWarning:(Ljava/lang/String;)V]
spark-core_2.10-1.4.0.jar, SparkContext.class
package org.apache.spark
SparkContext.applicationAttemptId ( ) : scala.Option<String>
[mangled: org/apache/spark/SparkContext.applicationAttemptId:()Lscala/Option;]
SparkContext.externalBlockStoreFolderName ( ) : String
[mangled: org/apache/spark/SparkContext.externalBlockStoreFolderName:()Ljava/lang/String;]
SparkContext.getOrCreate ( ) [static] : SparkContext
[mangled: org/apache/spark/SparkContext.getOrCreate:()Lorg/apache/spark/SparkContext;]
SparkContext.getOrCreate ( SparkConf p1 ) [static] : SparkContext
[mangled: org/apache/spark/SparkContext.getOrCreate:(Lorg/apache/spark/SparkConf;)Lorg/apache/spark/SparkContext;]
SparkContext.SparkContext.._conf ( ) : SparkConf
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._conf:()Lorg/apache/spark/SparkConf;]
SparkContext.SparkContext.._env ( ) : SparkEnv
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext.._env:()Lorg/apache/spark/SparkEnv;]
SparkContext.SparkContext..assertNotStopped ( ) : void
[mangled: org/apache/spark/SparkContext.org.apache.spark.SparkContext..assertNotStopped:()V]
SparkContext.range ( long start, long end, long step, int numSlices ) : rdd.RDD<Object>
[mangled: org/apache/spark/SparkContext.range:(JJJI)Lorg/apache/spark/rdd/RDD;]
SparkContext.setLogLevel ( String logLevel ) : void
[mangled: org/apache/spark/SparkContext.setLogLevel:(Ljava/lang/String;)V]
SparkContext.supportDynamicAllocation ( ) : boolean
[mangled: org/apache/spark/SparkContext.supportDynamicAllocation:()Z]
SparkContext.withScope ( scala.Function0<U> body ) : U
[mangled: org/apache/spark/SparkContext.withScope:(Lscala/Function0;)Ljava/lang/Object;]
spark-core_2.10-1.4.0.jar, TaskContext.class
package org.apache.spark
TaskContext.taskMemoryManager ( ) [abstract] : unsafe.memory.TaskMemoryManager
[mangled: org/apache/spark/TaskContext.taskMemoryManager:()Lorg/apache/spark/unsafe/memory/TaskMemoryManager;]
spark-sql_2.10-1.4.0.jar, BaseRelation.class
package org.apache.spark.sql.sources
BaseRelation.needConversion ( ) : boolean
[mangled: org/apache/spark/sql/sources/BaseRelation.needConversion:()Z]
spark-sql_2.10-1.4.0.jar, DataFrame.class
package org.apache.spark.sql
DataFrame.coalesce ( int numPartitions ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.coalesce:(I)Lorg/apache/spark/sql/DataFrame;]
DataFrame.cube ( Column... cols ) : GroupedData
[mangled: org/apache/spark/sql/DataFrame.cube:([Lorg/apache/spark/sql/Column;)Lorg/apache/spark/sql/GroupedData;]
DataFrame.cube ( scala.collection.Seq<Column> cols ) : GroupedData
[mangled: org/apache/spark/sql/DataFrame.cube:(Lscala/collection/Seq;)Lorg/apache/spark/sql/GroupedData;]
DataFrame.cube ( String col1, scala.collection.Seq<String> cols ) : GroupedData
[mangled: org/apache/spark/sql/DataFrame.cube:(Ljava/lang/String;Lscala/collection/Seq;)Lorg/apache/spark/sql/GroupedData;]
DataFrame.cube ( String col1, String... cols ) : GroupedData
[mangled: org/apache/spark/sql/DataFrame.cube:(Ljava/lang/String;[Ljava/lang/String;)Lorg/apache/spark/sql/GroupedData;]
DataFrame.describe ( scala.collection.Seq<String> cols ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.describe:(Lscala/collection/Seq;)Lorg/apache/spark/sql/DataFrame;]
DataFrame.describe ( String... cols ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.describe:([Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;]
DataFrame.drop ( String colName ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.drop:(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;]
DataFrame.dropDuplicates ( ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.dropDuplicates:()Lorg/apache/spark/sql/DataFrame;]
DataFrame.dropDuplicates ( scala.collection.Seq<String> colNames ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.dropDuplicates:(Lscala/collection/Seq;)Lorg/apache/spark/sql/DataFrame;]
DataFrame.dropDuplicates ( String[ ] colNames ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.dropDuplicates:([Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;]
DataFrame.join ( DataFrame right, String usingColumn ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.join:(Lorg/apache/spark/sql/DataFrame;Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;]
DataFrame.na ( ) : DataFrameNaFunctions
[mangled: org/apache/spark/sql/DataFrame.na:()Lorg/apache/spark/sql/DataFrameNaFunctions;]
DataFrame.DataFrame..logicalPlanToDataFrame ( catalyst.plans.logical.LogicalPlan logicalPlan ) : DataFrame
[mangled: org/apache/spark/sql/DataFrame.org.apache.spark.sql.DataFrame..logicalPlanToDataFrame:(Lorg/apache/spark/sql/catalyst/plans/logical/LogicalPlan;)Lorg/apache/spark/sql/DataFrame;]
DataFrame.randomSplit ( double[ ] weights ) : DataFrame[ ]
[mangled: org/apache/spark/sql/DataFrame.randomSplit:([D)[Lorg/apache/spark/sql/DataFrame;]
DataFrame.randomSplit ( double[ ] weights, long seed ) : DataFrame[ ]
[mangled: org/apache/spark/sql/DataFrame.randomSplit:([DJ)[Lorg/apache/spark/sql/DataFrame;]
DataFrame.randomSplit ( scala.collection.immutable.List<Object> weights, long seed ) : DataFrame[ ]
[mangled: org/apache/spark/sql/DataFrame.randomSplit:(Lscala/collection/immutable/List;J)[Lorg/apache/spark/sql/DataFrame;]
DataFrame.rollup ( Column... cols ) : GroupedData
[mangled: org/apache/spark/sql/DataFrame.rollup:([Lorg/apache/spark/sql/Column;)Lorg/apache/spark/sql/GroupedData;]
DataFrame.rollup ( scala.collection.Seq<Column> cols ) : GroupedData
[mangled: org/apache/spark/sql/DataFrame.rollup:(Lscala/collection/Seq;)Lorg/apache/spark/sql/GroupedData;]
DataFrame.rollup ( String col1, scala.collection.Seq<String> cols ) : GroupedData
[mangled: org/apache/spark/sql/DataFrame.rollup:(Ljava/lang/String;Lscala/collection/Seq;)Lorg/apache/spark/sql/GroupedData;]
DataFrame.rollup ( String col1, String... cols ) : GroupedData
[mangled: org/apache/spark/sql/DataFrame.rollup:(Ljava/lang/String;[Ljava/lang/String;)Lorg/apache/spark/sql/GroupedData;]
DataFrame.stat ( ) : DataFrameStatFunctions
[mangled: org/apache/spark/sql/DataFrame.stat:()Lorg/apache/spark/sql/DataFrameStatFunctions;]
DataFrame.write ( ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrame.write:()Lorg/apache/spark/sql/DataFrameWriter;]
spark-sql_2.10-1.4.0.jar, DataFrameReader.class
package org.apache.spark.sql
DataFrameReader.DataFrameReader ( SQLContext sqlContext )
[mangled: org/apache/spark/sql/DataFrameReader."<init>":(Lorg/apache/spark/sql/SQLContext;)V]
DataFrameReader.format ( String source ) : DataFrameReader
[mangled: org/apache/spark/sql/DataFrameReader.format:(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrameReader;]
DataFrameReader.jdbc ( String url, String table, java.util.Properties properties ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.jdbc:(Ljava/lang/String;Ljava/lang/String;Ljava/util/Properties;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.jdbc ( String url, String table, String columnName, long lowerBound, long upperBound, int numPartitions, java.util.Properties connectionProperties ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.jdbc:(Ljava/lang/String;Ljava/lang/String;Ljava/lang/String;JJILjava/util/Properties;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.jdbc ( String url, String table, String[ ] predicates, java.util.Properties connectionProperties ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.jdbc:(Ljava/lang/String;Ljava/lang/String;[Ljava/lang/String;Ljava/util/Properties;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.json ( org.apache.spark.api.java.JavaRDD<String> jsonRDD ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.json:(Lorg/apache/spark/api/java/JavaRDD;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.json ( org.apache.spark.rdd.RDD<String> jsonRDD ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.json:(Lorg/apache/spark/rdd/RDD;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.json ( String path ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.json:(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.load ( ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.load:()Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.load ( String path ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.load:(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.option ( String key, String value ) : DataFrameReader
[mangled: org/apache/spark/sql/DataFrameReader.option:(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/spark/sql/DataFrameReader;]
DataFrameReader.options ( java.util.Map<String,String> options ) : DataFrameReader
[mangled: org/apache/spark/sql/DataFrameReader.options:(Ljava/util/Map;)Lorg/apache/spark/sql/DataFrameReader;]
DataFrameReader.options ( scala.collection.Map<String,String> options ) : DataFrameReader
[mangled: org/apache/spark/sql/DataFrameReader.options:(Lscala/collection/Map;)Lorg/apache/spark/sql/DataFrameReader;]
DataFrameReader.parquet ( scala.collection.Seq<String> paths ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.parquet:(Lscala/collection/Seq;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.parquet ( String... paths ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.parquet:([Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;]
DataFrameReader.schema ( types.StructType schema ) : DataFrameReader
[mangled: org/apache/spark/sql/DataFrameReader.schema:(Lorg/apache/spark/sql/types/StructType;)Lorg/apache/spark/sql/DataFrameReader;]
DataFrameReader.table ( String tableName ) : DataFrame
[mangled: org/apache/spark/sql/DataFrameReader.table:(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrame;]
spark-sql_2.10-1.4.0.jar, DataFrameWriter.class
package org.apache.spark.sql
DataFrameWriter.DataFrameWriter ( DataFrame df )
[mangled: org/apache/spark/sql/DataFrameWriter."<init>":(Lorg/apache/spark/sql/DataFrame;)V]
DataFrameWriter.format ( String source ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrameWriter.format:(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrameWriter;]
DataFrameWriter.insertInto ( String tableName ) : void
[mangled: org/apache/spark/sql/DataFrameWriter.insertInto:(Ljava/lang/String;)V]
DataFrameWriter.jdbc ( String url, String table, java.util.Properties connectionProperties ) : void
[mangled: org/apache/spark/sql/DataFrameWriter.jdbc:(Ljava/lang/String;Ljava/lang/String;Ljava/util/Properties;)V]
DataFrameWriter.json ( String path ) : void
[mangled: org/apache/spark/sql/DataFrameWriter.json:(Ljava/lang/String;)V]
DataFrameWriter.mode ( SaveMode saveMode ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrameWriter.mode:(Lorg/apache/spark/sql/SaveMode;)Lorg/apache/spark/sql/DataFrameWriter;]
DataFrameWriter.mode ( String saveMode ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrameWriter.mode:(Ljava/lang/String;)Lorg/apache/spark/sql/DataFrameWriter;]
DataFrameWriter.option ( String key, String value ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrameWriter.option:(Ljava/lang/String;Ljava/lang/String;)Lorg/apache/spark/sql/DataFrameWriter;]
DataFrameWriter.options ( java.util.Map<String,String> options ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrameWriter.options:(Ljava/util/Map;)Lorg/apache/spark/sql/DataFrameWriter;]
DataFrameWriter.options ( scala.collection.Map<String,String> options ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrameWriter.options:(Lscala/collection/Map;)Lorg/apache/spark/sql/DataFrameWriter;]
DataFrameWriter.parquet ( String path ) : void
[mangled: org/apache/spark/sql/DataFrameWriter.parquet:(Ljava/lang/String;)V]
DataFrameWriter.partitionBy ( scala.collection.Seq<String> colNames ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrameWriter.partitionBy:(Lscala/collection/Seq;)Lorg/apache/spark/sql/DataFrameWriter;]
DataFrameWriter.partitionBy ( String... colNames ) : DataFrameWriter
[mangled: org/apache/spark/sql/DataFrameWriter.partitionBy:([Ljava/lang/String;)Lorg/apache/spark/sql/DataFrameWriter;]
DataFrameWriter.save ( ) : void
[mangled: org/apache/spark/sql/DataFrameWriter.save:()V]
DataFrameWriter.save ( String path ) : void
[mangled: org/apache/spark/sql/DataFrameWriter.save:(Ljava/lang/String;)V]
DataFrameWriter.saveAsTable ( String tableName ) : void
[mangled: org/apache/spark/sql/DataFrameWriter.saveAsTable:(Ljava/lang/String;)V]
spark-sql_2.10-1.4.0.jar, SQLContext.class
package org.apache.spark.sql
SQLContext.cacheManager ( ) : execution.CacheManager
[mangled: org/apache/spark/sql/SQLContext.cacheManager:()Lorg/apache/spark/sql/execution/CacheManager;]
SQLContext.createDataFrame ( org.apache.spark.rdd.RDD<Row> rowRDD, types.StructType schema, boolean needsConversion ) : DataFrame
[mangled: org/apache/spark/sql/SQLContext.createDataFrame:(Lorg/apache/spark/rdd/RDD;Lorg/apache/spark/sql/types/StructType;Z)Lorg/apache/spark/sql/DataFrame;]
SQLContext.createSession ( ) : SQLContext.SQLSession
[mangled: org/apache/spark/sql/SQLContext.createSession:()Lorg/apache/spark/sql/SQLContext$SQLSession;]
SQLContext.currentSession ( ) : SQLContext.SQLSession
[mangled: org/apache/spark/sql/SQLContext.currentSession:()Lorg/apache/spark/sql/SQLContext$SQLSession;]
SQLContext.defaultSession ( ) : SQLContext.SQLSession
[mangled: org/apache/spark/sql/SQLContext.defaultSession:()Lorg/apache/spark/sql/SQLContext$SQLSession;]
SQLContext.detachSession ( ) : void
[mangled: org/apache/spark/sql/SQLContext.detachSession:()V]
SQLContext.dialectClassName ( ) : String
[mangled: org/apache/spark/sql/SQLContext.dialectClassName:()Ljava/lang/String;]
SQLContext.getOrCreate ( org.apache.spark.SparkContext p1 ) [static] : SQLContext
[mangled: org/apache/spark/sql/SQLContext.getOrCreate:(Lorg/apache/spark/SparkContext;)Lorg/apache/spark/sql/SQLContext;]
SQLContext.getSQLDialect ( ) : catalyst.ParserDialect
[mangled: org/apache/spark/sql/SQLContext.getSQLDialect:()Lorg/apache/spark/sql/catalyst/ParserDialect;]
SQLContext.openSession ( ) : SQLContext.SQLSession
[mangled: org/apache/spark/sql/SQLContext.openSession:()Lorg/apache/spark/sql/SQLContext$SQLSession;]
SQLContext.range ( long start, long end ) : DataFrame
[mangled: org/apache/spark/sql/SQLContext.range:(JJ)Lorg/apache/spark/sql/DataFrame;]
SQLContext.range ( long start, long end, long step, int numPartitions ) : DataFrame
[mangled: org/apache/spark/sql/SQLContext.range:(JJJI)Lorg/apache/spark/sql/DataFrame;]
SQLContext.read ( ) : DataFrameReader
[mangled: org/apache/spark/sql/SQLContext.read:()Lorg/apache/spark/sql/DataFrameReader;]
SQLContext.tlSession ( ) : ThreadLocal<SQLContext.SQLSession>
[mangled: org/apache/spark/sql/SQLContext.tlSession:()Ljava/lang/ThreadLocal;]
spark-streaming_2.10-1.4.0.jar, StreamingContext.class
package org.apache.spark.streaming
StreamingContext.getActive ( ) [static] : scala.Option<StreamingContext>
[mangled: org/apache/spark/streaming/StreamingContext.getActive:()Lscala/Option;]
StreamingContext.getActiveOrCreate ( scala.Function0<StreamingContext> p1 ) [static] : StreamingContext
[mangled: org/apache/spark/streaming/StreamingContext.getActiveOrCreate:(Lscala/Function0;)Lorg/apache/spark/streaming/StreamingContext;]
StreamingContext.getActiveOrCreate ( String p1, scala.Function0<StreamingContext> p2, org.apache.hadoop.conf.Configuration p3, boolean p4 ) [static] : StreamingContext
[mangled: org/apache/spark/streaming/StreamingContext.getActiveOrCreate:(Ljava/lang/String;Lscala/Function0;Lorg/apache/hadoop/conf/Configuration;Z)Lorg/apache/spark/streaming/StreamingContext;]
StreamingContext.getNewInputStreamId ( ) : int
[mangled: org/apache/spark/streaming/StreamingContext.getNewInputStreamId:()I]
StreamingContext.getState ( ) : StreamingContextState
[mangled: org/apache/spark/streaming/StreamingContext.getState:()Lorg/apache/spark/streaming/StreamingContextState;]
StreamingContext.isCheckpointingEnabled ( ) : boolean
[mangled: org/apache/spark/streaming/StreamingContext.isCheckpointingEnabled:()Z]
StreamingContext.StreamingContext..startSite ( ) : java.util.concurrent.atomic.AtomicReference<org.apache.spark.util.CallSite>
[mangled: org/apache/spark/streaming/StreamingContext.org.apache.spark.streaming.StreamingContext..startSite:()Ljava/util/concurrent/atomic/AtomicReference;]
StreamingContext.StreamingContext..stopOnShutdown ( ) : void
[mangled: org/apache/spark/streaming/StreamingContext.org.apache.spark.streaming.StreamingContext..stopOnShutdown:()V]
StreamingContext.StreamingContext ( String path, org.apache.spark.SparkContext sparkContext )
[mangled: org/apache/spark/streaming/StreamingContext."<init>":(Ljava/lang/String;Lorg/apache/spark/SparkContext;)V]
StreamingContext.withNamedScope ( String name, scala.Function0<U> body ) : U
[mangled: org/apache/spark/streaming/StreamingContext.withNamedScope:(Ljava/lang/String;Lscala/Function0;)Ljava/lang/Object;]
StreamingContext.withScope ( scala.Function0<U> body ) : U
[mangled: org/apache/spark/streaming/StreamingContext.withScope:(Lscala/Function0;)Ljava/lang/Object;]
to the top
Problems with Data Types, High Severity (7)
spark-core_2.10-1.4.0.jar
package org.apache.spark
[+] TaskContext (1)
| Change | Effect |
|---|
| 1 | Abstract method taskMemoryManager ( ) has been removed from this class. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (15)
compute ( Partition, TaskContext )2nd parameter 'p2' of this abstract method has type 'TaskContext'.
computeOrReadCheckpoint ( Partition, TaskContext )2nd parameter 'context' of this method has type 'TaskContext'.
iterator ( Partition, TaskContext )2nd parameter 'context' of this method has type 'TaskContext'.
addTaskCompletionListener ( util.TaskCompletionListener )This abstract method is from 'TaskContext' abstract class.
addTaskCompletionListener ( scala.Function1<TaskContext,scala.runtime.BoxedUnit> )This abstract method is from 'TaskContext' abstract class.
attemptNumber ( )This abstract method is from 'TaskContext' abstract class.
get ( )This method is from 'TaskContext' abstract class.
isCompleted ( )This abstract method is from 'TaskContext' abstract class.
isInterrupted ( )This abstract method is from 'TaskContext' abstract class.
isRunningLocally ( )This abstract method is from 'TaskContext' abstract class.
partitionId ( )This abstract method is from 'TaskContext' abstract class.
stageId ( )This abstract method is from 'TaskContext' abstract class.
taskAttemptId ( )This abstract method is from 'TaskContext' abstract class.
TaskContext ( )This constructor is from 'TaskContext' abstract class.
taskMetrics ( )This abstract method is from 'TaskContext' abstract class.
spark-sql_2.10-1.4.0.jar
package org.apache.spark.sql
[+] Column (1)
| Change | Effect |
|---|
| 1 | Removed super-interface org.apache.spark.Logging. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (9)
agg ( Column, Column... )1st parameter 'expr' of this method has type 'Column'.
agg ( Column, scala.collection.Seq<Column> )1st parameter 'expr' of this method has type 'Column'.
apply ( java.lang.String )Return value of this method has type 'Column'.
col ( java.lang.String )Return value of this method has type 'Column'.
filter ( Column )1st parameter 'condition' of this method has type 'Column'.
join ( DataFrame, Column )2nd parameter 'joinExprs' of this method has type 'Column'.
join ( DataFrame, Column, java.lang.String )2nd parameter 'joinExprs' of this method has type 'Column'.
where ( Column )1st parameter 'condition' of this method has type 'Column'.
withColumn ( java.lang.String, Column )2nd parameter 'col' of this method has type 'Column'.
[+] DataFrameReader (1)
| Change | Effect |
|---|
| 1 | This class has been removed. | A client program may be interrupted by NoClassDefFoundError exception. |
|---|
[+] affected methods (17)
DataFrameReader ( SQLContext )This constructor is from 'DataFrameReader' class.
format ( java.lang.String )This method is from 'DataFrameReader' class.
jdbc ( java.lang.String, java.lang.String, java.lang.String, long, long, int, java.util.Properties )This method is from 'DataFrameReader' class.
jdbc ( java.lang.String, java.lang.String, java.lang.String[ ], java.util.Properties )This method is from 'DataFrameReader' class.
jdbc ( java.lang.String, java.lang.String, java.util.Properties )This method is from 'DataFrameReader' class.
json ( java.lang.String )This method is from 'DataFrameReader' class.
json ( org.apache.spark.api.java.JavaRDD<java.lang.String> )This method is from 'DataFrameReader' class.
json ( org.apache.spark.rdd.RDD<java.lang.String> )This method is from 'DataFrameReader' class.
load ( )This method is from 'DataFrameReader' class.
load ( java.lang.String )This method is from 'DataFrameReader' class.
option ( java.lang.String, java.lang.String )This method is from 'DataFrameReader' class.
options ( java.util.Map<java.lang.String,java.lang.String> )This method is from 'DataFrameReader' class.
options ( scala.collection.Map<java.lang.String,java.lang.String> )This method is from 'DataFrameReader' class.
parquet ( java.lang.String... )This method is from 'DataFrameReader' class.
parquet ( scala.collection.Seq<java.lang.String> )This method is from 'DataFrameReader' class.
schema ( types.StructType )This method is from 'DataFrameReader' class.
table ( java.lang.String )This method is from 'DataFrameReader' class.
[+] DataFrameWriter (1)
| Change | Effect |
|---|
| 1 | This class has been removed. | A client program may be interrupted by NoClassDefFoundError exception. |
|---|
[+] affected methods (16)
DataFrameWriter ( DataFrame )This constructor is from 'DataFrameWriter' class.
format ( java.lang.String )This method is from 'DataFrameWriter' class.
insertInto ( java.lang.String )This method is from 'DataFrameWriter' class.
jdbc ( java.lang.String, java.lang.String, java.util.Properties )This method is from 'DataFrameWriter' class.
json ( java.lang.String )This method is from 'DataFrameWriter' class.
mode ( java.lang.String )This method is from 'DataFrameWriter' class.
mode ( SaveMode )This method is from 'DataFrameWriter' class.
option ( java.lang.String, java.lang.String )This method is from 'DataFrameWriter' class.
options ( java.util.Map<java.lang.String,java.lang.String> )This method is from 'DataFrameWriter' class.
options ( scala.collection.Map<java.lang.String,java.lang.String> )This method is from 'DataFrameWriter' class.
parquet ( java.lang.String )This method is from 'DataFrameWriter' class.
partitionBy ( java.lang.String... )This method is from 'DataFrameWriter' class.
partitionBy ( scala.collection.Seq<java.lang.String> )This method is from 'DataFrameWriter' class.
save ( )This method is from 'DataFrameWriter' class.
save ( java.lang.String )This method is from 'DataFrameWriter' class.
saveAsTable ( java.lang.String )This method is from 'DataFrameWriter' class.
[+] SQLConf (1)
| Change | Effect |
|---|
| 1 | Removed super-interface catalyst.CatalystConf. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (1)
conf ( )Return value of this method has type 'SQLConf'.
package org.apache.spark.sql.sources
[+] DDLParser (1)
| Change | Effect |
|---|
| 1 | Removed super-interface org.apache.spark.sql.types.DataTypeParser. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (1)
ddlParser ( )Return value of this method has type 'DDLParser'.
spark-streaming_2.10-1.4.0.jar
package org.apache.spark.streaming.ui
[+] StreamingJobProgressListener (1)
| Change | Effect |
|---|
| 1 | Removed super-interface org.apache.spark.scheduler.SparkListener. | A client program may be interrupted by NoSuchMethodError exception. |
|---|
[+] affected methods (1)
progressListener ( )Return value of this method has type 'StreamingJobProgressListener'.
to the top
Problems with Data Types, Medium Severity (3)
spark-core_2.10-1.4.0.jar
package org.apache.spark.api.java
[+] JavaDoubleRDD (1)
| Change | Effect |
|---|
| 1 | Removed super-class AbstractJavaRDDLike<java.lang.Double,JavaDoubleRDD>. | Access of a client program to the fields or methods of the old super-class may be interrupted by NoSuchFieldError or NoSuchMethodError exceptions. |
|---|
[+] affected methods (3)
parallelizeDoubles ( java.util.List<java.lang.Double> )Return value of this method has type 'JavaDoubleRDD'.
parallelizeDoubles ( java.util.List<java.lang.Double>, int )Return value of this method has type 'JavaDoubleRDD'.
union ( JavaDoubleRDD, java.util.List<JavaDoubleRDD> )1st parameter 'first' of this method has type 'JavaDoubleRDD'.
[+] JavaPairRDD<K,V> (1)
| Change | Effect |
|---|
| 1 | Removed super-class AbstractJavaRDDLike<scala.Tuple2<K,V>,JavaPairRDD<K,V>>. | Access of a client program to the fields or methods of the old super-class may be interrupted by NoSuchFieldError or NoSuchMethodError exceptions. |
|---|
[+] affected methods (11)
hadoopFile ( java.lang.String, java.lang.Class<F>, java.lang.Class<K>, java.lang.Class<V> )Return value of this method has type 'JavaPairRDD<K,V>'.
hadoopFile ( java.lang.String, java.lang.Class<F>, java.lang.Class<K>, java.lang.Class<V>, int )Return value of this method has type 'JavaPairRDD<K,V>'.
hadoopRDD ( org.apache.hadoop.mapred.JobConf, java.lang.Class<F>, java.lang.Class<K>, java.lang.Class<V> )Return value of this method has type 'JavaPairRDD<K,V>'.
hadoopRDD ( org.apache.hadoop.mapred.JobConf, java.lang.Class<F>, java.lang.Class<K>, java.lang.Class<V>, int )Return value of this method has type 'JavaPairRDD<K,V>'.
newAPIHadoopFile ( java.lang.String, java.lang.Class<F>, java.lang.Class<K>, java.lang.Class<V>, org.apache.hadoop.conf.Configuration )Return value of this method has type 'JavaPairRDD<K,V>'.
newAPIHadoopRDD ( org.apache.hadoop.conf.Configuration, java.lang.Class<F>, java.lang.Class<K>, java.lang.Class<V> )Return value of this method has type 'JavaPairRDD<K,V>'.
parallelizePairs ( java.util.List<scala.Tuple2<K,V>> )Return value of this method has type 'JavaPairRDD<K,V>'.
parallelizePairs ( java.util.List<scala.Tuple2<K,V>>, int )Return value of this method has type 'JavaPairRDD<K,V>'.
sequenceFile ( java.lang.String, java.lang.Class<K>, java.lang.Class<V> )Return value of this method has type 'JavaPairRDD<K,V>'.
sequenceFile ( java.lang.String, java.lang.Class<K>, java.lang.Class<V>, int )Return value of this method has type 'JavaPairRDD<K,V>'.
union ( JavaPairRDD<K,V>, java.util.List<JavaPairRDD<K,V>> )1st parameter 'first' of this method has type 'JavaPairRDD<K,V>'.
[+] JavaRDD<T> (1)
| Change | Effect |
|---|
| 1 | Removed super-class AbstractJavaRDDLike<T,JavaRDD<T>>. | Access of a client program to the fields or methods of the old super-class may be interrupted by NoSuchFieldError or NoSuchMethodError exceptions. |
|---|
[+] affected methods (37)
cache ( )Return value of this method has type 'JavaRDD<T>'.
classTag ( )This method is from 'JavaRDD<T>' class.
coalesce ( int )Return value of this method has type 'JavaRDD<T>'.
coalesce ( int, boolean )Return value of this method has type 'JavaRDD<T>'.
distinct ( )Return value of this method has type 'JavaRDD<T>'.
distinct ( int )Return value of this method has type 'JavaRDD<T>'.
filter ( function.Function<T,java.lang.Boolean> )Return value of this method has type 'JavaRDD<T>'.
fromRDD ( org.apache.spark.rdd.RDD<T>, scala.reflect.ClassTag<T> )Return value of this method has type 'JavaRDD<T>'.
intersection ( JavaRDD<T> )Return value of this method has type 'JavaRDD<T>'.
JavaRDD ( org.apache.spark.rdd.RDD<T>, scala.reflect.ClassTag<T> )This method is from 'JavaRDD<T>' class.
persist ( org.apache.spark.storage.StorageLevel )Return value of this method has type 'JavaRDD<T>'.
randomSplit ( double[ ] )This method is from 'JavaRDD<T>' class.
randomSplit ( double[ ], long )This method is from 'JavaRDD<T>' class.
rdd ( )This method is from 'JavaRDD<T>' class.
repartition ( int )Return value of this method has type 'JavaRDD<T>'.
sample ( boolean, double )Return value of this method has type 'JavaRDD<T>'.
sample ( boolean, double, long )Return value of this method has type 'JavaRDD<T>'.
setName ( java.lang.String )Return value of this method has type 'JavaRDD<T>'.
sortBy ( function.Function<T,S>, boolean, int )Return value of this method has type 'JavaRDD<T>'.
subtract ( JavaRDD<T> )Return value of this method has type 'JavaRDD<T>'.
subtract ( JavaRDD<T>, int )Return value of this method has type 'JavaRDD<T>'.
subtract ( JavaRDD<T>, org.apache.spark.Partitioner )Return value of this method has type 'JavaRDD<T>'.
toRDD ( JavaRDD<T> )1st parameter 'p1' of this method has type 'JavaRDD<T>'.
toString ( )This method is from 'JavaRDD<T>' class.
union ( JavaRDD<T> )Return value of this method has type 'JavaRDD<T>'.
unpersist ( )Return value of this method has type 'JavaRDD<T>'.
unpersist ( boolean )Return value of this method has type 'JavaRDD<T>'.
wrapRDD ( org.apache.spark.rdd.RDD )This method is from 'JavaRDD<T>' class.
wrapRDD ( org.apache.spark.rdd.RDD<T> )Return value of this method has type 'JavaRDD<T>'.
checkpointFile ( java.lang.String )Return value of this method has type 'JavaRDD<T>'.
emptyRDD ( )Return value of this method has type 'JavaRDD<T>'.
objectFile ( java.lang.String )Return value of this method has type 'JavaRDD<T>'.
objectFile ( java.lang.String, int )Return value of this method has type 'JavaRDD<T>'.
parallelize ( java.util.List<T> )Return value of this method has type 'JavaRDD<T>'.
parallelize ( java.util.List<T>, int )Return value of this method has type 'JavaRDD<T>'.
union ( JavaRDD<T>, java.util.List<JavaRDD<T>> )1st parameter 'first' of this method has type 'JavaRDD<T>'.
toJavaRDD ( )Return value of this method has type 'JavaRDD<T>'.
to the top
Java ARchives (3)
spark-core_2.10-1.4.0.jar
spark-sql_2.10-1.4.0.jar
spark-streaming_2.10-1.4.0.jar
to the top
Generated on Tue Oct 20 09:59:23 2015 for spark-connector_2.10-1.0.0 by Java API Compliance Checker 1.4.1
A tool for checking backward compatibility of a Java library API