-
- Downloads
[SPARK-3369][CORE][STREAMING] Java mapPartitions Iterator->Iterable is...
[SPARK-3369][CORE][STREAMING] Java mapPartitions Iterator->Iterable is inconsistent with Scala's Iterator->Iterator Fix Java function API methods for flatMap and mapPartitions to require producing only an Iterator, not Iterable. Also fix DStream.flatMap to require a function producing TraversableOnce only, not Traversable. CC rxin pwendell for API change; tdas since it also touches streaming. Author: Sean Owen <sowen@cloudera.com> Closes #10413 from srowen/SPARK-3369.
Showing
- core/src/main/java/org/apache/spark/api/java/function/CoGroupFunction.java 1 addition, 1 deletion...a/org/apache/spark/api/java/function/CoGroupFunction.java
- core/src/main/java/org/apache/spark/api/java/function/DoubleFlatMapFunction.java 2 additions, 1 deletion...apache/spark/api/java/function/DoubleFlatMapFunction.java
- core/src/main/java/org/apache/spark/api/java/function/FlatMapFunction.java 2 additions, 1 deletion...a/org/apache/spark/api/java/function/FlatMapFunction.java
- core/src/main/java/org/apache/spark/api/java/function/FlatMapFunction2.java 2 additions, 1 deletion.../org/apache/spark/api/java/function/FlatMapFunction2.java
- core/src/main/java/org/apache/spark/api/java/function/FlatMapGroupsFunction.java 1 addition, 1 deletion...apache/spark/api/java/function/FlatMapGroupsFunction.java
- core/src/main/java/org/apache/spark/api/java/function/MapPartitionsFunction.java 1 addition, 1 deletion...apache/spark/api/java/function/MapPartitionsFunction.java
- core/src/main/java/org/apache/spark/api/java/function/PairFlatMapFunction.java 2 additions, 1 deletion...g/apache/spark/api/java/function/PairFlatMapFunction.java
- core/src/main/scala/org/apache/spark/api/java/JavaRDDLike.scala 10 additions, 10 deletions...rc/main/scala/org/apache/spark/api/java/JavaRDDLike.scala
- core/src/test/java/org/apache/spark/JavaAPISuite.java 12 additions, 12 deletionscore/src/test/java/org/apache/spark/JavaAPISuite.java
- docs/streaming-programming-guide.md 2 additions, 2 deletionsdocs/streaming-programming-guide.md
- examples/src/main/java/org/apache/spark/examples/JavaPageRank.java 8 additions, 10 deletions...src/main/java/org/apache/spark/examples/JavaPageRank.java
- examples/src/main/java/org/apache/spark/examples/JavaWordCount.java 3 additions, 2 deletions...rc/main/java/org/apache/spark/examples/JavaWordCount.java
- examples/src/main/java/org/apache/spark/examples/streaming/JavaActorWordCount.java 3 additions, 2 deletions...g/apache/spark/examples/streaming/JavaActorWordCount.java
- examples/src/main/java/org/apache/spark/examples/streaming/JavaCustomReceiver.java 4 additions, 3 deletions...g/apache/spark/examples/streaming/JavaCustomReceiver.java
- examples/src/main/java/org/apache/spark/examples/streaming/JavaDirectKafkaWordCount.java 3 additions, 3 deletions...he/spark/examples/streaming/JavaDirectKafkaWordCount.java
- examples/src/main/java/org/apache/spark/examples/streaming/JavaKafkaWordCount.java 4 additions, 5 deletions...g/apache/spark/examples/streaming/JavaKafkaWordCount.java
- examples/src/main/java/org/apache/spark/examples/streaming/JavaNetworkWordCount.java 6 additions, 5 deletions...apache/spark/examples/streaming/JavaNetworkWordCount.java
- examples/src/main/java/org/apache/spark/examples/streaming/JavaRecoverableNetworkWordCount.java 3 additions, 3 deletions...k/examples/streaming/JavaRecoverableNetworkWordCount.java
- examples/src/main/java/org/apache/spark/examples/streaming/JavaSqlNetworkWordCount.java 4 additions, 4 deletions...che/spark/examples/streaming/JavaSqlNetworkWordCount.java
- examples/src/main/java/org/apache/spark/examples/streaming/JavaStatefulNetworkWordCount.java 3 additions, 2 deletions...park/examples/streaming/JavaStatefulNetworkWordCount.java
Loading
Please register or sign in to comment