-
- Downloads
[SPARK-6752] [STREAMING] [REOPENED] Allow StreamingContext to be recreated...
[SPARK-6752] [STREAMING] [REOPENED] Allow StreamingContext to be recreated from checkpoint and existing SparkContext Original PR #5428 got reverted due to issues between MutableBoolean and Hadoop 1.0.4 (see JIRA). This replaces MutableBoolean with AtomicBoolean. srowen pwendell Author: Tathagata Das <tathagata.das1565@gmail.com> Closes #5773 from tdas/SPARK-6752 and squashes the following commits: a0c0ead [Tathagata Das] Fix for hadoop 1.0.4 70ae85b [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into SPARK-6752 94db63c [Tathagata Das] Fix long line. 524f519 [Tathagata Das] Many changes based on PR comments. eabd092 [Tathagata Das] Added Function0, Java API and unit tests for StreamingContext.getOrCreate 36a7823 [Tathagata Das] Minor changes. 204814e [Tathagata Das] Added StreamingContext.getOrCreate with existing SparkContext
Showing
- core/src/main/java/org/apache/spark/api/java/function/Function0.java 27 additions, 0 deletions...in/java/org/apache/spark/api/java/function/Function0.java
- streaming/src/main/scala/org/apache/spark/streaming/Checkpoint.scala 20 additions, 6 deletions...rc/main/scala/org/apache/spark/streaming/Checkpoint.scala
- streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala 71 additions, 14 deletions...n/scala/org/apache/spark/streaming/StreamingContext.scala
- streaming/src/main/scala/org/apache/spark/streaming/api/java/JavaStreamingContext.scala 117 additions, 2 deletions...pache/spark/streaming/api/java/JavaStreamingContext.scala
- streaming/src/test/java/org/apache/spark/streaming/JavaAPISuite.java 108 additions, 37 deletions...rc/test/java/org/apache/spark/streaming/JavaAPISuite.java
- streaming/src/test/scala/org/apache/spark/streaming/CheckpointSuite.scala 1 addition, 2 deletions...st/scala/org/apache/spark/streaming/CheckpointSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala 159 additions, 0 deletions...la/org/apache/spark/streaming/StreamingContextSuite.scala
Loading
Please register or sign in to comment