-
- Downloads
[SPARK-12847][CORE][STREAMING] Remove StreamingListenerBus and post all...
[SPARK-12847][CORE][STREAMING] Remove StreamingListenerBus and post all Streaming events to the same thread as Spark events Including the following changes: 1. Add StreamingListenerForwardingBus to WrappedStreamingListenerEvent process events in `onOtherEvent` to StreamingListener 2. Remove StreamingListenerBus 3. Merge AsynchronousListenerBus and LiveListenerBus to the same class LiveListenerBus 4. Add `logEvent` method to SparkListenerEvent so that EventLoggingListener can use it to ignore WrappedStreamingListenerEvents Author: Shixiong Zhu <shixiong@databricks.com> Closes #10779 from zsxwing/streaming-listener.
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 3 additions, 3 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala 3 additions, 1 deletion...ala/org/apache/spark/scheduler/EventLoggingListener.scala
- core/src/main/scala/org/apache/spark/scheduler/LiveListenerBus.scala 160 additions, 7 deletions...in/scala/org/apache/spark/scheduler/LiveListenerBus.scala
- core/src/main/scala/org/apache/spark/scheduler/SparkListener.scala 4 additions, 1 deletion...main/scala/org/apache/spark/scheduler/SparkListener.scala
- core/src/main/scala/org/apache/spark/scheduler/SparkListenerBus.scala 1 addition, 1 deletion...n/scala/org/apache/spark/scheduler/SparkListenerBus.scala
- core/src/main/scala/org/apache/spark/util/AsynchronousListenerBus.scala 0 additions, 190 deletions...scala/org/apache/spark/util/AsynchronousListenerBus.scala
- core/src/main/scala/org/apache/spark/util/ListenerBus.scala 11 additions, 3 deletionscore/src/main/scala/org/apache/spark/util/ListenerBus.scala
- project/MimaExcludes.scala 4 additions, 0 deletionsproject/MimaExcludes.scala
- streaming/src/main/scala/org/apache/spark/streaming/StreamingContext.scala 5 additions, 4 deletions...n/scala/org/apache/spark/streaming/StreamingContext.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/JobScheduler.scala 2 additions, 2 deletions...a/org/apache/spark/streaming/scheduler/JobScheduler.scala
- streaming/src/main/scala/org/apache/spark/streaming/scheduler/StreamingListenerBus.scala 53 additions, 16 deletions...ache/spark/streaming/scheduler/StreamingListenerBus.scala
- streaming/src/test/scala/org/apache/spark/streaming/InputStreamsSuite.scala 1 addition, 1 deletion.../scala/org/apache/spark/streaming/InputStreamsSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/StreamingListenerSuite.scala 22 additions, 0 deletions...a/org/apache/spark/streaming/StreamingListenerSuite.scala
- streaming/src/test/scala/org/apache/spark/streaming/scheduler/ReceiverTrackerSuite.scala 0 additions, 2 deletions...ache/spark/streaming/scheduler/ReceiverTrackerSuite.scala
Loading
Please register or sign in to comment