-
- Downloads
Deduplicate Local and Cluster schedulers.
The code in LocalScheduler/LocalTaskSetManager was nearly identical to the code in ClusterScheduler/ClusterTaskSetManager. The redundancy made making updating the schedulers unnecessarily painful and error- prone. This commit combines the two into a single TaskScheduler/ TaskSetManager.
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 16 additions, 18 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/scheduler/ExecutorLossReason.scala 1 addition, 1 deletion...scala/org/apache/spark/scheduler/ExecutorLossReason.scala
- core/src/main/scala/org/apache/spark/scheduler/SchedulerBackend.scala 3 additions, 3 deletions...n/scala/org/apache/spark/scheduler/SchedulerBackend.scala
- core/src/main/scala/org/apache/spark/scheduler/TaskResultGetter.scala 4 additions, 5 deletions...n/scala/org/apache/spark/scheduler/TaskResultGetter.scala
- core/src/main/scala/org/apache/spark/scheduler/TaskScheduler.scala 459 additions, 21 deletions...main/scala/org/apache/spark/scheduler/TaskScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala 673 additions, 15 deletions...ain/scala/org/apache/spark/scheduler/TaskSetManager.scala
- core/src/main/scala/org/apache/spark/scheduler/WorkerOffer.scala 1 addition, 1 deletion...c/main/scala/org/apache/spark/scheduler/WorkerOffer.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/ClusterScheduler.scala 0 additions, 486 deletions...org/apache/spark/scheduler/cluster/ClusterScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/ClusterTaskSetManager.scala 0 additions, 703 deletions...pache/spark/scheduler/cluster/ClusterTaskSetManager.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala 3 additions, 2 deletions...ark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/SimrSchedulerBackend.scala 3 additions, 1 deletion...apache/spark/scheduler/cluster/SimrSchedulerBackend.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/SparkDeploySchedulerBackend.scala 4 additions, 2 deletions...spark/scheduler/cluster/SparkDeploySchedulerBackend.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala 3 additions, 2 deletions...scheduler/cluster/mesos/CoarseMesosSchedulerBackend.scala
- core/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerBackend.scala 4 additions, 5 deletions...spark/scheduler/cluster/mesos/MesosSchedulerBackend.scala
- core/src/main/scala/org/apache/spark/scheduler/local/LocalBackend.scala 73 additions, 0 deletions...scala/org/apache/spark/scheduler/local/LocalBackend.scala
- core/src/main/scala/org/apache/spark/scheduler/local/LocalScheduler.scala 0 additions, 219 deletions...ala/org/apache/spark/scheduler/local/LocalScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/local/LocalTaskSetManager.scala 0 additions, 191 deletions...rg/apache/spark/scheduler/local/LocalTaskSetManager.scala
- core/src/test/scala/org/apache/spark/FailureSuite.scala 14 additions, 6 deletionscore/src/test/scala/org/apache/spark/FailureSuite.scala
- core/src/test/scala/org/apache/spark/scheduler/SparkListenerSuite.scala 6 additions, 13 deletions...scala/org/apache/spark/scheduler/SparkListenerSuite.scala
- core/src/test/scala/org/apache/spark/scheduler/cluster/TaskResultGetterSuite.scala 1 addition, 3 deletions...pache/spark/scheduler/cluster/TaskResultGetterSuite.scala
Loading
Please register or sign in to comment