-
- Downloads
Merge pull request #74 from rxin/kill
Job cancellation via job group id. This PR adds a simple API to group together a set of jobs belonging to a thread and threads spawned from it. It also allows the cancellation of all jobs in this group. An example: sc.setJobDescription("this_is_the_group_id", "some job description") sc.parallelize(1 to 10000, 2).map { i => Thread.sleep(10); i }.count() In a separate thread: sc.cancelJobGroup("this_is_the_group_id")
No related branches found
No related tags found
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 20 additions, 2 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala 21 additions, 5 deletions.../main/scala/org/apache/spark/scheduler/DAGScheduler.scala
- core/src/main/scala/org/apache/spark/scheduler/DAGSchedulerEvent.scala 2 additions, 0 deletions.../scala/org/apache/spark/scheduler/DAGSchedulerEvent.scala
- core/src/test/scala/org/apache/spark/JobCancellationSuite.scala 32 additions, 0 deletions...rc/test/scala/org/apache/spark/JobCancellationSuite.scala
Loading
Please register or sign in to comment