Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

S

spark
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Releases
- Model registry
- Environments
- Incidents

Snippets Groups Projects

bab496c1

Commit bab496c1 authored 11 years ago by Matei Zaharia

Downloads
- Plain Diff

Merge pull request #108 from alig/master

Changes to enable executing by using HDFS as a synchronization point between driver and executors, as well as ensuring executors exit properly.

parents d307db6e eef261c8

No related branches found

No related tags found

No related merge requests found

Changes 7

Hide whitespace changes

Inline Side-by-side

Showing

core/src/main/scala/org/apache/spark/SparkContext.scala 11 additions, 5 deletions

core/src/main/scala/org/apache/spark/SparkContext.scala
core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala 5 additions, 0 deletions

.../apache/spark/executor/CoarseGrainedExecutorBackend.scala
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedClusterMessage.scala 4 additions, 0 deletions

...spark/scheduler/cluster/CoarseGrainedClusterMessage.scala
core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala 22 additions, 2 deletions

...ark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala
core/src/main/scala/org/apache/spark/scheduler/cluster/SimrSchedulerBackend.scala 66 additions, 0 deletions

...apache/spark/scheduler/cluster/SimrSchedulerBackend.scala
examples/src/main/scala/org/apache/spark/examples/SparkPi.scala 1 addition, 1 deletion

...es/src/main/scala/org/apache/spark/examples/SparkPi.scala
repl/src/main/scala/org/apache/spark/repl/SparkILoop.scala 14 additions, 0 deletions

repl/src/main/scala/org/apache/spark/repl/SparkILoop.scala

with 123 additions and 8 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment