Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

S

spark
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Wiki
- Releases
- Model registry
- Environments
- Incidents

Snippets Groups Projects

a35472e1

Commit a35472e1 authored 11 years ago by tgravescs

Downloads
- Patches
- Plain Diff

Allow spark on yarn to be run from HDFS. Allows the spark.jar, app.jar, and...

Allow spark on yarn to be run from HDFS. Allows the spark.jar, app.jar, and log4j.properties to be put into hdfs.

parent b5dc3393

No related branches found

No related tags found

Loading

Changes 8

Hide whitespace changes

Inline Side-by-side

Showing

docs/running-on-yarn.md 1 addition, 0 deletions

docs/running-on-yarn.md
pom.xml 6 additions, 0 deletions

pom.xml
yarn/pom.xml 50 additions, 0 deletions

yarn/pom.xml
yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala 1 addition, 1 deletion

...cala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 140 additions, 136 deletions

.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientDistributedCacheManager.scala 228 additions, 0 deletions

...che/spark/deploy/yarn/ClientDistributedCacheManager.scala
yarn/src/main/scala/org/apache/spark/deploy/yarn/WorkerRunnable.scala 7 additions, 35 deletions

...n/scala/org/apache/spark/deploy/yarn/WorkerRunnable.scala
yarn/src/test/scala/org/apache/spark/deploy/yarn/ClientDistributedCacheManagerSuite.scala 220 additions, 0 deletions

...park/deploy/yarn/ClientDistributedCacheManagerSuite.scala

with 653 additions and 172 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment