-
- Downloads
Merge pull request #323 from tgravescs/sparkconf_yarn_fix
fix spark on yarn after the sparkConf changes This fixes it so that spark on yarn now compiles and works after the sparkConf changes. There are also other issues I discovered along the way that are broken: - mvn builds for yarn don't assemble correctly - unset SPARK_EXAMPLES_JAR isn't handled properly anymore - I'm pretty sure spark.conf doesn't actually work as its not distributed with yarn those things can be fixed in separate pr unless others disagree.
No related branches found
No related tags found
Showing
- new-yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala 17 additions, 35 deletions...cala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
- new-yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 6 additions, 4 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
- new-yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala 2 additions, 1 deletion.../scala/org/apache/spark/deploy/yarn/ClientArguments.scala
- new-yarn/src/main/scala/org/apache/spark/deploy/yarn/WorkerLauncher.scala 8 additions, 5 deletions...n/scala/org/apache/spark/deploy/yarn/WorkerLauncher.scala
- new-yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocationHandler.scala 17 additions, 10 deletions.../org/apache/spark/deploy/yarn/YarnAllocationHandler.scala
- yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMaster.scala 18 additions, 37 deletions...cala/org/apache/spark/deploy/yarn/ApplicationMaster.scala
- yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala 5 additions, 5 deletions.../src/main/scala/org/apache/spark/deploy/yarn/Client.scala
- yarn/src/main/scala/org/apache/spark/deploy/yarn/ClientArguments.scala 2 additions, 1 deletion.../scala/org/apache/spark/deploy/yarn/ClientArguments.scala
- yarn/src/main/scala/org/apache/spark/deploy/yarn/WorkerLauncher.scala 10 additions, 6 deletions...n/scala/org/apache/spark/deploy/yarn/WorkerLauncher.scala
- yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocationHandler.scala 16 additions, 9 deletions.../org/apache/spark/deploy/yarn/YarnAllocationHandler.scala
Loading
Please register or sign in to comment