-
- Downloads
[SPARK-1395] Allow "local:" URIs to work on Yarn.
This only works for the three paths defined in the environment (SPARK_JAR, SPARK_YARN_APP_JAR and SPARK_LOG4J_CONF). Tested by running SparkPi with local: and file: URIs against Yarn cluster (no "upload" shows up in logs in the local case). Author: Marcelo Vanzin <vanzin@cloudera.com> Closes #303 from vanzin/yarn-local and squashes the following commits: 82219c1 [Marcelo Vanzin] [SPARK-1395] Allow "local:" URIs to work on Yarn.
Showing
- core/src/main/scala/org/apache/spark/deploy/SparkSubmit.scala 2 additions, 2 deletions.../src/main/scala/org/apache/spark/deploy/SparkSubmit.scala
- yarn/alpha/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnable.scala 1 addition, 1 deletion...scala/org/apache/spark/deploy/yarn/ExecutorRunnable.scala
- yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ClientBase.scala 128 additions, 62 deletions.../main/scala/org/apache/spark/deploy/yarn/ClientBase.scala
- yarn/common/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala 9 additions, 8 deletions...a/org/apache/spark/deploy/yarn/ExecutorRunnableUtil.scala
- yarn/common/src/main/scala/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala 1 addition, 5 deletions...la/org/apache/spark/deploy/yarn/YarnSparkHadoopUtil.scala
- yarn/stable/src/main/scala/org/apache/spark/deploy/yarn/ExecutorRunnable.scala 1 addition, 1 deletion...scala/org/apache/spark/deploy/yarn/ExecutorRunnable.scala
Loading
Please register or sign in to comment