-
- Downloads
[SPARK-20096][SPARK SUBMIT][MINOR] Expose the right queue name not null if set...
[SPARK-20096][SPARK SUBMIT][MINOR] Expose the right queue name not null if set by --conf or configure file ## What changes were proposed in this pull request? while submit apps with -v or --verbose, we can print the right queue name, but if we set a queue name with `spark.yarn.queue` by --conf or in the spark-default.conf, we just got `null` for the queue in Parsed arguments. ``` bin/spark-shell -v --conf spark.yarn.queue=thequeue Using properties file: /home/hadoop/spark-2.1.0-bin-apache-hdp2.7.3/conf/spark-defaults.conf .... Adding default property: spark.yarn.queue=default Parsed arguments: master yarn deployMode client ... queue null .... verbose true Spark properties used, including those specified through --conf and those from the properties file /home/hadoop/spark-2.1.0-bin-apache-hdp2.7.3/conf/spark-defaults.conf: spark.yarn.queue -> thequeue .... ``` ## How was this patch tested? ut and local verify Author: Kent Yao <yaooqinn@hotmail.com> Closes #17430 from yaooqinn/SPARK-20096.
Showing
- core/src/main/scala/org/apache/spark/deploy/SparkSubmitArguments.scala 1 addition, 0 deletions.../scala/org/apache/spark/deploy/SparkSubmitArguments.scala
- core/src/test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala 11 additions, 0 deletions...test/scala/org/apache/spark/deploy/SparkSubmitSuite.scala
Please register or sign in to comment