-
- Downloads
SPARK-1136: Fix FaultToleranceTest for Docker 0.8.1
This patch allows the FaultToleranceTest to work in newer versions of Docker. See https://spark-project.atlassian.net/browse/SPARK-1136 for more details. Besides changing the Docker and FaultToleranceTest internals, this patch also changes the behavior of Master to accept new Workers which share an address with a Worker that we are currently trying to recover. This can only happen when the Worker itself was restarted and got the same IP address/port at the same time as a Master recovery occurs. Finally, this adds a good bit of ASCII art to the test to make failures, successes, and actions more apparent. This is very much needed. Author: Aaron Davidson <aaron@databricks.com> Closes #5 from aarondav/zookeeper and squashes the following commits: 5d7a72a [Aaron Davidson] SPARK-1136: Fix FaultToleranceTest for Docker 0.8.1
Showing
- core/src/main/scala/org/apache/spark/deploy/FaultToleranceTest.scala 35 additions, 6 deletions...in/scala/org/apache/spark/deploy/FaultToleranceTest.scala
- core/src/main/scala/org/apache/spark/deploy/master/Master.scala 9 additions, 2 deletions...rc/main/scala/org/apache/spark/deploy/master/Master.scala
- core/src/main/scala/org/apache/spark/deploy/master/SparkCuratorUtil.scala 12 additions, 1 deletion...ala/org/apache/spark/deploy/master/SparkCuratorUtil.scala
- docker/README.md 3 additions, 1 deletiondocker/README.md
- docker/spark-test/master/default_cmd 7 additions, 1 deletiondocker/spark-test/master/default_cmd
- docker/spark-test/worker/default_cmd 7 additions, 1 deletiondocker/spark-test/worker/default_cmd
Loading
Please register or sign in to comment