-
- Downloads
[SPARK-14667] Remove HashShuffleManager
## What changes were proposed in this pull request? The sort shuffle manager has been the default since Spark 1.2. It is time to remove the old hash shuffle manager. ## How was this patch tested? Removed some tests related to the old manager. Author: Reynold Xin <rxin@databricks.com> Closes #12423 from rxin/SPARK-14667.
Showing
- common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolver.java 1 addition, 12 deletions...e/spark/network/shuffle/ExternalShuffleBlockResolver.java
- common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/protocol/ExecutorShuffleInfo.java 1 addition, 1 deletion...e/spark/network/shuffle/protocol/ExecutorShuffleInfo.java
- common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleBlockResolverSuite.java 3 additions, 30 deletions...rk/network/shuffle/ExternalShuffleBlockResolverSuite.java
- common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleCleanupSuite.java 0 additions, 3 deletions...he/spark/network/shuffle/ExternalShuffleCleanupSuite.java
- common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/ExternalShuffleIntegrationSuite.java 4 additions, 34 deletions...park/network/shuffle/ExternalShuffleIntegrationSuite.java
- common/network-shuffle/src/test/java/org/apache/spark/network/shuffle/TestShuffleDataContext.java 1 addition, 10 deletions.../apache/spark/network/shuffle/TestShuffleDataContext.java
- core/src/main/scala/org/apache/spark/SparkEnv.scala 2 additions, 3 deletionscore/src/main/scala/org/apache/spark/SparkEnv.scala
- core/src/main/scala/org/apache/spark/shuffle/FileShuffleBlockResolver.scala 0 additions, 136 deletions...a/org/apache/spark/shuffle/FileShuffleBlockResolver.scala
- core/src/main/scala/org/apache/spark/shuffle/hash/HashShuffleManager.scala 0 additions, 81 deletions...la/org/apache/spark/shuffle/hash/HashShuffleManager.scala
- core/src/main/scala/org/apache/spark/shuffle/hash/HashShuffleWriter.scala 0 additions, 141 deletions...ala/org/apache/spark/shuffle/hash/HashShuffleWriter.scala
- core/src/test/scala/org/apache/spark/ContextCleanerSuite.scala 1 addition, 80 deletions...src/test/scala/org/apache/spark/ContextCleanerSuite.scala
- core/src/test/scala/org/apache/spark/HashShuffleSuite.scala 0 additions, 30 deletionscore/src/test/scala/org/apache/spark/HashShuffleSuite.scala
- core/src/test/scala/org/apache/spark/storage/BlockManagerReplicationSuite.scala 2 additions, 2 deletions...g/apache/spark/storage/BlockManagerReplicationSuite.scala
- core/src/test/scala/org/apache/spark/storage/BlockManagerSuite.scala 2 additions, 2 deletions...st/scala/org/apache/spark/storage/BlockManagerSuite.scala
- core/src/test/scala/org/apache/spark/util/collection/ExternalAppendOnlyMapSuite.scala 0 additions, 2 deletions...he/spark/util/collection/ExternalAppendOnlyMapSuite.scala
- docs/configuration.md 0 additions, 9 deletionsdocs/configuration.md
- sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/ShuffleExchange.scala 0 additions, 4 deletions...apache/spark/sql/execution/exchange/ShuffleExchange.scala
- streaming/src/test/scala/org/apache/spark/streaming/ReceivedBlockHandlerSuite.scala 2 additions, 2 deletions...rg/apache/spark/streaming/ReceivedBlockHandlerSuite.scala
Loading
Please register or sign in to comment