-
- Downloads
Add RDD.subtract.
Instead of reusing the cogroup primitive, this adds a SubtractedRDD that knows it only needs to keep rdd1's values (per split) in memory.
Showing
- core/src/main/scala/spark/RDD.scala 21 additions, 0 deletionscore/src/main/scala/spark/RDD.scala
- core/src/main/scala/spark/rdd/SubtractedRDD.scala 108 additions, 0 deletionscore/src/main/scala/spark/rdd/SubtractedRDD.scala
- core/src/test/scala/spark/ShuffleSuite.scala 26 additions, 0 deletionscore/src/test/scala/spark/ShuffleSuite.scala
Loading
Please register or sign in to comment