-
- Downloads
[SPARK-10048] [SPARKR] Support arbitrary nested Java array in serde.
This PR: 1. supports transferring arbitrary nested array from JVM to R side in SerDe; 2. based on 1, collect() implemenation is improved. Now it can support collecting data of complex types from a DataFrame. Author: Sun Rui <rui.sun@intel.com> Closes #8276 from sun-rui/SPARK-10048.
Showing
- R/pkg/R/DataFrame.R 43 additions, 12 deletionsR/pkg/R/DataFrame.R
- R/pkg/R/deserialize.R 31 additions, 41 deletionsR/pkg/R/deserialize.R
- R/pkg/R/serialize.R 1 addition, 9 deletionsR/pkg/R/serialize.R
- R/pkg/inst/tests/test_Serde.R 77 additions, 0 deletionsR/pkg/inst/tests/test_Serde.R
- R/pkg/inst/worker/worker.R 2 additions, 2 deletionsR/pkg/inst/worker/worker.R
- core/src/main/scala/org/apache/spark/api/r/RBackendHandler.scala 7 additions, 0 deletions...c/main/scala/org/apache/spark/api/r/RBackendHandler.scala
- core/src/main/scala/org/apache/spark/api/r/SerDe.scala 51 additions, 35 deletionscore/src/main/scala/org/apache/spark/api/r/SerDe.scala
- sql/core/src/main/scala/org/apache/spark/sql/api/r/SQLUtils.scala 4 additions, 28 deletions.../src/main/scala/org/apache/spark/sql/api/r/SQLUtils.scala
Loading
Please register or sign in to comment