Skip to content
Snippets Groups Projects
  • Sun Rui's avatar
    45e3be5c
    [SPARK-10049] [SPARKR] Support collecting data of ArraryType in DataFrame. · 45e3be5c
    Sun Rui authored
    this PR :
    1.  Enhance reflection in RBackend. Automatically matching a Java array to Scala Seq when finding methods. Util functions like seq(), listToSeq() in R side can be removed, as they will conflict with the Serde logic that transferrs a Scala seq to R side.
    
    2.  Enhance the SerDe to support transferring  a Scala seq to R side. Data of ArrayType in DataFrame
    after collection is observed to be of Scala Seq type.
    
    3.  Support ArrayType in createDataFrame().
    
    Author: Sun Rui <rui.sun@intel.com>
    
    Closes #8458 from sun-rui/SPARK-10049.
    45e3be5c
    History
    [SPARK-10049] [SPARKR] Support collecting data of ArraryType in DataFrame.
    Sun Rui authored
    this PR :
    1.  Enhance reflection in RBackend. Automatically matching a Java array to Scala Seq when finding methods. Util functions like seq(), listToSeq() in R side can be removed, as they will conflict with the Serde logic that transferrs a Scala seq to R side.
    
    2.  Enhance the SerDe to support transferring  a Scala seq to R side. Data of ArrayType in DataFrame
    after collection is observed to be of Scala Seq type.
    
    3.  Support ArrayType in createDataFrame().
    
    Author: Sun Rui <rui.sun@intel.com>
    
    Closes #8458 from sun-rui/SPARK-10049.