-
- Downloads
[SPARK-9201] [ML] Initial integration of MLlib + SparkR using RFormula
This exposes the SparkR:::glm() and SparkR:::predict() APIs. It was necessary to change RFormula to silently drop the label column if it was missing from the input dataset, which is kind of a hack but necessary to integrate with the Pipeline API. The umbrella design doc for MLlib + SparkR integration can be viewed here: https://docs.google.com/document/d/10NZNSEurN2EdWM31uFYsgayIPfCFHiuIu3pCWrUmP_c/edit mengxr Author: Eric Liang <ekl@databricks.com> Closes #7483 from ericl/spark-8774 and squashes the following commits: 3dfac0c [Eric Liang] update 17ef516 [Eric Liang] more comments 1753a0f [Eric Liang] make glm generic b0f50f8 [Eric Liang] equivalence test 550d56d [Eric Liang] export methods c015697 [Eric Liang] second pass 117949a [Eric Liang] comments 5afbc67 [Eric Liang] test label columns 6b7f15f [Eric Liang] Fri Jul 17 14:20:22 PDT 2015 3a63ae5 [Eric Liang] Fri Jul 17 13:41:52 PDT 2015 ce61367 [Eric Liang] Fri Jul 17 13:41:17 PDT 2015 0299c59 [Eric Liang] Fri Jul 17 13:40:32 PDT 2015 e37603f [Eric Liang] Fri Jul 17 12:15:03 PDT 2015 d417d0c [Eric Liang] Merge remote-tracking branch 'upstream/master' into spark-8774 29a2ce7 [Eric Liang] Merge branch 'spark-8774-1' into spark-8774 d1959d2 [Eric Liang] clarify comment 2db68aa [Eric Liang] second round of comments dc3c943 [Eric Liang] address comments 5765ec6 [Eric Liang] fix style checks 1f361b0 [Eric Liang] doc d33211b [Eric Liang] r support fb0826b [Eric Liang] [SPARK-8774] Add R model formula with basic support as a transformer
Showing
- R/pkg/DESCRIPTION 1 addition, 0 deletionsR/pkg/DESCRIPTION
- R/pkg/NAMESPACE 4 additions, 0 deletionsR/pkg/NAMESPACE
- R/pkg/R/generics.R 4 additions, 0 deletionsR/pkg/R/generics.R
- R/pkg/R/mllib.R 73 additions, 0 deletionsR/pkg/R/mllib.R
- R/pkg/inst/tests/test_mllib.R 42 additions, 0 deletionsR/pkg/inst/tests/test_mllib.R
- mllib/src/main/scala/org/apache/spark/ml/feature/RFormula.scala 11 additions, 3 deletions...src/main/scala/org/apache/spark/ml/feature/RFormula.scala
- mllib/src/main/scala/org/apache/spark/ml/r/SparkRWrappers.scala 41 additions, 0 deletions...src/main/scala/org/apache/spark/ml/r/SparkRWrappers.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/RFormulaSuite.scala 9 additions, 0 deletions...est/scala/org/apache/spark/ml/feature/RFormulaSuite.scala
Loading
Please register or sign in to comment