Skip to content
Snippets Groups Projects
  • Burak Yavuz's avatar
    c9a4c36d
    [SPARK-8313] R Spark packages support · c9a4c36d
    Burak Yavuz authored
    shivaram cafreeman Could you please help me in testing this out? Exposing and running `rPackageBuilder` from inside the shell works, but for some reason, I can't get it to work during Spark Submit. It just starts relaunching Spark Submit.
    
    For testing, you may use the R branch with [sbt-spark-package](https://github.com/databricks/sbt-spark-package). You can call spPackage, and then pass the jar using `--jars`.
    
    Author: Burak Yavuz <brkyvz@gmail.com>
    
    Closes #7139 from brkyvz/r-submit and squashes the following commits:
    
    0de384f [Burak Yavuz] remove unused imports 2
    d253708 [Burak Yavuz] removed unused imports
    6603d0d [Burak Yavuz] addressed comments
    4258ffe [Burak Yavuz] merged master
    ddfcc06 [Burak Yavuz] added zipping test
    3a1be7d [Burak Yavuz] don't zip
    77995df [Burak Yavuz] fix URI
    ac45527 [Burak Yavuz] added zipping of all libs
    e6bf7b0 [Burak Yavuz] add println ignores
    1bc5554 [Burak Yavuz] add assumes for tests
    9778e03 [Burak Yavuz] addressed comments
    b42b300 [Burak Yavuz] merged master
    ffd134e [Burak Yavuz] Merge branch 'master' of github.com:apache/spark into r-submit
    d867756 [Burak Yavuz] add apache header
    eff5ba1 [Burak Yavuz] ready for review
    8838edb [Burak Yavuz] Merge branch 'master' of github.com:apache/spark into r-submit
    e5b5a06 [Burak Yavuz] added doc
    bb751ce [Burak Yavuz] fix null bug
    0226768 [Burak Yavuz] fixed issues
    8810beb [Burak Yavuz] R packages support
    c9a4c36d
    History
    [SPARK-8313] R Spark packages support
    Burak Yavuz authored
    shivaram cafreeman Could you please help me in testing this out? Exposing and running `rPackageBuilder` from inside the shell works, but for some reason, I can't get it to work during Spark Submit. It just starts relaunching Spark Submit.
    
    For testing, you may use the R branch with [sbt-spark-package](https://github.com/databricks/sbt-spark-package). You can call spPackage, and then pass the jar using `--jars`.
    
    Author: Burak Yavuz <brkyvz@gmail.com>
    
    Closes #7139 from brkyvz/r-submit and squashes the following commits:
    
    0de384f [Burak Yavuz] remove unused imports 2
    d253708 [Burak Yavuz] removed unused imports
    6603d0d [Burak Yavuz] addressed comments
    4258ffe [Burak Yavuz] merged master
    ddfcc06 [Burak Yavuz] added zipping test
    3a1be7d [Burak Yavuz] don't zip
    77995df [Burak Yavuz] fix URI
    ac45527 [Burak Yavuz] added zipping of all libs
    e6bf7b0 [Burak Yavuz] add println ignores
    1bc5554 [Burak Yavuz] add assumes for tests
    9778e03 [Burak Yavuz] addressed comments
    b42b300 [Burak Yavuz] merged master
    ffd134e [Burak Yavuz] Merge branch 'master' of github.com:apache/spark into r-submit
    d867756 [Burak Yavuz] add apache header
    eff5ba1 [Burak Yavuz] ready for review
    8838edb [Burak Yavuz] Merge branch 'master' of github.com:apache/spark into r-submit
    e5b5a06 [Burak Yavuz] added doc
    bb751ce [Burak Yavuz] fix null bug
    0226768 [Burak Yavuz] fixed issues
    8810beb [Burak Yavuz] R packages support