Skip to content
Snippets Groups Projects
  • Josh Rosen's avatar
    665466df
    Simplify PySpark installation. · 665466df
    Josh Rosen authored
    - Bundle Py4J binaries, since it's hard to install
    - Uses Spark's `run` script to launch the Py4J
      gateway, inheriting the settings in spark-env.sh
    
    With these changes, (hopefully) nothing more than
    running `sbt/sbt package` will be necessary to run
    PySpark.
    665466df
    History
    Simplify PySpark installation.
    Josh Rosen authored
    - Bundle Py4J binaries, since it's hard to install
    - Uses Spark's `run` script to launch the Py4J
      gateway, inheriting the settings in spark-env.sh
    
    With these changes, (hopefully) nothing more than
    running `sbt/sbt package` will be necessary to run
    PySpark.