Skip to content
Snippets Groups Projects
  1. Oct 12, 2013
  2. Sep 29, 2013
  3. Sep 22, 2013
  4. Aug 29, 2013
    • Matei Zaharia's avatar
    • Matei Zaharia's avatar
      Change build and run instructions to use assemblies · 53cd50c0
      Matei Zaharia authored
      This commit makes Spark invocation saner by using an assembly JAR to
      find all of Spark's dependencies instead of adding all the JARs in
      lib_managed. It also packages the examples into an assembly and uses
      that as SPARK_EXAMPLES_JAR. Finally, it replaces the old "run" script
      with two better-named scripts: "run-examples" for examples, and
      "spark-class" for Spark internal classes (e.g. REPL, master, etc). This
      is also designed to minimize the confusion people have in trying to use
      "run" to run their own classes; it's not meant to do that, but now at
      least if they look at it, they can modify run-examples to do a decent
      job for them.
      
      As part of this, Bagel's examples are also now properly moved to the
      examples package instead of bagel.
      53cd50c0
  5. Aug 18, 2013
  6. Aug 16, 2013
  7. Aug 15, 2013
  8. Jul 24, 2013
  9. Jul 22, 2013
    • Josh Rosen's avatar
      Add JavaAPICompletenessChecker. · c8368043
      Josh Rosen authored
      This is used to find methods in the Scala API that
      need to be ported to the Java API.  To use it:
      
        ./run spark.tools.JavaAPICompletenessChecker
      Conflicts:
      	project/SparkBuild.scala
      	run
      	run2.cmd
      c8368043
  10. Jul 17, 2013
  11. Jul 16, 2013
  12. Jul 05, 2013
  13. Jun 25, 2013
    • Matei Zaharia's avatar
      Fix computation of classpath when we launch java directly · 6c8d1b2c
      Matei Zaharia authored
      The previous version assumed that a CLASSPATH environment variable was
      set by the "run" script when launching the process that starts the
      ExecutorRunner, but unfortunately this is not true in tests. Instead, we
      factor the classpath calculation into an extenral script and call that.
      
      NOTE: This includes a Windows version but hasn't yet been tested there.
      6c8d1b2c
Loading