- Nov 20, 2012
-
-
Thomas Dudziak authored
-
Thomas Dudziak authored
-
- Nov 19, 2012
-
-
Matei Zaharia authored
Improved use of Boto
-
Peter Sankauskas authored
handling Boto connection exceptions (like AuthFailure)
-
Matei Zaharia authored
Let EC2 script launch slaves in multiple availability zones
-
Matei Zaharia authored
SPARK-624: make the default local IP customizable
-
mbautin authored
-
- Nov 18, 2012
-
-
Peter Sankauskas authored
-
- Nov 16, 2012
-
-
Matei Zaharia authored
Set default uncaught exception handler to exit
-
Matei Zaharia authored
Delete security groups when destroying cluster
-
Matei Zaharia authored
-
Charles Reiss authored
Among other things, should prevent OutOfMemoryErrors in some daemon threads (such as the network manager) from causing a spark executor to enter a state where it cannot make progress but does not report an error.
-
Peter Sankauskas authored
across multiple availability zones in order to make the cluster more resilient to failure
-
Peter Sankauskas authored
are done on instances in specific security groups, this seems like a reasonable thing to clean up.
-
- Nov 15, 2012
-
-
mbautin authored
-
Matei Zaharia authored
matching with data locality hints from storage systems.
-
Matei Zaharia authored
-
- Nov 11, 2012
-
-
Matei Zaharia authored
SPARK-617 #resolve
-
root authored
-
- Nov 09, 2012
-
-
Matei Zaharia authored
Blockmanager fix
-
Tathagata Das authored
Incorporated Matei's suggestions. Tested with 5 producer(consumer) threads each doing 50k puts (gets), took 15 minutes to run, no errors or deadlocks.
-
Tathagata Das authored
1. Changed the lock structure of BlockManager by replacing the 337 coarse-grained locks to use BlockInfo objects as per-block fine-grained locks. 2. Changed the MemoryStore lock structure by making the block putting threads lock on a different object (not the memory store) thus making sure putting threads minimally blocks to the getting treads. 3. Added spark.storage.ThreadingTest to stress test the BlockManager using 5 block producer and 5 block consumer threads.
-
Matei Zaharia authored
-
- Nov 08, 2012
-
-
Matei Zaharia authored
-
Imran Rashid authored
-
- Nov 07, 2012
-
-
Matei Zaharia authored
- Don't report a job as finishing multiple times - Don't show state of workers as LOADING when they're running - Show start and finish times in web UI - Sort web UI tables by ID and time by default
-
- Nov 06, 2012
-
-
Matei Zaharia authored
-
- Nov 03, 2012
-
-
Matei Zaharia authored
Fix check for existing instances during spark-ec2 launch
-
Josh Rosen authored
-
- Nov 01, 2012
-
-
Matei Zaharia authored
Remove unnecessary hash-map put in MemoryStore
-
Matei Zaharia authored
Cancel spot instance requests when exiting spark-ec2
-
Shivaram Venkataraman authored
-
- Oct 31, 2012
-
-
Josh Rosen authored
-
- Oct 27, 2012
-
-
Matei Zaharia authored
Fix minor typos in quickstart and Scala programming guides
-
- Oct 26, 2012
-
-
Josh Rosen authored
-
root authored
a locally computed operation Conflicts: core/src/main/scala/spark/storage/BlockManagerMaster.scala
-
- Oct 24, 2012
-
-
Matei Zaharia authored
-
Matei Zaharia authored
Added a method to report slave memory status; force serialize accumulator update in local mode.
-
Matei Zaharia authored
Conflicts: core/src/main/scala/spark/Dependency.scala core/src/main/scala/spark/rdd/CoGroupedRDD.scala core/src/main/scala/spark/rdd/ShuffledRDD.scala
-
- Oct 23, 2012
-
-
Matei Zaharia authored
Allow EC2 script to stop/destroy cluster after master/slave failures
-