Add zip partitions interface

(the previous commit only renamed the file)

Fix issues with streaming test cases after yarn branch merge

The current code supports 2, 3 or 4 arguments but can be extended
to more arguments if required.

SPARK-739 Have quickstart standlone job use README

test failure on Hadoop 2.0)

Manual merge of yarn branch to trunk

Patch from Thomas Graves to improve the YARN Client, and move to more production ready hadoop yarn branch

Fix review comments, add a new api to SparkHadoopUtil to create appropriate Configuration. Modify an example to show how to use SplitInfo

cache sizes due to having 2 instances of the Scala compiler and a bunch
of classloaders.

Increase ReservedCodeCacheSize for sbt

Move back to 2.0.2-alpha, since 2.0.3-alpha is not available in cloudera yet. Also, add netty dependency explicitly to prevent resolving to older 2.3x version. Additionally, comment out retrievePattern to ensure correct netty is picked up

Ensure all ask/await block for spark.akka.askTimeout - so that it is controllable : instead of arbitrary timeouts spread across codebase. In our tests, we use 30 seconds, though default of 10 is maintained

Fudge order of classpath - so that our jars take precedence over what is in CLASSPATH variable. Sounds logical, hope there is no issue cos of it