-
- Downloads
[SPARK-1133] Add whole text files reader in MLlib
Here is a pointer to the former [PR164](https://github.com/apache/spark/pull/164). I add the pull request for the JIRA issue [SPARK-1133](https://spark-project.atlassian.net/browse/SPARK-1133), which brings a new files reader API in MLlib. Author: Xusen Yin <yinxusen@gmail.com> Closes #252 from yinxusen/whole-files-input and squashes the following commits: 7191be6 [Xusen Yin] refine comments 0af3faf [Xusen Yin] add JavaAPI test 01745ee [Xusen Yin] fix deletion error cc97dca [Xusen Yin] move whole text file API to Spark core d792cee [Xusen Yin] remove the typo character "+" 6bdf2c2 [Xusen Yin] test for small local file system block size a1f1e7e [Xusen Yin] add two extra spaces 28cb0fe [Xusen Yin] add whole text files reader
Showing
- core/src/main/scala/org/apache/spark/SparkContext.scala 34 additions, 0 deletionscore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/api/java/JavaSparkContext.scala 28 additions, 0 deletions...in/scala/org/apache/spark/api/java/JavaSparkContext.scala
- core/src/main/scala/org/apache/spark/input/WholeTextFileInputFormat.scala 47 additions, 0 deletions...ala/org/apache/spark/input/WholeTextFileInputFormat.scala
- core/src/main/scala/org/apache/spark/input/WholeTextFileRecordReader.scala 72 additions, 0 deletions...la/org/apache/spark/input/WholeTextFileRecordReader.scala
- core/src/test/java/org/apache/spark/JavaAPISuite.java 27 additions, 3 deletionscore/src/test/java/org/apache/spark/JavaAPISuite.java
- core/src/test/scala/org/apache/spark/input/WholeTextFileRecordReaderSuite.scala 105 additions, 0 deletions...g/apache/spark/input/WholeTextFileRecordReaderSuite.scala
Loading
Please register or sign in to comment