-
- Downloads
[SPARK-7565] [SQL] fix MapType in JsonRDD
The key of Map in JsonRDD should be converted into UTF8String (also failed records), Thanks to yhuai viirya Closes #6084 Author: Davies Liu <davies@databricks.com> Closes #6299 from davies/string_in_json and squashes the following commits: 0dbf559 [Davies Liu] improve test, fix corrupt record 6836a80 [Davies Liu] move unit tests into Scala b97af11 [Davies Liu] fix MapType in JsonRDD
Showing
- sql/core/src/main/scala/org/apache/spark/sql/json/JacksonParser.scala 4 additions, 4 deletions.../main/scala/org/apache/spark/sql/json/JacksonParser.scala
- sql/core/src/main/scala/org/apache/spark/sql/json/JsonRDD.scala 10 additions, 6 deletions...re/src/main/scala/org/apache/spark/sql/json/JsonRDD.scala
- sql/core/src/test/scala/org/apache/spark/sql/json/JsonSuite.scala 27 additions, 1 deletion.../src/test/scala/org/apache/spark/sql/json/JsonSuite.scala
Loading
Please register or sign in to comment