-
- Downloads
[SPARK-8246] [SQL] Implement get_json_object
This is based on #7485 , thanks to NathanHowell Tests were copied from Hive, but do not seem to be super comprehensive. I've generally replicated Hive's unusual behavior rather than following a JSONPath reference, except for one case (as noted in the comments). I don't know if there is a way of fully replicating Hive's behavior without a slower TreeNode implementation, so I've erred on the side of performance instead. Author: Davies Liu <davies@databricks.com> Author: Yin Huai <yhuai@databricks.com> Author: Nathan Howell <nhowell@godaddy.com> Closes #7901 from davies/get_json_object and squashes the following commits: 3ace9b9 [Davies Liu] Merge branch 'get_json_object' of github.com:davies/spark into get_json_object 98766fc [Davies Liu] Merge branch 'master' of github.com:apache/spark into get_json_object a7dc6d0 [Davies Liu] Update JsonExpressionsSuite.scala c818519 [Yin Huai] new results. 18ce26b [Davies Liu] fix tests 6ac29fb [Yin Huai] Golden files. 25eebef [Davies Liu] use HiveQuerySuite e0ac6ec [Yin Huai] Golden answer files. 940c060 [Davies Liu] tweat code style 44084c5 [Davies Liu] Merge branch 'master' of github.com:apache/spark into get_json_object 9192d09 [Nathan Howell] Match Hive’s behavior for unwrapping arrays of one element 8dab647 [Nathan Howell] [SPARK-8246] [SQL] Implement get_json_object
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala 1 addition, 0 deletions...apache/spark/sql/catalyst/analysis/FunctionRegistry.scala
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/jsonFunctions.scala 309 additions, 0 deletions...apache/spark/sql/catalyst/expressions/jsonFunctions.scala
- sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/JsonExpressionsSuite.scala 202 additions, 0 deletions...spark/sql/catalyst/expressions/JsonExpressionsSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala 32 additions, 0 deletions.../test/scala/org/apache/spark/sql/JsonFunctionsSuite.scala
- sql/hive/compatibility/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala 3 additions, 0 deletions...che/spark/sql/hive/execution/HiveCompatibilitySuite.scala
- sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala 5 additions, 1 deletion.../main/scala/org/apache/spark/sql/hive/test/TestHive.scala
- sql/hive/src/test/resources/golden/get_json_object #1-0-f01b340b5662c45bb5f1e3b7c6900e1f 1 addition, 0 deletions...den/get_json_object #1-0-f01b340b5662c45bb5f1e3b7c6900e1f
- sql/hive/src/test/resources/golden/get_json_object #10-0-f3f47d06d7c51d493d68112b0bd6c1fc 1 addition, 0 deletions...en/get_json_object #10-0-f3f47d06d7c51d493d68112b0bd6c1fc
- sql/hive/src/test/resources/golden/get_json_object #2-0-e84c2f8136919830fd665a278e4158a 1 addition, 0 deletions...lden/get_json_object #2-0-e84c2f8136919830fd665a278e4158a
- sql/hive/src/test/resources/golden/get_json_object #3-0-bf140c65c31f8d892ec23e41e16e58bb 1 addition, 0 deletions...den/get_json_object #3-0-bf140c65c31f8d892ec23e41e16e58bb
- sql/hive/src/test/resources/golden/get_json_object #4-0-f0bd902edc1990c9a6c65a6bb672c4d5 1 addition, 0 deletions...den/get_json_object #4-0-f0bd902edc1990c9a6c65a6bb672c4d5
- sql/hive/src/test/resources/golden/get_json_object #5-0-3c09f4316a1533049aee8af749cdcab 1 addition, 0 deletions...lden/get_json_object #5-0-3c09f4316a1533049aee8af749cdcab
- sql/hive/src/test/resources/golden/get_json_object #6-0-8334d1ddbe0f41fc7b80d4e6b45409da 1 addition, 0 deletions...den/get_json_object #6-0-8334d1ddbe0f41fc7b80d4e6b45409da
- sql/hive/src/test/resources/golden/get_json_object #7-0-40d7dff94b26a2e3f4ab71baee3d3ce0 1 addition, 0 deletions...den/get_json_object #7-0-40d7dff94b26a2e3f4ab71baee3d3ce0
- sql/hive/src/test/resources/golden/get_json_object #8-0-180b4b6fdb26011fec05a7ca99fd9844 1 addition, 0 deletions...den/get_json_object #8-0-180b4b6fdb26011fec05a7ca99fd9844
- sql/hive/src/test/resources/golden/get_json_object #9-0-47c451a969d856f008f4d6b3d378d94b 1 addition, 0 deletions...den/get_json_object #9-0-47c451a969d856f008f4d6b3d378d94b
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveQuerySuite.scala 51 additions, 0 deletions.../org/apache/spark/sql/hive/execution/HiveQuerySuite.scala
Loading
Please register or sign in to comment