-
- Downloads
SPARK-2226: [SQL] transform HAVING clauses with aggregate expressions that...
SPARK-2226: [SQL] transform HAVING clauses with aggregate expressions that aren't in the aggregation list This change adds an analyzer rule to 1. find expressions in `HAVING` clause filters that depend on unresolved attributes, 2. push these expressions down to the underlying aggregates, and then 3. project them away above the filter. It also enables the `HAVING` queries in the Hive compatibility suite. Author: William Benton <willb@redhat.com> Closes #1497 from willb/spark-2226 and squashes the following commits: 92c9a93 [William Benton] Removed unnecessary import f1d4f34 [William Benton] Cleanups missed in prior commit 0e1624f [William Benton] Incorporated suggestions from @marmbrus; thanks! 541d4ee [William Benton] Cleanups from review 5a12647 [William Benton] Explanatory comments and stylistic cleanups. c7f2b2c [William Benton] Whitelist HAVING queries. 29a26e3 [William Benton] Added rule to handle unresolved attributes in HAVING clauses (SPARK-2226)
Showing
- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala 26 additions, 1 deletion...ala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala
- sql/hive/src/test/resources/golden/having-0-57f3f26c0203c29c2a91a7cca557ce55 0 additions, 0 deletions...esources/golden/having-0-57f3f26c0203c29c2a91a7cca557ce55
- sql/hive/src/test/resources/golden/having-1-ef81808faeab6d212c3cf32abfc0d873 10 additions, 0 deletions...esources/golden/having-1-ef81808faeab6d212c3cf32abfc0d873
- sql/hive/src/test/resources/golden/having-2-a2b4f52cb92f730ddb912b063636d6c1 0 additions, 0 deletions...esources/golden/having-2-a2b4f52cb92f730ddb912b063636d6c1
- sql/hive/src/test/resources/golden/having-3-3fa6387b6a4ece110ac340c7b893964e 308 additions, 0 deletions...esources/golden/having-3-3fa6387b6a4ece110ac340c7b893964e
- sql/hive/src/test/resources/golden/having-4-e9918bd385cb35db4ebcbd4e398547f4 0 additions, 0 deletions...esources/golden/having-4-e9918bd385cb35db4ebcbd4e398547f4
- sql/hive/src/test/resources/golden/having-5-4a0c4e521b8a6f6146151c13a2715ff 199 additions, 0 deletions...resources/golden/having-5-4a0c4e521b8a6f6146151c13a2715ff
- sql/hive/src/test/resources/golden/having-6-9f50df5b5f31c7166b0396ab434dc095 0 additions, 0 deletions...esources/golden/having-6-9f50df5b5f31c7166b0396ab434dc095
- sql/hive/src/test/resources/golden/having-7-5ad96cb287df02080da1e2594f08d83e 125 additions, 0 deletions...esources/golden/having-7-5ad96cb287df02080da1e2594f08d83e
- sql/hive/src/test/resources/golden/having-8-4aa7197e20b5a64461ca670a79488103 0 additions, 0 deletions...esources/golden/having-8-4aa7197e20b5a64461ca670a79488103
- sql/hive/src/test/resources/golden/having-9-a79743372d86d77b0ff53a71adcb1cff 199 additions, 0 deletions...esources/golden/having-9-a79743372d86d77b0ff53a71adcb1cff
- sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveCompatibilitySuite.scala 2 additions, 0 deletions...che/spark/sql/hive/execution/HiveCompatibilitySuite.scala
Loading
Please register or sign in to comment