[SPARK-22881][ML][TEST] ML regression package testsuite add StructuredStreaming test
## What changes were proposed in this pull request? ML regression package testsuite add StructuredStreaming test In order to make testsuite easier to modify, new helper function added in `MLTest`: ``` def testTransformerByGlobalCheckFunc[A : Encoder]( dataframe: DataFrame, transformer: Transformer, firstResultCol: String, otherResultCols: String*) (globalCheckFunction: Seq[Row] => Unit): Unit ``` ## How was this patch tested? N/A Author: WeichenXu <weichen.xu@databricks.com> Author: Bago Amirbekian <bago@databricks.com> Closes #19979 from WeichenXu123/ml_stream_test.
Showing
- mllib/src/test/scala/org/apache/spark/ml/regression/AFTSurvivalRegressionSuite.scala 8 additions, 11 deletions...ache/spark/ml/regression/AFTSurvivalRegressionSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/regression/DecisionTreeRegressorSuite.scala 20 additions, 23 deletions...ache/spark/ml/regression/DecisionTreeRegressorSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/regression/GBTRegressorSuite.scala 12 additions, 11 deletions...la/org/apache/spark/ml/regression/GBTRegressorSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/regression/GeneralizedLinearRegressionSuite.scala 24 additions, 23 deletions...park/ml/regression/GeneralizedLinearRegressionSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/regression/IsotonicRegressionSuite.scala 17 additions, 26 deletions.../apache/spark/ml/regression/IsotonicRegressionSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/regression/LinearRegressionSuite.scala 13 additions, 12 deletions...rg/apache/spark/ml/regression/LinearRegressionSuite.scala
- mllib/src/test/scala/org/apache/spark/ml/util/MLTest.scala 30 additions, 9 deletionsmllib/src/test/scala/org/apache/spark/ml/util/MLTest.scala
- mllib/src/test/scala/org/apache/spark/ml/util/MLTestSuite.scala 10 additions, 2 deletions...src/test/scala/org/apache/spark/ml/util/MLTestSuite.scala
- sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamTest.scala 13 additions, 14 deletions...est/scala/org/apache/spark/sql/streaming/StreamTest.scala
Loading
Please register or sign in to comment