-
- Downloads
[SPARK-22538][ML] SQLTransformer should not unpersist possibly cached input dataset
## What changes were proposed in this pull request? `SQLTransformer.transform` unpersists input dataset when dropping temporary view. We should not change input dataset's cache status. ## How was this patch tested? Added test. Author: Liang-Chi Hsieh <viirya@gmail.com> Closes #19772 from viirya/SPARK-22538.
Showing
- mllib/src/main/scala/org/apache/spark/ml/feature/SQLTransformer.scala 2 additions, 1 deletion...in/scala/org/apache/spark/ml/feature/SQLTransformer.scala
- mllib/src/test/scala/org/apache/spark/ml/feature/SQLTransformerSuite.scala 12 additions, 0 deletions...ala/org/apache/spark/ml/feature/SQLTransformerSuite.scala
Loading
Please register or sign in to comment