Skip to content
  • Dongjoon Hyun's avatar
    431a3d04
    [SPARK-12653][SQL] Re-enable test "SPARK-8489: MissingRequirementError during reflection" · 431a3d04
    Dongjoon Hyun authored
    ## What changes were proposed in this pull request?
    
    The purpose of [SPARK-12653](https://issues.apache.org/jira/browse/SPARK-12653) is re-enabling a regression test.
    Historically, the target regression test is added by [SPARK-8498](https://github.com/apache/spark/commit/093c34838d1db7a9375f36a9a2ab5d96a23ae683), but is temporarily disabled by [SPARK-12615](https://github.com/apache/spark/commit/8ce645d4eeda203cf5e100c4bdba2d71edd44e6a) due to binary compatibility error.
    
    The following is the current error message at the submitting spark job with the pre-built `test.jar` file in the target regression test.
    ```
    Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.SparkContext$.$lessinit$greater$default$6()Lscala/collection/Map;
    ```
    
    Simple rebuilding `test.jar` can not recover the purpose of testcase since we need to support both Scala 2.10 and 2.11 for a while. For example, we will face the following Scala 2.11 error if we use `test.jar` built by Scala 2.10.
    ```
    Exception in thread "main" java.lang.NoSuchMethodError: scala.reflect.api.JavaUniverse.runtimeMirror(Ljava/lang/ClassLoader;)Lscala/reflect/api/JavaMirrors$JavaMirror;
    ```
    
    This PR replace the existing `test.jar` with `test-2.10.jar` and `test-2.11.jar` and improve the regression test to use the suitable jar file.
    
    ## How was this patch tested?
    
    Pass the existing Jenkins test.
    
    Author: Dongjoon Hyun <dongjoon@apache.org>
    
    Closes #11744 from dongjoon-hyun/SPARK-12653.
    431a3d04
    [SPARK-12653][SQL] Re-enable test "SPARK-8489: MissingRequirementError during reflection"
    Dongjoon Hyun authored
    ## What changes were proposed in this pull request?
    
    The purpose of [SPARK-12653](https://issues.apache.org/jira/browse/SPARK-12653) is re-enabling a regression test.
    Historically, the target regression test is added by [SPARK-8498](https://github.com/apache/spark/commit/093c34838d1db7a9375f36a9a2ab5d96a23ae683), but is temporarily disabled by [SPARK-12615](https://github.com/apache/spark/commit/8ce645d4eeda203cf5e100c4bdba2d71edd44e6a) due to binary compatibility error.
    
    The following is the current error message at the submitting spark job with the pre-built `test.jar` file in the target regression test.
    ```
    Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.SparkContext$.$lessinit$greater$default$6()Lscala/collection/Map;
    ```
    
    Simple rebuilding `test.jar` can not recover the purpose of testcase since we need to support both Scala 2.10 and 2.11 for a while. For example, we will face the following Scala 2.11 error if we use `test.jar` built by Scala 2.10.
    ```
    Exception in thread "main" java.lang.NoSuchMethodError: scala.reflect.api.JavaUniverse.runtimeMirror(Ljava/lang/ClassLoader;)Lscala/reflect/api/JavaMirrors$JavaMirror;
    ```
    
    This PR replace the existing `test.jar` with `test-2.10.jar` and `test-2.11.jar` and improve the regression test to use the suitable jar file.
    
    ## How was this patch tested?
    
    Pass the existing Jenkins test.
    
    Author: Dongjoon Hyun <dongjoon@apache.org>
    
    Closes #11744 from dongjoon-hyun/SPARK-12653.
Loading