Skip to content
  • Bertrand Bossy's avatar
    c243b21a
    SPARK-3039: Allow spark to be built using avro-mapred for hadoop2 · c243b21a
    Bertrand Bossy authored
    SPARK-3039: Adds the maven property "avro.mapred.classifier" to build spark-assembly with avro-mapred with support for the new Hadoop API. Sets this property to hadoop2 for Hadoop 2 profiles.
    
    I am not very familiar with maven, nor do I know whether this potentially breaks something in the hive part of spark. There might be a more elegant way of doing this.
    
    Author: Bertrand Bossy <bertrandbossy@gmail.com>
    
    Closes #1945 from bbossy/SPARK-3039 and squashes the following commits:
    
    c32ce59 [Bertrand Bossy] SPARK-3039: Allow spark to be built using avro-mapred for hadoop2
    c243b21a
    SPARK-3039: Allow spark to be built using avro-mapred for hadoop2
    Bertrand Bossy authored
    SPARK-3039: Adds the maven property "avro.mapred.classifier" to build spark-assembly with avro-mapred with support for the new Hadoop API. Sets this property to hadoop2 for Hadoop 2 profiles.
    
    I am not very familiar with maven, nor do I know whether this potentially breaks something in the hive part of spark. There might be a more elegant way of doing this.
    
    Author: Bertrand Bossy <bertrandbossy@gmail.com>
    
    Closes #1945 from bbossy/SPARK-3039 and squashes the following commits:
    
    c32ce59 [Bertrand Bossy] SPARK-3039: Allow spark to be built using avro-mapred for hadoop2
Loading