Skip to content
Snippets Groups Projects
  • Junjie Chen's avatar
    4f15d94c
    [SPARK-13331] AES support for over-the-wire encryption · 4f15d94c
    Junjie Chen authored
    ## What changes were proposed in this pull request?
    
    DIGEST-MD5 mechanism is used for SASL authentication and secure communication. DIGEST-MD5 mechanism supports 3DES, DES, and RC4 ciphers. However, 3DES, DES and RC4 are slow relatively.
    
    AES provide better performance and security by design and is a replacement for 3DES according to NIST. Apache Common Crypto is a cryptographic library optimized with AES-NI, this patch employ Apache Common Crypto as enc/dec backend for SASL authentication and secure channel to improve spark RPC.
    ## How was this patch tested?
    
    Unit tests and Integration test.
    
    Author: Junjie Chen <junjie.j.chen@intel.com>
    
    Closes #15172 from cjjnjust/shuffle_rpc_encrypt.
    4f15d94c
    History
    [SPARK-13331] AES support for over-the-wire encryption
    Junjie Chen authored
    ## What changes were proposed in this pull request?
    
    DIGEST-MD5 mechanism is used for SASL authentication and secure communication. DIGEST-MD5 mechanism supports 3DES, DES, and RC4 ciphers. However, 3DES, DES and RC4 are slow relatively.
    
    AES provide better performance and security by design and is a replacement for 3DES according to NIST. Apache Common Crypto is a cryptographic library optimized with AES-NI, this patch employ Apache Common Crypto as enc/dec backend for SASL authentication and secure channel to improve spark RPC.
    ## How was this patch tested?
    
    Unit tests and Integration test.
    
    Author: Junjie Chen <junjie.j.chen@intel.com>
    
    Closes #15172 from cjjnjust/shuffle_rpc_encrypt.
src NaN GiB