Skip to content
Snippets Groups Projects
  • pshearer's avatar
    0368ff30
    [SPARK-13973][PYSPARK] Make pyspark fail noisily if IPYTHON or IPYTHON_OPTS are set · 0368ff30
    pshearer authored
    ## What changes were proposed in this pull request?
    
    https://issues.apache.org/jira/browse/SPARK-13973
    
    Following discussion with srowen the IPYTHON and IPYTHON_OPTS variables are removed. If they are set in the user's environment, pyspark will not execute and prints an error message. Failing noisily will force users to remove these options and learn the new configuration scheme, which is much more sustainable and less confusing.
    
    ## How was this patch tested?
    
    Manual testing; set IPYTHON=1 and verified that the error message prints.
    
    Author: pshearer <pshearer@massmutual.com>
    Author: shearerp <shearerp@umich.edu>
    
    Closes #12528 from shearerp/master.
    0368ff30
    History
    [SPARK-13973][PYSPARK] Make pyspark fail noisily if IPYTHON or IPYTHON_OPTS are set
    pshearer authored
    ## What changes were proposed in this pull request?
    
    https://issues.apache.org/jira/browse/SPARK-13973
    
    Following discussion with srowen the IPYTHON and IPYTHON_OPTS variables are removed. If they are set in the user's environment, pyspark will not execute and prints an error message. Failing noisily will force users to remove these options and learn the new configuration scheme, which is much more sustainable and less confusing.
    
    ## How was this patch tested?
    
    Manual testing; set IPYTHON=1 and verified that the error message prints.
    
    Author: pshearer <pshearer@massmutual.com>
    Author: shearerp <shearerp@umich.edu>
    
    Closes #12528 from shearerp/master.