Skip to content
Snippets Groups Projects
  • Yanbo Liang's avatar
    6ecedf39
    [SPARK-13590][ML][DOC] Document spark.ml LiR, LoR and AFTSurvivalRegression behavior difference · 6ecedf39
    Yanbo Liang authored
    ## What changes were proposed in this pull request?
    When fitting ```LinearRegressionModel```(by "l-bfgs" solver) and ```LogisticRegressionModel``` w/o intercept on dataset with constant nonzero column, spark.ml produce same model as R glmnet but different from LIBSVM.
    
    When fitting ```AFTSurvivalRegressionModel``` w/o intercept on dataset with constant nonzero column, spark.ml produce different model compared with R survival::survreg.
    
    We should output a warning message and clarify in document for this condition.
    
    ## How was this patch tested?
    Document change, no unit test.
    
    cc mengxr
    
    Author: Yanbo Liang <ybliang8@gmail.com>
    
    Closes #12731 from yanboliang/spark-13590.
    6ecedf39
    History
    [SPARK-13590][ML][DOC] Document spark.ml LiR, LoR and AFTSurvivalRegression behavior difference
    Yanbo Liang authored
    ## What changes were proposed in this pull request?
    When fitting ```LinearRegressionModel```(by "l-bfgs" solver) and ```LogisticRegressionModel``` w/o intercept on dataset with constant nonzero column, spark.ml produce same model as R glmnet but different from LIBSVM.
    
    When fitting ```AFTSurvivalRegressionModel``` w/o intercept on dataset with constant nonzero column, spark.ml produce different model compared with R survival::survreg.
    
    We should output a warning message and clarify in document for this condition.
    
    ## How was this patch tested?
    Document change, no unit test.
    
    cc mengxr
    
    Author: Yanbo Liang <ybliang8@gmail.com>
    
    Closes #12731 from yanboliang/spark-13590.