Skip to content
Snippets Groups Projects
  • Allan Douglas R. de Oliveira's avatar
    4669a84a
    EC2 configurable workers · 4669a84a
    Allan Douglas R. de Oliveira authored
    Added option to configure number of worker instances and to set SPARK_MASTER_OPTS
    
    Depends on: https://github.com/mesos/spark-ec2/pull/46
    
    Author: Allan Douglas R. de Oliveira <allan@chaordicsystems.com>
    
    Closes #612 from douglaz/ec2_configurable_workers and squashes the following commits:
    
    d6c5d65 [Allan Douglas R. de Oliveira] Added master opts parameter
    6c34671 [Allan Douglas R. de Oliveira] Use number of worker instances as string on template
    ba528b9 [Allan Douglas R. de Oliveira] Added SPARK_WORKER_INSTANCES parameter
    4669a84a
    History
    EC2 configurable workers
    Allan Douglas R. de Oliveira authored
    Added option to configure number of worker instances and to set SPARK_MASTER_OPTS
    
    Depends on: https://github.com/mesos/spark-ec2/pull/46
    
    Author: Allan Douglas R. de Oliveira <allan@chaordicsystems.com>
    
    Closes #612 from douglaz/ec2_configurable_workers and squashes the following commits:
    
    d6c5d65 [Allan Douglas R. de Oliveira] Added master opts parameter
    6c34671 [Allan Douglas R. de Oliveira] Use number of worker instances as string on template
    ba528b9 [Allan Douglas R. de Oliveira] Added SPARK_WORKER_INSTANCES parameter