Skip to content
Snippets Groups Projects
  • Joseph E. Gonzalez's avatar
    894ecde0
    Synthetic GraphX Benchmark · 894ecde0
    Joseph E. Gonzalez authored
    This PR accomplishes two things:
    
    1. It introduces a Synthetic Benchmark application that generates an arbitrarily large log-normal graph and executes either PageRank or connected components on the graph.  This can be used to profile GraphX system on arbitrary clusters without access to large graph datasets
    
    2. This PR improves the implementation of the log-normal graph generator.
    
    Author: Joseph E. Gonzalez <joseph.e.gonzalez@gmail.com>
    Author: Ankur Dave <ankurdave@gmail.com>
    
    Closes #720 from jegonzal/graphx_synth_benchmark and squashes the following commits:
    
    e40812a [Ankur Dave] Exclude all of GraphX from compatibility checks vs. 1.0.0
    bccccad [Ankur Dave] Fix long lines
    374678a [Ankur Dave] Bugfix and style changes
    1bdf39a [Joseph E. Gonzalez] updating options
    d943972 [Joseph E. Gonzalez] moving the benchmark application into the examples folder.
    f4f839a [Joseph E. Gonzalez] Creating a synthetic benchmark script.
    894ecde0
    History
    Synthetic GraphX Benchmark
    Joseph E. Gonzalez authored
    This PR accomplishes two things:
    
    1. It introduces a Synthetic Benchmark application that generates an arbitrarily large log-normal graph and executes either PageRank or connected components on the graph.  This can be used to profile GraphX system on arbitrary clusters without access to large graph datasets
    
    2. This PR improves the implementation of the log-normal graph generator.
    
    Author: Joseph E. Gonzalez <joseph.e.gonzalez@gmail.com>
    Author: Ankur Dave <ankurdave@gmail.com>
    
    Closes #720 from jegonzal/graphx_synth_benchmark and squashes the following commits:
    
    e40812a [Ankur Dave] Exclude all of GraphX from compatibility checks vs. 1.0.0
    bccccad [Ankur Dave] Fix long lines
    374678a [Ankur Dave] Bugfix and style changes
    1bdf39a [Joseph E. Gonzalez] updating options
    d943972 [Joseph E. Gonzalez] moving the benchmark application into the examples folder.
    f4f839a [Joseph E. Gonzalez] Creating a synthetic benchmark script.
juno_utils NaN GiB