Skip to content
Snippets Groups Projects
Commit dc28a3ac authored by Matei Zaharia's avatar Matei Zaharia
Browse files

Modified shuffle to limit the maximum outstanding data size in bytes,

instead of the maximum number of outstanding fetches. This should make
it faster when there are many small map output files, as well as more
robust to overallocating memory on large map outputs.
parent 9a3b3f32
No related branches found
No related tags found
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment