Skip to content
Snippets Groups Projects
Commit 8de080d9 authored by DjvuLee's avatar DjvuLee Committed by Marcelo Vanzin
Browse files

[SPARK-21383][YARN] Fix the YarnAllocator allocates more Resource

When NodeManagers launching Executors,
the `missing` value will exceed the
real value when the launch is slow, this can lead to YARN allocates more resource.

We add the `numExecutorsRunning` when calculate the `missing` to avoid this.

Test by experiment.

Author: DjvuLee <lihu@bytedance.com>

Closes #18651 from djvulee/YarnAllocate.
parent 799e1316
No related branches found
No related tags found
Loading
Loading
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment