-
- Downloads
Merge pull request #272 from tmyklebu/master
Track and report task result serialisation time. - DirectTaskResult now has a ByteBuffer valueBytes instead of a T value. - DirectTaskResult now has a member function T value() that deserialises valueBytes. - Executor serialises value into a ByteBuffer and passes it to DTR's ctor. - Executor tracks the time taken to do so and puts it in a new field in TaskMetrics. - StagePage now reports serialisation time from TaskMetrics along with the other things it reported.
No related branches found
No related tags found
Showing
- core/src/main/scala/org/apache/spark/executor/Executor.scala 8 additions, 4 deletionscore/src/main/scala/org/apache/spark/executor/Executor.scala
- core/src/main/scala/org/apache/spark/executor/TaskMetrics.scala 5 additions, 0 deletions...rc/main/scala/org/apache/spark/executor/TaskMetrics.scala
- core/src/main/scala/org/apache/spark/scheduler/TaskResult.scala 10 additions, 10 deletions...rc/main/scala/org/apache/spark/scheduler/TaskResult.scala
- core/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala 11 additions, 1 deletioncore/src/main/scala/org/apache/spark/ui/jobs/StagePage.scala
- core/src/test/scala/org/apache/spark/scheduler/cluster/ClusterTaskSetManagerSuite.scala 2 additions, 1 deletion.../spark/scheduler/cluster/ClusterTaskSetManagerSuite.scala
Loading
Please register or sign in to comment