Skip to content
Snippets Groups Projects
Commit c1a0c66b authored by Liwei Lin's avatar Liwei Lin Committed by Reynold Xin
Browse files

[SPARK-18261][STRUCTURED STREAMING] Add statistics to MemorySink for joining 

## What changes were proposed in this pull request?

Right now, there is no way to join the output of a memory sink with any table:

> UnsupportedOperationException: LeafNode MemoryPlan must implement statistics

This patch adds statistics to MemorySink, making joining snapshots of memory streams with tables possible.

## How was this patch tested?

Added a test case.

Author: Liwei Lin <lwlin7@gmail.com>

Closes #15786 from lw-lin/memory-sink-stat.
parent 9b0593d5
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment