Skip to content
Snippets Groups Projects
Commit dcac8e6f authored by Reynold Xin's avatar Reynold Xin
Browse files

[SPARK-15454][SQL] Filter out files starting with _ 

## What changes were proposed in this pull request?
Many other systems (e.g. Impala) uses _xxx as staging, and Spark should not be reading those files.

## How was this patch tested?
Added a unit test case.

Author: Reynold Xin <rxin@databricks.com>

Closes #13227 from rxin/SPARK-15454.
parent 0e70fd61
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment