Repository navigation
Implement statistics estimation for partition columns #1186
Description
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
The ability to read partitioned tables is added the the ListingTable in #1141. As partitions are constant columns, we could estimate their statistics pretty accurately (currently they are left as Default.
Describe the solution you'd like
Replace default with a column statistics that has:
- min value
- max value
- distinct count
- null number as 0
Activity
andrei-ionescu commentedon Dec 12, 2021
I think first we need to fully support statistics on nested fields. Please see this comment: #1392 (comment).
houqp commentedon Dec 13, 2021
I believe this can be worked on in parallel. Once we implement the solution mentioned in the comment you linked, it should work out of the box for nested columns.