Skip to content

Fix Firebolt Q36-Q42 Parquet date filters - #1395

Open
vogelsgesang wants to merge 1 commit into
ClickHouse:mainfrom
vogelsgesang:fix-firebolt
Open

Fix Firebolt Q36-Q42 Parquet date filters#1395
vogelsgesang wants to merge 1 commit into
ClickHouse:mainfrom
vogelsgesang:fix-firebolt

Conversation

@vogelsgesang

Copy link
Copy Markdown
Contributor

Firebolt's Q36–Q42 used incorrect epoch-day constants.

  • Firebolt filtered 16617..16647, meaning July 2015.
  • The dataset spans 15888..15917—July 2013.

Therefore, Firebolt returned empty results quickly via Parquet metadata pruning.

This commit uses the dataset's actual epoch-day ranges, so Q36-Q42 process the intended July 2013 rows instead of returning empty results.

Firebolt's Q36–Q42 used incorrect epoch-day constants.
* Firebolt filtered 16617..16647, meaning July 2015.
* The dataset spans 15888..15917—July 2013.

Therefore, Firebolt returns empty results, quickly via Parquet metadata
pruning.

Use the dataset's actual epoch-day ranges so Q36-Q42 process the
intended July 2013 rows instead of returning empty results.
@vogelsgesang

Copy link
Copy Markdown
Contributor Author

FYI @hall-alex @moshap-firebolt as previous contributors to the Firebolt setup

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant