Commit f44a73a
authored
Xarray-specific filter predicate pushdown. (#113)
Partition pruning: In the Xarray data model, we can always get
statistics for the dataset dims, which function like the "primary keys"
of the materialized table. These statistics lend themselves to omit
processing data that we know we don't need to. For example,
```sql
SELECT * FROM air WHERE time > '2020-02-01'
```
Will skip loading partitions whose time ranges are entirely before
2020-02-01.1 parent 17bc410 commit f44a73a
File tree
6 files changed
+965
-40
lines changed- src
- xarray_sql
6 files changed
+965
-40
lines changedSome generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
| 23 | + | |
23 | 24 | | |
24 | 25 | | |
25 | 26 | | |
| |||
0 commit comments