Cannot parse the partition key from SQL for less table scan if the partition keys are specified in OR conditions #13467
pangyifish
started this conversation in
General
Replies: 1 comment 1 reply
-
This is a known limitation of TupleDomain-based predicate pushdown. Same technique could be applied in other connectors as well (eg Iceberg), but seems not quite applicable to eg Hive. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
a
is a hive table partitioned bydt
, stored in s3.I have where conditions like:
Trino ended up doing a full table scan on
a
so I have to add
AND a.dt in (DATE'2022-07-17', DATE'2022-07-18', DATE'2022-07-23', DATE'2022-07-24')
to make it scan less data.version: 380
Beta Was this translation helpful? Give feedback.
All reactions