Skip to content

[FEA] Support unary operators in Parquet row group and page filtering #20125

@mhaseeb123

Description

@mhaseeb123

Is your feature request related to a problem? Please describe.
Currently, we only support binary operators such as >, <, == to filter Parquet row groups and data pages. We would now like to extend our parquet filtering to unary operators such as IS_NULL. Currently, using a unary operator in the AST expression leads to a runtime error in the predicate pushdown code (first occurrence: stats based row group filtering).

Describe the solution you'd like

Describe alternatives you've considered
Pre-processing the AST expression to not use unary operators during read_parquet and apply the remaining filters post-read

Additional context
Helps Velox

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

In progress

Relationships

None yet

Development

No branches or pull requests

Issue actions