Skip to content

arrow-55.1.0 breaks filter_record_batch #7500

Closed
@ion-elgreco

Description

@ion-elgreco

Describe the bug
With latest minor release the filter_record_batch function stopped working: https://github.com/delta-io/delta-rs/actions/runs/14999489487/job/42142313983?pr=3426#step:4:2506

cannot use StructArray::new_unchecked if there are no fields, length is unknown

To Reproduce
Run delta-rs codebase and do cargo test.

Expected behavior
Being able to filter recordbatch by predicate.

I tried doing this, to verify whether the recordbatch had fields, but it doesn't seem to be an issue with there being no fields

        if filtered.num_columns() > 0 {
            Ok(filter_record_batch(&filtered, &BooleanArray::from(keep))?)
        } else {
            Ok(filtered)
        }

Also not entirely sure, what we can do on our end here. With another failure I was able to swap out the function for StructArray to try_new_with_length

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions