Skip to content

Zarr Streaming - hand through compressed buckets #6180

Open
@leowe

Description

@leowe

Detailed Description

Follow-up for #6144.

When using zarr remote datasets, it is possible to define a compression scheme in the .zarray file.

Currently, this feature is unused and all requested buckets are decompressed before sending them to the client. We should hand through the compressed files if possible saving time de-compressing and on the transmission. For that it is necessary to write new data request code paths that don't decompress the read buckets.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions