How to spatially concatenate (along latitude and longitude) using open_virtual_mfdataset
#655
Unanswered
PouriaRezz
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi Virtualizarr team,
I'm testing Virtualizarr for the first time and would like to virtually concatenate a large collection of NetCDF (.nc) files hosted remotely (over HTTP) without loading any data into memory. Here's what I'm doing:
Unfortunately, I run into this error:
From the traceback, it seems like xarray tries to call
.compute()
or.load()
internally during thecombine_by_coords
logic.I also tried without the data_vars/coords arguments:
But then i get:
My Understanding:
Virtualizarr is meant to allow lazy access without loading data. But
xarray.combine_by_coords
tries to compare variables internally using.compute()
, which causesManifestArray
to break because it's not integrated with any known chunk managerQuestion:
Is it possible to concatenate these files fully lazily, i.e., without triggering any
.compute()
or.load()
on the underlying arrays?Let me know if I'm missing something or if you have an idea how to do it right i would be happy to hear it
Beta Was this translation helpful? Give feedback.
All reactions