zarr chunking error for long videos

[macaskill-lab]

Hi! Thanks for the amazing package! Everything is working really well for us, but we have an issue when we start to import longer acquisition videos, that seems to stem from dash, xarray or zarr - where it tries to chunk into invalid dimensions and throws an error

so e.g. at the save in your example pipeline immediately after loading the videos:

varr = save_minian( varr.chunk({"frame": chk["frame"], "height": -1, "width": -1}).rename("varr"), intpath, overwrite=True,

it throws an error:

ValueError: cannot reshape array of size 338400000 into shape (1000,600,600)

which makes sense as these are incompatible shapes. this only occurs once you get above a certain number of frames, and is completely fine with roughly 10-15 mins at 30Hz.

this is similar to this previous noted error: pydata/xarray#6640, and also some issues that are unanswered like: #229

Im going to start playing with versions - but if anyone knows a clever fix let me know!