Resolvable PIDs for icechunk repos? #1044
NathanCummings
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I just want to see if anyone has any ideas or experience around this. I have a separate metadata catalogue of my zarr (soon to be icechunk) repositories to make it easier to find data. Right now, the metadata database has a field for the url pointing to the object, but I guess I may want to at some point migrate the data to some other object store. It would be nice if I had resolvable PIDs in that field instead, so it doesn't break for people if I move the data.
With DOIs, it seems to be expected that the DOI would resolve to a landing page, that might have a link to download the 'file', but it feels like it would be better to have something that resolves directly to the object (or collection of objects) in s3, so users can:
urlfield which contains a PIDicechunk.s3_storage()I guess then you'd need some way to parse out the
endpoint_url,bucket, andprefixso icechunk knew what to do with it. What would be even cooler would be if you could utilise versionable PIDs and have the PID somehow resolve to specific tags of your icechunk repo... but maybe I'm getting carried away at this point.Beta Was this translation helpful? Give feedback.
All reactions