Release dataset on Hugging Face (with gated access)

[NielsRogge]

Hi @FHR-L,

Niels here from the open-source team at Hugging Face. I discovered your work through ECCV, congrats on getting it accepted! I indexed the paper here: https://huggingface.co/papers/2408.07500 (feel free to claim it with your HF account). I work together with AK on improving the visibility of researchers' work on the hub.

It'd be great to make the dataset available on the 🤗 hub, we can add tags so that people find them when filtering https://huggingface.co/datasets, so that people can do:

from datasets import load_dataset

dataset = load_dataset("your-hf-username-or-organization/your-dataset")

See here for a guide: https://huggingface.co/docs/datasets/image_dataset.

There's then also the dataset viewer which allows people to see the first few rows in the browser: https://huggingface.co/docs/hub/en/datasets-viewer.

This would make the dataset easier accessible, and also discoverable. We can then also link the dataset to the paper page.

Gating mechanism

We support gating (similar to how this works for llama/mistral models), so that you can manually review who can access the dataset: https://huggingface.co/docs/hub/en/datasets-gated. See FineVideo (a video dataset created by HF) as an example: https://huggingface.co/datasets/HuggingFaceFV/finevideo.

Let us know if you need any help.

Cheers,

Niels
ML Engineer @ HF 🤗