BEIR Evaluation Datasets

[UmarEm]

Hey. What are the datasets available for Evaluation of a QA System using BEIR. Their was one that i found in the tutorial
"https://s3.eu-central-1.amazonaws.com/deepset.ai-farm-qa/datasets/nq_dev_subset_v2.json.zip"

but are their alternatives for this from deepset?

[julian-risch]

Hello @UmarEm sorry for taking so long to respond to your question. There is a long list of supported datasets already here: https://github.com/beir-cellar/beir#beers-available-datasets Therefore, we didn't add more datasets for BEIR specifically in Haystack.