A repository for HySQA: Hybrid Scholarly Question Answering Dataset paper.
The following resources are shared or hosted by us:
In case you want to host the KGs on your system, download the triples from the following Google Drive link.
Codalab computes two metrics when you upload your answers to the test set questions:
-
Exact Match
-
F-score
The evaluation script can be found here.
The Scholarly Hybrid QA challenge at ISWC 2024 test set split (which contains 702 questions) is found [https://github.com/semantic-systems/hysqa/blob/main/data/hysqa_test_set.json].
If you want to test your model please follow the instructions in Codalab Page.