-
Notifications
You must be signed in to change notification settings - Fork 2
Pre release Checklist
Graham Neubig edited this page May 16, 2022
·
5 revisions
We should check at least the following things before making a release:
- The dataset page displays and can be scrolled through
- The system page displays and can be scrolled through
- Both pages above can also be viewed when not logged in (in an incognito window)
- It is possible to submit the SST2 example, analysis works, and error cases are displayed (tests text classification): https://github.com/neulab/ExplainaBoard/tree/main/data/system_outputs/sst2
- It is possible to submit the ConLL example, analysis works, and error cases are displayed (tests sequence labeling): https://github.com/neulab/ExplainaBoard/tree/main/data/system_outputs/conll2003
- It is possible to submit the CoNaLa example, analysis works, and error cases are displayed (tests seq2seq): https://github.com/neulab/ExplainaBoard/tree/main/data/system_outputs/conala