Skip to content
This repository was archived by the owner on Mar 23, 2025. It is now read-only.

v0.1.0

Latest
Latest

Choose a tag to compare

View all tags
@AJDERS AJDERS released this 22 Feb 13:29
· 56 commits to main since this release
v0.1.0
764663f
This commit was signed with the committer’s verified signature.
AJDERS Anders Jess Pedersen
GPG key ID: 58AC504476102734
Verified
Learn about vigilant mode.

[v0.1.0] - 2023-02-22

Added

  • Support for evaluation of local Hugging Face models.
  • Tests for the question_answering-task.
  • The automatic_speech_recognition-task.
  • Util functions, leaderboard_utils, for interacting with the associated REST-api which interacts with the leaderboard holding the evaluation results.
  • A new function in the evaluator module, called _send_results_to_leaderboard which sends evaluation results to the leaderboard using the util functions from leaderboard_utils, and tests for this function and leaderboard_utils.
  • The discourse-coherence-task.
  • Support for integer labels.
Assets 2
Loading