Skip to content

v0.6.0 Beta

Choose a tag to compare

View all tags
@LSeu-Open LSeu-Open released this 18 Jul 12:17
· 5 commits to main since this release
v0.6.0-Beta
90ef8eb
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

LLMScoreEngine v0.6.0 - New Feature & Enhanced Technical Scoring

This update introduces a powerful Command Line Interface (CLI) feature to the LLM-Score-Engine, enabling the generation of comprehensive graphical reports from model evaluation data. The new functionality allows users to produce detailed, visually rich analyses of their models' performance metrics.

New Feature: Graphical Reporting

  • Graphical Report (--graph):
    Generate an in-depth graphical report from your latest CSV output (via --csv option) with a single command.
    This interactive report includes:
    • An intuitive and interactive Leaderboard for comparing LLM performances
    • A Model Comparison Tool for detailed side-by-side analysis
    • Cost/Efficiency-Performance metrics Leaderboard
    • Comprehensive graphical exploration of all evaluation metrics produced by the engine

Enhanced Technical Scoring Methodology

  • The JSON model configuration files now support both input and output pricing specifications for all models.
  • This expanded pricing data enables a more accurate, real-world technical scoring methodology that better reflects actual operational costs.
Assets 2
Loading