Skip to content

Feature Request: Add interactive cost vs performance chart view for polyglot leaderboard #4237

@engnadeau

Description

@engnadeau

I want an interactive scatter plot visualization that complements the existing polyglot leaderboard table and shows the relationship between model cost and performance.

Problem

The current leaderboard table is excellent for detailed comparisons, but it's difficult to visualize cost-performance trade-offs across models quickly. Users must mentally compare the cost and pass rate columns to identify models that offer good value or understand the performance spectrum at different price points.

Proposed Solution

Create a new chart page (e.g., /docs/leaderboards/polyglot-chart.html) that displays:

  • Scatter plot with cost (x-axis, logarithmic scale) vs pass rate (y-axis)
  • Colour coding by edit format (diff=blue, whole=red, architect=teal)
  • Interactive tooltips showing model details on hover
  • Search/filter functionality to focus on specific models
  • Navigation links between table and chart views

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions