Skip to content

Conversation

@mattzh72
Copy link
Collaborator

  • Split GraderSpec into ToolGraderSpec, ModelJudgeGraderSpec, LettaJudgeGraderSpec with shared BaseGraderSpec
  • Union type discriminated by kind field using Annotated[Union[...], Field(discriminator='kind')]
  • Validation logic moved from init to @model_validator per class
  • Required fields now typed correctly (not Optional when required)
  • Updated runner.py to use isinstance() checks instead of kind == comparisons
  • Updated tests/test_examples_e2e_live.py and visualization/factory.py to use isinstance()
  • Backward compatible: YAML configs unchanged

@mattzh72 mattzh72 merged commit bb21f1b into main Oct 22, 2025
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants