Skip to content

Add Reasoning and Assessment criteria to the custom_llm_as_a_judge_evaluation section #32376

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 8 commits into
base: master
Choose a base branch
from
Open

Add Reasoning and Assessment criteria to the custom_llm_as_a_judge_evaluation section #32376

wants to merge 8 commits into from
+57 −13

Conversation

@gsvigruha
Copy link
Contributor

@gsvigruha gsvigruha commented Oct 24, 2025 •
edited
Loading

What does this PR do? What is the motivation?

Add Reasoning and Assessment criteria to the custom_llm_as_a_judge_evaluation section. These are new features that should be documented.

Merge instructions

Merge readiness:

  • Ready for merge

@gsvigruha
add more byop steps
43b5232 
Signed-off-by: Greg Svigruha <gergely.svigruha@datadoghq.com>
@gsvigruha
fixes
ff389a8 
Signed-off-by: Greg Svigruha <gergely.svigruha@datadoghq.com>
@gsvigruha
nit
b0ec637
@gsvigruha gsvigruha changed the title add more byop steps Add Reasoning and Assessment criteria custom_llm_as_a_judge_evaluation Oct 24, 2025
@gsvigruha gsvigruha mentioned this pull request Oct 24, 2025
Closed
1 task
@github-actions
Copy link
Contributor

Preview links (active after the build_preview check completes)

Modified Files

@github-actions github-actions bot added the Architecture Everything related to the Doc backend label Oct 24, 2025
@github-actions github-actions bot added the Images Images are added/removed with this PR label Oct 24, 2025
@gsvigruha gsvigruha changed the title Add Reasoning and Assessment criteria custom_llm_as_a_judge_evaluation Add Reasoning and Assessment criteria to the custom_llm_as_a_judge_evaluation section Oct 24, 2025
@gsvigruha gsvigruha marked this pull request as ready for review October 24, 2025 17:37
@gsvigruha gsvigruha requested a review from a team as a code owner October 24, 2025 17:37
@maycmlee
Copy link
Contributor

Created docs review card: https://datadoghq.atlassian.net/browse/DOCS-12419

@maycmlee maycmlee added the editorial review Waiting on a more in-depth review label Oct 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

Architecture Everything related to the Doc backend editorial review Waiting on a more in-depth review Images Images are added/removed with this PR

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@gsvigruha @maycmlee