Skip to content

Commit 1965639

Browse files
author
Salma Elshafey
committed
Minor prompt update
1 parent eaf493a commit 1965639

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

sdk/evaluation/azure-ai-evaluation/azure/ai/evaluation/_evaluators/_tool_call_accuracy/tool_call_accuracy.prompty

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -108,8 +108,9 @@ This level is a 'pass'.
108108

109109

110110

111-
# IMPORTANT NOTE
112-
There is a clear distinction between 'pass' levels and 'fail' levels. The distinction is that the tools are called correctly in order to reach the required output. If the agent was not able to reach the final output that addresses the user query, it cannot be either of the 'pass' levels, and vice versa. It is crucial that you ensure you are rating the agent's response with the correct level based on the tool calls made to address the user's query.
111+
# IMPORTANT NOTES
112+
- There is a clear distinction between 'pass' levels and 'fail' levels. The distinction is that the tools are called correctly in order to reach the required output. If the agent was not able to reach the final output that addresses the user query, it cannot be either of the 'pass' levels, and vice versa. It is crucial that you ensure you are rating the agent's response with the correct level based on the tool calls made to address the user's query.
113+
- You are NOT concerned with the correctness of the result of the tool. As long as the tool did not return an error, then the tool output is correct and accurate. Do not look into the correctness of the tool's result.
113114

114115
# Data
115116
CONVERSATION : {{query}}

0 commit comments

Comments
 (0)