Azure AI Foundry
-
|
I am migrating to the new azure foundry project (no hub). I have custom evaluators (code-based) in my old hub for things like total latency, tokens, costs, tool call success, etc. How do we use custom evaluators in the new foundry projects? According to this the old method doesn't work and I don't see in the docs how to do this in the new projects.
|
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
Thanks, @hayescode, for reaching out! We're actively working on enabling support for custom evaluators in Foundry Projects. While the effort is still in the early design phase, it's an exciting direction we're committed to. Although we don’t have an ETA just yet, we’ll be sharing updates through azure-ai-projects SDK, so stay tuned! |
Beta Was this translation helpful? Give feedback.
-
|
Useful resources Samples for the Project type Azure AI Foundry Project Type Evaluation Samples Breaking Changes Log |
Beta Was this translation helpful? Give feedback.
Thanks, @hayescode, for reaching out! We're actively working on enabling support for custom evaluators in Foundry Projects. While the effort is still in the early design phase, it's an exciting direction we're committed to. Although we don’t have an ETA just yet, we’ll be sharing updates through azure-ai-projects SDK, so stay tuned!