azure-ai-evaluation: Intent Resolution Evaluator not recognized despite being listed as built-in in AI Projects SDK

[ManniArora]

• Package Name: azure-ai-projects
• Package Version: azure-ai-projects==1.0.0b11
• Operating System: Windows
• Python Version: Python3.12

Describe the bug
Unable to run intent resolution evaluator using azure-ai-projects. I noticed that evaluators like Intent Resolution and Task Adherence are not present in the Evaluator library, yet the SDK includes EvaluatorIds for them as if they are built-in e.g., INTENT_RESOLUTION = "azureai://built-in/evaluators/intent_resolution". This mismatch is quite confusing. It would be helpful to get a list of evaluators that are supported for cloud evaluation vs local evaluation.

To Reproduce
Steps to reproduce the behavior:

evaluator = EvaluatorConfiguration(
                id=EvaluatorIds.INTENT_RESOLUTION.value,
                init_params={"deployment_name": deployment_name},
            )

Expected behavior
Intent Resolution Evaluator should be used to evaluate the data.

Screenshots

Additional context
Add any other context about the problem here.

[github-actions]

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @dargilco @glharper @howieleung @jhakulin @nick863 @trangevi.

[swathipil]

Hi @ManniArora - Thanks for opening an issue and your detailed report! We'll take a look asap.