Issue with Eval Sets/Cases

[TooGoodDT]

I created a few different eval sets/cases through the adk web dev ui. However, when I try to run these said eval sets that have been created through the server I get the following error:

Traceback (most recent call last):
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/uvicorn/protocols/http/h11_impl.py", line 403, in run_asgi
result = await app( # type: ignore[func-returns-value]
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in call
return await self.app(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/applications.py", line 112, in call
await self.middleware_stack(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/errors.py", line 187, in call
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/errors.py", line 165, in call
await self.app(scope, receive, _send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/middleware/exceptions.py", line 62, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 714, in call
await self.middleware_stack(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 734, in app
await route.handle(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 288, in handle
await self.app(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 76, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
raise exc
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
await app(scope, receive, sender)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/starlette/routing.py", line 73, in app
response = await f(request)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/routing.py", line 301, in app
raw_response = await run_endpoint_function(
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/fastapi/routing.py", line 212, in run_endpoint_function
return await dependant.call(**values)
File "/Users//Desktop/agent_poc/.agent_poc/lib/python3.9/site-packages/google/adk/cli/fast_api.py", line 470, in run_eval
await run_evals(
TypeError: object async_generator can't be used in 'await' expression

[boyangsvl]

Which version of ADK are you using?

[TooGoodDT]

I'm running it through Vertex AI & everything else is handled by adk web except for the necessary definitions: agent, tools, etc, and they work fine on their own. I haven't edited run eval or anything that might mess it up as well so not too sure what's happening here. Anything code you might need from my end to help you out?

[TooGoodDT]

Issue is the same as the currently open issue request "eval function is broken #651"

[mutaphore]

I received a similar issue with async, and upgrading to google-adk==1.0.0 seemed to do the trick