Replies: 1 comment
-
Good idea to bring it up! I opened #1081 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi, I've notice that "normal" chat model produce a set of
gen_ai*
metrics. But I've been unable to use them with streaming models. Also when we use a combination of Mutiny StreamingResponseHandler I'm almost sure that it can't be done.My question is, how can I add metrics to a streaming model even if need to instantiate them? I've found the
MetricsChatModelListener
class but I can't find a way to put it together with the streaming model interface.Beta Was this translation helpful? Give feedback.
All reactions