Accessing data about generation using Ollama + Outlines? #1686
Unanswered
cd-jocelyn-z
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
When I use the Ollama library without Outlines, I can easily do
response.model_dump( )
to get the data about the generation.This doesn't seem to be the case when using Outlines. The response is a string (not a Pydantic object) and does not have any info I'd get when using Ollama + Pydantic alone.
Beta Was this translation helpful? Give feedback.
All reactions