Using ollama. It works, but very slow. Are all prompts executing a new api call? #626
Unanswered
jlacour-git
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
First of all let me say “THANK YOU” for this tool. I am still trying to get it working stably, but I love the idea and really appreciate the effort.
Basically all works fine using a local ollama install. But I noticed the runtime to generate title etc. is substantially longer than other ways to call.
I looked at the prompts. Is it possible, that each prompt generates a completely new API call with a fresh transmit of the document?
Wouldn’t it be more efficient to send the document once and one prompt that defines all the work to be done?
Beta Was this translation helpful? Give feedback.
All reactions