Unload model from memory #16183
Unanswered
aaronbolton
asked this question in
Q&A
Unload model from memory
#16183
Replies: 3 comments
-
|
Looking for the same. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Also looking for how to properly unload a model for the purpose of batch-generating over multiple models without needing to keep the X number of previous models in memory. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
bump |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Is there an option to timeout the model from VRAM like ollamas OLLAMA_KEEP_ALIVE
Beta Was this translation helpful? Give feedback.
All reactions