Replies: 1 comment 1 reply
-
Add |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I am running "Meta-Llama-3.1-8B-Instruct-f32.gguf" size is 32GB.
RAM size is 64GB
After load llama-cli.exe uses 16GB according process explorer.
also in the log
so how to run in float32 mode?
Beta Was this translation helpful? Give feedback.
All reactions