What is gqa? #3016
Closed
ianscrivener
started this conversation in
General
What is gqa?
#3016
Replies: 1 comment
-
|
Self-answered thanks to @ScarletEmerald "-gqa used to be needed when loading Llama2 70B model, but in the current code with the new GGUF format it is no longer used." |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Can't find any documentation on a
gqacommand line argument for it... though seems to be a C++ code variables.Beta Was this translation helpful? Give feedback.
All reactions