Does anyone have llama-65b throughput perf data on multi A100 40GB? #443
zhaoyang-star
announced in
Q&A
Replies: 1 comment 1 reply
-
|
Here's the perf data of llama65B on A100 80GB, refer to #421, hope to help. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Thanks. I had a glace at #421 , which is a very solid work. I will go deeper in the next few days. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Does anyone have llama-65b throughput perf data on multi A100 40GB?
Beta Was this translation helpful? Give feedback.
All reactions