Suggestions for larger models? #564
Unanswered
Anaxagoras-bc
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Most of the questions i see asking for recommendations for smaller models. I'm wondering if anyone has had any experience with larger models? Are they worth it? Have a recommendation? Right now I'm messing around with gemma3 27b and qwen3 32b.
I have a macbook with 128gb of ram, i can pretty comfortably run 32b models before things start to get too slow. And with intel pro b60 on the horizion with a 48gb (dual gpu card, bifurcated pcie card) for allegedly under $1,000, i'd happily gobble one or two of those up for a dedicated llm machine.
Beta Was this translation helpful? Give feedback.
All reactions