We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent fd3f355 commit 0e7dadbCopy full SHA for 0e7dadb
README.md
@@ -176,7 +176,7 @@ pip install -r requirements.txt
176
3. Build the project
177
```bash
178
# Manually download the model and run with local path
179
-huggingface-cli download microsoft/BitNet-b1.58-2B-4T --local-dir models/BitNet-b1.58-2B-4T
+huggingface-cli download microsoft/BitNet-b1.58-2B-4T-gguf --local-dir models/BitNet-b1.58-2B-4T
180
python setup_env.py -md models/BitNet-b1.58-2B-4T -q i2_s
181
182
# Or you can download a model from Hugging Face, convert it to quantized gguf format, and build the project
0 commit comments