You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Please help! I'm getting this error from past 4 days, trying to solve:(((, not able to , finally posting here!
Writing this line of code, !/content/llama.cpp/llama-quantize.exe /content/quantized_model/FP16.gguf /content/quantized_model/Q4_K_M.gguf Q4_K_M
but its saying permission denied
standard code from llama cpp official doc ./llama-quantize ./models/mymodel/ggml-model-f16.gguf ./models/mymodel/ggml-model-Q4_K_M.gguf Q4_K_M
but its showing, no such file or directory, and also i dont have any file named llama-quantize.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
Please help! I'm getting this error from past 4 days, trying to solve:(((, not able to , finally posting here!
Writing this line of code,
!/content/llama.cpp/llama-quantize.exe /content/quantized_model/FP16.gguf /content/quantized_model/Q4_K_M.gguf Q4_K_M
but its saying permission denied
standard code from llama cpp official doc
./llama-quantize ./models/mymodel/ggml-model-f16.gguf ./models/mymodel/ggml-model-Q4_K_M.gguf Q4_K_M
but its showing, no such file or directory, and also i dont have any file named llama-quantize.
PLEASE PLEASE HELP ASAP!
OFFICIAL DOC

!ls -l in llama.cpp folder
total 217244
-rw-r--r-- 1 root root 34499 Jul 24 12:45 AUTHORS
drwxr-xr-x 2 root root 4096 Jul 24 12:45 ci
drwxr-xr-x 2 root root 4096 Jul 24 12:45 cmake
-rw-r--r-- 1 root root 6579 Jul 24 12:45 CMakeLists.txt
-rw-r--r-- 1 root root 2955 Jul 24 12:45 CMakePresets.json
drwxr-xr-x 3 root root 4096 Jul 24 12:45 common
-rw-r--r-- 1 root root 2218 Jul 24 12:45 CONTRIBUTING.md
-rw-r--r-- 1 root root 170281 Jul 24 12:45 convert_hf_to_gguf.py
-rw-r--r-- 1 root root 15130 Jul 24 12:45 convert_hf_to_gguf_update.py
-rw-r--r-- 1 root root 19529 Jul 24 12:45 convert_llama_ggml_to_gguf.py
-rw-r--r-- 1 root root 14775 Jul 24 12:45 convert_lora_to_gguf.py
drwxr-xr-x 4 root root 4096 Jul 24 12:45 docs
drwxr-xr-x 44 root root 4096 Jul 24 12:45 examples
-rw-r--r-- 1 root root 1614 Jul 24 12:45 flake.lock
-rw-r--r-- 1 root root 7536 Jul 24 12:45 flake.nix
drwxr-xr-x 5 root root 4096 Jul 24 12:45 ggml
drwxr-xr-x 6 root root 4096 Jul 24 12:45 gguf-py
drwxr-xr-x 2 root root 4096 Jul 24 12:45 grammars
drwxr-xr-x 2 root root 4096 Jul 24 12:45 include
-rw-r--r-- 1 root root 33478 Jul 24 12:45 libllava.a
-rw-r--r-- 1 root root 1099 Jul 24 12:45 LICENSE
-rw-r--r-- 1 root root 6046089 Jul 24 12:45 llama-baby-llama.exe
-rw-r--r-- 1 root root 6046586 Jul 24 12:45 llama-batched-bench.exe
-rw-r--r-- 1 root root 6047324 Jul 24 12:45 llama-batched.exe
-rw-r--r-- 1 root root 6164385 Jul 24 12:45 llama-bench.exe
-rw-r--r-- 1 root root 1522334 Jul 24 12:45 llama-benchmark-matmult.exe
-rw-r--r-- 1 root root 6099471 Jul 24 12:45 llama-cli.exe
-rw-r--r-- 1 root root 5183655 Jul 24 12:45 llama-convert-llama2c-to-ggml.exe
drwxr-xr-x 21 root root 4096 Jul 24 12:44 llama.cpp
-rw-r--r-- 1 root root 6066232 Jul 24 12:45 llama-cvector-generator.exe
-rw-r--r-- 1 root root 6045289 Jul 24 12:45 llama-embedding.exe
-rw-r--r-- 1 root root 6042232 Jul 24 12:45 llama-eval-callback.exe
-rw-r--r-- 1 root root 6070882 Jul 24 12:45 llama-export-lora.exe
-rw-r--r-- 1 root root 6098550 Jul 24 12:45 llama-finetune.exe
-rw-r--r-- 1 root root 6039090 Jul 24 12:45 llama-gbnf-validator.exe
-rw-r--r-- 1 root root 3296703 Jul 24 12:45 llama-gguf.exe
-rw-r--r-- 1 root root 6093183 Jul 24 12:45 llama-gguf-hash.exe
-rw-r--r-- 1 root root 6048017 Jul 24 12:45 llama-gguf-split.exe
-rw-r--r-- 1 root root 6049723 Jul 24 12:45 llama-gritlm.exe
-rw-r--r-- 1 root root 6094174 Jul 24 12:45 llama-imatrix.exe
-rw-r--r-- 1 root root 6076288 Jul 24 12:45 llama-infill.exe
-rw-r--r-- 1 root root 6345978 Jul 24 12:45 llama-llava-cli.exe
-rw-r--r-- 1 root root 6055744 Jul 24 12:45 llama-lookahead.exe
-rw-r--r-- 1 root root 6037924 Jul 24 12:45 llama-lookup-create.exe
-rw-r--r-- 1 root root 6055660 Jul 24 12:45 llama-lookup.exe
-rw-r--r-- 1 root root 6034429 Jul 24 12:45 llama-lookup-merge.exe
-rw-r--r-- 1 root root 6044742 Jul 24 12:45 llama-lookup-stats.exe
-rw-r--r-- 1 root root 6061087 Jul 24 12:45 llama-parallel.exe
-rw-r--r-- 1 root root 6053090 Jul 24 12:45 llama-passkey.exe
-rw-r--r-- 1 root root 6135809 Jul 24 12:45 llama-perplexity.exe
-rw-r--r-- 1 root root 1522389 Jul 24 12:45 llama-q8dot.exe
-rwxr-xr-x 1 root root 6064435 Jul 24 12:45 llama-quantize.exe
-rw-r--r-- 1 root root 6066488 Jul 24 12:45 llama-quantize-stats.exe
-rw-r--r-- 1 root root 6058677 Jul 24 12:45 llama-retrieval.exe
-rw-r--r-- 1 root root 6045511 Jul 24 12:45 llama-save-load-state.exe
-rw-r--r-- 1 root root 7256472 Jul 24 12:45 llama-server.exe
-rw-r--r-- 1 root root 6043682 Jul 24 12:45 llama-simple.exe
-rw-r--r-- 1 root root 6074615 Jul 24 12:45 llama-speculative.exe
-rw-r--r-- 1 root root 6042916 Jul 24 12:45 llama-tokenize.exe
-rw-r--r-- 1 root root 6075404 Jul 24 12:45 llama-train-text-from-scratch.exe
-rw-r--r-- 1 root root 1524049 Jul 24 12:45 llama-vdot.exe
-rw-r--r-- 1 root root 492828 Jul 24 12:45 main.exe
-rw-r--r-- 1 root root 51624 Jul 24 12:45 Makefile
drwxr-xr-x 2 root root 4096 Jul 24 12:45 media
drwxr-xr-x 2 root root 4096 Jul 24 12:45 models
-rw-r--r-- 1 root root 170 Jul 24 12:45 mypy.ini
-rw-r--r-- 1 root root 2123 Jul 24 12:45 Package.swift
drwxr-xr-x 3 root root 4096 Jul 24 12:45 pocs
-rw-r--r-- 1 root root 125983 Jul 24 12:45 poetry.lock
drwxr-xr-x 2 root root 4096 Jul 24 12:45 prompts
-rw-r--r-- 1 root root 1323 Jul 24 12:45 pyproject.toml
-rw-r--r-- 1 root root 549 Jul 24 12:45 pyrightconfig.json
-rw-r--r-- 1 root root 28872 Jul 24 12:45 README.md
drwxr-xr-x 2 root root 4096 Jul 24 12:45 requirements
-rw-r--r-- 1 root root 517 Jul 24 12:45 requirements.txt
drwxr-xr-x 2 root root 4096 Jul 24 12:45 scripts
-rw-r--r-- 1 root root 5157 Jul 24 12:45 SECURITY.md
-rw-r--r-- 1 root root 492828 Jul 24 12:45 server.exe
drwxr-xr-x 2 root root 4096 Jul 24 12:45 spm-headers
drwxr-xr-x 2 root root 4096 Jul 24 12:45 src
drwxr-xr-x 2 root root 4096 Jul 24 12:45 tests
MY CODE

Beta Was this translation helpful? Give feedback.
All reactions