File tree Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Expand file tree Collapse file tree 1 file changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -123,10 +123,10 @@ You can consume the endpoints with Postman or NodeJS with axios library. You can
123
123
### Docker
124
124
125
125
``` bash
126
- docker run -p 8080:8080 -v /path/to/models:/models ggerganov/llama.cpp:server -m models/7B/ggml-model.gguf -c 512 --host 0.0.0.0 --port 8080
126
+ docker run -p 8080:8080 -v /path/to/models:/models ghcr.io/ ggerganov/llama.cpp:server -m models/7B/ggml-model.gguf -c 512 --host 0.0.0.0 --port 8080
127
127
128
128
# or, with CUDA:
129
- docker run -p 8080:8080 -v /path/to/models:/models --gpus all ggerganov/llama.cpp:server-cuda -m models/7B/ggml-model.gguf -c 512 --host 0.0.0.0 --port 8080 --n-gpu-layers 99
129
+ docker run -p 8080:8080 -v /path/to/models:/models --gpus all ghcr.io/ ggerganov/llama.cpp:server-cuda -m models/7B/ggml-model.gguf -c 512 --host 0.0.0.0 --port 8080 --n-gpu-layers 99
130
130
```
131
131
132
132
## Testing with CURL
You can’t perform that action at this time.
0 commit comments