File tree 2 files changed +5
-5
lines changed
2 files changed +5
-5
lines changed Original file line number Diff line number Diff line change 20
20
down :
21
21
$(DOCKER ) compose down
22
22
23
- % :
23
+ llama-3-8b :
24
24
cd models && ../docker-entrypoint.sh $@
Original file line number Diff line number Diff line change @@ -38,10 +38,10 @@ for the complete list of server options.
38
38
39
39
The [ ` docker-entrypoint.sh ` ] ( docker-entrypoint.sh ) has targets for downloading
40
40
popular models. Run ` ./docker-entrypoint.sh --help ` to list available models.
41
- Download models by running ` ./docker-entrypoint.sh <model> ` or ` make <model>`
42
- where ` <model> ` is the name of the model. By default, these will download the
43
- ` _Q5_K_M.gguf ` versions of the models. These models are quantized to 5 bits
44
- which provide a good balance between speed and accuracy.
41
+ Download models by running ` ./docker-entrypoint.sh <model> ` where ` <model> ` is
42
+ the name of the model. By default, these will download the ` _Q5_K_M.gguf `
43
+ versions of the models. These models are quantized to 5 bits which provide a
44
+ good balance between speed and accuracy.
45
45
46
46
Confused about which model to use? Below is a list of popular models, ranked by
47
47
[ ELO rating] ( https://en.wikipedia.org/wiki/Elo_rating_system ) . Generally, the
You can’t perform that action at this time.
0 commit comments