We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 1409245 commit d1d50b6Copy full SHA for d1d50b6
README.md
@@ -64,7 +64,7 @@ GuideLLM requires an OpenAI-compatible server to run evaluations. [Text Generati
64
65
```bash
66
docker run --gpus 1 -ti --shm-size 1g --ipc=host --rm -p 8080:80 \
67
- -e MODEL_ID=https://huggingface.co/llhf/Meta-Llama-3.1-8B-Instruct \
+ -e MODEL_ID=meta-llama/Meta-Llama-3.1-8B-Instruct \
68
-e NUM_SHARD=1 \
69
-e MAX_INPUT_TOKENS=4096 \
70
-e MAX_TOTAL_TOKENS=6000 \
0 commit comments