Skip to content

Commit d1d50b6

Browse files
philschmideldarkurticmarkurtz
authored
FIX TGI example (#51)
Co-authored-by: Eldar Kurtic <eldarkurtic314@gmail.com> Co-authored-by: Mark Kurtz <mark.kurtz@neuralmagic.com>
1 parent 1409245 commit d1d50b6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,7 @@ GuideLLM requires an OpenAI-compatible server to run evaluations. [Text Generati
6464

6565
```bash
6666
docker run --gpus 1 -ti --shm-size 1g --ipc=host --rm -p 8080:80 \
67-
-e MODEL_ID=https://huggingface.co/llhf/Meta-Llama-3.1-8B-Instruct \
67+
-e MODEL_ID=meta-llama/Meta-Llama-3.1-8B-Instruct \
6868
-e NUM_SHARD=1 \
6969
-e MAX_INPUT_TOKENS=4096 \
7070
-e MAX_TOTAL_TOKENS=6000 \

0 commit comments

Comments
 (0)