Skip to content

Commit 3dd3591

Browse files
authored
[Docs] Update EAGLE example (#20375)
Signed-off-by: NickLucche <nlucches@redhat.com>
1 parent 657f2f3 commit 3dd3591

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

docs/features/spec_decode.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -201,6 +201,7 @@ an [EAGLE (Extrapolation Algorithm for Greater Language-model Efficiency)](https
201201
speculative_config={
202202
"model": "yuhuili/EAGLE-LLaMA3-Instruct-8B",
203203
"draft_tensor_parallel_size": 1,
204+
"num_speculative_tokens": 2,
204205
},
205206
)
206207

0 commit comments

Comments
 (0)