Commit 87be51e

committed

[V1] Support ngram spec decode

Signed-off-by: ponix-j <657511300@qq.com>

1 parent fd515cd commit 87be51eCopy full SHA for 87be51e

11 files changed

+1711

-28

lines changed

tests
- sample
  - __init__.py
  - test_rejection_sampler.py
- singlecard/spec_decode/e2e
  - test_spec_decode.py
vllm_ascend
- attention
  - attention_v1.py
- patch/spec_decode
  - __init__.py
  - patch_common
    - __init__.py
    - eagle.py
- sample
  - __init__.py
  - rejection_sampler.py
- utils.py
- worker
  - model_runner_v1.py

11 files changed

+1711

-28

lines changed

`‎tests/sample/init.py`

Original file line number	Diff line number	Diff line change
`@@ -0,0 +1 @@`
	`1`	`+`

Comments

(0)