Commit 10bf350

committed

[V1] Support ngram spec decode

Signed-off-by: ponix-j <657511300@qq.com>

1 parent 00e0243 commit 10bf350Copy full SHA for 10bf350

12 files changed

+1698

-10

lines changed

requirements-dev.txt
tests
- sample
  - __init__.py
  - test_rejection_sampler.py
- singlecard/spec_decode/e2e
  - test_spec_decode.py
vllm_ascend
- attention
  - attention_v1.py
- patch/spec_decode
  - __init__.py
  - patch_common
    - __init__.py
    - eagle.py
- sample
  - __init__.py
  - rejection_sampler.py
- utils.py
- worker
  - model_runner_v1.py

12 files changed

+1698

-10

lines changed

`‎requirements-dev.txt`

-Original file line number
+Diff line change
 types-jsonschema
 xgrammar
 zmq
 +numba

`‎tests/sample/init.py`

Whitespace-only changes.

Comments

(0)