Skip to content

Commit 6fb1624

Browse files
authored
[doc] fix ordered list issue (#20819)
Signed-off-by: reidliu41 <reid201711@gmail.com>
1 parent 6617718 commit 6fb1624

File tree

1 file changed

+6
-6
lines changed

1 file changed

+6
-6
lines changed

docs/features/spec_decode.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -256,12 +256,12 @@ speculative decoding, breaking down the guarantees into three key areas:
256256
2. **Algorithmic Losslessness**
257257
\- vLLM’s implementation of speculative decoding is algorithmically validated to be lossless. Key validation tests include:
258258

259-
> - **Rejection Sampler Convergence**: Ensures that samples from vLLM’s rejection sampler align with the target
260-
> distribution. [View Test Code](https://github.com/vllm-project/vllm/blob/47b65a550866c7ffbd076ecb74106714838ce7da/tests/samplers/test_rejection_sampler.py#L252)
261-
> - **Greedy Sampling Equality**: Confirms that greedy sampling with speculative decoding matches greedy sampling
262-
> without it. This verifies that vLLM's speculative decoding framework, when integrated with the vLLM forward pass and the vLLM rejection sampler,
263-
> provides a lossless guarantee. Almost all of the tests in <gh-dir:tests/spec_decode/e2e>.
264-
> verify this property using [this assertion implementation](https://github.com/vllm-project/vllm/blob/b67ae00cdbbe1a58ffc8ff170f0c8d79044a684a/tests/spec_decode/e2e/conftest.py#L291)
259+
> - **Rejection Sampler Convergence**: Ensures that samples from vLLM’s rejection sampler align with the target
260+
> distribution. [View Test Code](https://github.com/vllm-project/vllm/blob/47b65a550866c7ffbd076ecb74106714838ce7da/tests/samplers/test_rejection_sampler.py#L252)
261+
> - **Greedy Sampling Equality**: Confirms that greedy sampling with speculative decoding matches greedy sampling
262+
> without it. This verifies that vLLM's speculative decoding framework, when integrated with the vLLM forward pass and the vLLM rejection sampler,
263+
> provides a lossless guarantee. Almost all of the tests in <gh-dir:tests/spec_decode/e2e>.
264+
> verify this property using [this assertion implementation](https://github.com/vllm-project/vllm/blob/b67ae00cdbbe1a58ffc8ff170f0c8d79044a684a/tests/spec_decode/e2e/conftest.py#L291)
265265
266266
3. **vLLM Logprob Stability**
267267
\- vLLM does not currently guarantee stable token log probabilities (logprobs). This can result in different outputs for the

0 commit comments

Comments
 (0)