We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 231a5e4 commit c5a0d57Copy full SHA for c5a0d57
examples/server/tests/features/cancel.feature
@@ -18,10 +18,8 @@ Feature: Cancellation of llama.cpp server requests
18
And 64 server max tokens to predict
19
And prometheus compatible metrics exposed
20
And 300 milliseconds delay in sampler for testing
21
- And no warmup
22
Then the server is starting
23
Then the server is healthy
24
- # Then the server is healthy with timeout 10 seconds
25
26
27
Scenario Outline: Cancelling an OAI chat completion request frees up slot (streaming <enable_streaming>)
0 commit comments