Skip to content

Is there a way for vllm to cancel this inference when I call the/chat/completeness interface? #7180

fu1996 announced in Q&A
Is there a way for vllm to cancel this inference when I call the/chat/completeness interface? #7180
@fu1996 fu1996
Aug 6, 2024 · 1 comment
Return to top
Discussion options

fu1996
Aug 6, 2024

You must be logged in to vote

Replies: 1 comment

Comment options

datalee
Aug 12, 2024

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants
@fu1996 @datalee