Investigate cases of non-synchronization between node and proxy #341
Description
This seems to happen only in the case of confidential compute endpoints, when we drop stream connection (ctrl+c) before response completion. The normal chat completion endpoint seems fine.
Metadata
Metadata
Assignees
Labels
No labels