Skip to content

Commit ebfff97

Browse files
committed
docs responses routing
1 parent a7db0df commit ebfff97

File tree

1 file changed

+0
-7
lines changed

1 file changed

+0
-7
lines changed

docs/my-website/docs/response_api.md

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -631,10 +631,3 @@ follow_up = client.responses.create(
631631

632632
</TabItem>
633633
</Tabs>
634-
635-
#### How It Works
636-
637-
1. When a user makes an initial request to the Responses API, LiteLLM caches which model deployment that returned the specific response. (Stored in Redis if you connected LiteLLM to Redis)
638-
2. When a subsequent request includes `previous_response_id`, LiteLLM automatically routes it to the same deployment
639-
3. If the original deployment is unavailable, or if the `previous_response_id` isn't found in the cache, LiteLLM falls back to normal routing
640-

0 commit comments

Comments
 (0)