You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/my-website/docs/proxy/architecture.md
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -13,7 +13,7 @@ import TabItem from '@theme/TabItem';
13
13
14
14
1.**User Sends Request**: The process begins when a user sends a request to the LiteLLM Proxy Server (Gateway).
15
15
16
-
2.[**Virtual Keys**](../virtual_keys): At this stage the `Bearer` token in the request is checked to ensure it is valid and under it's budget
16
+
2.[**Virtual Keys**](../virtual_keys): At this stage the `Bearer` token in the request is checked to ensure it is valid and under it's budget. [Here is the list of checks that run for each request](https://github.com/BerriAI/litellm/blob/ba41a72f92a9abf1d659a87ec880e8e319f87481/litellm/proxy/auth/auth_checks.py#L43)
17
17
18
18
3.**Rate Limiting**: The [MaxParallelRequestsHandler](https://github.com/BerriAI/litellm/blob/main/litellm/proxy/hooks/parallel_request_limiter.py) checks the **rate limit (rpm/tpm)** for the the following components:
19
19
- Global Server Rate Limit
@@ -34,4 +34,4 @@ import TabItem from '@theme/TabItem';
34
34
- Virtual Key Rate Limit
35
35
- User Rate Limit
36
36
- Team Limit
37
-
- The `_PROXY_track_cost_callback` updates spend / usage in the LiteLLM database.
37
+
- The `_PROXY_track_cost_callback` updates spend / usage in the LiteLLM database.[Here is everything tracked in the DB per request](https://github.com/BerriAI/litellm/blob/ba41a72f92a9abf1d659a87ec880e8e319f87481/schema.prisma#L172)
0 commit comments