Skip to content

Commit 3bf6589

Browse files
committed
docs architecture
1 parent 67c1853 commit 3bf6589

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/my-website/docs/proxy/architecture.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ import TabItem from '@theme/TabItem';
1313

1414
1. **User Sends Request**: The process begins when a user sends a request to the LiteLLM Proxy Server (Gateway).
1515

16-
2. [**Virtual Keys**](../virtual_keys): At this stage the `Bearer` token in the request is checked to ensure it is valid and under it's budget
16+
2. [**Virtual Keys**](../virtual_keys): At this stage the `Bearer` token in the request is checked to ensure it is valid and under it's budget. [Here is the list of checks that run for each request](https://github.com/BerriAI/litellm/blob/ba41a72f92a9abf1d659a87ec880e8e319f87481/litellm/proxy/auth/auth_checks.py#L43)
1717

1818
3. **Rate Limiting**: The [MaxParallelRequestsHandler](https://github.com/BerriAI/litellm/blob/main/litellm/proxy/hooks/parallel_request_limiter.py) checks the **rate limit (rpm/tpm)** for the the following components:
1919
- Global Server Rate Limit
@@ -34,4 +34,4 @@ import TabItem from '@theme/TabItem';
3434
- Virtual Key Rate Limit
3535
- User Rate Limit
3636
- Team Limit
37-
- The `_PROXY_track_cost_callback` updates spend / usage in the LiteLLM database.
37+
- The `_PROXY_track_cost_callback` updates spend / usage in the LiteLLM database. [Here is everything tracked in the DB per request](https://github.com/BerriAI/litellm/blob/ba41a72f92a9abf1d659a87ec880e8e319f87481/schema.prisma#L172)

0 commit comments

Comments
 (0)