(#10265) fix caching soft_budget

[yeahyung]

fix caching soft_budget

Relevant issues

• [Bug]: fix caching soft_budget #10265

Pre-Submission checklist

Please complete all items before asking a LiteLLM maintainer to review your PR

• I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
• I have added a screenshot of my new test passing locally
• My PR passes all unit tests on (make test-unit)[https://docs.litellm.ai/docs/extras/contributing_code]
• My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🐛 Bug Fix

Changes

I think keys in different team or user have to send each alert if they exceed soft_budget

ex) team1 with virtual key1 / team2 with virtual key2
if virtual key1 exceed soft budget, send alert
if virtual key2 exceed soft budget, send alert too, because they are in different team.
but current logic, it sends alert only once since they might have same cache key

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Apr 24, 2025 8:54am