v1.70.1.dev8

What's Changed

• add docs for spend logs by @jugaldb in #10913
• [QA/Guardrails] Allow editing guardrail entity configs by @ishaan-jaff in #10918
• [UI QA Guardrails] - Minor UI Fixes by @ishaan-jaff in #10920
• [CI/CD] Fix - linting cryptography error by @ishaan-jaff in #10921
• LiteLLM Stable release notes by @krrishdholakia in #10919
• docs apply guardrail endpoint by @ishaan-jaff in #10923
• [Docs] Pii masking with LiteLLM by @ishaan-jaff in #10924
• Add provider Featherless AI (access to 4200+ models) by @DarinVerheijke in #10596
• fix(vertex_llm_base.py): remove quota_project_id parameter from crede… by @krrishdholakia in #10915
• Enable structured JSON schema outputs in LM Studio by @estsauver in #10929
• update sambanova models and parameters by @jhpiedrahitao in #10900
• Fix Cohere Rerank Provider by @keyute in #10822
• add skip server startup flag to cli by @mohittalele in #10665
• Allow passed in vertex_ai credentials to be authorized_user type by @pselden in #10899
• fix: handle DB_USER, DB_PASSWORD, DB_HOST problem I faced, since this… by @unrealandychan in #10842
• Add keys and members count in team info by @NANDINI-star in #10950
• Update github.md by @dastaiger in #10946
• docs: add llms.txt and llms_full.txt for LLM-friendly scraping by @colesmcintosh in #10961
• [Fix] Invitation Email does not include the invitation link by @ishaan-jaff in #10958

New Contributors

• @DarinVerheijke made their first contribution in #10596
• @estsauver made their first contribution in #10929
• @mohittalele made their first contribution in #10665
• @pselden made their first contribution in #10899
• @unrealandychan made their first contribution in #10842
• @dastaiger made their first contribution in #10946

Full Changelog: v1.70.1-stable...v1.70.1.dev8

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.70.1.dev8

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name	Status	Median Response Time (ms)	Average Response Time (ms)	Requests/s	Failures/s	Request Count	Failure Count	Min Response Time (ms)	Max Response Time (ms)
/chat/completions	Failed ❌	490.0	562.6894453097084	5.610163428556303	0.0033413719050365115	1679	1	195.35745899997892	1568.1852209999647
Aggregated	Failed ❌	490.0	562.6894453097084	5.610163428556303	0.0033413719050365115	1679	1	195.35745899997892	1568.1852209999647