Skip to content

Releases: BerriAI/litellm

v1.69.2-nightly

13 May 20:14
3130c4f
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v1.69.1-nightly...v1.69.2-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.69.2-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.69.2-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 230.0 261.87647271929023 6.201675294060423 0.0 1856 0 196.7134870000109 3269.9465260000125
Aggregated Passed ✅ 230.0 261.87647271929023 6.201675294060423 0.0 1856 0 196.7134870000109 3269.9465260000125

v1.69.0.dev1

12 May 22:10
51930c0
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v1.69.0-stable...v1.69.0.dev1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.69.0.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 210.0 225.99198177358326 6.202078923901813 0.0 1855 0 185.55775300001187 1628.1567700000323
Aggregated Passed ✅ 210.0 225.99198177358326 6.202078923901813 0.0 1855 0 185.55775300001187 1628.1567700000323

v1.69.1-nightly

13 May 00:05
Compare
Choose a tag to compare

What's Changed

Full Changelog: v1.69.0-stable...v1.69.1-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.69.1-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 250.0 266.2933357954668 6.193235506165493 0.0 1853 0 214.53170099999852 1247.624820999988
Aggregated Passed ✅ 250.0 266.2933357954668 6.193235506165493 0.0 1853 0 214.53170099999852 1247.624820999988

v1.69.0-stable

11 May 02:24
beae5cf
Compare
Choose a tag to compare

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:litellm_stable_release_branch-v1.69.0-stable

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 240.0 264.33108534405653 6.12787888551344 0.0 1834 0 216.09041499999648 1326.1799069999824
Aggregated Passed ✅ 240.0 264.33108534405653 6.12787888551344 0.0 1834 0 216.09041499999648 1326.1799069999824

What's Changed

Read more

v1.69.0-nightly

11 May 01:55
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v1.68.2-nightly...v1.69.0-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.69.0-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 250.0 292.69430995024163 6.184694862389694 0.0 1849 0 216.9113210000262 60025.948276999996
Aggregated Passed ✅ 250.0 292.69430995024163 6.184694862389694 0.0 1849 0 216.9113210000262 60025.948276999996

v1.68.2.dev6

09 May 23:14
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v1.68.2-nightly...v1.68.2.dev6

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.68.2.dev6

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 190.0 210.63173736431506 6.257034907859717 0.0 1872 0 166.34112399992773 1685.74146200001
Aggregated Passed ✅ 190.0 210.63173736431506 6.257034907859717 0.0 1872 0 166.34112399992773 1685.74146200001

v1.68.2-nightly

09 May 21:18
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v1.68.1.dev4...v1.68.2-nightly

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.68.2-nightly

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 190.0 223.07673508503882 6.209370359620187 0.0033419646714855688 1858 1 75.31227999999146 4978.849046000022
Aggregated Passed ✅ 190.0 223.07673508503882 6.209370359620187 0.0033419646714855688 1858 1 75.31227999999146 4978.849046000022

v1.68.1.dev4

08 May 18:22
416429e
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v1.68.1-nightly...v1.68.1.dev4

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.68.1.dev4

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 190.0 233.10816080888745 6.241336822394705 0.0 1868 0 166.93079599997418 5406.457653000075
Aggregated Passed ✅ 190.0 233.10816080888745 6.241336822394705 0.0 1868 0 166.93079599997418 5406.457653000075

v1.68.1.dev2

06 May 22:19
Compare
Choose a tag to compare

Full Changelog: v1.68.1.dev1...v1.68.1.dev2

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.68.1.dev2

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 240.0 271.34034604220733 6.1752223755996924 0.0 1848 0 206.34432800000013 5012.736279000023
Aggregated Passed ✅ 240.0 271.34034604220733 6.1752223755996924 0.0 1848 0 206.34432800000013 5012.736279000023

v1.68.1.dev1

06 May 18:25
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v1.68.0-nightly...v1.68.1.dev1

Docker Run LiteLLM Proxy

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.68.1.dev1

Don't want to maintain your internal proxy? get in touch 🎉

Hosted Proxy Alpha: https://calendly.com/d/4mp-gd3-k5k/litellm-1-1-onboarding-chat

Load Test LiteLLM Proxy Results

Name Status Median Response Time (ms) Average Response Time (ms) Requests/s Failures/s Request Count Failure Count Min Response Time (ms) Max Response Time (ms)
/chat/completions Passed ✅ 210.0 244.34719839029643 6.203411663807808 0.0 1855 0 183.31073700005618 5362.244745999988
Aggregated Passed ✅ 210.0 244.34719839029643 6.203411663807808 0.0 1855 0 183.31073700005618 5362.244745999988