Load balancing docs say that "[Setting weight] works across ALL routing strategies.", but that's not true

[hnykda]

...at least I think so, or am I missing anything?

https://docs.litellm.ai/docs/routing#weighted-deployments

but when I checked https://github.com/BerriAI/litellm/blob/main/litellm/router.py, I don't see the weight being used in e.g. https://github.com/BerriAI/litellm/blob/main/litellm/router_strategy/lowest_tpm_rpm_v2.py#L30 in any way (usage-based-routing-v2)

[krrishdholakia]

My bad - i confused 'weight' with 'order' -

litellm/litellm/router.py

Line 5677 in c2f01b0

## ORDER FILTERING ## -> if user set 'order' in deployments, return deployments with lowest order (e.g. order=1 > order=2)

which is supported as a pre-call filter

[krrishdholakia]

Fixed here - 9860a4e