Does ai-rate-limiting have to be used in conjunction with ai-proxy or ai-proxy-multi?

[renshunhang]

Does ai-rate-limiting have to be used in conjunction with ai-proxy or ai-proxy-multi?

[dosubot[bot]]

ai-rate-limiting does not have a hardcoded dependency on ai-proxy or ai-proxy-multi, but in practice, it needs to be used with one of these (or a similar plugin) to function correctly. This is because ai-rate-limiting relies on the request context variable ctx.picked_ai_instance_name, which is set by ai-proxy or ai-proxy-multi. Without this context, ai-rate-limiting cannot enforce rate limits as intended. All official documentation and examples show ai-rate-limiting used together with ai-proxy or ai-proxy-multi, not standalone. For more details, see the ai-rate-limiting plugin documentation and the plugin implementation.

To reply, just mention @dosu.

---

^{How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other}