LiteLLM Permission Management Roadmap - MCPs, Vector Store

[krrishdholakia]

The Feature

Starting this to discuss LiteLLM Permission Management Roadmap

• OpenAI/Azure support for Vector Stores
• Permission Management for MCPs
• Streamable MCP support
• Make File Search on Responses API private to each team/key

Just do a +1 [feature] for any you find interesting, or add one below

[harvardfly]

@krrishdholakia
Additionally, I hope that MCP can support the following capabilities:

1. Add the LiteLLM proxy MCP service address, which allows direct access to an MCP service via the LiteLLM path instead of using tools.
2. Rate limiting at the MCP service level and the API key level.
3. Monitoring for MCP services and invocation information, integrated with Prometheus.