[Bug]: The current mcp tool list interface is too slow

[sxueck]

What happened?

The current tool acquisition interface synchronizes with the upstream SSE server every time, causing the MCP refresh to be exceptionally slow whenever a tool is added or tested. Is it possible to improve this situation?

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.12.1

Twitter / LinkedIn details

No response

[krrishdholakia]

cc: @wagnerjt

[sxueck]

If the upstream SSE server connection is good, the response rate of the /tool/list interface is currently acceptable. I feel this issue might not be urgent?

[wagnerjt]

Totally understand that is the behaviour at the moment. Once we add the additional MCP support it will be easier to optimise and improve tool calls like this. Especially once we have support for passing authentication to external MCP servers