External Rerank via API / Litellm

[vaclcer]

Hi, is there a way how to re-rank remotely, for example via reranker deployed in vLLM or via Litellm?

As far as I know there is SentenceTransformersSimilarityRanker for local reranking, there is Cohere/Jina external rerankers... but not for Rerank API like https://docs.litellm.ai/docs/rerank Thanks!

[vaclcer]

Now I see that Litellm: "follows the cohere api request / response for the rerank api".

And "api_base_url" in CohereRanker can be changed, so it should work in theory.. 🤔