Openai compatiblity for Rerank models

[Yiqian-Liu]

Feature request

Will TEI support openai compatible route and request body schema / response body schema for Rerank models?

Motivation

For better compatibility.

Your contribution

Looking forward to this new feature.

[alvarobartt]

Hey @Yiqian-Liu thanks for opening the issue and the interest! Could you point us to the OpenAI Documentation for such API? I could only see the ranking features mentioned around the Vector Stores, which might not be suitable in this case, so asking just in case.

Also note that Text Embeddings Inference (TEI) already supports the v1/embeddings route for creating embeddings with embedding models as per https://huggingface.github.io/text-embeddings-inference/#/Text%20Embeddings%20Inference/openai_embed.

Thanks in advance 🤗