docs/integrations/retrievers/bm25/

[giscus[bot]]

docs/integrations/retrievers/bm25/

BM25 (Wikipedia) also known as the Okapi BM25, is a ranking function used in information retrieval systems to estimate the relevance of documents to a given search query.

https://python.langchain.com/docs/integrations/retrievers/bm25/

[hackerdjaKODJO]

I wonder if Langchain currently supports BM25S, an ultrafast Python implementation of BM25 that leverages Scipy sparse matrices for efficient text retrieval. BM25S significantly outperforms other BM25 implementations in terms of speed and memory usage, and it offers a simple and flexible API, supports various BM25 variants, and integrates seamlessly with Hugging Face for model sharing and community use. If BM25S is not yet supported, I would like to request its inclusion as a feature in Langchain. The integration of BM25S would greatly enhance the performance and flexibility of text retrieval tasks within Langchain.