How to use distributed index with FAISSDocumentStore

[lpi-tn]

Hi everybody,
My team actually considering use of HayStack for the industrialization of our product.
But because of our architecture we need to use the ability of FAISS to distribute index file along multiple servers.

How HayStack handle this case ?

[bogdankostic]

Copy of @anakin87's answer on our Discord server:

I have the impression is that the desired feature is supported by https://github.com/facebookresearch/distributed-faiss and not by the original FAISS library.

Haystack's FAISSDocumentStore is built upon the original FAISS library.

For this type of features, I would suggest more modern vector databases such as Qdrant (https://qdrant.tech/documentation/distributed_deployment/) which integrates with Haystack.

In any case, I am not an expert on this topic.

[lpi-tn]

Thanks, this answer is very interesting and relaunch vector database debate in our team.