SQLDocument Store dynamic schema?

[yemaney]

Hey guys. Want to ask a question about using haystack retrievers and document stores. I have a postgres database that store customer reviews. These tables all have different schemas, and don't follow the default one defined herer : https://github.com/deepset-ai/haystack/blob/main/haystack/document_stores/sql.py#L65

Wondering how to go about using haystack to connect to postgres tables with different schemas? Is there a workaround? Would using a view work?

[ZanSara]

Hello @yemaney! Right now I don't think there's a way to do so. Haystack expects a very specific schema. If you can setup views that mimick this schema exactly, then it's probably going to work, but there's no way currently to use a different schema from SQLDocumentStore.

If you're really determined, though, you can consider writing your own document store, or subclassing SQLDocumentStore to overwrite the methods that you need. No easy feat, but it all depends on how your schemas look like. If they're close enough to Haystack's, then you can probably succeed by starting from the existing SQLDocumentStore implementation.

Let me know if you need any help on the matter 🙂