German model for answer generation

[StoyanVenDimitrov]

Hi,

I'm looking for a model for answer generation in German, using the Seq2SeqGenerator. But it is somehow unclear which models I exist for that. Do you have some suggestions?
I guess I need something like yjernite/bart_eli5 or vblagoje/bart_lfqa, but multilingual or German.

[JasperLS]

Hi @StoyanVenDimitrov,

I think the easiest way to find suitable models would be to search at Huggingface model hub and filter for seq2seq task and German as a language. The T5 model might me a reasonable pick for you.

[StoyanVenDimitrov]

Thanks. but none of them seems to have been fine-tuned on question generation. Does this make a big difference?

[mayankjobanputra]

Maybe you can try this t5-e2e-quad, which seems to be trained on German QG task. In general, if you plan to fine-tune the model on your own, you only need to ensure that the model has been pretrained on the language of your interest.

[StoyanVenDimitrov]

I'm looking for a fully trained model, I'm not going to fine-tune it. That's why I look for model trained on the exact task - generative question answering and not question generation. But I don't see any model doing it, perhaps there is also no data for this?

[mayankjobanputra]

Sorry my bad... I think you're right, there's no specific model that does Generative QA in German but I think you should still be able to use flan-modes with PromptNode in Haystack to achieve your goals.

I believe you can do this in two ways:

1. Translate your inputs to English, do QA on translated inputs and translate them back into German.
2. Find a prompt in German that works on your task and do QA directly on German task.