Configuring the WebCrawser as Data Provider

[superbobich]

Hi, I would be very thankful if someone could help me.
I am using PIM X and I'm trying to get Dynamic Search to run.
For a Data Provider I would like to use the webCrawler.
The thing is in the documentation there are things like the Trasnformers, more scpecifically the scaffolders and the field transformers and I have no clue where to configure them in the yaml.
I tried to bring them under the data_provider but sadly it doesn't work.
Would it be possible for someone to post an example of a full yaml configuration with everything in it?
Would really appreciate if someone with more experience could help me out.

[beheist]

I have exactly the same problem. This package seems like it could work very well, but without explaining the concepts and how to actually implement them, I cannot figure out how to correctly configure it.
Have asked the same question over in the main repo.
pimcore/pimcore#15997

[solverat]

@superbobich, @beheist maybe this PR (which hasn't been merged by now) will guide you into the right direction: #66

[beheist]

Thank you Stefan, that looks like it might be helpful. We will see if that helps us along further.