Weighted Sum for Downstream Tasks #58
Description
Hello!
The paper denotes that hidden states of WavLM are weighted sum for downstream tasks, and the weight assigned for each layer and downstream tasks are denoted in Figure 2 of the WavLM paper.
I want to use the exact weight values for my research.
Can I get any help on this? Or is there any place that I can find the exact weights for each downstream task and layer?
Also I have a question regarding the normalization before the weighted sum.
It is stated "We normalize the weights from differnet layers based on the hidden states values". How are they exactly normalized e.g. applying layernorm for each layer hidden states...?
Thank you.