absolute positional encoding [abs_pos]

[poyupaulchen]

Hi all,
First appreciate the team providing such a great tool.
Currently I would like to try some experiments on the positional encoding for conformer. As I saw in the coding (see below), if I configure absolute positional encoding using
self_attention_model: abs_pos,
it will call the 'MultiHeadAttention'
https://github.com/NVIDIA/NeMo/blob/df5a39583e31fd99bda371759c7954f928195594/nemo/collections/asr/parts/submodules/conformer_modules.py#L124-L127

And it seems like 'pos_emb' is never applied to the self attention part.

https://github.com/NVIDIA/NeMo/blob/df5a39583e31fd99bda371759c7954f928195594/nemo/collections/asr/parts/submodules/multi_head_attention.py#L121-L147

Does it mean that 'abs_pos' implies 'no positional encoding'? or I miss something.
Thank you,
Paul