-
|
Hello all, I am trying to visualise attention throughout the fine-tuned BioMegatron Model with token classification(ner) and text classification(re) downstream tasks using bertviz. How can I get the attention, query, and key sequences? It seems that the NeMo code cannot be edited on Colab. Can anyone assist? Thanks, |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
We don't expose this to the user. But NeMo's models are just Pytorch models and code is open-sourced, so you can attempt to expose what you need yourself. |
Beta Was this translation helpful? Give feedback.
We don't expose this to the user. But NeMo's models are just Pytorch models and code is open-sourced, so you can attempt to expose what you need yourself.