saliency maps

[CHEN-H01]

Hi!

This is a very nice work. And I have a question. Could you please tell me how you drew the saliency maps in the paper? If possible, please provide some details. Thanks!

[binbinjiang]

Hi, you can refer to the open source 'pytorch_grad_cam' for details. Thx!

[CHEN-H01]

Hi, you can refer to the open source 'pytorch_grad_cam' for details. Thx!

Thank you! I have already know how to do that. Also, I'd like to know how you draw the Cross-modal Alignment Matrices in your paper? if you could give me some hints, I would very appreciate it.

[binbinjiang]

Hi, here are some hints for you:

a = ret["conv_logits"].squeeze(1)
b = ret["sequence_logits"].squeeze(1)
T = 1
simi_matric = softmax(T*(a @ b.T))

Hope you can understand, and thank you for your concern! Welcome to cite the work!

[CHEN-H01]

I got it! Thanks again, and I'm very happy to cite your paper!