Nan loss when replace pytorch LSTM with your LSTM or LayerNormLSTM

[andkot]

everething is identical insted of perplacing pytorch LSTM to one of your implementation leads to NAN loss

[sharvil]

Can you share your network / provide a minimal example of the failure?

[andkot]

Very Strange, I've tested it on another machine and everything works perfect.