RMU

[Dornavineeth]

What does this PR do?

1. Added RMU method

Fixes # (issue)

1. Change overwrite=True for evaluation during training
2. Minor fix to the device of reference model

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Have you gone through the documentation of adding new components?
• Did you make sure to update the documentation with your changes? Here are the pointers to documentation
  documentation guidelines.