What is the best practice to clear application component state between running tests?

I have multiple test classes and once I inject module this module now is used in all other test classes until I reinject application component. I wanted to ask if there is any suggested way to do it or is creating custom rule that doesn't inject any module is the way to go?