Using with other RL env

Hi, thanks for the work so much, 

I would like to ask how we can use this with another gym-like environments?

For example, I create a robot simulation env that have API like Open AI gym like step, start etc. How could I adapt that env to your implementation?

