Reproducibility Issue of Atari, and Fetch tasks #2337
Description
Hey all,
I am having some trouble reproducing the baseline numbers on both Atari and Fetch (Push/Pick-and-Place/Slide) tasks.
Although, the same code works for Pong, Enduro, it seems to not reproduce numbers for other environments such as Breakout, Space Invaders (attached image below), and many more. These baseline numbers close resemble the figure you have at https://garage.readthedocs.io/en/latest/user/algo_dqn.html , but these numbers do not match the original paper. Is a different metric being plotted here?
The same is also true for Fetchpush task using DDPG:
Please do let me know what you think. Thanks in advance!