Figure 11 issue

Hi everyone,
I'm trying to regenerate figure 11 for the learning rates. 
Can I ask for how many episodes you run the code? I tried for 300 episodes and 10000 steps, and it still does not converge! 
Any advice?
I also see that the one the author saved at Learning_rates are vectors of the length 10000 (steps). Shouldn't it be of the shape (number of episodes x number of steps)?
Thanks!