You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on May 6, 2021. It is now read-only.
Copy file name to clipboardExpand all lines: README.md
+14-1Lines changed: 14 additions & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -49,10 +49,23 @@ Some built-in experiments are exported to help new users to easily run benchmark
49
49
-``E`rlpyt_A2C_Atari(pong)` ``
50
50
-``E`rlpyt_PPO_Atari(pong)` ``
51
51
52
-
**Notes:**
52
+
### Notes:
53
53
54
54
- Experiments on `CartPole` usually run faster with CPU only due to the overhead of sending data between CPU and GPU.
55
55
- It shouldn't surprise you that our experiments on `CartPole` are much faster than those written in Python. The secret is that our environment is written in Julia!
56
56
- Remember to set `JULIA_NUM_THREADS` to enable multi-threading when using algorithms like `A2C` and `PPO`.
57
57
- Experiments on `Atari` are only available when you have `ArcadeLearningEnvironment.jl` installed and `using ArcadeLearningEnvironment`.
58
+
59
+
### Speed
60
+
58
61
- Different configurations might affect the performance a lot. According to our tests, our implementations are generally comparable to those written in PyTorch or TensorFlow with the same configuration (sometimes we are significantly faster).
62
+
63
+
The following data are collected from experiments on *Intel(R) Xeon(R) W-2123 CPU @ 3.60GHz* with a GPU card of *RTX 2080ti*.
64
+
65
+
| Experiment | FPS | Notes |
66
+
|:---------- |:----:| ----:|
67
+
|``E`Dopamine_DQN_Atari(pong)` ``|~210 | Use the same config of [dqn.gin in google/dopamine](https://github.com/google/dopamine/blob/master/dopamine/agents/dqn/configs/dqn.gin)|
68
+
|``E`Dopamine_Rainbow_Atari(pong)` ``|~171 | Use the same config of [rainbow.gin in google/dopamine](https://github.com/google/dopamine/blob/master/dopamine/agents/implicit_quantile/configs/rainbow.gin)|
69
+
|``E`Dopamine_IQN_Atari(pong)` ``|~162 | Use the same config of [implicit_quantile.gin in google/dopamine](https://github.com/google/dopamine/blob/master/dopamine/agents/implicit_quantile/configs/implicit_quantile.gin)|
70
+
|``E`rlpyt_A2C_Atari(pong)` ``|~768 | Use the same default parameters of [A2C in rlpyt](https://github.com/astooke/rlpyt/blob/master/rlpyt/algos/pg/a2c.py) with **4 threads**|
71
+
|``E`rlpyt_PPO_Atari(pong)` ``|~711 | Use the same default parameters of [PPO in rlpyt](https://github.com/astooke/rlpyt/blob/master/rlpyt/algos/pg/ppo.py) with **4 threads**|
0 commit comments