File tree Expand file tree Collapse file tree 2 files changed +6
-0
lines changed Expand file tree Collapse file tree 2 files changed +6
-0
lines changed Original file line number Diff line number Diff line change @@ -509,6 +509,8 @@ single agent standards.
509
509
Auto-resetting Envs
510
510
-------------------
511
511
512
+ .. _autoresetting_envs :
513
+
512
514
Auto-resetting environments are environments where calls to :meth: `~torchrl.envs.EnvBase.reset ` are not expected when
513
515
the environment reaches a ``"done" `` state during a rollout, as the reset happens automatically.
514
516
Usually, in such cases the observations delivered with the done and reward (which effectively result from performing the
@@ -920,6 +922,7 @@ to be able to create this other composition:
920
922
TargetReturn
921
923
TensorDictPrimer
922
924
TimeMaxPool
925
+ Tokenizer
923
926
ToTensorImage
924
927
TrajCounter
925
928
UnaryTransform
Original file line number Diff line number Diff line change @@ -317,6 +317,9 @@ class EnvBase(nn.Module, metaclass=_EnvPostInit):
317
317
.. note:: The auto-resetting is achieved by the `EnvBase` metaclass. It does not appear in the
318
318
`__init__` method and is included in the keyword arguments strictly for type-hinting purpose.
319
319
320
+ .. seealso:: The :ref:`auto-resetting environments API <autoresetting_envs>` section in the API
321
+ documentation.
322
+
320
323
Attributes:
321
324
done_spec (Composite): equivalent to ``full_done_spec`` as all
322
325
``done_specs`` contain at least a ``"done"`` and a ``"terminated"`` entry
You can’t perform that action at this time.
0 commit comments