Skip to content

Commit 2743c28

Browse files
authored
Documentation nits (#756)
* Fix heading level in tutorial. * Fix capitalization of algorithm article titles.
1 parent fdcb36e commit 2743c28

File tree

3 files changed

+5
-5
lines changed

3 files changed

+5
-5
lines changed

docs/algorithms/density.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
.. _density docs:
22

33
=============================
4-
Density-based reward modeling
4+
Density-Based Reward Modeling
55
=============================
66

77
Density-based reward modeling is an inverse reinforcement learning (IRL) technique that assigns higher rewards

docs/algorithms/preference_comparisons.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
.. _preference comparisons docs:
22

33
======================
4-
Preference comparisons
4+
Preference Comparisons
55
======================
66

77
The preference comparison algorithm learns a reward function from preferences between pairs of trajectories.

docs/tutorials/8_train_custom_env.ipynb

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -66,7 +66,7 @@
6666
"cell_type": "markdown",
6767
"metadata": {},
6868
"source": [
69-
"# Step 2: create the environment"
69+
"## Step 2: create the environment"
7070
]
7171
},
7272
{
@@ -88,7 +88,7 @@
8888
"cell_type": "markdown",
8989
"metadata": {},
9090
"source": [
91-
"## Step 2a (recommended): add the environment to the gym registry"
91+
"### Step 2a (recommended): add the environment to the gym registry"
9292
]
9393
},
9494
{
@@ -165,7 +165,7 @@
165165
"metadata": {},
166166
"source": [
167167
"\n",
168-
"## Step 2b: directly use the environment\n",
168+
"### Step 2b: directly use the environment\n",
169169
"\n",
170170
"Alternatively, we can directly initialize the environment by instantiating the class we created earlier, and handle all the additional logic ourselves."
171171
]

0 commit comments

Comments
 (0)