Skip to content
This repository was archived by the owner on Aug 26, 2022. It is now read-only.

Commit f8397a1

Browse files
committed
Fix configuration docs
1 parent da5b77a commit f8397a1

File tree

6 files changed

+34
-29
lines changed

6 files changed

+34
-29
lines changed

docs/CONFIGURATION/activation_checkpointing.html

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -298,14 +298,14 @@ <h2> Contents </h2>
298298
<div class="section" id="activation-checkpointing">
299299
<h1>Activation Checkpointing<a class="headerlink" href="#activation-checkpointing" title="Permalink to this headline"></a></h1>
300300
<p>You can specify your own activation checkpointing related configuration under <code class="docutils literal notranslate"><span class="pre">activation_checkpointing</span></code> like:</p>
301-
<div class="highlight-json notranslate"><div class="highlight"><pre><span></span>{
302-
&quot;activation_checkpointing&quot;: {
303-
&quot;enable&quot;: bool,
304-
&quot;cpu_checkpointing&quot;: bool,
305-
&quot;partitioned_checkpointing&quot;: bool,
306-
&quot;contiguous_checkpointing&quot;: bool
307-
}
308-
}
301+
<div class="highlight-json notranslate"><div class="highlight"><pre><span></span><span class="p">{</span>
302+
<span class="nt">&quot;activation_checkpointing&quot;</span><span class="p">:</span> <span class="p">{</span>
303+
<span class="nt">&quot;enable&quot;</span><span class="p">:</span> <span class="s2">&quot;bool&quot;</span><span class="p">,</span>
304+
<span class="nt">&quot;cpu_checkpointing&quot;</span><span class="p">:</span> <span class="s2">&quot;bool&quot;</span><span class="p">,</span>
305+
<span class="nt">&quot;partitioned_checkpointing&quot;</span><span class="p">:</span> <span class="s2">&quot;bool&quot;</span><span class="p">,</span>
306+
<span class="nt">&quot;contiguous_checkpointing&quot;</span><span class="p">:</span> <span class="s2">&quot;bool&quot;</span>
307+
<span class="p">}</span>
308+
<span class="p">}</span>
309309
</pre></div>
310310
</div>
311311
<div class="section" id="enable-bool">

docs/CONFIGURATION/model_parallelism.html

Lines changed: 14 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -34,7 +34,7 @@
3434
<script src="../_static/sphinx-book-theme.9d8b4a8b9bb19db25eeaddc40d639ba2.js"></script>
3535
<link rel="index" title="Index" href="../genindex.html" />
3636
<link rel="search" title="Search" href="../search.html" />
37-
<link rel="next" title="Tensor Model Parallelism Tutorial" href="../TUTORIALS/tensor_model_parallelism.html" />
37+
<link rel="next" title="Activation Checkpointing" href="activation_checkpointing.html" />
3838
<link rel="prev" title="OSLO: Open Source framework for Large-scale transformer Optimization" href="../index.html" />
3939
<meta name="viewport" content="width=device-width, initial-scale=1" />
4040
<meta name="docsearch:language" content="None">
@@ -83,6 +83,11 @@ <h1 class="site-logo" id="site-title">OSLO documentation</h1>
8383
Model Parallelism
8484
</a>
8585
</li>
86+
<li class="toctree-l1">
87+
<a class="reference internal" href="activation_checkpointing.html">
88+
Activation Checkpointing
89+
</a>
90+
</li>
8691
</ul>
8792
<p class="caption">
8893
<span class="caption-text">
@@ -267,12 +272,12 @@ <h2> Contents </h2>
267272
<div class="section" id="model-parallelism">
268273
<h1>Model Parallelism<a class="headerlink" href="#model-parallelism" title="Permalink to this headline"></a></h1>
269274
<p>You can specify your own model parallelism related configuration under <code class="docutils literal notranslate"><span class="pre">model_parallelism</span></code> like:</p>
270-
<div class="highlight-json notranslate"><div class="highlight"><pre><span></span>{
271-
&quot;model_parallelism&quot;: {
272-
&quot;enable&quot;: bool,
273-
&quot;tensor_parallel_size&quot;: int,
274-
}
275-
}
275+
<div class="highlight-json notranslate"><div class="highlight"><pre><span></span><span class="p">{</span>
276+
<span class="nt">&quot;model_parallelism&quot;</span><span class="p">:</span> <span class="p">{</span>
277+
<span class="nt">&quot;enable&quot;</span><span class="p">:</span> <span class="s2">&quot;bool&quot;</span><span class="p">,</span>
278+
<span class="nt">&quot;tensor_parallel_size&quot;</span><span class="p">:</span> <span class="s2">&quot;int&quot;</span>
279+
<span class="p">}</span>
280+
<span class="p">}</span>
276281
</pre></div>
277282
</div>
278283
<div class="section" id="enable-bool">
@@ -329,10 +334,10 @@ <h3>SUPPORTED MODELS<a class="headerlink" href="#supported-models" title="Permal
329334
<p class="prev-next-title">OSLO: Open Source framework for Large-scale transformer Optimization</p>
330335
</div>
331336
</a>
332-
<a class='right-next' id="next-link" href="../TUTORIALS/tensor_model_parallelism.html" title="next page">
337+
<a class='right-next' id="next-link" href="activation_checkpointing.html" title="next page">
333338
<div class="prev-next-info">
334339
<p class="prev-next-subtitle">next</p>
335-
<p class="prev-next-title">Tensor Model Parallelism Tutorial</p>
340+
<p class="prev-next-title">Activation Checkpointing</p>
336341
</div>
337342
<i class="fas fa-angle-right"></i>
338343
</a>

docs/_sources/CONFIGURATION/activation_checkpointing.md.txt

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,10 @@ You can specify your own activation checkpointing related configuration under `a
44
```json
55
{
66
"activation_checkpointing": {
7-
"enable": bool,
8-
"cpu_checkpointing": bool,
9-
"partitioned_checkpointing": bool,
10-
"contiguous_checkpointing": bool
7+
"enable": "bool",
8+
"cpu_checkpointing": "bool",
9+
"partitioned_checkpointing": "bool",
10+
"contiguous_checkpointing": "bool"
1111
}
1212
}
1313
```

docs/_sources/CONFIGURATION/model_parallelism.md.txt

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,8 +4,8 @@ You can specify your own model parallelism related configuration under `model_pa
44
```json
55
{
66
"model_parallelism": {
7-
"enable": bool,
8-
"tensor_parallel_size": int,
7+
"enable": "bool",
8+
"tensor_parallel_size": "int"
99
}
1010
}
1111
```

docs/source/CONFIGURATION/activation_checkpointing.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -4,10 +4,10 @@ You can specify your own activation checkpointing related configuration under `a
44
```json
55
{
66
"activation_checkpointing": {
7-
"enable": bool,
8-
"cpu_checkpointing": bool,
9-
"partitioned_checkpointing": bool,
10-
"contiguous_checkpointing": bool
7+
"enable": "bool",
8+
"cpu_checkpointing": "bool",
9+
"partitioned_checkpointing": "bool",
10+
"contiguous_checkpointing": "bool"
1111
}
1212
}
1313
```

docs/source/CONFIGURATION/model_parallelism.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,8 +4,8 @@ You can specify your own model parallelism related configuration under `model_pa
44
```json
55
{
66
"model_parallelism": {
7-
"enable": bool,
8-
"tensor_parallel_size": int,
7+
"enable": "bool",
8+
"tensor_parallel_size": "int"
99
}
1010
}
1111
```

0 commit comments

Comments
 (0)