Skip to content

Commit a15263e

Browse files
authored
docs(all): misc clean-up and add a navigation footer (#1846)
1 parent fed1f65 commit a15263e

File tree

9 files changed

+28
-44
lines changed

9 files changed

+28
-44
lines changed

README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,8 @@
66
[![uv](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/uv/main/assets/badge/v0.json)](https://github.com/astral-sh/uv)
77
[![License](https://img.shields.io/github/license/ethereum/execution-spec-tests)](https://github.com/ethereum/execution-spec-tests/blob/main/LICENSE)
88

9+
The full execution-spec-tests documentation can be found [here](https://eest.ethereum.org/main/).
10+
911
[ethereum/execution-spec-tests](https://github.com/ethereum/execution-spec-tests) is both a collection of test cases and a framework implemented in Python to generate tests for Ethereum execution clients.
1012

1113
The framework collects and executes the test cases in order to generate _test fixtures_ (JSON) which can be consumed by any execution client to verify their implementation of [ethereum/execution-specs](https://github.com/ethereum/execution-specs). The fixtures, which define state transition and block tests, are generated by the framework using one of the `t8n` command-line tools that are provided by most execution clients, see below for an overview of the supported `t8n` tools.

docs/CHANGELOG.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,6 +57,7 @@ Users can select any of the artifacts depending on their testing needs for their
5757

5858
### 📋 Misc
5959

60+
- 🔀 Misc. doc updates, including a navigation footer ([#1846](https://github.com/ethereum/execution-spec-tests/pull/1846)).
6061
- 🔀 Remove Python 3.10 support ([#1808](https://github.com/ethereum/execution-spec-tests/pull/1808)).
6162
- 🔀 Modernize codebase with Python 3.11 language features ([#1812](https://github.com/ethereum/execution-spec-tests/pull/1812)).
6263
- ✨ Add changelog formatting validation to CI to ensure consistent punctuation in bullet points [#1691](https://github.com/ethereum/execution-spec-tests/pull/1691).

docs/filling_tests/filling_tests_command_line.md

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ The execution-spec-tests test framework uses the [pytest framework](https://docs
66
The command-line options specific to filling tests can be listed via:
77

88
```console
9-
fill --help
9+
uv run fill --help
1010
```
1111

1212
See [Custom `fill` Command-Line Options](#custom-fill-command-line-options) for all options.
@@ -16,35 +16,35 @@ The execution-spec-tests test framework uses the [pytest framework](https://docs
1616
The test cases implemented in the `./tests` sub-directory can be listed in the console using:
1717

1818
```console
19-
fill --collect-only
19+
uv run fill --collect-only
2020
```
2121

2222
and can be filtered (by test path, function and parameter substring):
2323

2424
```console
25-
fill --collect-only -k warm_coinbase
25+
uv run fill --collect-only -k warm_coinbase
2626
```
2727

2828
Docstrings are additionally displayed when ran verbosely:
2929

3030
```console
31-
fill --collect-only -k warm_coinbase -vv
31+
uv run fill --collect-only -k warm_coinbase -vv
3232
```
3333

3434
## Execution
3535

3636
By default, test cases are filled for all forks already deployed to mainnet, but not for forks still under active development, i.e., as of time of writing, Q2 2023:
3737

3838
```console
39-
fill
39+
uv run fill
4040
```
4141

4242
will generate fixtures for test cases from Frontier to Shanghai.
4343

4444
To generate all the test fixtures defined in the `./tests/shanghai` sub-directory and write them to the `./fixtures-shanghai` directory, run `fill` in the top-level directory as:
4545

4646
```console
47-
fill ./tests/shanghai --output="fixtures-shanghai"
47+
uv run fill ./tests/shanghai --output="fixtures-shanghai"
4848
```
4949

5050
!!! note "Test case verification"
@@ -53,25 +53,25 @@ fill ./tests/shanghai --output="fixtures-shanghai"
5353
To generate all the test fixtures in the `tests/shanghai/eip3651_warm_coinbase/test_warm_coinbase.py` module, for example, run:
5454

5555
```console
56-
fill tests/shanghai/eip3651_warm_coinbase/test_warm_coinbase.py
56+
uv run fill tests/shanghai/eip3651_warm_coinbase/test_warm_coinbase.py
5757
```
5858

5959
To generate specific test fixtures from a specific test function or even test function and parameter set, obtain the corresponding test ID using:
6060

6161
```console
62-
fill --collect-only -q -k test_warm_coinbase
62+
uv run fill --collect-only -q -k test_warm_coinbase
6363
```
6464

6565
This filters the tests by `test_warm_coinbase`. Then find the relevant test ID in the console output and provide it to fill, for example, for a test function:
6666

6767
```console
68-
fill tests/shanghai/eip3651_warm_coinbase/test_warm_coinbase.py::test_warm_coinbase_gas_usage
68+
uv run fill tests/shanghai/eip3651_warm_coinbase/test_warm_coinbase.py::test_warm_coinbase_gas_usage
6969
```
7070

7171
or, for a test function and specific parameter combination:
7272

7373
```console
74-
fill tests/shanghai/eip3651_warm_coinbase/test_warm_coinbase.py::test_warm_coinbase_gas_usage[fork_Paris-DELEGATECALL]
74+
uv run fill tests/shanghai/eip3651_warm_coinbase/test_warm_coinbase.py::test_warm_coinbase_gas_usage[fork_Paris-DELEGATECALL]
7575
```
7676

7777
## Execution for Development Forks
@@ -80,10 +80,10 @@ fill tests/shanghai/eip3651_warm_coinbase/test_warm_coinbase.py::test_warm_coinb
8080
By default, test cases are not filled for upcoming Ethereum forks so that they can be readily filled using the `evm` tool from the latest `geth` release.
8181

8282
In order to fill test cases for an upcoming fork, ensure that the `evm` tool used supports that fork and features under test and use the `--until` or `--fork` flag.
83-
83+
8484
For example, as of Q2 2023, the current fork under active development is `Cancun`:
8585
```console
86-
fill --until Cancun
86+
uv run fill --until Cancun
8787
```
8888

8989
See: [Filling Tests for Features under Development](./filling_tests_dev_fork.md).
@@ -95,10 +95,10 @@ The `--evm-dump-dir` flag can be used to dump the inputs and outputs of every ca
9595
## Other Useful Pytest Command-Line Options
9696

9797
```console
98-
fill -vv # More verbose output
99-
fill -x # Exit instantly on first error or failed test case
100-
fill --pdb -nauto # Drop into the debugger upon error in a test case
101-
fill -s # Print stdout from tests to the console during execution
98+
uv run fill -vv # More verbose output
99+
uv run fill -x # Exit instantly on first error or failed test case
100+
uv run fill --pdb -nauto # Drop into the debugger upon error in a test case
101+
uv run fill -s # Print stdout from tests to the console during execution
102102
```
103103

104104
## Custom `fill` Command-Line Options
@@ -108,7 +108,7 @@ To see all the options available to fill, including pytest and pytest plugin opt
108108
To list the options that only specific to fill, use:
109109

110110
```console
111-
fill --help
111+
uv run fill --help
112112
```
113113

114-
For a complete, up-to-date list of all command-line options, see the [Fill Command-Line Options](filling_tests_command_line_options.md) page, which is automatically generated from the current `fill --help` output.
114+
For a complete, up-to-date list of all command-line options, see the [Fill Command-Line Options](filling_tests_command_line_options.md) page, which is automatically generated from the current `uv run fill --help` output.

docs/filling_tests/filling_tests_dev_fork.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -10,26 +10,26 @@ By default, execution-spec-tests only generates fixtures for forks that have bee
1010
=== "via the `--fork` flag"
1111

1212
```console
13-
fill -k 4844 --fork=Cancun -v
13+
uv run fill -k 4844 --fork=Cancun -v
1414
```
1515

1616
=== "via the `--from` flag"
1717

1818
```console
19-
fill -k 4844 --from=Cancun -v
19+
uv run fill -k 4844 --from=Cancun -v
2020
```
2121

2222
=== "via the `--until` flag"
2323

2424
```console
25-
fill -k 4844 --until=Cancun -v
25+
uv run fill -k 4844 --until=Cancun -v
2626
```
2727

2828
!!! note "Specifying the `evm` binary via `evm-bin`"
2929
It is possible to explicitly specify the `evm` binary used to generate fixtures via the `--evm-bin` flag, for example,
3030

3131
```console
32-
fill --fork=Cancun --evm-bin=/opt/bin/evm -v
32+
uv run fill --fork=Cancun --evm-bin=/opt/bin/evm -v
3333
```
3434

3535
## Further Help

docs/navigation.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,6 @@
4343
* [Blockchain Tests](running_tests/test_formats/blockchain_test.md)
4444
* [Blockchain Engine Tests](running_tests/test_formats/blockchain_test_engine.md)
4545
* [Blockchain Engine X Tests](running_tests/test_formats/blockchain_test_engine_x.md)
46-
* [EOF Tests](running_tests/test_formats/eof_test.md)
4746
* [Transaction Tests](running_tests/test_formats/transaction_test.md)
4847
* [Common Types](running_tests/test_formats/common_types.md)
4948
* [Exceptions](running_tests/test_formats/exceptions.md)

docs/running_tests/releases.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ Please see below for an explanation of the optional `<pre_release_name>` that is
2626

2727
### Standard Releases
2828

29-
Releases are published on the @ethereum/execution-spec-tests [releases](https://github.com/ethereum/execution-spec-tests/releases) page. Standard releases are tagged using the format `vX.Y.Z` (they don't have a don't `<pre_release_name>`).
29+
Releases are published on the @ethereum/execution-spec-tests [releases](https://github.com/ethereum/execution-spec-tests/releases) page. Standard releases are tagged using the format `vX.Y.Z` (they don't have a `<pre_release_name>`).
3030

3131
For standard releases, two tarballs are available:
3232

docs/running_tests/running.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -110,7 +110,7 @@ See [Execute Command](./execute/index.md).
110110

111111
## Two Methods to Run EEST Simulators
112112

113-
Many of the methods use the Hive Testing Environment to interact clients and run tests against them. These methods are also called Hive simulators. While Hive is always necessary to run simulators, they can be called in two different ways. Both of these commands execute the same simulator code, but in different environments, we take the example of the `eest/consume-engine` simulator:
113+
Many of the methods use the Hive Testing Environment to interact with clients and run tests against them. These methods are also called Hive simulators. While Hive is always necessary to run simulators, they can be called in two different ways. Both of these commands execute the same simulator code, but in different environments, we take the example of the `eest/consume-engine` simulator:
114114

115115
1. `./hive --sim=eest/consume-engine` is a standalone command that installs EEST and the `consume` command in a dockerized container managed by Hive. This is the standard method to execute EEST [fixture releases](./releases.md) against clients in CI environments and is the method to generate the results at [hive.ethpandaops.io](https://hive.ethpandaops.io). See [Hive](./hive/index.md) and its [Common Options](./hive/common_options.md) for help with this method.
116116
2. `uv run consume engine` requires the user to clone and [install EEST](../getting_started/installation.md) and start a Hive server in [development mode](./hive/dev_mode.md). In this case, the simulator runs on the native system and communicate to the client via the Hive API. This is particularly useful during test development as fixtures on the local disk can be specified via `--input=fixtures/`. As the simulator runs natively, it is easy to drop into a debugger and inspect the simulator or client container state. See [Hive Developer Mode](./hive/dev_mode.md) for help with this method.

docs/running_tests/test_formats/eof_test.md

Lines changed: 0 additions & 19 deletions
This file was deleted.

mkdocs.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,7 @@ theme:
5151
- navigation.indexes
5252
- navigation.instant
5353
- navigation.tabs
54+
- navigation.footer
5455
# disabled due to https://github.com/ethereum/execution-spec-tests/issues/816
5556
# palette:
5657
# # Palette toggle for automatic mode

0 commit comments

Comments
 (0)