fix(consume): allow absolute paths for --evm-bin (#1052)

* fix(consume): enable --evm-bin with absolute paths

If the value passed to --evm-bin was an abolute path, it got ignored by pytest. Perhaps, it got interpreted as a test paths? This workaround avoids the problem.

* chore(consume): better default value for --evm-bin with consume direct

The default value of the TransitionTool (`ethereum-spec-evm-resolver`) doesn't support state- or blocktest consumption; use the Geth `evm` binary in PATH as the default value.

* docs: update changelog

Author: danceratopz

docs/CHANGELOG.md

@@ -65,8 +65,9 @@ Test fixtures for use by clients are available for each release on the [Github r
 - ✨ Add a default location for evm logs (`--evm-dump-dir`) when filling tests ([#999](https://github.com/ethereum/execution-spec-tests/pull/999)).
 - ✨ Slow tests now have greater timeout when making a request to the T8N server ([#1037](https://github.com/ethereum/execution-spec-tests/pull/1037)).
 - ✨ Introduce [`fork_covariant_parametrize`](https://ethereum.github.io/execution-spec-tests/main/writing_tests/test_markers/#custom-fork-covariant-markers) helper function ([#1019](https://github.com/ethereum/execution-spec-tests/pull/1019)).
-- 🔀 Update EIP-7251 according to [spec updates](https://github.com/ethereum/EIPs/pull/9127) ([#1024](https://github.com/ethereum/execution-spec-tests/pull/1024))
-- 🔀 Update EIP-7002 according to [spec updates](https://github.com/ethereum/EIPs/pull/9119) ([#1024](https://github.com/ethereum/execution-spec-tests/pull/1024))
+- 🔀 Update EIP-7251 according to [spec updates](https://github.com/ethereum/EIPs/pull/9127) ([#1024](https://github.com/ethereum/execution-spec-tests/pull/1024)).
+- 🔀 Update EIP-7002 according to [spec updates](https://github.com/ethereum/EIPs/pull/9119) ([#1024](https://github.com/ethereum/execution-spec-tests/pull/1024)).
+- 🐞 fix(consume): allow absolute paths with `--evm-bin` ([#1052](https://github.com/ethereum/execution-spec-tests/pull/1052)).
 
 ### 🔧 EVM Tools
 

src/cli/pytest_commands/consume.py

@@ -78,8 +78,8 @@ def create_command(
         )
         @common_click_options
         def command(pytest_args: List[str], **kwargs) -> None:
-            args = handle_consume_command_flags(pytest_args, is_hive)
-            args += [str(p) for p in command_paths]
+            args = [str(p) for p in command_paths]
+            args += handle_consume_command_flags(pytest_args, is_hive)
             sys.exit(pytest.main(args))
 
         return command

src/pytest_plugins/consume/direct/conftest.py

@@ -28,7 +28,7 @@ def pytest_addoption(parser):  # noqa: D103
         action="store",
         dest="evm_bin",
         type=Path,
-        default=None,
+        default=Path("evm"),
         help=(
             "Path to an evm executable that provides `blocktest`. Default: First 'evm' entry in "
             "PATH."