SKILL-001: Run EELS Test Suite
Overview
Automates the execution of EELS compliance tests. This skill handles the complexity of setting up the Python environment, installing dependencies, invoking pytest against a target EVM binary, and parsing the results into standardized reports.
Trigger Phrases
run eels testseels compliance checkverify evm implementationrun execution specs
Inputs
| Parameter |
Type |
Required |
Default |
Description |
--evm-binary |
string |
Yes |
- |
Path to the EVM executable (e.g., ELR.CLI.exe) |
--test-filter |
string |
No |
- |
Optional pytest filter (e.g., -k "add or sub") |
--specs-path |
string |
No |
Auto-detect |
Path to execution-specs repo |
--output-dir |
string |
No |
./.forensics |
Directory to save reports |
--json |
switch |
No |
False |
Return raw JSON output only |
Outputs
- Console Output: Real-time test execution progress.
- Report File:
EELS_TEST_RESULTS_<timestamp>.md with pass/fail summary and details.
- JSON Results:
eels_results.json (if --json or requested).
Preconditions
- SKILL-000 must have been run (checked via
WORKSPACE_PROFILE.json).
execution-specs repo must exist (usually C:\projects\Scrutor\execution-specs or similar).- Python 3.10+ installed and accessible.
- Target EVM binary must be built and executable.
Safety/QA Checks
- Binary Verification: Checks if
--evm-binary exists and runs (version check).
- Repo State: Checks if
execution-specs is clean/valid.
- Venv Isolation: Uses a local
.venv to avoid system pollution.
Implementation
See run_eels_tests.ps1.
Integration
# Example integration
.\skills\01_run_eels_tests\run_eels_tests.ps1 -EvmBinary ".\bin\Debug\net8.0\ELR.CLI.exe" -TestFilter "tests/shanghai/eip3855_push0"
