Semantic UI element detection via uiautomator2
Semantic UI element detection via uiautomator2
What It Does: Automates interactions and testing for the target app.
Core Capabilities:
When to Use:
Uiautomator Launch automation.
# Basic usage
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-launch.py
# With device specification
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-launch.py \
--device 127.0.0.1:5555
# JSON output
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-launch.py --json
Uiautomator Check automation.
# Basic usage
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-check.py
# With device specification
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-check.py \
--device 127.0.0.1:5555
# JSON output
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-check.py --json
Uiautomator Test automation.
# Basic usage
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-test.py
# With device specification
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-test.py \
--device 127.0.0.1:5555
# JSON output
uv run .claude/skills/adb-uiautomator/scripts/adb-uiautomator-test.py --json
This skill includes TOON-based workflow definitions for automation.
TOON (Task-Oriented Orchestration Notation) is a structured workflow definition language that pairs with Markdown documentation. Each workflow consists of:
This TOON+MD pairing approach is inspired by the BMAD METHOD pattern, adapted to use TOON instead of YAML for better orchestration support.
Workflow files are located in workflow/ directory:
Example Workflows (adb-uiautomator):
workflow/app-launch.toon - Launch app with uiautomator2 verificationworkflow/element-check.toon - Find and verify UI elementsworkflow/functional-test.toon - Complete app functionality testingExecute any workflow using the ADB workflow orchestrator:
uv run .claude/skills/adb-workflow-orchestrator/scripts/adb-run-workflow.py \
--workflow .claude/skills/adb-uiautomator/workflow/app-launch.toon \
--param device="127.0.0.1:5555"
Each workflow includes comprehensive documentation in the corresponding .md file:
See the workflow/ directory for complete TOON file definitions and documentation.
To create custom workflows for this skill:
.toon file in the workflow/ directory.md file with comprehensive documentationFor more information, refer to the TOON specification and the workflow orchestrator documentation.