feat(selenium-devtools-py): A11y tree and element overlay in Python traces

[vishnuv688]

What & why

Type of change

• Bugfix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Polish (an improvement to an existing feature)
• Breaking change (existing behavior changes for users)
• Documentation
• Internal (build, CI, dependencies, tooling)

Packages touched

• shared (types and contracts)
• core (framework-agnostic capture/reporting)
• elements (published element/snapshot API — @wdio/elements)
• service (WebdriverIO adapter)
• nightwatch-devtools (Nightwatch adapter)
• selenium-devtools (Selenium adapter)
• backend (server)
• app (UI)
• script (page-injected runtime)
• selenium-devtools-py
• trace

Notes for reviewers

Screenshots / recordings

[greptile-apps]

Greptile Summary

The PR adds accessibility snapshots and element-overlay evidence to Python Selenium traces while centralizing browser element scripts in the shared package.

• Serves runner-specific accessibility and element scripts from the backend for the Python adapter.
• Captures per-action accessibility trees, element bounds, selectors, viewport metadata, and overlay points.
• Extends trace generation and baseline handling for the new snapshot evidence.
• Removes unused input values and links from captured element resources while retaining the full live element API.

Confidence Score: 5/5

The PR appears safe to merge.

No blocking failure remains.

Important Files Changed

Filename	Overview
packages/shared/src/element-scripts.ts	Centralizes runner-aware browser extraction scripts and projects trace element records to the fields consumed by overlays.
packages/selenium-devtools-py/src/selenium_devtools/instrumentation.py	Adds guarded per-command accessibility, element, selector, and viewport capture to Python Selenium instrumentation.
packages/selenium-devtools-py/src/selenium_devtools/element_scripts.py	Fetches and caches version-aligned element scripts from the active backend without affecting test execution on failure.
packages/trace/src/a11y-snapshot.ts	Converts captured accessibility nodes into the shared snapshot text consumed by trace viewers.
packages/backend/src/index.ts	Exposes the runner-specific element-script endpoint used by adapters that cannot import the TypeScript package.
packages/backend/src/trace-export.ts	Carries the new action snapshot evidence through backend-managed trace export.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  Page[Browser page] --> Scripts[Shared element scripts]
  Backend[Backend route] --> Python[Python Selenium adapter]
  Scripts --> Backend
  Python --> Capture[Per-action capture]
  Capture --> A11y[Accessibility snapshot]
  Capture --> Elements[Element bounds and selectors]
  Capture --> Viewport[Viewport metadata]
  A11y --> Trace[Trace archive]
  Elements --> Trace
  Viewport --> Trace
  Trace --> Viewer[A11y tree and element overlay]

Loading

_{Reviews (5): Last reviewed commit: "refactor(shared): capture only the eleme..." | Re-trigger Greptile}