Expand description
Perception pipeline — converts raw browser state into structured UiMap data.
The pipeline takes screenshots and accessibility trees from a BrowserBackend
and produces UiMap objects that the AI agent reasons about.
Re-exports§
pub use pipeline::PerceptionPipeline;pub use ui_map::UiElement;pub use ui_map::UiMap;pub use ui_map::UiRole;pub use ui_map::UiState;
Modules§
- ax_
converter - Accessibility tree to UiElement converter.
- diff
- UI state change detection between UiMap snapshots.
- formatting
- UiMap formatting for LLM prompt consumption.
- pipeline
- Perception pipeline trait and basic implementation.
- signals
- Page signal detection from accessibility tree.
- ui_map
- UI state representation for perception pipeline.