pub struct ContextElement {Show 13 fields
pub id: String,
pub label: Option<String>,
pub description: Option<String>,
pub element_type: String,
pub value: Option<String>,
pub bounds: Option<Bounds>,
pub state: ElementState,
pub parent_id: Option<String>,
pub actions: Vec<String>,
pub confidence: f64,
pub source: ContextSource,
pub content_role: ContentRole,
pub properties: HashMap<String, String>,
}Expand description
A single UI element in the unified context model.
Fields§
§id: StringUnique identifier for this element.
label: Option<String>Human-readable label.
description: Option<String>Accessibility description (tooltip / secondary label).
element_type: StringElement type (button, input, text, etc.).
value: Option<String>Current value (for inputs, dropdowns, etc.).
bounds: Option<Bounds>Screen-space bounding rectangle.
state: ElementStateCurrent state flags (from accessibility tree). Defaults to all-false for sources that don’t provide state (e.g., vision).
parent_id: Option<String>ID of the parent element (None for root elements).
actions: Vec<String>Available actions (from AT-SPI2 Action interface): “click”, “press”, “activate”, etc.
confidence: f64Confidence score (0.0 - 1.0).
source: ContextSourceWhich context source provided this element.
content_role: ContentRoleContent role for prompt injection defense. Classifies elements as Interactive (safe to act on), Content (untrusted text), Decorative (deprioritize), or System (chrome UI).
properties: HashMap<String, String>Extended properties from the accessibility or native API. Keys: “placeholder”, “url”, “required”, “invalid”, “role_desc”, “selected_text”, “dom_id”, “document”, “filename”, “min_value”, “max_value”, “has_popup”, “column_count”, “row_count”, “loading_progress”
Implementations§
Source§impl ContextElement
impl ContextElement
Sourcepub fn to_reference(
&self,
screen_width: u32,
screen_height: u32,
) -> ContextReference
pub fn to_reference( &self, screen_width: u32, screen_height: u32, ) -> ContextReference
Build a resilient reference from this element’s current data.
screen_width and screen_height are used to compute normalized coordinates.
Sourcepub fn to_reference_in_context(
&self,
screen_width: u32,
screen_height: u32,
all_elements: &[ContextElement],
) -> ContextReference
pub fn to_reference_in_context( &self, screen_width: u32, screen_height: u32, all_elements: &[ContextElement], ) -> ContextReference
Build a resilient reference with ancestor path context.
all_elements is the flattened element list from the ContextSnapshot.
Trait Implementations§
Source§impl Clone for ContextElement
impl Clone for ContextElement
Source§fn clone(&self) -> ContextElement
fn clone(&self) -> ContextElement
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
source. Read more