Skip to main content

ContextElement

Struct ContextElement 

Source
pub struct ContextElement {
Show 13 fields pub id: String, pub label: Option<String>, pub description: Option<String>, pub element_type: String, pub value: Option<String>, pub bounds: Option<Bounds>, pub state: ElementState, pub parent_id: Option<String>, pub actions: Vec<String>, pub confidence: f64, pub source: ContextSource, pub content_role: ContentRole, pub properties: HashMap<String, String>,
}
Expand description

A single UI element in the unified context model.

Fields§

§id: String

Unique identifier for this element.

§label: Option<String>

Human-readable label.

§description: Option<String>

Accessibility description (tooltip / secondary label).

§element_type: String

Element type (button, input, text, etc.).

§value: Option<String>

Current value (for inputs, dropdowns, etc.).

§bounds: Option<Bounds>

Screen-space bounding rectangle.

§state: ElementState

Current state flags (from accessibility tree). Defaults to all-false for sources that don’t provide state (e.g., vision).

§parent_id: Option<String>

ID of the parent element (None for root elements).

§actions: Vec<String>

Available actions (from AT-SPI2 Action interface): “click”, “press”, “activate”, etc.

§confidence: f64

Confidence score (0.0 - 1.0).

§source: ContextSource

Which context source provided this element.

§content_role: ContentRole

Content role for prompt injection defense. Classifies elements as Interactive (safe to act on), Content (untrusted text), Decorative (deprioritize), or System (chrome UI).

§properties: HashMap<String, String>

Extended properties from the accessibility or native API. Keys: “placeholder”, “url”, “required”, “invalid”, “role_desc”, “selected_text”, “dom_id”, “document”, “filename”, “min_value”, “max_value”, “has_popup”, “column_count”, “row_count”, “loading_progress”

Implementations§

Source§

impl ContextElement

Source

pub fn to_reference( &self, screen_width: u32, screen_height: u32, ) -> ContextReference

Build a resilient reference from this element’s current data. screen_width and screen_height are used to compute normalized coordinates.

Source

pub fn to_reference_in_context( &self, screen_width: u32, screen_height: u32, all_elements: &[ContextElement], ) -> ContextReference

Build a resilient reference with ancestor path context. all_elements is the flattened element list from the ContextSnapshot.

Trait Implementations§

Source§

impl Clone for ContextElement

Source§

fn clone(&self) -> ContextElement

Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source. Read more
Source§

impl Debug for ContextElement

Source§

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter. Read more
Source§

impl<'de> Deserialize<'de> for ContextElement

Source§

fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>
where __D: Deserializer<'de>,

Deserialize this value from the given Serde deserializer. Read more
Source§

impl Serialize for ContextElement

Source§

fn serialize<__S>(&self, __serializer: __S) -> Result<__S::Ok, __S::Error>
where __S: Serializer,

Serialize this value into the given Serde serializer. Read more

Auto Trait Implementations§

Blanket Implementations§

Source§

impl<T> Any for T
where T: 'static + ?Sized,

Source§

fn type_id(&self) -> TypeId

Gets the TypeId of self. Read more
Source§

impl<T> Borrow<T> for T
where T: ?Sized,

Source§

fn borrow(&self) -> &T

Immutably borrows from an owned value. Read more
Source§

impl<T> BorrowMut<T> for T
where T: ?Sized,

Source§

fn borrow_mut(&mut self) -> &mut T

Mutably borrows from an owned value. Read more
Source§

impl<T> CloneToUninit for T
where T: Clone,

Source§

unsafe fn clone_to_uninit(&self, dest: *mut u8)

🔬This is a nightly-only experimental API. (clone_to_uninit)
Performs copy-assignment from self to dest. Read more
Source§

impl<T> DeserializeOwned for T
where T: for<'de> Deserialize<'de>,

Source§

impl<T> From<T> for T

Source§

fn from(t: T) -> T

Returns the argument unchanged.

Source§

impl<T, U> Into<U> for T
where U: From<T>,

Source§

fn into(self) -> U

Calls U::from(self).

That is, this conversion is whatever the implementation of From<T> for U chooses to do.

Source§

impl<T> ToOwned for T
where T: Clone,

Source§

type Owned = T

The resulting type after obtaining ownership.
Source§

fn to_owned(&self) -> T

Creates owned data from borrowed data, usually by cloning. Read more
Source§

fn clone_into(&self, target: &mut T)

Uses borrowed data to replace owned data, usually by cloning. Read more
Source§

impl<T, U> TryFrom<U> for T
where U: Into<T>,

Source§

type Error = Infallible

The type returned in the event of a conversion error.
Source§

fn try_from(value: U) -> Result<T, <T as TryFrom<U>>::Error>

Performs the conversion.
Source§

impl<T, U> TryInto<U> for T
where U: TryFrom<T>,

Source§

type Error = <U as TryFrom<T>>::Error

The type returned in the event of a conversion error.
Source§

fn try_into(self) -> Result<U, <U as TryFrom<T>>::Error>

Performs the conversion.