Struct NativeBackend 

pub struct NativeBackend { /* private fields */ }

Available on macOS and (Linux or macOS or Windows) only.

The macOS Backend.

Requires macOS 14 or later, and the Accessibility and Screen Recording permissions for the host process (usually the terminal or app that runs your binary).

Implementations

impl MacBackend

pub fn new() -> Result<Self>

Creates the backend. Never fails; missing permissions surface on first use.

Errors

Infallible today; the Result keeps the signature uniform across platforms.

Trait Implementations

impl Backend for MacBackend

type Handle = CFRetained<AXUIElement>

Handle to a live accessibility element (e.g. AXUIElement, IUIAutomationElement).

fn list_apps(&self) -> Result<Vec<AppInfo>>

Running apps plus installed apps the user can launch.

fn launch_app(&self, app: &AppInfo) -> Result<AppInfo>

Starts app without bringing it to the foreground and returns its running record.

fn permissions(&self) -> Permissions

Permissions currently held by this process.

fn request_permissions(&self) -> Permissions

Asks the OS to prompt the user for missing permissions, then reports the current state.

fn capture( &self, app: &AppInfo, request: &CaptureRequest, ) -> Result<Capture<CFRetained<AXUIElement>>>

Captures the app’s current window.

fn perform_action( &self, element: &CFRetained<AXUIElement>, action: &str, ) -> Result<()>

Invokes a named accessibility action (as listed in Action::name).

fn set_value( &self, element: &CFRetained<AXUIElement>, value: &str, ) -> Result<()>

Writes an element’s value.

fn value(&self, element: &CFRetained<AXUIElement>) -> Result<Option<String>>

Reads an element’s full, untruncated value.

fn select_text( &self, element: &CFRetained<AXUIElement>, value: &str, range: Range<usize>, ) -> Result<()>

Selects range (byte offsets into value, the element’s current value). An empty range places the caret.

fn insert_text(&self, app: &AppInfo, text: &str) -> Result<bool>

Inserts text at the caret of the focused element without synthesizing keystrokes. Returns Ok(false) when the focused element does not support it, so the caller can fall back to Backend::type_text.

fn click( &self, target: InputTarget<'_>, point: Point, button: MouseButton, count: u32, ) -> Result<()>

Clicks count times at a screen point.

fn scroll( &self, target: InputTarget<'_>, point: Point, dx: f64, dy: f64, ) -> Result<()>

Scrolls at a screen point by (dx, dy) points; positive dy reveals content below.

fn drag(&self, target: InputTarget<'_>, from: Point, to: Point) -> Result<()>

Presses the primary button at from, moves to to, and releases.

fn type_text(&self, target: InputTarget<'_>, text: &str) -> Result<()>

Types literal text.

fn press_key(&self, target: InputTarget<'_>, chord: &KeyChord) -> Result<()>

Presses and releases a key chord.

impl Debug for MacBackend

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for MacBackend

fn default() -> Self

Returns the “default value” for a type.