Crate george_ai 

George is an API leveraging AI to make it easy to control a computer with natural language.

George runs in an isolated Docker container and uses AI vision to interpret the screen like a human would, executing basic computer commands (mouse, keyboard) to interact with elements. This makes it more resilient to UI changes and able to automate interfaces that traditional tools can’t handle.

Example

use george_ai::George;

#[tokio::main]
async fn main() -> Result<(), Box<dyn std::error::Error>> {
    let mut george = George::new("https://your-molmo-llm.com");
    george.start().await?;
    george.open_chrome("https://some-website.com").await?;
    george.click("sign in link").await?;
    george.fill_in("input Email text field", "your@email.com").await?;
    george.fill_in("input Password text field", "super-secret").await?;
    george.click("sign in button").await?;
    george.close_chrome().await?;
    george.stop().await?;

    Ok(())
}

Structs

George