Crate helios_engine 

Helios - LLM Agent Framework

Helios is a powerful and flexible Rust framework for building LLM-powered agents with tool support, chat capabilities, and easy configuration management.

Quick Start

Using as a Library (Direct LLM Calls)

use helios_engine::{LLMClient, ChatMessage};
use helios_engine::config::LLMConfig;

#[tokio::main]
async fn main() -> helios_engine::Result<()> {
    let llm_config = LLMConfig {
        model_name: "gpt-3.5-turbo".to_string(),
        base_url: "https://api.openai.com/v1".to_string(),
        api_key: std::env::var("OPENAI_API_KEY").unwrap(),
        temperature: 0.7,
        max_tokens: 2048,
    };

    let client = LLMClient::new(helios_engine::llm::LLMProviderType::Remote(llm_config)).await?;
    let messages = vec![
        ChatMessage::system("You are a helpful assistant."),
        ChatMessage::user("What is the capital of France?"),
    ];

    let response = client.chat(messages, None).await?;
    println!("Response: {}", response.content);
    Ok(())
}

Using with Agent System

use helios_engine::{Agent, Config, CalculatorTool};

#[tokio::main]
async fn main() -> helios_engine::Result<()> {
    let config = Config::from_file("config.toml")?;

    let mut agent = Agent::builder("MyAgent")
        .config(config)
        .system_prompt("You are a helpful assistant.")
        .tool(Box::new(CalculatorTool))
        .build()
        .await?;

    let response = agent.chat("What is 15 * 7?").await?;
    println!("Agent: {}", response);
    Ok(())
}

Features

• Direct LLM Access: Use LLMClient for simple, direct calls to LLM models
• Agent System: Create intelligent agents with tools and persistent conversation
• Tool Support: Extensible tool system for adding custom functionality
• Multi-Provider: Works with OpenAI, Azure OpenAI, local models, and any OpenAI-compatible API
• Type-Safe: Leverages Rust’s type system for reliability
• Async: Built on Tokio for high-performance async operations

Re-exports

pub use agent::Agent;

pub use agent::AgentBuilder;

pub use chat::ChatMessage;

pub use chat::ChatSession;

pub use chat::Role;

pub use config::Config;

pub use config::LLMConfig;

pub use config::LocalConfig;

pub use error::HeliosError;

pub use error::Result;

pub use llm::Delta;

pub use llm::LLMClient;

pub use llm::LLMProvider;

pub use llm::LLMRequest;

pub use llm::LLMResponse;

pub use llm::LocalLLMProvider;

pub use llm::StreamChoice;

pub use llm::StreamChunk;

pub use tools::CalculatorTool;

pub use tools::EchoTool;

pub use tools::FileSearchTool;

pub use tools::FileReadTool;

pub use tools::FileWriteTool;

pub use tools::FileEditTool;

pub use tools::Tool;

pub use tools::ToolParameter;

pub use tools::ToolRegistry;

pub use tools::ToolResult;

Modules

agent

chat

config

error

llm

tools