🔥 Helios Engine - LLM Agent Framework

Helios Engine is a powerful and flexible Rust framework for building LLM-powered agents with tool support, streaming chat capabilities, and easy configuration management. Create intelligent agents that can interact with users, call tools, and maintain conversation context - with both online and offline local model support.

🚀 Key Features

• 🆕 Forest of Agents: Multi-agent collaboration system where agents can communicate, delegate tasks, and share context
• Agent System: Create multiple agents with different personalities and capabilities
• 🆕 Tool Builder: Simplified tool creation with builder pattern - wrap any function as a tool without manual trait implementation
• Tool Registry: Extensible tool system for adding custom functionality
• Extensive Tool Suite: 16+ built-in tools including web scraping, JSON parsing, timestamp operations, file I/O, shell commands, HTTP requests, system info, and text processing
• 🆕 RAG System: Retrieval-Augmented Generation with vector stores (InMemory and Qdrant)
• Streaming Support: True real-time response streaming for both remote and local models with immediate token delivery
• Local Model Support: Run local models offline using llama.cpp with HuggingFace integration (optional local feature)
• HTTP Server & API: Expose OpenAI-compatible API endpoints with full parameter support
• Dual Mode Support: Auto, online (remote API), and offline (local) modes
• CLI & Library: Use as both a command-line tool and a Rust library crate
• 🆕 Feature Flags: Optional local feature for offline model support - build only what you need!

📚 Documentation

🎯 Start Here

• 📖 Getting Started - Comprehensive guide: installation, configuration, first agent, tools, and CLI

🔧 Core Features

• 🛠️ Tools Guide - Built-in tools, custom tool creation, and Tool Builder (new .tools() syntax!)
• 🌲 Forest of Agents - Multi-agent systems, coordination, and communication (new .agents() syntax!)
• 🔍 RAG System - Retrieval-Augmented Generation with vector stores

📖 Reference

• 📋 API Reference - Complete API documentation
• ⚙️ Configuration - Configuration options and local inference setup
• ✨ Features - Complete feature overview
• 🏗️ Architecture - System architecture and design
• 📦 Using as Crate - Library usage guide

📚 Full Documentation Index - Complete navigation and updated structure

🏃‍♂️ Quick Start

Install CLI Tool

# Install without local model support (lighter, faster install)
cargo install helios-engine

# Install with local model support (enables offline mode with llama-cpp-2)
cargo install helios-engine --features local

Basic Usage

# Initialize configuration
helios-engine init

# Start interactive chat
helios-engine chat

# Ask a quick question
helios-engine ask "What is Rust?"

As a Library Crate

Add to your Cargo.toml:

[dependencies]
helios-engine = "0.4.3"
tokio = { version = "1.35", features = ["full"] }

See 📖 Getting Started Guide for detailed examples and comprehensive tutorial!

📁 Project Structure

helios-engine/
├── src/                    # Source code
├── examples/               # Example applications
├── docs/                   # Documentation
├── tests/                  # Integration tests
├── Cargo.toml             # Project configuration
└── README.md              # This file

🤝 Contributing

We welcome contributions! See Contributing Guide for details on:

• Development setup
• Code standards
• Documentation guidelines
• Testing procedures

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.

Made with ❤️ in Rust