octoroute 1.0.0

Intelligent multi-model router for self-hosted LLMs
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

//! Octoroute - Intelligent multi-model router for self-hosted LLMs
//!
//! This library provides intelligent routing between multiple local LLM endpoints
//! based on task complexity, importance, and resource availability.

pub mod cli;
pub mod config;
pub mod error;
pub mod handlers;
pub mod metrics;
pub mod middleware;
pub mod models;
pub mod router;
pub mod shared;
pub mod telemetry;