llama-rs 0.16.0

A high-performance Rust implementation of llama.cpp - LLM inference engine with full GGUF support
Documentation 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25

//! Council of Experts — multi-agent debate orchestration.
//!
//! A council coordinates a structured multi-round debate across N expert
//! agents on the network and produces a synthesized final answer. Agents
//! may be llama-rs servers reached via gRPC or any OpenAI-compatible
//! HTTP endpoint reached via the fallback adapter.

pub mod agent;
pub mod builder;
pub mod config;
pub mod convergence;
pub mod embedder;
pub mod event;
pub mod grpc_agent;
pub mod http_agent;
pub mod local_embedder;
pub mod orchestrator;
pub mod transcript;

#[allow(clippy::all)]
pub mod proto {
    tonic::include_proto!("council");
}

pub use orchestrator::{Council, CouncilError, CouncilParams};