hoosh 1.3.0

AI inference gateway — multi-provider LLM routing, local model serving, speech-to-text, and token budget management
Documentation
1
2
3
4
5
//! Context management — token counting, context compaction, prompt compression.

pub mod compactor;
pub mod compression;
pub mod tokens;