liter-llm 1.12.2

Universal LLM API client — 165 providers, streaming, tool calling. Rust-powered, type-safe, compiled.
Documentation
//! Generic multi-tenant primitives for propagating tenant identity through the
//! Tower request stack.
//!
//! # Overview
//!
//! - [`TenantId`] / [`TenantContext`] — carry tenant identity on each request.
//! - [`KeyResolver`] / [`ResolvedKey`] / [`KeyResolverError`] — trait and types
//!   for resolving raw API tokens to tenant metadata.
//! - [`InMemoryKeyResolver`] — built-in in-memory implementation for tests and
//!   simple deployments.
//!
//! # Wiring
//!
//! Attach a tenant to any [`LlmRequest`][crate::tower::types::LlmRequest] via
//! [`LlmRequest::with_tenant_id`].  Tower layers (budget, cache, hooks) read
//! [`LlmRequest::tenant_id`] automatically.

/// Tenant context propagation primitives (TenantContext, TenantId).
pub mod context;
/// Etcd-backed [`resolver::KeyResolver`] implementation for distributed setups.
#[cfg(feature = "etcd-key-resolver")]
pub mod etcd;
/// In-memory [`resolver::KeyResolver`] implementation for single-process tenants.
pub mod in_memory;
/// `KeyResolver` trait + error type defining the per-tenant credential lookup contract.
pub mod resolver;

pub use context::{TenantContext, TenantId};
#[cfg(feature = "etcd-key-resolver")]
pub use etcd::{EtcdKeyResolver, EtcdKeyResolverConfig};
pub use in_memory::InMemoryKeyResolver;
pub use resolver::{KeyResolver, KeyResolverError, ResolvedKey};