Skip to main content Crate llmshim Copy item path Source pub use fallback::completion_with_fallback ;pub use fallback::FallbackConfig ;client config Configuration file management for llmshim. env Shared environment/config loading. error fallback log models Static model registry — shared between the CLI and proxy. provider providers router vision Vision/image content block translation between providers. SHARED_CLIENT Shared HTTP client — reuses connection pool across all requests.
Shared HTTP client with connection pooling. completion Top-level entry point. Resolves the provider from the model string and fires the request. completion_with_logger Completion with optional logging. stream Streaming entry point. Returns an SSE stream of OpenAI-format chunks. warmup Pre-establish TCP+TLS connections to all configured provider endpoints.
Call once after creating the Router to eliminate cold-start latency on first request.