Skip to main content

Crate llmshim

Crate llmshim 

Source

Re-exports§

pub use fallback::completion_with_fallback;
pub use fallback::FallbackConfig;

Modules§

client
config
Configuration file management for llmshim.
env
Shared environment/config loading.
error
fallback
log
models
provider
providers
router
vision
Vision/image content block translation between providers.

Statics§

SHARED_CLIENT
Shared HTTP client — reuses connection pool across all requests. Shared HTTP client with connection pooling.

Functions§

completion
Top-level entry point. Resolves the provider from the model string and fires the request.
completion_with_logger
Completion with optional logging.
stream
Streaming entry point. Returns an SSE stream of OpenAI-format chunks.
warmup
Pre-establish TCP+TLS connections to all configured provider endpoints. Call once after creating the Router to eliminate cold-start latency on first request.