Skip to main content

Module provider

llm

Module provider 

Source

Traits§

ProviderFactory
Factory trait for constructing model providers from environment configuration.
StreamingModelProvider
The core abstraction for all LLM providers. Every provider in this crate implements this trait, and all consumer code should depend on it rather than on concrete types.

Functions§

get_context_window
Look up context window for a known provider + model ID combo via the catalog.

Type Aliases§

LlmResponseStream
A stream of LlmResponse events from an LLM provider.