Expand description
LLM provider abstraction — protocol-level types shared across the workspace.
Sub-modules are split by responsibility (chunk / request / model / capability / error / provider). External access goes through this module’s re-exports.
The registry module is not here — it depends on the session capabilities config
(a runtime concern) and lives in defect-agent::llm::registry. This module holds only
the provider-protocol types that defect-llm needs to implement a provider without
pulling in the agent runtime.
Re-exports§
pub use capability::Capabilities;pub use capability::FeatureSupport;pub use capability::HostedCapabilities;pub use capability::ModelCapabilityOverrides;pub use capability::ThinkingEcho;pub use chunk::ProviderChunk;pub use chunk::StopReason;pub use chunk::Usage;pub use error::ProviderError;pub use error::ProviderErrorKind;pub use error::RateLimitScope;pub use error::RetryAction;pub use error::RetryHint;pub use error::TimeoutPhase;pub use model::ModelInfo;pub use model::ProtocolId;pub use model::ProviderInfo;pub use provider::LlmProvider;pub use provider::ProviderStream;pub use request::CompletionRequest;pub use request::ImageData;pub use request::Message;pub use request::MessageContent;pub use request::ProviderActivityKind;pub use request::ReasoningEffort;pub use request::Role;pub use request::SamplingParams;pub use request::ThinkingConfig;pub use request::ToolChoice;pub use request::ToolResultBody;pub use request::ToolResultContent;
Modules§
- capability
- Provider and model capability matrix.
- chunk
- Unified shape for streaming output chunks.
- error
- Provider error types.
- model
- Metadata for providers and models.
- provider
LlmProvidertrait — the primary LLM vendor integration interface.- request
- Provider request parameters.