Skip to main content

Module llm

Module llm 

Source
Expand description

LLM provider abstraction — protocol-level types shared across the workspace.

Sub-modules are split by responsibility (chunk / request / model / capability / error / provider). External access goes through this module’s re-exports.

The registry module is not here — it depends on the session capabilities config (a runtime concern) and lives in defect-agent::llm::registry. This module holds only the provider-protocol types that defect-llm needs to implement a provider without pulling in the agent runtime.

Re-exports§

pub use capability::Capabilities;
pub use capability::FeatureSupport;
pub use capability::HostedCapabilities;
pub use capability::ModelCapabilityOverrides;
pub use capability::ThinkingEcho;
pub use chunk::ProviderChunk;
pub use chunk::StopReason;
pub use chunk::Usage;
pub use error::ProviderError;
pub use error::ProviderErrorKind;
pub use error::RateLimitScope;
pub use error::RetryAction;
pub use error::RetryHint;
pub use error::TimeoutPhase;
pub use model::ModelInfo;
pub use model::ProtocolId;
pub use model::ProviderInfo;
pub use provider::LlmProvider;
pub use provider::ProviderStream;
pub use request::CompletionRequest;
pub use request::ImageData;
pub use request::Message;
pub use request::MessageContent;
pub use request::ProviderActivityKind;
pub use request::ReasoningEffort;
pub use request::Role;
pub use request::SamplingParams;
pub use request::ThinkingConfig;
pub use request::ToolChoice;
pub use request::ToolResultBody;
pub use request::ToolResultContent;

Modules§

capability
Provider and model capability matrix.
chunk
Unified shape for streaming output chunks.
error
Provider error types.
model
Metadata for providers and models.
provider
LlmProvider trait — the primary LLM vendor integration interface.
request
Provider request parameters.