Expand description
LLM client factory trait and registry.
LlmClientFactory is the extension point for custom LLM providers.
LlmClient defines the chat interface that all providers implement.
LlmRegistry provides string-keyed lookup for provider factories.
Structs§
- Advisor
Token Usage - What an advisor model spent while it helped answer one request.
- Chat
Response - Response from a chat completion request.
- LlmRegistry
- Registry for LLM providers (string-keyed).
- Message
- A single message in a chat conversation.
- Model
Info - Information about a model available on a provider.
- Token
Usage - Token usage statistics from the LLM.
- Tool
Definition - A tool (function) exposed to the LLM for action execution.
Enums§
- Prompt
Reuse - Which part of a request the caller will send again, so a provider that keeps a prompt cache marks only that part.
- Stream
Event - Events emitted during a streaming LLM response.
Traits§
- LlmClient
- Unified interface for sending chat messages to any LLM provider.
- LlmClient
Factory - Factory that creates LLM client instances from configuration.