Module llm

Module llm 

Source
Expand description

LLM provider abstractions and implementations.

Structs§

ClaudeProvider
LLM provider using Anthropic’s Claude API.
CompletionRequest
A request to complete a prompt.
CompletionResponse
Response from an LLM completion.
CompletionStream
Streaming response from an LLM completion.
Message
A message in the conversation.
MockLlmProvider
Mock LLM provider that returns canned responses.
RetryWrapper
Wraps an LLM provider with retry logic.
TokenUsage
Token usage statistics.

Enums§

Role
Role of a message sender.
StopReason
Reason why the model stopped generating.

Traits§

LlmProvider
Abstraction over LLM providers (Claude, GPT, etc.).