Expand description
LLM provider abstractions and implementations.
Structs§
- Claude
Provider - LLM provider using Anthropic’s Claude API.
- Completion
Request - A request to complete a prompt.
- Completion
Response - Response from an LLM completion.
- Completion
Stream - Streaming response from an LLM completion.
- Message
- A message in the conversation.
- Mock
LlmProvider - Mock LLM provider that returns canned responses.
- Retry
Wrapper - Wraps an LLM provider with retry logic.
- Token
Usage - Token usage statistics.
Enums§
- Role
- Role of a message sender.
- Stop
Reason - Reason why the model stopped generating.
Traits§
- LlmProvider
- Abstraction over LLM providers (Claude, GPT, etc.).