Expand description
Core LLM abstractions and types
Defines the fundamental traits and types for the LLM system, providing a provider-agnostic interface for different LLM backends.
Structs§
- Generation
Params - LLM generation parameters
- LLMCapabilities
- Capabilities of an LLM provider
- LLMMessage
- A message in an LLM conversation
- LLMProvider
Config - Configuration for an LLM provider
- LLMRequest
- Request to an LLM provider
- LLMResponse
- Response from an LLM provider
- Model
Info - Information about a specific model
- Model
Pricing - Pricing information for a model
- Token
Usage - Token usage information
Enums§
- LLMError
- Errors that can occur during LLM operations
- Message
Content - Content type for messages
- Message
Role - Role of a message in a conversation
Traits§
- LLMProvider
- Core trait for LLM providers