Expand description
Core types for LLM requests and responses.
This module defines standardized types that are used across all providers, including request/response structures, messages, and common data types.
Structs§
- Chat
Request - A chat request containing messages and parameters.
- Chat
Request Builder - Builder for ChatRequest
- Completion
Request - A completion request for non-chat text generation.
- Embedding
- An embedding vector.
- Function
- Definition of a function that can be called.
- Function
Call - A function call within a tool call.
- Generated
Image - A generated image.
- Image
Request - Request for image generation.
- Message
- A message in a conversation.
- Metadata
- Metadata for requests, including provider-specific extensions.
- Parameters
- Common parameters used across providers.
- Speech
ToText Request - Request for speech-to-text conversion.
- Text
ToSpeech Request - Request for text-to-speech conversion.
- Tool
- Definition of a tool/function that can be called.
- Tool
Call - A tool/function call made by the AI.
- Tool
Content - Tool-related message content.
- Usage
- Usage statistics for a request.
Enums§
- Content
Part - A part of multimodal message content.
- Finish
Reason - Reason why the model stopped generating.
- Image
Source - Message
Content - Content of a message, which can be text or multimodal.
- Role
- The role of a message sender.
Traits§
- Chat
Response - Trait for chat response types.
- Completion
Response - Trait for completion response types.
- Image
Response - Trait for image generation response types.
- Speech
ToText Response - Trait for speech-to-text response types.
- Text
ToSpeech Response - Trait for text-to-speech response types.