Expand description
Chat completions client and related types. Chat completions client for generating text responses.
Modules§
- upstream
- Upstream provider clients (e.g., OpenRouter). Upstream provider clients for LLM inference.
- usage_
handler - Usage tracking handlers. Usage tracking handlers for chat completions.
Structs§
- Client
- Client for creating chat completions.
Enums§
- Error
- Errors that can occur during chat completion creation.
Functions§
- response_
id - Generates a unique response ID for a chat completion.